Accession Number:

AD1032195

Title:

Implicitly Defined Neural Networks for Sequence Labeling

Descriptive Note:

[Technical Report, Technical Paper]

Corporate Author:

MASSACHUSETTS INST OF TECH LEXINGTON

Report Date:

2017-07-31

Pagination or Media Count:

5

Abstract:

In this paper, we propose an implicit neural network architecture and show that it can be computed in a reasonably efficient manner. Our architecture relaxes the causality assumption in formulating recurrent neural networks, so that the hidden states of the network are coupled together, in order to improve performance on complex, long-range dependencies in either direction of a sequence. We contrast our architecture with a bidirectional RNN, and show that our proposed architecture the bidirectional network matches its performance on one task, while providing an ensembling benefit greater than ensembling multiple bidirectional networks.

Subject Categories:

  • Statistics and Probability

Distribution Statement:

[A, Approved For Public Release]