Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: Dependency Parsing with LSTMs: An Empirical Evaluation
(Submitted on 22 Apr 2016 (v1), last revised 30 Jun 2016 (this version, v2))
Abstract: We propose a transition-based dependency parser using Recurrent Neural Networks with Long Short-Term Memory (LSTM) units. This extends the feedforward neural network parser of Chen and Manning (2014) and enables modelling of entire sequences of shift/reduce transition decisions. On the Google Web Treebank, our LSTM parser is competitive with the best feedforward parser on overall accuracy and notably achieves more than 3% improvement for long-range dependencies, which has proved difficult for previous transition-based parsers due to error propagation and limited context information. Our findings additionally suggest that dropout regularisation on the embedding layer is crucial to improve the LSTM's generalisation.
Submission history
From: Adhiguna Kuncoro [view email][v1] Fri, 22 Apr 2016 03:20:24 GMT (320kb)
[v2] Thu, 30 Jun 2016 04:23:07 GMT (325kb)
Link back to: arXiv, form interface, contact.