Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Neural Semantic Encoders
(Submitted on 14 Jul 2016 (v1), last revised 5 Jan 2017 (this version, v3))
Abstract: We present a memory augmented neural network for natural language understanding: Neural Semantic Encoders. NSE is equipped with a novel memory update rule and has a variable sized encoding memory that evolves over time and maintains the understanding of input sequences through read}, compose and write operations. NSE can also access multiple and shared memories. In this paper, we demonstrated the effectiveness and the flexibility of NSE on five different natural language tasks: natural language inference, question answering, sentence classification, document sentiment analysis and machine translation where NSE achieved state-of-the-art performance when evaluated on publically available benchmarks. For example, our shared-memory model showed an encouraging result on neural machine translation, improving an attention-based baseline by approximately 1.0 BLEU.
Submission history
From: Tsendsuren Munkhdalai [view email][v1] Thu, 14 Jul 2016 20:58:26 GMT (94kb,D)
[v2] Wed, 20 Jul 2016 14:01:11 GMT (94kb,D)
[v3] Thu, 5 Jan 2017 15:41:13 GMT (134kb,D)
Link back to: arXiv, form interface, contact.