References & Citations
Computer Science > Computation and Language
Title: Contextualized Word Representations for Reading Comprehension
(Submitted on 10 Dec 2017 (v1), last revised 4 Sep 2018 (this version, v4))
Abstract: Reading a document and extracting an answer to a question about its content has attracted substantial attention recently. While most work has focused on the interaction between the question and the document, in this work we evaluate the importance of context when the question and document are processed independently. We take a standard neural architecture for this task, and show that by providing rich contextualized word representations from a large pre-trained language model as well as allowing the model to choose between context-dependent and context-independent word representations, we can obtain dramatic improvements and reach performance comparable to state-of-the-art on the competitive SQuAD dataset.
Submission history
From: Shimi Salant [view email][v1] Sun, 10 Dec 2017 23:16:02 GMT (856kb,D)
[v2] Sat, 10 Mar 2018 22:13:12 GMT (118kb,D)
[v3] Sat, 26 May 2018 20:25:15 GMT (118kb,D)
[v4] Tue, 4 Sep 2018 08:20:26 GMT (118kb,D)
Link back to: arXiv, form interface, contact.