We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?

Abstract: Despite being designed for performance rather than cognitive plausibility, transformer language models have been found to be better at predicting metrics used to assess human language comprehension than language models with other architectures, such as recurrent neural networks. Based on how well they predict the N400, a neural signal associated with processing difficulty, we propose and provide evidence for one possible explanation - their predictions are affected by the preceding context in a way analogous to the effect of semantic facilitation in humans.
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Journal reference: Proceedings of the 43rd Annual Meeting of the Cognitive Science Society (2021) 300-306
Cite as: arXiv:2107.09648 [cs.CL]
  (or arXiv:2107.09648v1 [cs.CL] for this version)

Submission history

From: James Michaelov [view email]
[v1] Tue, 20 Jul 2021 17:33:13 GMT (255kb,D)

Link back to: arXiv, form interface, contact.