We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: How poor is the stimulus? Evaluating hierarchical generalization in neural networks trained on child-directed speech

Abstract: When acquiring syntax, children consistently choose hierarchical rules over competing non-hierarchical possibilities. Is this preference due to a learning bias for hierarchical structure, or due to more general biases that interact with hierarchical cues in children's linguistic input? We explore these possibilities by training LSTMs and Transformers - two types of neural networks without a hierarchical bias - on data similar in quantity and content to children's linguistic input: text from the CHILDES corpus. We then evaluate what these models have learned about English yes/no questions, a phenomenon for which hierarchical structure is crucial. We find that, though they perform well at capturing the surface statistics of child-directed speech (as measured by perplexity), both model types generalize in a way more consistent with an incorrect linear rule than the correct hierarchical rule. These results suggest that human-like generalization from text alone requires stronger biases than the general sequence-processing biases of standard neural network architectures.
Comments: 10 pages plus references and appendices
Subjects: Computation and Language (cs.CL)
ACM classes: J.4; I.2.7
Cite as: arXiv:2301.11462 [cs.CL]
  (or arXiv:2301.11462v1 [cs.CL] for this version)

Submission history

From: Aditya Yedetore [view email]
[v1] Thu, 26 Jan 2023 23:24:17 GMT (1614kb,D)

Link back to: arXiv, form interface, contact.