We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: The optimality of syntactic dependency distances

Abstract: It is often stated that human languages, as other biological systems, are shaped by cost-cutting pressures but, to what extent? Attempts to quantify the degree of optimality of languages by means of an optimality score have been scarce and focused mostly on English. Here we recast the problem of the optimality of the word order of a sentence as an optimization problem on a spatial network where the vertices are words, arcs indicate syntactic dependencies and the space is defined by the linear order of the words in the sentence. We introduce a new score to quantify the cognitive pressure to reduce the distance between linked words in a sentence. The analysis of sentences from 93 languages representing 19 linguistic families reveals that half of languages are optimized to a 70% or more. The score indicates that distances are not significantly reduced in a few languages and confirms two theoretical predictions, i.e. that longer sentences are more optimized and that distances are more likely to be longer than expected by chance in short sentences. We present a new hierarchical ranking of languages by their degree of optimization. The statistical advantages of the new score call for a reevaluation of the evolution of dependency distance over time in languages as well as the relationship between dependency distance and linguistic competence. Finally, the principles behind the design of the score can be extended to develop more powerful normalizations of topological distances or physical distances in more dimensions.
Subjects: Computation and Language (cs.CL); Discrete Mathematics (cs.DM); Physics and Society (physics.soc-ph)
Cite as: arXiv:2007.15342 [cs.CL]
  (or arXiv:2007.15342v1 [cs.CL] for this version)

Submission history

From: Ramon Ferrer-i-Cancho [view email]
[v1] Thu, 30 Jul 2020 09:40:41 GMT (372kb,D)
[v2] Sun, 25 Oct 2020 22:15:22 GMT (381kb,D)
[v3] Tue, 11 May 2021 13:25:36 GMT (382kb,D)
[v4] Mon, 4 Oct 2021 18:59:21 GMT (438kb,D)

Link back to: arXiv, form interface, contact.