We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Minor changes make a difference: a case study on the consistency of UD-based dependency parsers

Abstract: Many downstream applications are using dependency trees, and are thus relying on dependency parsers producing correct, or at least consistent, output. However, dependency parsers are trained using machine learning, and are therefore susceptible to unwanted inconsistencies due to biases in the training data. This paper explores the effects of such biases in four languages - English, Swedish, Russian, and Ukrainian - though an experiment where we study the effect of replacing numerals in sentences. We show that such seemingly insignificant changes in the input can cause large differences in the output, and suggest that data augmentation can remedy the problems.
Comments: Accepted to the 5th Workshop on Universal Dependencies at SyntaxFest 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2111.15413 [cs.CL]
  (or arXiv:2111.15413v1 [cs.CL] for this version)

Submission history

From: Dmytro Kalpakchi [view email]
[v1] Tue, 30 Nov 2021 14:06:55 GMT (11166kb,D)

Link back to: arXiv, form interface, contact.