We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detection

Abstract: We study the selection of transfer languages for automatic abusive language detection. Instead of preparing a dataset for every language, we demonstrate the effectiveness of cross-lingual transfer learning for zero-shot abusive language detection. This way we can use existing data from higher-resource languages to build better detection systems for low-resource languages. Our datasets are from seven different languages from three language families. We measure the distance between the languages using several language similarity measures, especially by quantifying the World Atlas of Language Structures. We show that there is a correlation between linguistic similarity and classifier performance. This discovery allows us to choose an optimal transfer language for zero shot abusive language detection.
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Journal reference: Information Processing & Management, Volume 59, Issue 4, July 2022, paper ID: 102981
DOI: 10.1016/j.ipm.2022.102981
Cite as: arXiv:2206.00962 [cs.CL]
  (or arXiv:2206.00962v1 [cs.CL] for this version)

Submission history

From: Juuso Eronen [view email]
[v1] Thu, 2 Jun 2022 09:53:15 GMT (701kb)

Link back to: arXiv, form interface, contact.