We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification

Abstract: We present a multilingual bag-of-entities model that effectively boosts the performance of zero-shot cross-lingual text classification by extending a multilingual pre-trained language model (e.g., M-BERT). It leverages the multilingual nature of Wikidata: entities in multiple languages representing the same concept are defined with a unique identifier. This enables entities described in multiple languages to be represented using shared embeddings. A model trained on entity features in a resource-rich language can thus be directly applied to other languages. Our experimental results on cross-lingual topic classification (using the MLDoc and TED-CLDC datasets) and entity typing (using the SHINRA2020-ML dataset) show that the proposed model consistently outperforms state-of-the-art models.
Comments: 11 pages, 3 figures
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2110.07792 [cs.CL]
  (or arXiv:2110.07792v1 [cs.CL] for this version)

Submission history

From: Sosuke Nishikawa [view email]
[v1] Fri, 15 Oct 2021 01:10:50 GMT (915kb,D)

Link back to: arXiv, form interface, contact.