References & Citations
Computer Science > Computation and Language
Title: Cross-lingual Models of Word Embeddings: An Empirical Comparison
(Submitted on 1 Apr 2016 (v1), last revised 8 Jun 2016 (this version, v2))
Abstract: Despite interest in using cross-lingual knowledge to learn word embeddings for various tasks, a systematic comparison of the possible approaches is lacking in the literature. We perform an extensive evaluation of four popular approaches of inducing cross-lingual embeddings, each requiring a different form of supervision, on four typographically different language pairs. Our evaluation setup spans four different tasks, including intrinsic evaluation on mono-lingual and cross-lingual similarity, and extrinsic evaluation on downstream semantic and syntactic applications. We show that models which require expensive cross-lingual knowledge almost always perform better, but cheaply supervised models often prove competitive on certain tasks.
Submission history
From: Shyam Upadhyay [view email][v1] Fri, 1 Apr 2016 22:18:51 GMT (225kb,D)
[v2] Wed, 8 Jun 2016 03:14:08 GMT (127kb,D)
Link back to: arXiv, form interface, contact.