We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: Multilingual Open Text 1.0: Public Domain News in 44 Languages

Abstract: We present a new multilingual corpus containing text in 44 languages, many of which have relatively few existing resources for natural language processing. The first release of the corpus contains over 2.7 million news articles and 1 million shorter passages published between 2001--2021, collected from Voice of America news websites. We describe our process for collecting, filtering, and processing the data. The source material is in the public domain, our collection is licensed using a creative commons license (CC BY 4.0), and all software used to create the corpus is released under the MIT License. The corpus will be regularly updated as additional documents are published.
Comments: Submitted to LREC 2022
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2201.05609 [cs.CL]
  (or arXiv:2201.05609v1 [cs.CL] for this version)

Submission history

From: Chester Palen-Michel [view email]
[v1] Fri, 14 Jan 2022 18:58:17 GMT (238kb,D)
[v2] Thu, 9 Jun 2022 17:21:31 GMT (252kb,D)

Link back to: arXiv, form interface, contact.