We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Spanish Language Models

Abstract: This paper presents the Spanish RoBERTa-base and RoBERTa-large models, as well as the corresponding performance evaluations. Both models were pre-trained using the largest Spanish corpus known to date, with a total of 570GB of clean and deduplicated text processed for this work, compiled from the web crawlings performed by the National Library of Spain from 2009 to 2019. We extended the current evaluation datasets with an extractive Question Answering dataset and our models outperform the existing Spanish models across tasks and settings.
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as: arXiv:2107.07253 [cs.CL]
  (or arXiv:2107.07253v2 [cs.CL] for this version)

Submission history

From: Asier Gutiérrez-Fandiño [view email]
[v1] Thu, 15 Jul 2021 11:23:05 GMT (20kb)
[v2] Fri, 13 Aug 2021 13:47:44 GMT (23kb)
[v3] Fri, 1 Apr 2022 13:03:32 GMT (99kb,D)
[v4] Mon, 4 Apr 2022 16:25:12 GMT (99kb,D)
[v5] Tue, 5 Apr 2022 11:13:46 GMT (99kb,D)

Link back to: arXiv, form interface, contact.