We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluation

Abstract: Semantic Textual Similarity (STS) measures the meaning similarity of sentences. Applications include machine translation (MT), summarization, generation, question answering (QA), short answer grading, semantic search, dialog and conversational systems. The STS shared task is a venue for assessing the current state-of-the-art. The 2017 task focuses on multilingual and cross-lingual pairs with one sub-track exploring MT quality estimation (MTQE) data. The task obtained strong participation from 31 teams, with 17 participating in all language tracks. We summarize performance and review a selection of well performing methods. Analysis highlights common errors, providing insight into the limitations of existing models. To support ongoing work on semantic representations, the STS Benchmark is introduced as a new shared training and evaluation set carefully selected from the corpus of English STS shared task data (2012-2017).
Comments: To appear in proceedings of the SemEval workshop at ACL 2017; 14 pages, 14 Tables, 1 Figure
Subjects: Computation and Language (cs.CL)
MSC classes: 68T50
ACM classes: I.2.7
DOI: 10.18653/v1/S17-2001
Cite as: arXiv:1708.00055 [cs.CL]
  (or arXiv:1708.00055v1 [cs.CL] for this version)

Submission history

From: Daniel Cer [view email]
[v1] Mon, 31 Jul 2017 20:12:06 GMT (276kb,D)

Link back to: arXiv, form interface, contact.