We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: The Defeat of the Winograd Schema Challenge

Abstract: The Winograd Schema Challenge - a set of twin sentences involving pronoun reference disambiguation that seem to require the use of commonsense knowledge - was proposed by Hector Levesque in 2011. By 2019, a number of AI systems, based on large pre-trained transformer-based language models and fine-tuned on these kinds of problems, achieved better than 90% accuracy. In this paper, we review the history of the Winograd Schema Challenge and discuss the lasting contributions of the flurry of research that has taken place on the WSC in the last decade. We discuss the significance of various datasets developed for WSC, and the research community's deeper understanding of the role of surrogate tasks in assessing the intelligence of an AI system.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2201.02387 [cs.CL]
  (or arXiv:2201.02387v3 [cs.CL] for this version)

Submission history

From: Vid Kocijan [view email]
[v1] Fri, 7 Jan 2022 10:22:08 GMT (55kb)
[v2] Sun, 16 Jan 2022 17:35:37 GMT (55kb)
[v3] Mon, 23 Jan 2023 13:42:33 GMT (120kb,D)

Link back to: arXiv, form interface, contact.