We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Using Distributional Principles for the Semantic Study of Contextual Language Models

Abstract: Many studies were recently done for investigating the properties of contextual language models but surprisingly, only a few of them consider the properties of these models in terms of semantic similarity. In this article, we first focus on these properties for English by exploiting the distributional principle of substitution as a probing mechanism in the controlled context of SemCor and WordNet paradigmatic relations. Then, we propose to adapt the same method to a more open setting for characterizing the differences between static and contextual language models.
Comments: PACLIC 35
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2111.12174 [cs.CL]
  (or arXiv:2111.12174v1 [cs.CL] for this version)

Submission history

From: Olivier Ferret [view email]
[v1] Tue, 23 Nov 2021 22:21:16 GMT (23kb,D)

Link back to: arXiv, form interface, contact.