We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similarity

Abstract: We present a new scientific document similarity model based on matching fine-grained aspects of texts. To train our model, we exploit a naturally-occurring source of supervision: sentences in the full-text of papers that cite multiple papers together (co-citations). Such co-citations not only reflect close paper relatedness, but also provide textual descriptions of how the co-cited papers are related. This novel form of textual supervision is used for learning to match aspects across papers. We develop multi-vector representations where vectors correspond to sentence-level aspects of documents, and present two methods for aspect matching: (1) A fast method that only matches single aspects, and (2) a method that makes sparse multiple matches with an Optimal Transport mechanism that computes an Earth Mover's Distance between aspects. Our approach improves performance on document similarity tasks in four datasets. Further, our fast single-match method achieves competitive results, paving the way for applying fine-grained similarity to large scientific corpora. Code, data, and models available at: this https URL
Comments: NAACL 2022 camera-ready
Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)
Cite as: arXiv:2111.08366 [cs.CL]
  (or arXiv:2111.08366v3 [cs.CL] for this version)

Submission history

From: Sheshera Mysore [view email]
[v1] Tue, 16 Nov 2021 11:12:30 GMT (37513kb,D)
[v2] Sun, 10 Apr 2022 03:49:11 GMT (25732kb,D)
[v3] Wed, 4 May 2022 12:59:18 GMT (14664kb,D)

Link back to: arXiv, form interface, contact.