We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: FlexiTerm: A more efficient implementation of flexible multi-word term recognition

Authors: Irena Spasic
Abstract: Terms are linguistic signifiers of domain-specific concepts. Automated recognition of multi-word terms (MWT) in free text is a sequence labelling problem, which is commonly addressed using supervised machine learning methods. Their need for manual annotation of training data makes it difficult to port such methods across domains. FlexiTerm, on the other hand, is a fully unsupervised method for MWT recognition from domain-specific corpora. Originally implemented in Java as a proof of concept, it did not scale well, thus offering little practical value in the context of big data. In this paper, we describe its re-implementation in Python and compare the performance of these two implementations. The results demonstrated major improvements in terms of efficiency, which allow FlexiTerm to transition from the proof of concept to the production-grade application.
Subjects: Computation and Language (cs.CL)
ACM classes: I.2.7; H.3.1
Cite as: arXiv:2110.06981 [cs.CL]
  (or arXiv:2110.06981v2 [cs.CL] for this version)

Submission history

From: Irena Spasic [view email]
[v1] Wed, 13 Oct 2021 18:49:46 GMT (1093kb)
[v2] Fri, 5 Nov 2021 10:50:21 GMT (1093kb)

Link back to: arXiv, form interface, contact.