References & Citations
Computer Science > Computation and Language
Title: FlexiTerm: A more efficient implementation of flexible multi-word term recognition
(Submitted on 13 Oct 2021 (v1), last revised 5 Nov 2021 (this version, v2))
Abstract: Terms are linguistic signifiers of domain-specific concepts. Automated recognition of multi-word terms (MWT) in free text is a sequence labelling problem, which is commonly addressed using supervised machine learning methods. Their need for manual annotation of training data makes it difficult to port such methods across domains. FlexiTerm, on the other hand, is a fully unsupervised method for MWT recognition from domain-specific corpora. Originally implemented in Java as a proof of concept, it did not scale well, thus offering little practical value in the context of big data. In this paper, we describe its re-implementation in Python and compare the performance of these two implementations. The results demonstrated major improvements in terms of efficiency, which allow FlexiTerm to transition from the proof of concept to the production-grade application.
Submission history
From: Irena Spasic [view email][v1] Wed, 13 Oct 2021 18:49:46 GMT (1093kb)
[v2] Fri, 5 Nov 2021 10:50:21 GMT (1093kb)
Link back to: arXiv, form interface, contact.