We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Inducing Taxonomic Knowledge from Pretrained Transformers

Abstract: We present a method for inducing taxonomic trees from pretrained transformers. Given a set of input terms, we assign a score for the likelihood that each pair of terms forms a parent-child relation. To produce a tree from pairwise parent-child edge scores, we treat this as a graph optimization problem and output the maximum spanning tree. We train the model by finetuning it on parent-child relations from subtrees of WordNet and test on non-overlapping subtrees. In addition, we incorporate semi-structured definitions from the web to further improve performance. On the task of inducing subtrees of WordNet, the model achieves 66.0 ancestor F_1, a 10.4 point absolute increase over the previous best published result on this task.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2010.12813 [cs.CL]
  (or arXiv:2010.12813v1 [cs.CL] for this version)

Submission history

From: Kevin Lin [view email]
[v1] Sat, 24 Oct 2020 07:16:21 GMT (546kb,D)

Link back to: arXiv, form interface, contact.