We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Meta-Learning for Neural Relation Classification with Distant Supervision

Abstract: Distant supervision provides a means to create a large number of weakly labeled data at low cost for relation classification. However, the resulting labeled instances are very noisy, containing data with wrong labels. Many approaches have been proposed to select a subset of reliable instances for neural model training, but they still suffer from noisy labeling problem or underutilization of the weakly-labeled data. To better select more reliable training instances, we introduce a small amount of manually labeled data as reference to guide the selection process. In this paper, we propose a meta-learning based approach, which learns to reweight noisy training data under the guidance of reference data. As the clean reference data is usually very small, we propose to augment it by dynamically distilling the most reliable elite instances from the noisy data. Experiments on several datasets demonstrate that the reference data can effectively guide the selection of training data, and our augmented approach consistently improves the performance of relation classification comparing to the existing state-of-the-art methods.
Comments: 10 pages, 7 figures; corrected one encoding error in CIKM pdf
Subjects: Computation and Language (cs.CL)
Journal reference: In Proceedings of CIKM, pp. 815-824. 2020
DOI: 10.1145/3340531.3412039
Cite as: arXiv:2010.13544 [cs.CL]
  (or arXiv:2010.13544v1 [cs.CL] for this version)

Submission history

From: Zhenzhen Li [view email]
[v1] Mon, 26 Oct 2020 12:52:28 GMT (900kb,D)

Link back to: arXiv, form interface, contact.