We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: How Knowledge Graph and Attention Help? A Quantitative Analysis into Bag-level Relation Extraction

Abstract: Knowledge Graph (KG) and attention mechanism have been demonstrated effective in introducing and selecting useful information for weakly supervised methods. However, only qualitative analysis and ablation study are provided as evidence. In this paper, we contribute a dataset and propose a paradigm to quantitatively evaluate the effect of attention and KG on bag-level relation extraction (RE). We find that (1) higher attention accuracy may lead to worse performance as it may harm the model's ability to extract entity mention features; (2) the performance of attention is largely influenced by various noise distribution patterns, which is closely related to real-world datasets; (3) KG-enhanced attention indeed improves RE performance, while not through enhanced attention but by incorporating entity prior; and (4) attention mechanism may exacerbate the issue of insufficient training data. Based on these findings, we show that a straightforward variant of RE model can achieve significant improvements (6% AUC on average) on two real-world datasets as compared with three state-of-the-art baselines. Our codes and datasets are available at this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
DOI: 10.18653/v1/2021.acl-long.359
Cite as: arXiv:2107.12064 [cs.CL]
  (or arXiv:2107.12064v1 [cs.CL] for this version)

Submission history

From: Zikun Hu [view email]
[v1] Mon, 26 Jul 2021 09:38:28 GMT (880kb,D)

Link back to: arXiv, form interface, contact.