References & Citations
Computer Science > Computation and Language
Title: None Class Ranking Loss for Document-Level Relation Extraction
(Submitted on 1 May 2022 (v1), last revised 3 May 2022 (this version, v2))
Abstract: Document-level relation extraction (RE) aims at extracting relations among entities expressed across multiple sentences, which can be viewed as a multi-label classification problem. In a typical document, most entity pairs do not express any pre-defined relation and are labeled as "none" or "no relation". For good document-level RE performance, it is crucial to distinguish such none class instances (entity pairs) from those of pre-defined classes (relations). However, most existing methods only estimate the probability of pre-defined relations independently without considering the probability of "no relation". This ignores the context of entity pairs and the label correlations between the none class and pre-defined classes, leading to sub-optimal predictions. To address this problem, we propose a new multi-label loss that encourages large margins of label confidence scores between each pre-defined class and the none class, which enables captured label correlations and context-dependent thresholding for label prediction. To gain further robustness against positive-negative imbalance and mislabeled data that could appear in real-world RE datasets, we propose a margin regularization and a margin shifting technique. Experimental results demonstrate that our method significantly outperforms existing multi-label losses for document-level RE and works well in other multi-label tasks such as emotion classification when none class instances are available for training.
Submission history
From: Yang Zhou [view email][v1] Sun, 1 May 2022 14:24:37 GMT (142kb,D)
[v2] Tue, 3 May 2022 05:27:54 GMT (142kb,D)
Link back to: arXiv, form interface, contact.