References & Citations
Computer Science > Computation and Language
Title: TENER: Adapting Transformer Encoder for Named Entity Recognition
(Submitted on 10 Nov 2019 (v1), last revised 10 Dec 2019 (this version, v3))
Abstract: The Bidirectional long short-term memory networks (BiLSTM) have been widely used as an encoder in models solving the named entity recognition (NER) task. Recently, the Transformer is broadly adopted in various Natural Language Processing (NLP) tasks owing to its parallelism and advantageous performance. Nevertheless, the performance of the Transformer in NER is not as good as it is in other NLP tasks. In this paper, we propose TENER, a NER architecture adopting adapted Transformer Encoder to model the character-level features and word-level features. By incorporating the direction and relative distance aware attention and the un-scaled attention, we prove the Transformer-like encoder is just as effective for NER as other NLP tasks.
Submission history
From: Hang Yan [view email][v1] Sun, 10 Nov 2019 15:05:48 GMT (813kb,D)
[v2] Tue, 19 Nov 2019 17:34:19 GMT (813kb,D)
[v3] Tue, 10 Dec 2019 07:01:25 GMT (769kb,D)
Link back to: arXiv, form interface, contact.