We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: BERT based Transformers lead the way in Extraction of Health Information from Social Media

Abstract: This paper describes our submissions for the Social Media Mining for Health (SMM4H)2021 shared tasks. We participated in 2 tasks:(1) Classification, extraction and normalization of adverse drug effect (ADE) mentions in English tweets (Task-1) and (2) Classification of COVID-19 tweets containing symptoms(Task-6). Our approach for the first task uses the language representation model RoBERTa with a binary classification head. For the second task, we use BERTweet, based on RoBERTa. Fine-tuning is performed on the pre-trained models for both tasks. The models are placed on top of a custom domain-specific processing pipeline. Our system ranked first among all the submissions for subtask-1(a) with an F1-score of 61%. For subtask-1(b), our system obtained an F1-score of 50% with improvements up to +8% F1 over the score averaged across all submissions. The BERTweet model achieved an F1 score of 94% on SMM4H 2021 Task-6.
Comments: 6 pages, 1 figure
Subjects: Computation and Language (cs.CL); Social and Information Networks (cs.SI)
Cite as: arXiv:2104.07367 [cs.CL]
  (or arXiv:2104.07367v1 [cs.CL] for this version)

Submission history

From: Sidharth R [view email]
[v1] Thu, 15 Apr 2021 10:50:21 GMT (102kb,D)

Link back to: arXiv, form interface, contact.