References & Citations
Computer Science > Information Retrieval
Title: Automatic Pharma News Categorization
(Submitted on 28 Dec 2021)
Abstract: We use a text dataset consisting of 23 news categories relevant to pharma information science, in order to compare the fine-tuning performance of multiple transformer models in a classification task. Using a well-balanced dataset with multiple autoregressive and autocoding transformation models, we compare their fine-tuning performance. To validate the winning approach, we perform diagnostics of model behavior on mispredicted instances, including inspection of category-wise metrics, evaluation of prediction certainty and assessment of latent space representations. Lastly, we propose an ensemble model consisting of the top performing individual predictors and demonstrate that this approach offers a modest improvement in the F1 metric.
Submission history
From: Stanislaw Adaszewski [view email][v1] Tue, 28 Dec 2021 08:42:16 GMT (870kb,D)
Link back to: arXiv, form interface, contact.