We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Why only Micro-F1? Class Weighting of Measures for Relation Classification

Abstract: Relation classification models are conventionally evaluated using only a single measure, e.g., micro-F1, macro-F1 or AUC. In this work, we analyze weighting schemes, such as micro and macro, for imbalanced datasets. We introduce a framework for weighting schemes, where existing schemes are extremes, and two new intermediate schemes. We show that reporting results of different weighting schemes better highlights strengths and weaknesses of a model.
Comments: NLP Power! The First Workshop on Efficient Benchmarking in NLP (ACL 2022)
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as: arXiv:2205.09460 [cs.CL]
  (or arXiv:2205.09460v1 [cs.CL] for this version)

Submission history

From: David Harbecke [view email]
[v1] Thu, 19 May 2022 10:33:28 GMT (129kb,D)

Link back to: arXiv, form interface, contact.