We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification

Abstract: We aim to highlight an interesting trend to contribute to the ongoing debate around advances within legal Natural Language Processing. Recently, the focus for most legal text classification tasks has shifted towards large pre-trained deep learning models such as BERT. In this paper, we show that a more traditional approach based on Support Vector Machine classifiers reaches surprisingly competitive performance with BERT-based models on the classification tasks in the LexGLUE benchmark. We also highlight that error reduction obtained by using specialised BERT-based models over baselines is noticeably smaller in the legal domain when compared to general language tasks. We present and discuss three hypotheses as potential explanations for these results to support future discussions.
Comments: 6 pages, to be presented at JURIX 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2109.07234 [cs.CL]
  (or arXiv:2109.07234v2 [cs.CL] for this version)

Submission history

From: Benjamin Clavié [view email]
[v1] Wed, 15 Sep 2021 12:05:28 GMT (30kb)
[v2] Fri, 22 Oct 2021 09:01:28 GMT (33kb)

Link back to: arXiv, form interface, contact.