References & Citations
Computer Science > Computation and Language
Title: Structural Text Segmentation of Legal Documents
(Submitted on 7 Dec 2020 (v1), last revised 17 May 2021 (this version, v2))
Abstract: The growing complexity of legal cases has lead to an increasing interest in legal information retrieval systems that can effectively satisfy user-specific information needs. However, such downstream systems typically require documents to be properly formatted and segmented, which is often done with relatively simple pre-processing steps, disregarding topical coherence of segments. Systems generally rely on representations of individual sentences or paragraphs, which may lack crucial context, or document-level representations, which are too long for meaningful search results. To address this issue, we propose a segmentation system that can predict topical coherence of sequential text segments spanning several paragraphs, effectively segmenting a document and providing a more balanced representation for downstream applications. We build our model on top of popular transformer networks and formulate structural text segmentation as topical change detection, by performing a series of independent classifications that allow for efficient fine-tuning on task-specific data. We crawl a novel dataset consisting of roughly $74,000$ online Terms-of-Service documents, including hierarchical topic annotations, which we use for training. Results show that our proposed system significantly outperforms baselines, and adapts well to structural peculiarities of legal documents. We release both data and trained models to the research community for future work.this https URL
Submission history
From: Satya Almasian [view email][v1] Mon, 7 Dec 2020 12:09:37 GMT (7617kb,D)
[v2] Mon, 17 May 2021 11:38:28 GMT (680kb,D)
Link back to: arXiv, form interface, contact.