We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: The Law of Large Documents: Understanding the Structure of Legal Contracts Using Visual Cues

Abstract: Large, pre-trained transformer models like BERT have achieved state-of-the-art results on document understanding tasks, but most implementations can only consider 512 tokens at a time. For many real-world applications, documents can be much longer, and the segmentation strategies typically used on longer documents miss out on document structure and contextual information, hurting their results on downstream tasks. In our work on legal agreements, we find that visual cues such as layout, style, and placement of text in a document are strong features that are crucial to achieving an acceptable level of accuracy on long documents. We measure the impact of incorporating such visual cues, obtained via computer vision methods, on the accuracy of document understanding tasks including document segmentation, entity extraction, and attribute classification. Our method of segmenting documents based on structural metadata out-performs existing methods on four long-document understanding tasks as measured on the Contract Understanding Atticus Dataset.
Subjects: Computation and Language (cs.CL)
Journal reference: Document Intelligence Workshop at KDD, 2021
Cite as: arXiv:2107.08128 [cs.CL]
  (or arXiv:2107.08128v1 [cs.CL] for this version)

Submission history

From: Emad Elwany [view email]
[v1] Fri, 16 Jul 2021 21:21:50 GMT (1680kb,D)

Link back to: arXiv, form interface, contact.