Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: End-to-End Information Extraction by Character-Level Embedding and Multi-Stage Attentional U-Net
(Submitted on 2 Jun 2021 (v1), last revised 9 Sep 2021 (this version, v3))
Abstract: Information extraction from document images has received a lot of attention recently, due to the need for digitizing a large volume of unstructured documents such as invoices, receipts, bank transfers, etc. In this paper, we propose a novel deep learning architecture for end-to-end information extraction on the 2D character-grid embedding of the document, namely the \textit{Multi-Stage Attentional U-Net}. To effectively capture the textual and spatial relations between 2D elements, our model leverages a specialized multi-stage encoder-decoders design, in conjunction with efficient uses of the self-attention mechanism and the box convolution. Experimental results on different datasets show that our model outperforms the baseline U-Net architecture by a large margin while using 40\% fewer parameters. Moreover, it also significantly improved the baseline in erroneous OCR and limited training data scenario, thus becomes practical for real-world applications.
Submission history
From: Tuan-Anh Nguyen Dang [view email][v1] Wed, 2 Jun 2021 05:42:51 GMT (7105kb,D)
[v2] Wed, 8 Sep 2021 04:43:30 GMT (0kb,I)
[v3] Thu, 9 Sep 2021 07:36:35 GMT (6853kb,D)
Link back to: arXiv, form interface, contact.