We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models

Abstract: Text recognition is a long-standing research problem for document digitalization. Existing approaches for text recognition are usually built based on CNN for image understanding and RNN for char-level text generation. In addition, another language model is usually needed to improve the overall accuracy as a post-processing step. In this paper, we propose an end-to-end text recognition approach with pre-trained image Transformer and text Transformer models, namely TrOCR, which leverages the Transformer architecture for both image understanding and wordpiece-level text generation. The TrOCR model is simple but effective, and can be pre-trained with large-scale synthetic data and fine-tuned with human-labeled datasets. Experiments show that the TrOCR model outperforms the current state-of-the-art models on both printed and handwritten text recognition tasks. The code and models will be publicly available at this https URL
Comments: Work in Progress
Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2109.10282 [cs.CL]
  (or arXiv:2109.10282v3 [cs.CL] for this version)

Submission history

From: Lei Cui [view email]
[v1] Tue, 21 Sep 2021 16:01:56 GMT (103kb,D)
[v2] Wed, 22 Sep 2021 16:44:16 GMT (127kb,D)
[v3] Sat, 25 Sep 2021 05:00:01 GMT (127kb,D)

Link back to: arXiv, form interface, contact.