Current browse context:
cs.IR
Change to browse by:
References & Citations
Computer Science > Information Retrieval
Title: HYCEDIS: HYbrid Confidence Engine for Deep Document Intelligence System
(Submitted on 1 Jun 2022 (v1), last revised 10 Oct 2022 (this version, v2))
Abstract: Measuring the confidence of AI models is critical for safely deploying AI in real-world industrial systems. One important application of confidence measurement is information extraction from scanned documents. However, there exists no solution to provide reliable confidence score for current state-of-the-art deep-learning-based information extractors. In this paper, we propose a complete and novel architecture to measure confidence of current deep learning models in document information extraction task. Our architecture consists of a Multi-modal Conformal Predictor and a Variational Cluster-oriented Anomaly Detector, trained to faithfully estimate its confidence on its outputs without the need of host models modification. We evaluate our architecture on real-wold datasets, not only outperforming competing confidence estimators by a huge margin but also demonstrating generalization ability to out-of-distribution data.
Submission history
From: Tuan-Anh Nguyen Dang [view email][v1] Wed, 1 Jun 2022 09:57:34 GMT (864kb,D)
[v2] Mon, 10 Oct 2022 04:36:36 GMT (881kb,D)
Link back to: arXiv, form interface, contact.