Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Sequential Density Ratio Estimation for Simultaneous Optimization of Speed and Accuracy
(Submitted on 10 Jun 2020 (v1), last revised 6 Feb 2021 (this version, v3))
Abstract: Classifying sequential data as early and as accurately as possible is a challenging yet critical problem, especially when a sampling cost is high. One algorithm that achieves this goal is the sequential probability ratio test (SPRT), which is known as Bayes-optimal: it can keep the expected number of data samples as small as possible, given the desired error upper-bound. However, the original SPRT makes two critical assumptions that limit its application in real-world scenarios: (i) samples are independently and identically distributed, and (ii) the likelihood of the data being derived from each class can be calculated precisely. Here, we propose the SPRT-TANDEM, a deep neural network-based SPRT algorithm that overcomes the above two obstacles. The SPRT-TANDEM sequentially estimates the log-likelihood ratio of two alternative hypotheses by leveraging a novel Loss function for Log-Likelihood Ratio estimation (LLLR) while allowing correlations up to $N (\in \mathbb{N})$ preceding samples. In tests on one original and two public video databases, Nosaic MNIST, UCF101, and SiW, the SPRT-TANDEM achieves statistically significantly better classification accuracy than other baseline classifiers, with a smaller number of data samples. The code and Nosaic MNIST are publicly available at this https URL
Submission history
From: Akinori F Ebihara [view email][v1] Wed, 10 Jun 2020 01:05:00 GMT (3339kb,D)
[v2] Wed, 17 Jun 2020 11:03:37 GMT (2753kb,D)
[v3] Sat, 6 Feb 2021 06:30:42 GMT (14022kb,D)
Link back to: arXiv, form interface, contact.