We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.NE

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Neural and Evolutionary Computing

Title: Budgeted Classification with Rejection: An Evolutionary Method with Multiple Objectives

Abstract: Classification systems are often deployed in resource-constrained settings where labels must be assigned to inputs on a budget of time, memory, etc. Budgeted, sequential classifiers (BSCs) address these scenarios by processing inputs through a sequence of partial feature acquisition and evaluation steps with early-exit options. This allows for an efficient evaluation of inputs that prevents unneeded feature acquisition. To approximate an intractable combinatorial problem, current approaches to budgeted classification rely on well-behaved loss functions that account for two primary objectives (processing cost and error). These approaches offer improved efficiency over traditional classifiers but are limited by analytic constraints in formulation and do not manage additional performance objectives. Notably, such methods do not explicitly account for an important aspect of real-time detection systems -- the fraction of "accepted" predictions satisfying a confidence criterion imposed by a risk-averse monitor.
We propose a problem-specific genetic algorithm to build budgeted, sequential classifiers with confidence-based reject options. Three objectives -- accuracy, processing time/cost, and coverage -- are considered. The algorithm emphasizes Pareto efficiency while accounting for a notion of aggregate performance via a unique scalarization. Experiments show our method can quickly find globally Pareto optimal solutions in very large search spaces and is competitive with existing approaches while offering advantages for selective, budgeted deployment scenarios.
Comments: IEEE WCCI 2022. arXiv admin note: substantial text overlap with arXiv:2110.13067
Subjects: Neural and Evolutionary Computing (cs.NE)
Journal reference: IEEE Congress on Evolutionary Computation (CEC), 2022, pp. 1-10
DOI: 10.1109/CEC55065.2022.9870382
Cite as: arXiv:2205.00570 [cs.NE]
  (or arXiv:2205.00570v2 [cs.NE] for this version)

Submission history

From: Nolan Hamilton [view email]
[v1] Sun, 1 May 2022 22:05:16 GMT (756kb,D)
[v2] Fri, 3 Jun 2022 18:38:45 GMT (756kb,D)

Link back to: arXiv, form interface, contact.