References & Citations
Computer Science > Robotics
Title: Sample-Efficient Safety Assurances using Conformal Prediction
(Submitted on 28 Sep 2021 (v1), last revised 2 Jan 2024 (this version, v5))
Abstract: When deploying machine learning models in high-stakes robotics applications, the ability to detect unsafe situations is crucial. Early warning systems can provide alerts when an unsafe situation is imminent (in the absence of corrective action). To reliably improve safety, these warning systems should have a provable false negative rate; i.e. of the situations that are unsafe, fewer than $\epsilon$ will occur without an alert. In this work, we present a framework that combines a statistical inference technique known as conformal prediction with a simulator of robot/environment dynamics, in order to tune warning systems to provably achieve an $\epsilon$ false negative rate using as few as $1/\epsilon$ data points. We apply our framework to a driver warning system and a robotic grasping application, and empirically demonstrate guaranteed false negative rate while also observing low false detection (positive) rate.
Submission history
From: Rachel Luo [view email][v1] Tue, 28 Sep 2021 23:00:30 GMT (1871kb,D)
[v2] Fri, 25 Feb 2022 19:59:31 GMT (2143kb,D)
[v3] Tue, 27 Sep 2022 23:17:47 GMT (291kb,D)
[v4] Mon, 20 Feb 2023 00:16:48 GMT (1209kb,D)
[v5] Tue, 2 Jan 2024 18:23:59 GMT (2888kb,D)
Link back to: arXiv, form interface, contact.