Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Assurance Monitoring of Cyber-Physical Systems with Machine Learning Components
(Submitted on 14 Jan 2020 (v1), last revised 17 Apr 2020 (this version, v2))
Abstract: Machine learning components such as deep neural networks are used extensively in Cyber-Physical Systems (CPS). However, they may introduce new types of hazards that can have disastrous consequences and need to be addressed for engineering trustworthy systems. Although deep neural networks offer advanced capabilities, they must be complemented by engineering methods and practices that allow effective integration in CPS. In this paper, we investigate how to use the conformal prediction framework for assurance monitoring of CPS with machine learning components. In order to handle high-dimensional inputs in real-time, we compute nonconformity scores using embedding representations of the learned models. By leveraging conformal prediction, the approach provides well-calibrated confidence and can allow monitoring that ensures a bounded small error rate while limiting the number of inputs for which an accurate prediction cannot be made. Empirical evaluation results using the German Traffic Sign Recognition Benchmark and a robot navigation dataset demonstrate that the error rates are well-calibrated while the number of alarms is small. The method is computationally efficient, and therefore, the approach is promising for assurance monitoring of CPS.
Submission history
From: Dimitrios Boursinos [view email][v1] Tue, 14 Jan 2020 19:34:51 GMT (247kb)
[v2] Fri, 17 Apr 2020 22:59:01 GMT (142kb,D)
Link back to: arXiv, form interface, contact.