We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Certifiable Deep Importance Sampling for Rare-Event Simulation of Black-Box Systems

Abstract: Rare-event simulation techniques, such as importance sampling (IS), constitute powerful tools to speed up challenging estimation of rare catastrophic events. These techniques often leverage the knowledge and analysis on underlying system structures to endow desirable efficiency guarantees. However, black-box problems, especially those arising from recent safety-critical applications of AI-driven physical systems, can fundamentally undermine their efficiency guarantees and lead to dangerous under-estimation without diagnostically detected. We propose a framework called Deep Probabilistic Accelerated Evaluation (Deep-PrAE) to design statistically guaranteed IS, by converting black-box samplers that are versatile but could lack guarantees, into one with what we call a relaxed efficiency certificate that allows accurate estimation of bounds on the rare-event probability. We present the theory of Deep-PrAE that combines the dominating point concept with rare-event set learning via deep neural network classifiers, and demonstrate its effectiveness in numerical examples including the safety-testing of intelligent driving algorithms.
Comments: The conference version of this paper has appeared in AISTATS 2021 (arXiv:2006.15722)
Subjects: Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2111.02204 [stat.ME]
  (or arXiv:2111.02204v1 [stat.ME] for this version)

Submission history

From: Mansur Arief [view email]
[v1] Wed, 3 Nov 2021 13:19:05 GMT (4738kb,D)

Link back to: arXiv, form interface, contact.