We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computers and Society

Title: X-Risk Analysis for AI Research

Abstract: Artificial intelligence (AI) has the potential to greatly improve society, but as with any powerful technology, it comes with heightened risks and responsibilities. Current AI research lacks a systematic discussion of how to manage long-tail risks from AI systems, including speculative long-term risks. Keeping in mind the potential benefits of AI, there is some concern that building ever more intelligent and powerful AI systems could eventually result in systems that are more powerful than us; some say this is like playing with fire and speculate that this could create existential risks (x-risks). To add precision and ground these discussions, we provide a guide for how to analyze AI x-risk, which consists of three parts: First, we review how systems can be made safer today, drawing on time-tested concepts from hazard analysis and systems safety that have been designed to steer large processes in safer directions. Next, we discuss strategies for having long-term impacts on the safety of future systems. Finally, we discuss a crucial concept in making AI systems safer by improving the balance between safety and general capabilities. We hope this document and the presented concepts and tools serve as a useful guide for understanding how to analyze AI x-risk.
Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2206.05862 [cs.CY]
  (or arXiv:2206.05862v7 [cs.CY] for this version)

Submission history

From: Dan Hendrycks [view email]
[v1] Mon, 13 Jun 2022 00:22:50 GMT (1990kb,D)
[v2] Wed, 15 Jun 2022 03:03:31 GMT (2109kb,D)
[v3] Sat, 18 Jun 2022 18:36:29 GMT (2109kb,D)
[v4] Wed, 29 Jun 2022 18:35:00 GMT (2110kb,D)
[v5] Fri, 1 Jul 2022 17:48:44 GMT (1363kb,D)
[v6] Thu, 21 Jul 2022 21:03:10 GMT (2106kb,D)
[v7] Tue, 20 Sep 2022 16:49:56 GMT (2111kb,D)

Link back to: arXiv, form interface, contact.