Current browse context:
cs.SE
Change to browse by:
References & Citations
Computer Science > Software Engineering
Title: Toward Trustworthy Neural Program Synthesis
(Submitted on 29 Sep 2022 (v1), last revised 9 Oct 2023 (this version, v2))
Abstract: We develop an approach to estimate the probability that a program sampled from a large language model is correct. Given a natural language description of a programming problem, our method samples both candidate programs as well as candidate predicates specifying how the program should behave. This allows learning a model that forms a well-calibrated probabilistic prediction of program correctness. Our system also infers which predicates are useful to explain the behavior of the generated code, and humans preferred these in a human study over raw language model outputs. Our method is simple, easy to implement, and maintains state of the art generation accuracy results.
Submission history
From: Darren Key [view email][v1] Thu, 29 Sep 2022 20:32:07 GMT (2596kb,D)
[v2] Mon, 9 Oct 2023 21:21:31 GMT (14585kb,D)
Link back to: arXiv, form interface, contact.