We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Artificial Intelligence

Title: CAPE: Corrective Actions from Precondition Errors using Large Language Models

Abstract: Extracting commonsense knowledge from a large language model (LLM) offers a path to designing intelligent robots. Existing approaches that leverage LLMs for planning are unable to recover when an action fails and often resort to retrying failed actions, without resolving the error's underlying cause. We propose a novel approach (CAPE) that attempts to propose corrective actions to resolve precondition errors during planning. CAPE improves the quality of generated plans by leveraging few-shot reasoning from action preconditions. Our approach enables embodied agents to execute more tasks than baseline methods while ensuring semantic correctness and minimizing re-prompting. In VirtualHome, CAPE generates executable plans while improving a human-annotated plan correctness metric from 28.89% to 49.63% over SayCan. Our improvements transfer to a Boston Dynamics Spot robot initialized with a set of skills (specified in language) and associated preconditions, where CAPE improves the correctness metric of the executed task plans by 76.49% compared to SayCan. Our approach enables the robot to follow natural language commands and robustly recover from failures, which baseline approaches largely cannot resolve or address inefficiently.
Comments: 17 pages, 6 figures, accepted at ICRA 2024
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)
MSC classes: 68T20, 68T50
ACM classes: I.2.7; I.2.8; I.2.2; I.2.4
Cite as: arXiv:2211.09935 [cs.AI]
  (or arXiv:2211.09935v3 [cs.AI] for this version)

Submission history

From: Shreyas Sundara Raman [view email]
[v1] Thu, 17 Nov 2022 23:14:51 GMT (4624kb,D)
[v2] Mon, 23 Oct 2023 03:56:16 GMT (18486kb,D)
[v3] Sat, 9 Mar 2024 13:53:47 GMT (18749kb,D)

Link back to: arXiv, form interface, contact.