We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.AI

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Artificial Intelligence

Title: LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models

Abstract: This study focuses on using large language models (LLMs) as a planner for embodied agents that can follow natural language instructions to complete complex tasks in a visually-perceived environment. The high data cost and poor sample efficiency of existing methods hinders the development of versatile agents that are capable of many tasks and can learn new tasks quickly. In this work, we propose a novel method, LLM-Planner, that harnesses the power of large language models to do few-shot planning for embodied agents. We further propose a simple but effective way to enhance LLMs with physical grounding to generate and update plans that are grounded in the current environment. Experiments on the ALFRED dataset show that our method can achieve very competitive few-shot performance: Despite using less than 0.5% of paired training data, LLM-Planner achieves competitive performance with recent baselines that are trained using the full training data. Existing methods can barely complete any task successfully under the same few-shot setting. Our work opens the door for developing versatile and sample-efficient embodied agents that can quickly learn many tasks. Website: this https URL
Comments: 14 pages, 5 figures
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
Report number: ICCV 2023
Cite as: arXiv:2212.04088 [cs.AI]
  (or arXiv:2212.04088v3 [cs.AI] for this version)

Submission history

From: Chan Hee Song [view email]
[v1] Thu, 8 Dec 2022 05:46:32 GMT (597kb,D)
[v2] Sun, 19 Mar 2023 20:52:21 GMT (600kb,D)
[v3] Thu, 30 Mar 2023 04:50:44 GMT (600kb,D)

Link back to: arXiv, form interface, contact.