Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Zero Shot Action Generation
(Submitted on 28 Nov 2022 (v1), last revised 30 Nov 2022 (this version, v2))
Abstract: We introduce Action-GPT, a plug and play framework for incorporating Large Language Models (LLMs) into text-based action generation models. Action phrases in current motion capture datasets contain minimal and to-the-point information. By carefully crafting prompts for LLMs, we generate richer and fine-grained descriptions of the action. We show that utilizing these detailed descriptions instead of the original action phrases leads to better alignment of text and motion spaces. Our experiments show qualitative and quantitative improvement in the quality of synthesized motions produced by recent text-to-motion models. Code, pretrained models and sample videos will be made available at this https URL
Submission history
From: Ravi Kiran Sarvadevabhatla [view email][v1] Mon, 28 Nov 2022 17:57:48 GMT (2416kb,D)
[v2] Wed, 30 Nov 2022 13:13:29 GMT (2417kb,D)
Link back to: arXiv, form interface, contact.