We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.FL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Formal Languages and Automata Theory

Title: Learning Automata-Based Task Knowledge Representation from Large-Scale Generative Language Models

Abstract: Automata-based representations play an important role in control and planning in sequential decision-making, but obtaining high-level task knowledge for building automata is often difficult. Although large-scale generative language models (GLMs) can help automatically distill task knowledge, the textual outputs from GLMs are not directly utilizable in sequential decision-making. We resolve this problem by proposing a novel algorithm named GLM2FSA, which obtains high-level task knowledge, represented in a finite state automaton (FSA), from a given brief description of the task goal. GLM2FSA sends queries to a GLM for task knowledge in textual form and then builds a FSA to represent the textual knowledge. This algorithm fills the gap between text and automata-based representations, and the constructed FSA can be directly utilized in sequential decision-making. We provide examples to demonstrate how GLM2FSA constructs FSAs to represent knowledge encoded in the texts generated by the large-scale GLMs.
Subjects: Formal Languages and Automata Theory (cs.FL); Computation and Language (cs.CL)
Cite as: arXiv:2212.01944 [cs.FL]
  (or arXiv:2212.01944v1 [cs.FL] for this version)

Submission history

From: Yunhao Yang [view email]
[v1] Sun, 4 Dec 2022 22:34:16 GMT (657kb,D)

Link back to: arXiv, form interface, contact.