We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: The Power of Prompt Tuning for Low-Resource Semantic Parsing

Abstract: Prompt tuning has recently emerged as an effective method for adapting pre-trained language models to a number of language tasks. In this paper, we investigate prompt tuning for semantic parsing, the task of mapping natural language utterances onto formal meaning representations. For large T5 models we find (i) that prompt tuning significantly outperforms fine-tuning in the low data regime and (ii) that canonicalization -- i.e. naturalizing the meaning representations -- barely improves performance. This last result is surprising as it suggests that large T5 models can be modulated to generate sequences that are far from the pre-training distribution.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2110.08525 [cs.CL]
  (or arXiv:2110.08525v1 [cs.CL] for this version)

Submission history

From: Nathan Schucher [view email]
[v1] Sat, 16 Oct 2021 09:33:09 GMT (471kb,D)

Link back to: arXiv, form interface, contact.