References & Citations
Computer Science > Computation and Language
Title: The Power of Prompt Tuning for Low-Resource Semantic Parsing
(Submitted on 16 Oct 2021 (this version), latest version 1 Apr 2022 (v2))
Abstract: Prompt tuning has recently emerged as an effective method for adapting pre-trained language models to a number of language tasks. In this paper, we investigate prompt tuning for semantic parsing, the task of mapping natural language utterances onto formal meaning representations. For large T5 models we find (i) that prompt tuning significantly outperforms fine-tuning in the low data regime and (ii) that canonicalization -- i.e. naturalizing the meaning representations -- barely improves performance. This last result is surprising as it suggests that large T5 models can be modulated to generate sequences that are far from the pre-training distribution.
Submission history
From: Nathan Schucher [view email][v1] Sat, 16 Oct 2021 09:33:09 GMT (471kb,D)
[v2] Fri, 1 Apr 2022 13:59:36 GMT (1006kb,D)
Link back to: arXiv, form interface, contact.