References & Citations
Computer Science > Computation and Language
Title: The Power of Prompt Tuning for Low-Resource Semantic Parsing
(Submitted on 16 Oct 2021 (v1), last revised 1 Apr 2022 (this version, v2))
Abstract: Prompt tuning has recently emerged as an effective method for adapting pre-trained language models to a number of language understanding and generation tasks. In this paper, we investigate prompt tuning for semantic parsing -- the task of mapping natural language utterances onto formal meaning representations. On the low-resource splits of Overnight and TOPv2, we find that a prompt tuned T5-xl significantly outperforms its fine-tuned counterpart, as well as strong GPT-3 and BART baselines. We also conduct ablation studies across different model scales and target representations, finding that, with increasing model scale, prompt tuned T5 models improve at generating target representations that are far from the pre-training distribution.
Submission history
From: Nathan Schucher [view email][v1] Sat, 16 Oct 2021 09:33:09 GMT (471kb,D)
[v2] Fri, 1 Apr 2022 13:59:36 GMT (1006kb,D)
Link back to: arXiv, form interface, contact.