References & Citations
Computer Science > Computation and Language
Title: Black-Box Tuning for Language-Model-as-a-Service
(Submitted on 10 Jan 2022 (v1), last revised 27 Jun 2022 (this version, v4))
Abstract: Extremely large pre-trained language models (PTMs) such as GPT-3 are usually released as a service. It allows users to design task-specific prompts to query the PTMs through some black-box APIs. In such a scenario, which we call Language-Model-as-a-Service (LMaaS), the gradients of PTMs are usually unavailable. Can we optimize the task prompts by only accessing the model inference APIs? This paper proposes the black-box tuning framework to optimize the continuous prompt prepended to the input text via derivative-free optimization. Instead of optimizing in the original high-dimensional prompt space, which is intractable for traditional derivative-free optimization, we perform optimization in a randomly generated subspace due to the low intrinsic dimensionality of large PTMs. The experimental results show that the black-box tuning with RoBERTa on a few labeled samples not only significantly outperforms manual prompt and GPT-3's in-context learning, but also surpasses the gradient-based counterparts, i.e., prompt tuning and full model tuning.
Submission history
From: Tianxiang Sun [view email][v1] Mon, 10 Jan 2022 18:17:05 GMT (502kb,D)
[v2] Tue, 8 Feb 2022 16:28:09 GMT (457kb,D)
[v3] Tue, 17 May 2022 14:26:40 GMT (474kb,D)
[v4] Mon, 27 Jun 2022 08:14:54 GMT (818kb,D)
Link back to: arXiv, form interface, contact.