We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Is Prompt All You Need? No. A Comprehensive and Broader View of Instruction Learning

Abstract: Task semantics can be expressed by a set of input-to-output examples or a piece of textual instruction. Conventional machine learning approaches for natural language processing (NLP) mainly rely on the availability of large-scale sets of task-specific examples. Two issues arise: first, collecting task-specific labeled examples does not apply to scenarios where tasks may be too complicated or costly to annotate, or the system is required to handle a new task immediately; second, this is not user-friendly since end-users are probably more willing to provide task description rather than a set of examples before using the system. Therefore, the community is paying increasing interest in a new supervision-seeking paradigm for NLP: learning from task instructions. Despite its impressive progress, there are some common issues that the community struggles with. This survey paper tries to summarize and provide insights into the current research on instruction learning, particularly by answering the following questions: (i) What is task instruction, and what instruction types exist? (ii) How to model instructions? (iii) What factors influence and explain the instructions' performance? (iv) What challenges remain in instruction learning? To our knowledge, this is the first comprehensive survey about textual instructions.
Comments: Early Draft. Will be continually improved. The curated paper list is available at this https URL
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2303.10475 [cs.CL]
  (or arXiv:2303.10475v5 [cs.CL] for this version)

Submission history

From: Renze Lou [view email]
[v1] Sat, 18 Mar 2023 19:17:47 GMT (80kb)
[v2] Tue, 21 Mar 2023 01:27:16 GMT (2185kb,D)
[v3] Thu, 13 Apr 2023 23:03:57 GMT (2838kb,D)
[v4] Tue, 2 May 2023 09:30:02 GMT (2741kb,D)
[v5] Wed, 3 May 2023 00:45:11 GMT (2741kb,D)

Link back to: arXiv, form interface, contact.