We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Memory-assisted prompt editing to improve GPT-3 after deployment

Abstract: Large LMs such as GPT-3 are powerful, but can commit mistakes that are obvious to humans. For example, GPT-3 would mistakenly interpret "What word is similar to good?" to mean a homonym, while the user intended a synonym. Our goal is to effectively correct such errors via user interactions with the system but without retraining, which will be prohibitively costly. We pair GPT-3 with a growing memory of recorded cases where the model misunderstood the user's intents, along with user feedback for clarification. Such a memory allows our system to produce enhanced prompts for any new query based on the user feedback for error correction on similar cases in the past. On four tasks (two lexical tasks, two advanced ethical reasoning tasks), we show how a (simulated) user can interactively teach a deployed GPT-3, substantially increasing its accuracy over the queries with different kinds of misunderstandings by the GPT-3. Our approach is a step towards the low-cost utility enhancement for very large pre-trained LMs. All the code and data is available at this https URL
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2201.06009 [cs.CL]
  (or arXiv:2201.06009v4 [cs.CL] for this version)

Submission history

From: Aman Madaan [view email]
[v1] Sun, 16 Jan 2022 10:11:37 GMT (3993kb,D)
[v2] Fri, 25 Feb 2022 14:05:09 GMT (4068kb,D)
[v3] Fri, 4 Mar 2022 16:47:00 GMT (4073kb,D)
[v4] Wed, 16 Mar 2022 05:49:45 GMT (5239kb,D)

Link back to: arXiv, form interface, contact.