Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: One-shot and few-shot learning of word embeddings
(Submitted on 27 Oct 2017 (v1), last revised 2 Jan 2018 (this version, v2))
Abstract: Standard deep learning systems require thousands or millions of examples to learn a concept, and cannot integrate new concepts easily. By contrast, humans have an incredible ability to do one-shot or few-shot learning. For instance, from just hearing a word used in a sentence, humans can infer a great deal about it, by leveraging what the syntax and semantics of the surrounding words tells us. Here, we draw inspiration from this to highlight a simple technique by which deep recurrent networks can similarly exploit their prior knowledge to learn a useful representation for a new word from little data. This could make natural language processing systems much more flexible, by allowing them to learn continually from the new words they encounter.
Submission history
From: Andrew Lampinen [view email][v1] Fri, 27 Oct 2017 18:05:22 GMT (1972kb,D)
[v2] Tue, 2 Jan 2018 16:53:05 GMT (4126kb,D)
Link back to: arXiv, form interface, contact.