We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Neural Variational Learning for Grounded Language Acquisition

Abstract: We propose a learning system in which language is grounded in visual percepts without specific pre-defined categories of terms. We present a unified generative method to acquire a shared semantic/visual embedding that enables the learning of language about a wide range of real-world objects. We evaluate the efficacy of this learning by predicting the semantics of objects and comparing the performance with neural and non-neural inputs. We show that this generative approach exhibits promising results in language grounding without pre-specifying visual categories under low resource settings. Our experiments demonstrate that this approach is generalizable to multilingual, highly varied datasets.
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)
Journal reference: 2021 30th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
Cite as: arXiv:2107.14593 [cs.CL]
  (or arXiv:2107.14593v1 [cs.CL] for this version)

Submission history

From: Nisha Pillai [view email]
[v1] Tue, 20 Jul 2021 20:55:02 GMT (8584kb,D)

Link back to: arXiv, form interface, contact.