We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.RO
< prev | next >
new | recent | 2007

Change to browse by:

cs
cs.AI
cs.CL

References & Citations

DBLP - CS Bibliography

listing | bibtex

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Robotics

Title: Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment

Authors: Katherine Krajovic, Nikhil Krishnaswamy, Nathaniel J. Dimick, R. Pito Salas, James Pustejovsky
(Submitted on 13 Jul 2020)
Abstract: We present a new interface for controlling a navigation robot in novel environments using coordinated gesture and language. We use a TurtleBot3 robot with a LIDAR and a camera, an embodied simulation of what the robot has encountered while exploring, and a cross-platform bridge facilitating generic communication. A human partner can deliver instructions to the robot using spoken English and gestures relative to the simulated environment, to guide the robot through navigation tasks.
Comments: 4 pages, 1 table, 4 figures, proceedings of RoboDIAL special session a SigDIAL 2020
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as: arXiv:2007.09053 [cs.RO]
  (or arXiv:2007.09053v1 [cs.RO] for this version)

Submission history

From: Nikhil Krishnaswamy [view email]
[v1] Mon, 13 Jul 2020 16:37:01 GMT (1286kb,D)
Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Link back to: arXiv, form interface, contact.