We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Robotics

Title: Making Decisions with Spatially and Temporally Uncertain Data

Abstract: We consider a decision-making problem where the environment varies both in space and time. Such problems arise naturally when considering e.g., the navigation of an underwater robot amidst ocean currents or the navigation of an aerial vehicle in wind. To model such spatiotemporal variation, we extend the standard Markov Decision Process (MDP) to a new framework called the Time-Varying Markov Decision Process (TVMDP). The TVMDP has a time-varying state transition model and transforms the standard MDP that considers only {\em immediate} and {\em static} uncertainty descriptions of state transitions, to a framework that is able to adapt to future time-varying uncertainty over some horizon. We show how to solve a TVMDP via a redesign of the MDP value propagation mechanisms by incorporating the introduced dynamics along the temporal dimension. We validate our framework in a marine robotics navigation setting using real spatiotemporal ocean data and show that it outperforms prior efforts to explicitly accommodate time by including it in the state.
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI)
Cite as: arXiv:1605.01018 [cs.RO]
  (or arXiv:1605.01018v2 [cs.RO] for this version)

Submission history

From: Lantao Liu [view email]
[v1] Tue, 3 May 2016 18:43:58 GMT (4017kb,D)
[v2] Tue, 31 Jan 2017 23:56:57 GMT (2470kb,D)
[v3] Thu, 25 Jan 2018 23:05:57 GMT (1058kb,D)

Link back to: arXiv, form interface, contact.