We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: IRL with Partial Observations using the Principle of Uncertain Maximum Entropy

Abstract: The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible while constrained to match empirically estimated feature expectations. However, in many real-world applications that use noisy sensors computing the feature expectations may be challenging due to partial observation of the relevant model variables. For example, a robot performing apprenticeship learning may lose sight of the agent it is learning from due to environmental occlusion. We show that in generalizing the principle of maximum entropy to these types of scenarios we unavoidably introduce a dependency on the learned model to the empirical feature expectations. We introduce the principle of uncertain maximum entropy and present an expectation-maximization based solution generalized from the principle of latent maximum entropy. Finally, we experimentally demonstrate the improved robustness to noisy data offered by our technique in a maximum causal entropy inverse reinforcement learning domain.
Comments: 7 pages, 5 figures
Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)
Cite as: arXiv:2208.06988 [cs.LG]
  (or arXiv:2208.06988v1 [cs.LG] for this version)

Submission history

From: Kenneth Bogert [view email]
[v1] Mon, 15 Aug 2022 03:22:46 GMT (350kb)

Link back to: arXiv, form interface, contact.