Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: $f$-GAIL: Learning $f$-Divergence for Generative Adversarial Imitation Learning
(Submitted on 2 Oct 2020 (v1), last revised 19 Nov 2020 (this version, v2))
Abstract: Imitation learning (IL) aims to learn a policy from expert demonstrations that minimizes the discrepancy between the learner and expert behaviors. Various imitation learning algorithms have been proposed with different pre-determined divergences to quantify the discrepancy. This naturally gives rise to the following question: Given a set of expert demonstrations, which divergence can recover the expert policy more accurately with higher data efficiency? In this work, we propose $f$-GAIL, a new generative adversarial imitation learning (GAIL) model, that automatically learns a discrepancy measure from the $f$-divergence family as well as a policy capable of producing expert-like behaviors. Compared with IL baselines with various predefined divergence measures, $f$-GAIL learns better policies with higher data efficiency in six physics-based control tasks.
Submission history
From: Xin Zhang [view email][v1] Fri, 2 Oct 2020 21:39:56 GMT (1763kb,D)
[v2] Thu, 19 Nov 2020 05:29:20 GMT (5104kb,D)
Link back to: arXiv, form interface, contact.