Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Certified Reinforcement Learning with Logic Guidance
(Submitted on 2 Feb 2019 (v1), last revised 6 Jun 2023 (this version, v4))
Abstract: Reinforcement Learning (RL) is a widely employed machine learning architecture that has been applied to a variety of control problems. However, applications in safety-critical domains require a systematic and formal approach to specifying requirements as tasks or goals. We propose a model-free RL algorithm that enables the use of Linear Temporal Logic (LTL) to formulate a goal for unknown continuous-state/action Markov Decision Processes (MDPs). The given LTL property is translated into a Limit-Deterministic Generalised Buchi Automaton (LDGBA), which is then used to shape a synchronous reward function on-the-fly. Under certain assumptions, the algorithm is guaranteed to synthesise a control policy whose traces satisfy the LTL specification with maximal probability.
Submission history
From: Hosein Hasanbeig [view email][v1] Sat, 2 Feb 2019 20:09:32 GMT (4862kb,D)
[v2] Wed, 11 Dec 2019 00:13:32 GMT (4896kb,D)
[v3] Mon, 10 Feb 2020 11:09:18 GMT (4899kb,D)
[v4] Tue, 6 Jun 2023 15:52:30 GMT (7095kb,D)
Link back to: arXiv, form interface, contact.