We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Systems and Control

Title: Suspension Regulation of Medium-low-speed Maglev Trains via Deep Reinforcement Learning

Abstract: The suspension regulation is critical to the operation of medium-low-speed maglev trains (mlsMTs). Due to uncertain environment, strong disturbances and high nonlinearity of the system dynamics, this problem cannot be well solved by most of the model-based controllers. In this paper, we propose a model-free controller by reformulating it as a continuous-state, continuous-action Markov decision process (MDP) with unknown transition probabilities. With the deterministic policy gradient and neural network approximation, we design reinforcement learning (RL) algorithms to solve the MDP and obtain a state-feedback controller by using sampled data from the suspension system. To further improve its performance, we adopt a double Q-learning scheme for learning the regulation controller. We illustrate that the proposed controllers outperform the existing PID controller with a real dataset from the mlsMT in Changsha, China and is even comparable to model-based controllers, which assume that the complete information of the model is known, via simulations.
Comments: 12 pages, 15 figures
Subjects: Systems and Control (eess.SY)
Cite as: arXiv:1910.12491 [eess.SY]
  (or arXiv:1910.12491v2 [eess.SY] for this version)

Submission history

From: Feiran Zhao [view email]
[v1] Mon, 28 Oct 2019 08:12:41 GMT (2865kb,D)
[v2] Sat, 9 May 2020 02:33:19 GMT (2898kb,D)

Link back to: arXiv, form interface, contact.