We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.SY

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Systems and Control

Title: Optimal Resource Allocation in Wireless Control Systems via Deep Policy Gradient

Abstract: In wireless control systems, remote control of plants is achieved through closing of the control loop over a wireless channel. As wireless communication is noisy and subject to packet dropouts, proper allocation of limited resources, e.g. transmission power, across plants is critical for maintaining reliable operation. In this paper, we formulate the design of an optimal resource allocation policy that uses current plant states and wireless channel states to assign resources used to send control actuation information back to plants. While this problem is challenging due to its infinite dimensionality and need for explicit system model and state knowledge, we propose the use of deep reinforcement learning techniques to find neural network-based resource allocation policies. In particular, we use model-free policy gradient methods to directly learn continuous power allocation policies without knowledge of plant dynamics or communication models. Numerical simulations demonstrate the strong performance of learned policies relative to baseline resource allocation methods in settings where state information is available both with and without noise.
Comments: Submitted to 2020 American Control Conference (ACC)
Subjects: Systems and Control (eess.SY); Signal Processing (eess.SP)
Cite as: arXiv:1910.11900 [eess.SY]
  (or arXiv:1910.11900v1 [eess.SY] for this version)

Submission history

From: Vinicius Lima Silva [view email]
[v1] Fri, 25 Oct 2019 18:43:25 GMT (355kb)

Link back to: arXiv, form interface, contact.