We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Systems and Control

Title: Stochastic Dispatch of Energy Storage in Microgrids: An Augmented Reinforcement Learning Approach

Abstract: The dynamic dispatch (DD) of battery energy storage systems (BESSs) in microgrids integrated with volatile energy resources is essentially a multiperiod stochastic optimization problem (MSOP). Because the life span of a BESS is significantly affected by its charging and discharging behaviors, its lifecycle degradation costs should be incorporated into the DD model of BESSs, which makes it non-convex. In general, this MSOP is intractable. To solve this problem, we propose a reinforcement learning (RL) solution augmented with Monte-Carlo tree search (MCTS) and domain knowledge expressed as dispatching rules. In this solution, the Q-learning with function approximation is employed as the basic learning architecture that allows multistep bootstrapping and continuous policy learning. To improve the computation efficiency of randomized multistep simulations, we employed the MCTS to estimate the expected maximum action values. Moreover, we embedded a few dispatching rules in RL as probabilistic logics to reduce infeasible action explorations, which can improve the quality of the data-driven solution. Numerical test results show the proposed algorithm outperforms other baseline RL algorithms in all cases tested.
Subjects: Systems and Control (eess.SY)
Journal reference: Applied Energy. Volume 261, 1 March 2020
Cite as: arXiv:1910.04541 [eess.SY]
  (or arXiv:1910.04541v2 [eess.SY] for this version)

Submission history

From: Wenchuan Wu [view email]
[v1] Thu, 10 Oct 2019 13:23:12 GMT (931kb)
[v2] Sat, 4 Jul 2020 07:54:38 GMT (907kb)

Link back to: arXiv, form interface, contact.