We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Physics > Fluid Dynamics

Title: Efficient reinforcement learning with partially observable for fluid flow control

Abstract: Despite the low dimensionalities of dissipative viscous fluids, reinforcement learning (RL) requires many observables in fluid control problems. This is because the observables are assumed to follow a policy-independent Markov decision process in the RL framework. By including policy parameters as arguments of a value function, we construct a consistent algorithm with partially observable condition. Using typical examples of active flow control, we show that our algorithm is more stable and efficient than the existing RL algorithms, even under a small number of observables.
Comments: 17 pages, 7 figures
Subjects: Fluid Dynamics (physics.flu-dyn); Computational Physics (physics.comp-ph)
Cite as: arXiv:2012.04138 [physics.flu-dyn]
  (or arXiv:2012.04138v2 [physics.flu-dyn] for this version)

Submission history

From: Masaki Shimizu [view email]
[v1] Tue, 8 Dec 2020 00:53:43 GMT (368kb)
[v2] Thu, 29 Apr 2021 16:24:37 GMT (384kb)

Link back to: arXiv, form interface, contact.