We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Physics > Fluid Dynamics

Title: Migration of self-propelling agent in a turbulent environment with minimal energy consumption

Abstract: We present a numerical study of training a self-propelling agent to migrate in the unsteady flow environment. We control the agent to utilize the background flow structure by adopting the reinforcement learning algorithm to minimize energy consumption. We considered the agent migrating in two types of flows: one is simple periodical double-gyre flow as a proof-of-concept example, while the other is complex turbulent Rayleigh-B\'enard convection as a paradigm for migrating in the convective atmosphere or the ocean. The results show that the smart agent in both flows can learn to migrate from one position to another while utilizing background flow currents as much as possible to minimize the energy consumption, which is evident by comparing the smart agent with a naive agent that moves straight from the origin to the destination. In addition, we found that compared to the double-gyre flow, the flow field in the turbulent Rayleigh-B\'enard convection exhibits more substantial fluctuations, and the training agent is more likely to explore different migration strategies; thus, the training process is more difficult to converge. Nevertheless, we can still identify an energy-efficient trajectory that corresponds to the strategy with the highest reward received by the agent. These results have important implications for many migration problems such as unmanned aerial vehicles flying in a turbulent convective environment, where planning energy-efficient trajectories are often involved.
Comments: 23 pages, 12 figures
Subjects: Fluid Dynamics (physics.flu-dyn); Optimization and Control (math.OC)
Journal reference: Physics of Fluids 2022, 34 (3), 035117
DOI: 10.1063/5.0082845
Cite as: arXiv:2201.10041 [physics.flu-dyn]
  (or arXiv:2201.10041v2 [physics.flu-dyn] for this version)

Submission history

From: Ao Xu [view email]
[v1] Tue, 25 Jan 2022 01:55:09 GMT (3155kb)
[v2] Wed, 16 Mar 2022 03:21:32 GMT (3269kb)

Link back to: arXiv, form interface, contact.