We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Systems and Control

Title: A Review of Deep Reinforcement Learning for Smart Building Energy Management

Abstract: Global buildings account for about 30% of the total energy consumption and carbon emission, raising severe energy and environmental concerns. Therefore, it is significant and urgent to develop novel smart building energy management (SBEM) technologies for the advance of energy-efficient and green buildings. However, it is a nontrivial task due to the following challenges. Firstly, it is generally difficult to develop an explicit building thermal dynamics model that is both accurate and efficient enough for building control. Secondly, there are many uncertain system parameters (e.g., renewable generation output, outdoor temperature, and the number of occupants). Thirdly, there are many spatially and temporally coupled operational constraints. Fourthly, building energy optimization problems can not be solved in real-time by traditional methods when they have extremely large solution spaces. Fifthly, traditional building energy management methods have respective applicable premises, which means that they have low versatility when confronted with varying building environments. With the rapid development of Internet of Things technology and computation capability, artificial intelligence technology find its significant competence in control and optimization. As a general artificial intelligence technology, deep reinforcement learning (DRL) is promising to address the above challenges. Notably, the recent years have seen the surge of DRL for SBEM. However, there lacks a systematic overview of different DRL methods for SBEM. To fill the gap, this paper provides a comprehensive review of DRL for SBEM from the perspective of system scale. In particular, we identify the existing unresolved issues and point out possible future research directions.
Comments: 21 pages, 12 figures
Subjects: Systems and Control (eess.SY); Signal Processing (eess.SP)
Journal reference: IEEE Internet of Things Journal, vol. 8, no. 15, pp. 12046-12063, 2021
DOI: 10.1109/JIOT.2021.3078462
Cite as: arXiv:2008.05074 [eess.SY]
  (or arXiv:2008.05074v3 [eess.SY] for this version)

Submission history

From: Liang Yu [view email]
[v1] Wed, 12 Aug 2020 02:46:48 GMT (2653kb)
[v2] Mon, 9 Nov 2020 14:29:01 GMT (2517kb)
[v3] Wed, 22 Sep 2021 14:01:23 GMT (3407kb)

Link back to: arXiv, form interface, contact.