We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Signal Processing

Title: Reinforcement Learning for Beam Pattern Design in Millimeter Wave and Massive MIMO Systems

Abstract: Employing large antenna arrays is a key characteristic of millimeter wave (mmWave) and terahertz communication systems. However, due to the adoption of fully analog or hybrid analog/digital architectures, as well as non-ideal hardware or arbitrary/unknown array geometries, the accurate channel state information becomes hard to acquire. This impedes the design of beamforming/combining vectors that are crucial to fully exploit the potential of large-scale antenna arrays in providing sufficient receive signal power. In this paper, we develop a novel framework that leverages deep reinforcement learning (DRL) and a Wolpertinger-variant architecture and learns how to iteratively optimize the beam pattern (shape) for serving one or a small set of users relying only on the receive power measurements and without requiring any explicit channel knowledge. The proposed model accounts for key hardware constraints such as the phase-only, constant-modulus, and quantized-angle constraints. Further, the proposed framework can efficiently optimize the beam patterns for systems with non-ideal hardware and for arrays with unknown or arbitrary array geometries. Simulation results show that the developed solution is capable of finding near-optimal beam patterns based only on the receive power measurements.
Comments: Asilomar 2020, dataset and code files will be available soon on the DeepMIMO website this https URL
Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)
Cite as: arXiv:2102.09084 [eess.SP]
  (or arXiv:2102.09084v1 [eess.SP] for this version)

Submission history

From: Ahmed Alkhateeb [view email]
[v1] Thu, 18 Feb 2021 00:37:35 GMT (1430kb,D)

Link back to: arXiv, form interface, contact.