We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Networking and Internet Architecture

Title: Multi-Agent Deep Reinforcement Learning based Spectrum Allocation for D2D Underlay Communications

Abstract: Device-to-device (D2D) communication underlay cellular networks is a promising technique to improve spectrum efficiency. In this situation, D2D transmission may cause severe interference to both the cellular and other D2D links, which imposes a great technical challenge to spectrum allocation. Existing centralized schemes require global information, which causes a large signaling overhead. While existing distributed schemes requires frequent information exchange among D2D users and cannot achieve global optimization. In this paper, a distributed spectrum allocation framework based on multi-agent deep reinforcement learning is proposed, named multi-agent actor critic (MAAC). MAAC shares global historical states, actions and policies during centralized training, requires no signal interaction during execution and utilizes cooperation among users to further optimize system performance. Moreover, in order to decrease the computing complexity of the training, we further propose the neighbor-agent actor critic (NAAC) based on the neighbor users' historical information for centralized training. The simulation results show that the proposed MAAC and NAAC can effectively reduce the outage probability of cellular links, greatly improve the sum rate of D2D links and converge quickly.
Comments: Accepted to IEEE Transactions on Vehicular Technology. arXiv admin note: text overlap with arXiv:1904.06615
Subjects: Networking and Internet Architecture (cs.NI)
Cite as: arXiv:1912.09302 [cs.NI]
  (or arXiv:1912.09302v1 [cs.NI] for this version)

Submission history

From: Zheng Li [view email]
[v1] Wed, 18 Dec 2019 14:52:35 GMT (466kb,D)

Link back to: arXiv, form interface, contact.