References & Citations
Electrical Engineering and Systems Science > Signal Processing
Title: Minimizing the AoI in Resource-Constrained Multi-Source Relaying Systems: Dynamic and Learning-based Scheduling
(Submitted on 10 Mar 2022 (v1), last revised 8 Jan 2023 (this version, v3))
Abstract: We consider a multi-source relaying system where independent sources randomly generate status update packets which are sent to the destination with the aid of a relay through unreliable links. We develop transmission scheduling policies to minimize the weighted sum average age of information (AoI) subject to transmission capacity and long-run average resource constraints. We formulate a stochastic control optimization problem and solve it using a constrained Markov decision process (CMDP) approach and a drift-plus-penalty method. The CMDP problem is solved by transforming it into an MDP problem using the Lagrangian relaxation method. We theoretically analyze the structure of optimal policies for the MDP problem and subsequently propose a structure-aware algorithm that returns a practical near-optimal policy. Using the drift-plus-penalty method, we devise a near-optimal low-complexity policy that performs the scheduling decisions dynamically. We also develop a model-free deep reinforcement learning policy for which the Lyapunov optimization theory and a dueling double deep Q-network are employed. The complexities of the proposed policies are analyzed. Simulation results are provided to assess the performance of our policies and validate the theoretical results. The results show up to 91% performance improvement compared to a baseline policy.
Submission history
From: Abolfazl Zakeri [view email][v1] Thu, 10 Mar 2022 21:46:40 GMT (1219kb)
[v2] Fri, 23 Sep 2022 15:59:21 GMT (1415kb)
[v3] Sun, 8 Jan 2023 18:00:10 GMT (2334kb)
Link back to: arXiv, form interface, contact.