In this paper, we consider delay-optimal power and subcarrier allocation design for OFDMA systems with subcarriers, mobiles and one base station. There are queues at the base station for the downlink traffic to the mobiles with heterogeneous packet arrivals and delay requirements. We shall model the problem as a -dimensional infinite horizon average reward Markov Decision Problem (MDP) where the control actions are assumed to be a function of the instantaneous Channel State Information (CSI) as well as the joint Queue State Information (QSI). We propose an online stochastic value iteration solution using stochastic approximation. The proposed power control algorithm, which is a function of both the CSI and the QSI, takes the form of multi-level water-filling. We prove that under two mild conditions in Theorem 1, the proposed solution converges to the optimal solution almost surely (with probability 1) and the proposed framework offers a possible solution to the general stochastic NUM problem. By exploiting the birth-death structure of the queue dynamics, we obtain a reduced complexity decomposed solution with linear ( ) complexity and ( ) memory requirement.
The delay-optimal power and subcarrier allocation problem for OFDMA systems was modeled as a K-dimensional infinite horizon average reward MDP with the control actions based on channel state information (CSI) and joint queue state information (QSI) in REF .
Delay-optimal power and subcarrier allocation for OFDMA systems via stochastic approximation
IEEE Transactions on Wireless Communications
IEEE Transactions on Wireless Communications
Mathematics Computer Science