  In this paper, we present a novel joint hybrid beamforming (HYBF) and
combining scheme in a single-cell millimeter wave (mmWave) massive MIMO
full-duplex (FD) system for weighted sum-rate (WSR) maximization with
multi-antenna half-duplex (HD) uplink and downlink users with non-ideal
hardware. Moreover, we present a novel interference and self-interference (SI)
aware power allocation scheme for the optimal beamforming directions. Compared
to the traditional sum-power constraints, the proposed algorithm is designed
under the joint sum-power and per-antenna power constraints. The sum-power
constraints are naturally imposed to limit the maximum transmission power.
However, each antenna has its power amplifier (PA), and the per-antenna power
constraints consider the physical limits of each PA while maximizing the
communication system's performance. To model the non-ideal hardware of the FD
base station and the half-duplex users, we extend the traditional limited
dynamic range (LDR) noise model to mmWave with a FD hybrid transceiver. Our
design relies on alternating optimization based on the
minorization-maximization method. A detailed numerical analysis is presented,
and the impact of the different levels of the LDR noise variance on the maximum
achievable performance for HYBF in a practical FD system is investigated.
Simulation results show significant performance improvement compared to the
traditional HD system. However, the maximum achievable performance gain results
to be limited by the LDR noise level.
