TY - JOUR
T1 - Beamforming Optimization for IRS-Assisted mmWave V2I Communication Systems via Reinforcement Learning
AU - Lee, Yeongrok
AU - Lee, Ju Hyung
AU - Ko, Young Chai
N1 - Funding Information:
This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2022-2021-0-01810) supervised by the IITP (Institute for Information & Communications Technology Planning & Evaluation)
Publisher Copyright:
© 2013 IEEE.
PY - 2022
Y1 - 2022
N2 - Intelligent reflecting surface (IRS), which can provide a propagation path where non-line-of-sight (NLOS) link exists, is a promising technology to enable beyond fifth-generation (B5G) mobile communication systems. In this paper, we jointly optimize the base station (BS) and IRS beamforming to enhance network performance in the mmWave vehicle-to-infrastructure (V2I) communication system. However, the joint optimization of the beamforming matrix for BS and IRS is challenging due to non-convex and time-varying issues. To tackle those issues, we propose a novel reinforcement learning algorithm based on deep deterministic policy gradient (DDPG) method. Simulation results corroborate that the proposed algorithm converges in both systems with and without IRS, and the case with IRS improves the network performance from as little as about 5% to as much as about 100% depending on the environments such as the number of vehicles or deployment. Simulation results also show that in the IRS-assisted communication, up to 10% higher network throughput can be achieved in Dense V2I network scenario compared to Sparse case.
AB - Intelligent reflecting surface (IRS), which can provide a propagation path where non-line-of-sight (NLOS) link exists, is a promising technology to enable beyond fifth-generation (B5G) mobile communication systems. In this paper, we jointly optimize the base station (BS) and IRS beamforming to enhance network performance in the mmWave vehicle-to-infrastructure (V2I) communication system. However, the joint optimization of the beamforming matrix for BS and IRS is challenging due to non-convex and time-varying issues. To tackle those issues, we propose a novel reinforcement learning algorithm based on deep deterministic policy gradient (DDPG) method. Simulation results corroborate that the proposed algorithm converges in both systems with and without IRS, and the case with IRS improves the network performance from as little as about 5% to as much as about 100% depending on the environments such as the number of vehicles or deployment. Simulation results also show that in the IRS-assisted communication, up to 10% higher network throughput can be achieved in Dense V2I network scenario compared to Sparse case.
KW - deep reinforcement learning (DRL)
KW - Intelligent reflecting surface (IRS)
KW - mmWave
KW - vehicle-to-infrastructure communications (V2I)
UR - http://www.scopus.com/inward/record.url?scp=85131754788&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2022.3181152
DO - 10.1109/ACCESS.2022.3181152
M3 - Article
AN - SCOPUS:85131754788
SN - 2169-3536
VL - 10
SP - 60521
EP - 60533
JO - IEEE Access
JF - IEEE Access
ER -