Joint beamforming and user association with reduced CSI signaling in mobile environments: A Deep Q-learning approach - Laboratoire Interdisciplinaire des Sciences du Numérique Access content directly
Journal Articles Computer Networks Year : 2021

Joint beamforming and user association with reduced CSI signaling in mobile environments: A Deep Q-learning approach

Abstract

Heterogeneous Cloud Radio Access Network (H-CRAN) is considered as a cost-efficient network solution to meet 5G data traffic requirements. In this paper, we consider the problem of beamforming and user clustering (user-to-Remote Radio Head (RRH) association) in the downlink of a H-CRAN where users have heterogeneous mobility profiles. Given the rapidly time-varying nature of the mobile wireless environment, it is challenging to offer an optimal beamforming and user association performance during a long-term allocation process without incurring large Channel State Information (CSI) and signaling overheads. For that purpose, we proposed in Ha et al. (2019) an Adaptive Beamforming and User Clustering (ABUC) algorithm which resolves the joint beamforming and user clustering problem when considering CSI cost and imperfectness under user mobility assumptions. In this paper, we design a deep reinforcement-learning framework which enables the proposed ABUC algorithm to select on-the-fly its best feedback scheduling parameters, namely the period and type of CSI feedback, given each user mobility profile. The proposed ABUC-DQL approach can overcome the scalability limitation of the Q-learning approach (Ha et al., 2019) and better handle the problem when formulated using a POMDP (Partially Observable Markov Decision Process) model. The simulation results show that the convergence time is mainly impacted by the number of users in the network, and the online-learning ability of the framework can quickly adapt to the changes of users mobility.
Fichier principal
Vignette du fichier
S1389128621003078.pdf (4.91 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03943425 , version 1 (02-08-2023)

Licence

Attribution - NonCommercial

Identifiers

Cite

Ha Duc Thang, Lila Boukhatem, Megumi Kaneko, Nhan Nguyen-Thanh. Joint beamforming and user association with reduced CSI signaling in mobile environments: A Deep Q-learning approach. Computer Networks, 2021, 197, pp.108291. ⟨10.1016/j.comnet.2021.108291⟩. ⟨hal-03943425⟩
31 View
12 Download

Altmetric

Share

Gmail Facebook X LinkedIn More