Reinforcement Learning Method for Beam Management in Millimeter-Wave Networks

Wang, R., Onireti, O. , Zhang, L. , Imran, M. A. , Ren, G., Qiu, J. and Tian, T. (2019) Reinforcement Learning Method for Beam Management in Millimeter-Wave Networks. In: 4th International Conference on UK - China Emerging Technologies (UCET 2019), Glasgow, UK, 21-22 Aug 2019, ISBN 9781728127972 (doi: 10.1109/UCET.2019.8881841)

190545.pdf - Accepted Version



With the rapid growth of mobile data demand, the fifth generation (5G) mobile network must exploit the large amount of spectrum in the millimeter wave (mmWave) band to increase the network capacity. Due to the limitation of propagation distance, line-of-sight (LOS) link is highly desirable for mmWave systems. However, LOS channel is not feasible all the time and mmWave is also impacted significantly by the surrounding environment. The LOS signal can be easily blocked by surrounding buildings. Based on this issue, in this paper, we propose to use reinforcement learning to manage the non line of sight (NLOS) scenario. Specifically, we build a model simulating blocked LOS signal for the user equipment (UE) with only NLOS channel available for the UE. Q-Learning is used to select the NLOS beam that meets the UE's quality of service requirements. Simulation results show that Q-Learning can be used to manage the beam selection. In particular, at initial training stage the Q-Learning explores in the environment. However, with the training process, Q-Learning learns from experience and the received power increases significantly and converges to an excellent level.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Wang, Ruiyu and Imran, Professor Muhammad and Zhang, Professor Lei and Onireti, Oluwakayode
Authors: Wang, R., Onireti, O., Zhang, L., Imran, M. A., Ren, G., Qiu, J., and Tian, T.
College/School:College of Science and Engineering > School of Engineering > Electronics and Nanoscale Engineering
College of Science and Engineering > School of Engineering > Systems Power and Energy
Published Online:24 October 2019
Copyright Holders:Copyright © 2019 IEEE
First Published:First published in 2019 UK/ China Emerging Technologies (UCET)
Publisher Policy:Reproduced in accordance with the publisher copyright policy
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record