Wang, R., Onireti, O. , Zhang, L. , Imran, M. A. , Ren, G., Qiu, J. and Tian, T. (2019) Reinforcement Learning Method for Beam Management in Millimeter-Wave Networks. In: 4th International Conference on UK - China Emerging Technologies (UCET 2019), Glasgow, UK, 21-22 Aug 2019, ISBN 9781728127972 (doi: 10.1109/UCET.2019.8881841)
|
Text
190545.pdf - Accepted Version 553kB |
Abstract
With the rapid growth of mobile data demand, the fifth generation (5G) mobile network must exploit the large amount of spectrum in the millimeter wave (mmWave) band to increase the network capacity. Due to the limitation of propagation distance, line-of-sight (LOS) link is highly desirable for mmWave systems. However, LOS channel is not feasible all the time and mmWave is also impacted significantly by the surrounding environment. The LOS signal can be easily blocked by surrounding buildings. Based on this issue, in this paper, we propose to use reinforcement learning to manage the non line of sight (NLOS) scenario. Specifically, we build a model simulating blocked LOS signal for the user equipment (UE) with only NLOS channel available for the UE. Q-Learning is used to select the NLOS beam that meets the UE's quality of service requirements. Simulation results show that Q-Learning can be used to manage the beam selection. In particular, at initial training stage the Q-Learning explores in the environment. However, with the training process, Q-Learning learns from experience and the received power increases significantly and converges to an excellent level.
| Item Type: | Conference Proceedings |
|---|---|
| Status: | Published |
| Refereed: | Yes |
| Glasgow Author(s) Enlighten ID: | Wang, Ruiyu and Imran, Professor Muhammad and Zhang, Professor Lei and Onireti, Oluwakayode |
| Authors: | Wang, R., Onireti, O., Zhang, L., Imran, M. A., Ren, G., Qiu, J., and Tian, T. |
| College/School: | College of Science and Engineering > School of Engineering > Electronics and Nanoscale Engineering College of Science and Engineering > School of Engineering > Systems Power and Energy |
| ISBN: | 9781728127972 |
| Published Online: | 24 October 2019 |
| Copyright Holders: | Copyright © 2019 IEEE |
| First Published: | First published in 2019 UK/ China Emerging Technologies (UCET) |
| Publisher Policy: | Reproduced in accordance with the publisher copyright policy |
| Related URLs: |
University Staff: Request a correction | Enlighten Editors: Update this record
Altmetric
Altmetric