Dynamic Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning

Wei, F., Feng, G., Sun, Y. , Wang, Y. and Liang, Y.-C. (2020) Dynamic Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning. In: 54th IEEE International Conference on Communications (ICC), Dublin, Ireland, 7-11 June 2020, ISBN 9781728150895 (doi: 10.1109/ICC40277.2020.9148848)

[img]
Preview
Text
212843.pdf - Accepted Version

599kB

Abstract

It is widely acknowledged that network slicing can tackle the diverse usage scenarios and connectivity services that the 5G-and-beyond systems need to support. To guarantee performance isolation while maximizing network resource utilization under traffic uncertainty, network slice needs to be reconfigured adaptively. However, it is commonly believed that the fine-grained resource reconfiguration problem is intractable due to the extremely high computational complexity caused by the numerous variables. In this paper, we investigate network slice reconfiguration with aim of minimizing long-term resource consumption by exploiting Deep Reinforcement Learning (DRL). To address the curse of dimensionality of the problem, we propose to incorporate the Branching Dueling Q-network (BDQ) into DRL, to avoid some unnecessary calculations of Q-value by separating the Q-network into a shared value branch and a number of distributed advantage branches. Furthermore, the value branch and the advantage branch of each dimension are aggregated to derive the corresponding dimension’s sub-Q-value. Then the best reconfiguration action is composed of the subactions in individual dimensions which are selected by ϵ−greedy policy. Finally, we design an intelligent online network slice reconfiguration policy based on BDQ and extensive simulation experiments are conducted to validate the effectiveness of the proposed slice reconfiguration policy.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Liang, Professor Ying-Chang and Feng, Professor Gang and Sun, Dr Yao
Authors: Wei, F., Feng, G., Sun, Y., Wang, Y., and Liang, Y.-C.
College/School:College of Science and Engineering > School of Engineering
ISSN:1938-1883
ISBN:9781728150895
Copyright Holders:Copyright © 2020 IEEE
First Published:First published in ICC 2020 - 2020 IEEE International Conference on Communications (ICC)
Publisher Policy:Reproduced in accordance with the publisher copyright policy
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record