Self-imitation learning-based inter-cell interference coordination in autonomous HetNets

Yan, M., Yang, J., Chen, K., Sun, Y. and Feng, G. (2021) Self-imitation learning-based inter-cell interference coordination in autonomous HetNets. IEEE Transactions on Network and Service Management, 18(4), pp. 4589-4601. (doi: 10.1109/TNSM.2021.3088837)

[img] Text
268235.pdf - Accepted Version

3MB

Abstract

Recently, mobile operators have been shifting to an intelligent autonomous network paradigm, where the mobile networks are automated in a plug-and-play manner to reduce the manual intervention. Under this circumstance, serious inter-cell interference becomes inevitable which may severely deteriorate system throughput performance and users’ quality of service (QoS), especially for dense residential small base station (SBS) deployment. This paper proposes an intelligent inter-cell interference coordination (ICIC) scheme for autonomous heterogeneous networks (HetNets), where the SBSs agilely schedule sub-channels to individual users at each Transmit Time Interval (TTI) with aim of mitigating interferences and maximizing long-term throughput by sensing the environment. Since the reward function is inexplicit and only few samples can be used for prior-training, we formulate the ICIC problem as a distributed inverse reinforcement learning (IRL) problem following the POMDP games. We propose a non-prior knowledge based self-imitating learning (SIL) algorithm which incorporates Wasserstein Generative Adversarial Networks (WGANs) and Double Deep Q Network (Double DQN) algorithms for performing behavior imitation and few-shot learning in solving the IRL problem from both the policy and value . Numerical results reveal that SIL is able to implement TTI level’s decision-making to solve the ICIC problem, and the overall network throughput of SIL can be improved by up to 19.8% when compared with other known benchmark algorithms.

Item Type:Articles
Additional Information:The work was supported by The National Key Research and Development Project of China under Grant 2020YFB1806804, National Natural Science Foundation of China under Grant 62071091, and National Defense Science and Technology “Leading” Fund
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Sun, Dr Yao and Feng, Professor Gang
Authors: Yan, M., Yang, J., Chen, K., Sun, Y., and Feng, G.
College/School:College of Science and Engineering > School of Engineering > Autonomous Systems and Connectivity
Journal Name:IEEE Transactions on Network and Service Management
Publisher:IEEE
ISSN:1932-4537
ISSN (Online):1932-4537
Published Online:14 June 2021
Copyright Holders:Copyright © 2021 IEEE
First Published:First published in IEEE Transactions on Network and Service Management 18(4): 4589-4601
Publisher Policy:Reproduced in accordance with the publisher copyright policy

University Staff: Request a correction | Enlighten Editors: Update this record