Sampling, communication, and prediction co-design for synchronizing the real-world device and digital model in metaverse

Meng, Z., She, C., Zhao, G. and De Martini, D. (2023) Sampling, communication, and prediction co-design for synchronizing the real-world device and digital model in metaverse. IEEE Journal on Selected Areas in Communications, 41(1), pp. 288-300. (doi: 10.1109/JSAC.2022.3221993)

Abstract

The metaverse has the potential to revolutionize the next generation of the Internet by supporting highly interactive services with satisfactory user experience. The synchronization between devices in the physical world and their digital models in the metaverse is crucial. This work proposes a sampling, communication and prediction co-design framework to minimize the communication load subject to a constraint on the tracking error. To optimize the sampling rate and the prediction horizon, we exploit expert knowledge and develop a constrained deep reinforcement learning algorithm. We validate our framework on a prototype composed of a real-world robotic arm and its digital model. The results show that our framework achieves a better trade-off between the average tracking error and the average communication load compared with a communication system without sampling and prediction. For example, the average communication load can be reduced up to 87% when the average track error constraint is 0.002°. In addition, our policy outperforms the benchmark with the static sampling rate and prediction horizon optimized by exhaustive search, in terms of the tail probability of the tracking error. Furthermore, with the assistance of expert knowledge, the proposed algorithm achieves better convergence time, stability, communication load, and average tacking error.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Zhao, Dr Guodong and De Martini, Dr Daniele and Meng, Mr Zhen
• Authors: Meng, Z., She, C., Zhao, G., and De Martini, D.
• College/School: College of Science and Engineering > School of Engineering; College of Science and Engineering > School of Engineering > Autonomous Systems and Connectivity
• Journal Name: IEEE Journal on Selected Areas in Communications
• Publisher: IEEE
• ISSN: 0733-8716
• ISSN (Online): 1558-0008
• Published Online: 16 November 2022
• Copyright Holders: Copyright © 2022 IEEE
• First Published: First published in IEEE Journal on Selected Areas in Communications 41(1): 288-300
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher