Development of augmented reality serious games with a vibrotactile feedback jacket

Zhu, L., Cao, Q. and Cai, Y. (2020) Development of augmented reality serious games with a vibrotactile feedback jacket. Virtual Reality and Intelligent Hardware, 2(5), pp. 454-470. (doi: 10.1016/j.vrih.2020.05.005)

Abstract

Background: In the past few years, augmented reality (AR) has rapidly advanced and has been applied in different fields. One of the successful AR applications is the immersive and interactive serious games, which can be used for education and learning purposes. Methods: In this project, a prototype of an AR serious game is developed and demonstrated. Gamers utilize a head-mounted device and a vibrotactile feedback jacket to explore and interact with the AR serious game. Fourteen vibration actuators are embedded in the vibrotactile feedback jacket to generate immersive AR experience. These vibration actuators are triggered in accordance with the designed game scripts. Various vibration patterns and intensity levels are synthesized in different game scenes. This article presents the details of the entire software development of the AR serious game, including game scripts, game scenes with AR effects design, signal processing flow, behavior design, and communication configuration. Graphics computations are processed using the graphics processing unit in the system. Results /Conclusions: The performance of the AR serious game prototype is evaluated and analyzed. The computation loads and resource utilization of normal game scenes and heavy computation scenes are compared. With 14 vibration actuators placed at different body positions, various vibration patterns and intensity levels can be generated by the vibrotactile feedback jacket, providing different real-world feedback. The prototype of this AR serious game can be valuable in building large-scale AR or virtual reality educational and entertainment games. Possible future improvements of the proposed prototype are also discussed in this article.

• Item Type: Articles
• Keywords: Augmented reality, AR serious games, vibrotactile feedback jacket, game scenes.
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Cao, Dr Qi
• Authors: Zhu, L., Cao, Q., and Cai, Y.
• College/School: College of Science and Engineering > School of Computing Science
• Journal Name: Virtual Reality and Intelligent Hardware
• Publisher: China Science Publishing and Media
• ISSN: 2096-5796
• ISSN (Online): 2666-1209
• Published Online: 01 July 2020
• Copyright Holders: Copyright © 2020 Beijing Zhongke Journal Publishing Co. Ltd.
• First Published: First published in Virtual Reality and Intelligent Hardware 2(5): 454-470
• Publisher Policy: Reproduced under a Creative Commons License