The Dark Side of Perceptual Manipulations in Virtual Reality

Tseng, W.-J., Bonnail, E., McGill, M., Khamis, M. , Lecolinet, E., Huron, S. and Gugenheimer, J. (2022) The Dark Side of Perceptual Manipulations in Virtual Reality. In: 2022 CHI Conference on Human Factors in Computing Systems (CHI '22), New Orleans, LA, USA, 30 Apr - 05 May 2022, p. 612. ISBN 9781450391573 (doi: 10.1145/3491102.3517728)

Abstract

“Virtual-Physical Perceptual Manipulations” (VPPMs) such as redirected walking and haptics expand the user’s capacity to interact with Virtual Reality (VR) beyond what would ordinarily physically be possible. VPPMs leverage knowledge of the limits of human perception to effect changes in the user’s physical movements, becoming able to (perceptibly and imperceptibly) nudge their physical actions to enhance interactivity in VR. We explore the risks posed by the malicious use of VPPMs. First, we define, conceptualize and demonstrate the existence of VPPMs. Next, using speculative design workshops, we explore and characterize the threats/risks posed, proposing mitigations and preventative recommendations against the malicious use of VPPMs. Finally, we implement two sample applications to demonstrate how existing VPPMs could be trivially subverted to create the potential for physical harm. This paper aims to raise awareness that the current way we apply and publish VPPMs can lead to malicious exploits of our perceptual vulnerabilities.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Khamis, Dr Mohamed and McGill, Dr Mark
• Authors: Tseng, W.-J., Bonnail, E., McGill, M., Khamis, M., Lecolinet, E., Huron, S., and Gugenheimer, J.
• College/School: College of Science and Engineering > School of Computing Science
• ISBN: 9781450391573
• Copyright Holders: Copyright © 2022 The Authors
• First Published: First published in 2022 CHI Conference on Human Factors in Computing Systems (CHI '22): 612
• Publisher Policy: Reproduced in accordance with the publisher copyright policy

Related URLs

• Organisation