EyePACT: eye-based parallax correction on touch-enabled interactive displays

Khamis, M. , Buschek, D., Thieron, T., Alt, F. and Bulling, A. (2017) EyePACT: eye-based parallax correction on touch-enabled interactive displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1(4), 146. (doi: 10.1145/3161168)

Abstract

The parallax effect describes the displacement between the perceived and detected touch locations on a touch-enabled surface. Parallax is a key usability challenge for interactive displays, particularly for those that require thick layers of glass between the screen and the touch surface to protect them from vandalism. To address this challenge, we present EyePACT, a method that compensates for input error caused by parallax on public displays. Our method uses a display-mounted depth camera to detect the user's 3D eye position in front of the display and the detected touch location to predict the perceived touch location on the surface. We evaluate our method in two user studies in terms of parallax correction performance as well as multi-user support. Our evaluations demonstrate that EyePACT (1) significantly improves accuracy even with varying gap distances between the touch surface and the display, (2) adapts to different levels of parallax by resulting in significantly larger corrections with larger gap distances, and (3) maintains a significantly large distance between two users' fingers when interacting with the same object. These findings are promising for the development of future parallax-free interactive displays.

• Item Type: Articles
• Additional Information: This work was funded, in part, by the Cluster of Excellence on Multimodal Computing and Interaction (MMCI) at Saarland University, Germany, and by the Bavarian State Ministry of Education, Science and the Arts in the framework of the Centre Digitisation.Bavaria (ZD.B).
• Keywords: Gaze, parallax, public displays, touch screens.
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Khamis, Dr Mohamed
• Authors: Khamis, M., Buschek, D., Thieron, T., Alt, F., and Bulling, A.
• College/School: College of Science and Engineering > School of Computing Science
• Journal Name: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
• Publisher: Association for Computing Machinery
• ISSN: 2474-9567
• ISSN (Online): 2474-9567
• Published Online: 08 January 2018
• Copyright Holders: Copyright © 2017 The Authors
• First Published: First published in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1(4): 146
• Publisher Policy: Reproduced in accordance with the publisher copyright policy