Detecting Swipe Errors on Touchscreens Using Grip Modulation

Noor, M. F. M., Rogers, S. and Williamson, J. (2016) Detecting Swipe Errors on Touchscreens Using Grip Modulation. In: CHI 2016, San Jose, CA, USA, 7-12 May 2016, pp. 1909-1920. ISBN 9781450333627 (doi: 10.1145/2858036.2858474)

Abstract

We show that when users make errors on mobile devices they make immediate and distinct physical responses that can be observed with standard sensors. We used three standard cognitive tasks (Flanker, Stroop and SART) to induce errors from 20 participants. Using simple low-resolution capacitive touch sensors placed around a standard mobile device and the builtin accelerometer, we demonstrate that errors can be predicted at low error rates from micro-adjustments to hand grip and movement in the period shortly after swiping the touchscreen. Specifically, when combining features derived from hand grip and movement we obtain a mean AUC of 0.96 (with false accept and reject rates both below 10%). Our results demonstrate that hand grip and movement provide strong and low latency evidence for mistakes. The ability to detect user errors in this way could be a valuable component in future interaction systems, allowing interfaces to make it easier for users to correct erroneous inputs.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Williamson, Dr John and Rogers, Dr Simon
• Authors: Noor, M. F. M., Rogers, S., and Williamson, J.
• College/School: College of Science and Engineering > School of Computing Science
• ISBN: 9781450333627
• Copyright Holders: Copyright © 2016 ACM
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher.

Related URLs

• Organisation

• Data DOI: 10.5525/gla.researchdata.247