Stay Home! Conducting Remote Usability Evaluations of Novel Real-World Authentication Systems Using Virtual Reality

Mathis, F., O'Hagan, J., Vaniea, K. and Khamis, M. (2022) Stay Home! Conducting Remote Usability Evaluations of Novel Real-World Authentication Systems Using Virtual Reality. In: 2022 International Conference on Advanced Visual Interfaces (AVI 2022), Rome, Italy, 06-10 Jun 2022, p. 14. ISBN 9781450397193 (doi: 10.1145/3531073.3531087)

Abstract

Evaluating interactive systems often requires researchers to invite user study participants to the lab. However, corresponding evaluations often lack realism and participants are usually recruited from a local area only. In this work, we propose Remote Virtual Reality for simulating Real-world Research (RVR3) to evaluate novel real-world authentication prototypes. A user study (N=25) demonstrates the feasibility of using VR for remote usability research on simulated real-world prototypes. Our remote VR user study provides a glimpse into the usability and social acceptability of two novel authentication systems: Hand Menu and Tap. We build on prior research in this space and discuss the impact RVR3 studies have on the range of possible studies. In summary, our remote VR research method to design, implement, and evaluate interactive real-world prototypes is a next step towards moving human-centred research out of the lab and potentially reaching a more diverse and larger participant sample over time.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: O'Hagan, Mr Joseph and Mathis, Mr Florian and Khamis, Dr Mohamed
• Authors: Mathis, F., O'Hagan, J., Vaniea, K., and Khamis, M.
• College/School: College of Science and Engineering > School of Computing Science
• ISBN: 9781450397193
• Copyright Holders: Copyright © 2022 The Authors
• First Published: First published in 2022 International Conference on Advanced Visual Interfaces (AVI 2022): 14
• Publisher Policy: Reproduced in accordance with the publisher copyright policy

Related URLs

• Organisation

Project Code	Award No	Project Name	Principal Investigator	Funder's Name	Funder Ref	Lead Dept
310627		TAPS: Assessing, Mitigating and Raising Awareness of the Security and Privacy Risks of Thermal Imaging	Mohamed Khamis	Engineering and Physical Sciences Research Council (EPSRC)	EP/V008870/1	Computing Science
313490		Preventing THErmal ATtacks using AI-driven Approaches	Mohamed Khamis	Engineering and Physical Sciences Research Council (EPSRC)	5676417 -PETRAS	Computing Science