Spelling it Out: Real-Time ASL Fingerspelling Recognition

Pugeault, N. and Bowden, R. (2011) Spelling it Out: Real-Time ASL Fingerspelling Recognition. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 1114-1119. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130290)

Full text not currently available from Enlighten.

Abstract

This article presents an interactive hand shape recognition user interface for American Sign Language (ASL) finger-spelling. The system makes use of a Microsoft Kinect device to collect appearance and depth images, and of the OpenNI+NITE framework for hand detection and tracking. Hand-shapes corresponding to letters of the alphabet are characterized using appearance and depth images and classified using random forests. We compare classification using appearance and depth images, and show a combination of both lead to best results, and validate on a dataset of four different users. This hand shape detection works in real-time and is integrated in an interactive user interface allowing the signer to select between ambiguous detections and integrated with an English dictionary for efficient writing.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Pugeault, Dr Nicolas
Authors: Pugeault, N., and Bowden, R.
College/School:College of Science and Engineering > School of Computing Science
ISBN:9781467300636
Published Online:16 January 2012

University Staff: Request a correction | Enlighten Editors: Update this record