Pugeault, N. and Bowden, R. (2011) Spelling it Out: Real-Time ASL Fingerspelling Recognition. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 1114-1119. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130290)
Full text not currently available from Enlighten.
Abstract
This article presents an interactive hand shape recognition user interface for American Sign Language (ASL) finger-spelling. The system makes use of a Microsoft Kinect device to collect appearance and depth images, and of the OpenNI+NITE framework for hand detection and tracking. Hand-shapes corresponding to letters of the alphabet are characterized using appearance and depth images and classified using random forests. We compare classification using appearance and depth images, and show a combination of both lead to best results, and validate on a dataset of four different users. This hand shape detection works in real-time and is integrated in an interactive user interface allowing the signer to select between ambiguous detections and integrated with an English dictionary for efficient writing.
Item Type: | Conference Proceedings |
---|---|
Status: | Published |
Refereed: | Yes |
Glasgow Author(s) Enlighten ID: | Pugeault, Dr Nicolas |
Authors: | Pugeault, N., and Bowden, R. |
College/School: | College of Science and Engineering > School of Computing Science |
ISBN: | 9781467300636 |
Published Online: | 16 January 2012 |
University Staff: Request a correction | Enlighten Editors: Update this record