Reading the Signs: a Video Based Sign Dictionary

Cooper, H., Pugeault, N. and Bowden, R. (2011) Reading the Signs: a Video Based Sign Dictionary. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 914-919. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130349)

Full text not currently available from Enlighten.

Abstract

This article presents a dictionary for Sign Language using visual sign recognition based on linguistic sub-components. We demonstrate a system where the user makes a query, receiving in response a ranked selection of similar results. The approach uses concepts from linguistics to provide sign sub-unit features and classifiers based on motion, sign-location and handshape. These sub-units are combined using Markov Models for sign level recognition. Results are shown for a video dataset of 984 isolated signs performed by a native signer. Recognition rates reach 71.4% for the first candidate and 85.9% for retrieval within the top 10 ranked signs.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Pugeault, Dr Nicolas
Authors: Cooper, H., Pugeault, N., and Bowden, R.
College/School:College of Science and Engineering > School of Computing Science
ISBN:9781467300636
Published Online:16 January 2012

University Staff: Request a correction | Enlighten Editors: Update this record