Automatic Multimodal Descriptors of Rhythmic Body Movement

Mahmoud, M. , Morency, L.-P. and Robinson, P. (2013) Automatic Multimodal Descriptors of Rhythmic Body Movement. In: 15th ACM International Conference on Multimodal Interaction (ICMI '13), Sydney, Australia, 09-13 Dec 2013, pp. 429-436. ISBN 9781450321297 (doi: 10.1145/2522848.2522895)

Abstract

Prolonged durations of rhythmic body gestures were proved to be correlated with different types of psychological disorders. To-date, there is no automatic descriptor that can robustly detect those behaviours. In this paper, we propose a cyclic gestures descriptor that can detect and localise rhythmic body movements by taking advantage of both colour and depth modalities. We show experimentally how our rhythmic descriptor can successfully localise the rhythmic gestures as: hands fidgeting, legs fidgeting or rocking, significantly higher than the majority vote classification baseline. Our experiments also demonstrate the importance of fusing both modalities, with a significant increase in performance when compared to individual modalities.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Mahmoud, Dr Marwa
• Authors: Mahmoud, M., Morency, L.-P., and Robinson, P.
• College/School: College of Science and Engineering > School of Computing Science
• ISBN: 9781450321297