Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents

Joho, H., Staiano, J., Sebe, N. and Jose, J.M. (2011) Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents. Multimedia Tools and Applications, 51(2), pp. 505-523. (doi: 10.1007/s11042-010-0632-x)

Full text not currently available from Enlighten.

Abstract

This paper presents an approach to detect personal highlights in videos based on the analysis of facial activities of the viewer. Our facial activity analysis was based on the motion vectors tracked on twelve key points in the human face. In our approach, the magnitude of the motion vectors represented a degree of a viewer’s affective reaction to video contents. We examined 80 facial activity videos recorded for ten participants, each watching eight video clips in various genres. The experimental results suggest that useful motion vectors to detect personal highlights varied significantly across viewers. However, it was suggested that the activity in the upper part of face tended to be more indicative of personal highlights than the activity in the lower part.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Jose, Professor Joemon
Authors: Joho, H., Staiano, J., Sebe, N., and Jose, J.M.
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Multimedia Tools and Applications
ISSN:1380-7501
Published Online:28 October 2010

University Staff: Request a correction | Enlighten Editors: Update this record