Breaking down violence detection: combining divide-et-impera and coarse-to-fine strategies

Acar, E., Hopfgartner, F. and Albayrak, S. (2016) Breaking down violence detection: combining divide-et-impera and coarse-to-fine strategies. Neurocomputing, 208, pp. 225-237. (doi: 10.1016/j.neucom.2016.05.050)

Abstract

In today׳s society where audio–visual content is ubiquitous, violence detection in movies and Web videos has become a decisive functionality, e.g., for providing automated youth protection services. In this paper, we concentrate on two important aspects of video content analysis: Time efficiency and modeling of concepts (in this case, violence modeling). Traditional approaches to violent scene detection build on audio or visual features to model violence as a single concept in the feature space. Such modeling does not always provide a faithful representation of violence in terms of audio–visual features, as violence is not necessarily located compactly in the feature space. Consequently, in this paper, we target to close this gap. To this end, we present a solution which uses audio–visual features (MFCC-based audio and advanced motion features) and propose to model violence by means of multiple (sub)concepts. To cope with the heavy computations induced by the use of motion features, we perform a coarse-to-fine analysis, starting with a coarse-level analysis with time efficient audio features and pursuing with a fine-level analysis with advanced features when necessary. The results demonstrate the potential of the proposed approach on the standardized datasets of the latest editions of the MediaEval Affect in Multimedia: Violent Scenes Detection (VSD) task of 2014 and 2015.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Hopfgartner, Dr Frank
• Authors: Acar, E., Hopfgartner, F., and Albayrak, S.
• Subjects: Z Bibliography. Library Science. Information Resources > Z665 Library Science. Information Science
• College/School: College of Arts & Humanities > School of Humanities > Information Studies
• Journal Name: Neurocomputing
• Publisher: Elsevier
• ISSN: 0925-2312
• ISSN (Online): 1872-8286
• Published Online: 03 June 2016
• Copyright Holders: Copyright © 2016 Elsevier B.V.
• First Published: First published in Neurocomputing 208: 225-237
• Publisher Policy: Reproduced in accordance with the publisher copyright policy