Unveiling the multimedia unconscious: implicit cognitive processes and multimedia content analysis

Cristani, M., Vinciarelli, A. , Segalin, C. and Perina, A. (2013) Unveiling the multimedia unconscious: implicit cognitive processes and multimedia content analysis. In: 21st ACM international conference on Multimedia MM '13, Barcelona, Spain, 21-25 Oct 2013, pp. 213-222. ISBN 781450324045 (doi: 10.1145/2502081.2502280)

Abstract

One of the main findings of cognitive sciences is that automatic processes of which we are unaware shape, to a significant extent, our perception of the environment. The phenomenon applies not only to the real world, but also to multimedia data we consume every day. Whenever we look at pictures, watch a video or listen to audio recordings, our conscious attention efforts focus on the observable content, but our cognition spontaneously perceives intentions, beliefs, values, attitudes and other constructs that, while being outside of our conscious awareness, still shape our reactions and behavior. So far, multimedia technologies have neglected such a phenomenon to a large extent. This paper argues that taking into account cognitive effects is possible and it can also improve multimedia approaches. As a supporting proof-of-concept, the paper shows not only that there are visual patterns correlated with the personality traits of 300 Flickr users to a statistically significant extent, but also that the personality traits (both self-assessed and attributed by others) of those users can be inferred from the images these latter post as "favourite".

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Vinciarelli, Professor Alessandro
• Authors: Cristani, M., Vinciarelli, A., Segalin, C., and Perina, A.
• College/School: College of Science and Engineering > School of Computing Science
• ISBN: 781450324045
• Copyright Holders: Copyright © 2013 The Authors
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher