Affect Recognition in Ads with Application to Computational Advertising

Shukla, A., Gullapuram, S. S., Katti, H., Yadati, K., Kankanhalli, M. and Subramanian, R. (2017) Affect Recognition in Ads with Application to Computational Advertising. In: 2017 ACM on Multimedia Conference (MM '17), Mountain View, CA, USA, 23-27 Oct 2017, pp. 1148-1156. ISBN 9781450349062 (doi: 10.1145/3123266.3123444)

[img]
Preview
Text
150558.pdf - Accepted Version

1MB

Abstract

Advertisements (ads) often include strongly emotional content to leave a lasting impression on the viewer. This work (i) compiles an affective ad dataset capable of evoking coherent emotions across users, as determined from the affective opinions of five experts and 14 annotators; (ii) explores the efficacy of convolutional neural network (CNN) features for encoding emotions, and observes that CNN features outperform low-level audio-visual emotion descriptors [9] upon extensive experimentation; and (iii) demonstrates how enhanced affect prediction facilitates computational advertising, and leads to better viewing experience while watching an online video stream embedded with ads based on a study involving 17 users. We model ad emotions based on subjective human opinions as well as objective multimodal features, and show how effectively modeling ad emotions can positively impact a real-life application.

Item Type:Conference Proceedings
Additional Information:This research is supported by the National Research Foundation, Prime Ministers Office, Singapore under its International Research Centre in Singapore Funding Initiative.
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Subramanian, Dr Ramanathan
Authors: Shukla, A., Gullapuram, S. S., Katti, H., Yadati, K., Kankanhalli, M., and Subramanian, R.
College/School:College of Science and Engineering > School of Computing Science
Publisher:ACM Press
ISBN:9781450349062
Copyright Holders:Copyright © 2017 Association for Computing Machinery
First Published:First published in Proceedings of the 2017 ACM on Multimedia Conference (MM '17): 1148-1156
Publisher Policy:Reproduced in accordance with the publisher copyright policy

University Staff: Request a correction | Enlighten Editors: Update this record