Learning Combinations of Multiple Feature Representations for Music Emotion Prediction

Madsen, J., Sand Jensen, B. and Larson, J. (2015) Learning Combinations of Multiple Feature Representations for Music Emotion Prediction. In: ASM '15: 1st International Workshop on Affect and Sentiment in Multimedia, Brisbane, Australia, 26-30 Oct 2015, pp. 3-8. ISBN 9781450337502 (doi:10.1145/2813524.2813534)

119551.pdf - Published Version


Publisher's URL: http://dl.acm.org/citation.cfm?id=2813534


Music consists of several structures and patterns evolving through time which greatly influences the human decoding of higher-level cognitive aspects of music like the emotions expressed in music. For tasks, such as genre, tag and emotion recognition, these structures have often been identified and used as individual and non-temporal features and representations. In this work, we address the hypothesis whether using multiple temporal and non-temporal representations of different features is beneficial for modeling music structure with the aim to predict the emotions expressed in music. We test this hypothesis by representing temporal and non-temporal structures using generative models of multiple audio features. The representations are used in a discriminative setting via the Product Probability Kernel and the Gaussian Process model enabling Multiple Kernel Learning, finding optimized combinations of both features and temporal/ non-temporal representations. We show the increased predictive performance using the combination of different features and representations along with the great interpretive prospects of this approach.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Jensen, Dr Bjorn
Authors: Madsen, J., Sand Jensen, B., and Larson, J.
College/School:College of Science and Engineering > School of Computing Science
Copyright Holders:Copyright © 2015 The Authors
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record