The SONICOM project: artificial intelligence-driven immersive audio, from personalization to modeling

Picinali, L., Katz, B. F.G., Geronazzo, M., Majdak, P., Reyes-Lecuona, A. and Vinciarelli, A. (2022) The SONICOM project: artificial intelligence-driven immersive audio, from personalization to modeling. IEEE Signal Processing Magazine, 39(6), pp. 85-88. (doi: 10.1109/msp.2022.3182929)

Full text not currently available from Enlighten.

Abstract

Every individual perceives spatial audio differently, due in large part to the unique and complex shape of ears and head. Therefore, high-quality, headphone-based spatial audio should be uniquely tailored to each listener in an effective and efficient manner. Artificial intelligence (AI) is a powerful tool that can be used to drive forward research in spatial audio personalization. The SONICOM project aims to employ a data-driven approach that links physiological characteristics of the ear to the individual acoustic filters, which allows us to localize sound sources and perceive them as being located around us. A small amount of data acquired from users could allow personalized audio experiences, and AI could facilitate this by offering a new perspective on the matter. A Bayesian approach to computational neuroscience and binaural sound reproduction will be linked to create a metric for AI-based algorithms that will predict realistic spatial audio quality. Being able to consistently and repeatedly evaluate and quantify the improvements brought by technological advancements, as well as the impact these have on complex interactions in virtual environments, will be key for the development of new techniques and for unlocking new approaches to understanding the mechanisms of human spatial hearing and communication.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Vinciarelli, Professor Alessandro
Authors: Picinali, L., Katz, B. F.G., Geronazzo, M., Majdak, P., Reyes-Lecuona, A., and Vinciarelli, A.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:IEEE Signal Processing Magazine
Publisher:IEEE
ISSN:1053-5888
ISSN (Online):1558-0792
Published Online:27 October 2022

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
311886SONICOMAlessandro VinciarelliEuropean Commission (EC)101017743Computing Science