"My Day in Review": Visually Summarising Noisy Lifelog Data

Chowdhury, S., Mcparlane, P. J., Ferdous, M. S. and Jose, J. (2015) "My Day in Review": Visually Summarising Noisy Lifelog Data. In: ICMR'15: ACM International Conference on Multimedia Retrieval, Shanghai, China, 23-26 Jun 2015, pp. 607-610. ISBN 9781450332743 (doi:10.1145/2671188.2749393)

Full text not currently available from Enlighten.

Abstract

Lifelogging devices, which seamlessly gather various data about a user as they go about their daily life, have resulted in users amassing large collections of noisy photographs (e.g. visual duplicates, image blur), which are difficult to navigate, especially if they want to review their day in photographs. Social media websites, such as Facebook, have faced a similar information overload problem for which a number of summarization methods have been proposed (e.g. news story clustering, comment ranking etc.). In particular, Facebook's Year in Review received much user interest where the objective for the model was to identify key moments in a user's year, offering an automatic visual summary based on their uploaded content. In this paper, we follow this notion by automatically creating a review of a user's day using lifelogging images. Specifically, we address the quality issues faced by the photographs taken on lifelogging devices and attempt to create visual summaries by promoting visual and temporal-spatial diversity in the top ranks. Conducting two crowdsourced evaluations based on 9k images, we show the merits of combining time, location and visual appearance for summarization purposes.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Jose, Professor Joemon and Mcparlane, Mr Philip and Chowdhury, Soumyadeb and Ferdous, Mr MD SADEK
Authors: Chowdhury, S., Mcparlane, P. J., Ferdous, M. S., and Jose, J.
College/School:College of Science and Engineering > School of Computing Science
ISBN:9781450332743
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
651921Urban Big Data Research CentrePiyushimita ThakuriahEconomic & Social Research Council (ESRC)ES/L011921/1SPS - URBAN STUDIES