Overview of NewsREEL’16: Multi-dimensional Evaluation of Real-Time Stream-Recommendation Algorithms

Kille, B., Lommatzsch, A., Gebremeskel, G. G., Hopfgartner, F. , Larson, M., Brodt, T., Seiler, J., Malagoli, D., Sereny, A. and De Vries, A. P. (2016) Overview of NewsREEL’16: Multi-dimensional Evaluation of Real-Time Stream-Recommendation Algorithms. In: CLEF 2016: 7th Conference and Labs of the Evaluation Forum, Evora, Portugal, 5-8 Sept 2016, pp. 311-331. ISBN 9783319445632 (doi:10.1007/978-3-319-44564-9_27)

[img]
Preview
Text
120472.pdf - Accepted Version

338kB

Abstract

Successful news recommendation requires facing the challenges of dynamic item sets, contextual item relevance, and of fulfilling non-functional requirements, such as response time. The CLEF NewsREEL challenge is a campaignstyle evaluation lab allowing participants to tackle news recommendation and to optimize and evaluate their recommender algorithms both online and offline. In this paper, we summarize the objectives and challenges of NewsREEL 2016. We cover two contrasting perspectives on the challenge: that of the operator (the business providing recommendations) and that of the challenge participant (the researchers developing recommender algorithms). In the intersection of these perspectives, new insights can be gained on how to effectively evaluate real-time stream recommendation algorithms.

Item Type:Conference Proceedings
Additional Information:The research leading to these results was performed in the CrowdRec project, which has received funding from the European Union Seventh Framework Program FP7/2007–2013 under grant agreement No. 610594.
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Hopfgartner, Dr Frank
Authors: Kille, B., Lommatzsch, A., Gebremeskel, G. G., Hopfgartner, F., Larson, M., Brodt, T., Seiler, J., Malagoli, D., Sereny, A., and De Vries, A. P.
College/School:College of Arts > School of Humanities > Humanities Advanced Technology and Information Institute (HATII)
ISSN:0302-9743
ISBN:9783319445632
Published Online:23 August 2016
Copyright Holders:Copyright © 2016 Springer International Publishing
First Published:First published in Lecture Notes in Computer Science 9822: 311-331
Publisher Policy:Reproduced in accordance with the publisher copyright policy
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record