CLEF NewsREEL 2016: Comparing Multi-Dimensional Offline and Online Evaluation of News Recommender Systems

Kille, B., Lommatzsch, A., Hopfgartner, F. , Larson, M., Seiler, J., Malagoli, D., Sereny, A. and Brodt, T. (2016) CLEF NewsREEL 2016: Comparing Multi-Dimensional Offline and Online Evaluation of News Recommender Systems. CLEF 2016 - Conference and Labs of the Evaluation Forum, Evora, Portugal, 05-08 Sep 2016.

[img]
Preview
Text
121194.pdf - Accepted Version

314kB

Abstract

Running in its third year at CLEF, NewsREEL challenged participants to develop news recommendation algorithms and have them benchmarked in an online (Task 1) and offline setting (Task 2), respectively. This paper provides an overview of the NewsREEL scenario, outlines this year’s campaign, presents results of both tasks, and discusses the approaches of participating teams. Moreover, it overviews ideas on living lab evaluation that have been presented as part of a “New Ideas” track at the conference in Portugal. Presented results illustrate potentials for multi-dimensional evaluation of recommendation algorithms in a living lab and simulation based evaluation setting.

Item Type:Conference or Workshop Item
Status:Published
Refereed:No
Glasgow Author(s) Enlighten ID:Hopfgartner, Dr Frank
Authors: Kille, B., Lommatzsch, A., Hopfgartner, F., Larson, M., Seiler, J., Malagoli, D., Sereny, A., and Brodt, T.
Subjects:Z Bibliography. Library Science. Information Resources > Z665 Library Science. Information Science
College/School:College of Arts > School of Humanities > Humanities Advanced Technology and Information Institute (HATII)
Publisher:CEUR workshop proceedings
Copyright Holders:Copyright © 2016 The Authors
Publisher Policy:Reproduced in accordance with the publisher copyright policy
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record