Running in its third year at CLEF, NewsREEL challenged participants#R##N#to develop news recommendation algorithms and have them benchmarked in#R##N#an online (Task 1) and offline setting (Task 2), respectively. This paper provides#R##N#an overview of the NewsREEL scenario, outlines this year’s campaign, presents#R##N#results of both tasks, and discusses the approaches of participating teams. Moreover,#R##N#it overviews ideas on living lab evaluation that have been presented as part#R##N#of a “New Ideas” track at the conference in Portugal. Presented results illustrate#R##N#potentials for multi-dimensional evaluation of recommendation algorithms in#R##N#a living lab and simulation based evaluation setting.
['Benjamin Kille', 'Andreas Lommatzsch', 'Frank Hopfgartner', 'Martha Larson', 'Jonas Seiler', 'Davide Malagoli', 'András Serény', 'Torben Brodt']
CLEF NewsREEL 2016: Comparing Multi-dimensional Offline and Online Evaluation of News Recommender Systems.