Lucene4IR: Developing information retrieval evaluation resources using Lucene

Azzopardi, L. et al. (2016) Lucene4IR: Developing information retrieval evaluation resources using Lucene. ACM SIGIR Forum, 50(2), pp. 58-75. (doi: 10.1145/3053408.3053421)

154191.pdf - Accepted Version



The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Alkhawaldeh, Mr Rami Suleiman and Azzopardi, Dr Leif and Moshfeghi, Dr Yashar
Authors: Azzopardi, L., Mannix, J., Palchowdhury, S., Moshfeghi, Y., Halvey, M., Alkhawaldeh, R. S., Balog, K., Di Buccio, E., Ceccarelli, D., Fernández-Luna, J. M., and Hull, C.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:ACM SIGIR Forum
ISSN (Online):1558-0229
Published Online:14 February 2017
Copyright Holders:Copyright © 2017 ACM
First Published:First published in ACM SIGIR Forum 50(2):58-75
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher.

University Staff: Request a correction | Enlighten Editors: Update this record