Dockerising Terrier for The Open-Source IR Replicability Challenge

Câmara, A. B. and Macdonald, C. (2019) Dockerising Terrier for The Open-Source IR Replicability Challenge. In: The Open-Source IR Replicability Challenge (OSIRRC 2019 (SIGIR'19 Workshop)), Paris, France, 25 July 2015, pp. 26-30.

[img]
Preview
Text
189887.pdf - Published Version
Available under License Creative Commons Attribution.

1MB

Publisher's URL: http://ceur-ws.org/Vol-2409/docker02.pdf

Abstract

Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Macdonald, Professor Craig
Authors: Câmara, A. B., and Macdonald, C.
College/School:College of Science and Engineering > School of Computing Science
ISSN:1613-0073
Copyright Holders:Copyright © 2019 The Authors
First Published:First published in Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019): 26-30
Publisher Policy:Reproduced under a Creative Commons License
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record