Simulating Interactive Information Retrieval: SimIIR: A Framework for the Simulation of Interaction

Maxwell, D. and Azzopardi, L. (2016) Simulating Interactive Information Retrieval: SimIIR: A Framework for the Simulation of Interaction. In: 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, Pisa, Italy, 17-21 Jul 2016, pp. 1141-1144. ISBN 9781450340694 (doi:10.1145/2911451.2911469)

183471.pdf - Accepted Version



Simulation provides a powerful and cost-effective approach to explore and evaluate how interactions between a searcher and system influence search behaviour and performance. With a growing interest in simulation and an increasing number of papers using such an approach, there is a need for a flexible framework for simulation. Thus, we present SimIIR, an open-source toolkit for building and conducting Interactive Information Retrieval (IIR) experiments. The framework consists of a number of high level components, including the simulation, the searcher and the system, all of which must be configured. The SimIIR framework provides a series of interchangeable components. Examples of these components include the querying strategies (how simulated queries are formulated) and stopping strategies (the depth to which a searcher will examine snippets and documents) that a simulated searcher will employ. We have implemented various existing strategies so that they can be used by other researchers to not only replicate and reproduce past experiments, but also create new experiments. This paper describes the SimIIR framework and the different components that can be configured and extended as required.

Item Type:Conference Proceedings
Additional Information:The lead author is financially supported by the EPSRC, grant number 1367507.
Glasgow Author(s) Enlighten ID:Azzopardi, Dr Leif and Maxwell, Mr David
Authors: Maxwell, D., and Azzopardi, L.
College/School:College of Science and Engineering > School of Computing Science
Copyright Holders:Copyright © 2016 The Authors
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record