Automatic construction of known-item finding test beds

Azzopardi, L. and de Rijke, M. (2006) Automatic construction of known-item finding test beds. In: Annual ACM Conference on Research and Development in Information Retrieval, Seattle, Washington, 6-11 August 2006, pp. 603-604. ISBN 1595933697 (doi: 10.1145/1148170.1148276)

[img]
Preview
Text
automatic_test_bed.pdf

93kB

Publisher's URL: http://doi.acm.org/10.1145/1148170.1148276

Abstract

This work is an initial study on the utility of automatically generated queries for evaluating known-item retrieval and how such queries compare to real queries. The main advantage of automatically generating queries is that for any given test collection numerous queries can be produced at minimal cost. For evaluation, this has huge ramifications as state-of-the-art algorithms can be tested on different types of generated queries which mimic particular querying styles that a user may adopt. Our approach draws upon previous research in IR which has probabilistically generated simulated queries for other purposes [2, 3].

Item Type:Conference Proceedings
Additional Information:© ACM, 2006. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval http://doi.acm.org/10.1145/1148170.1148276
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Azzopardi, Dr Leif
Authors: Azzopardi, L., and de Rijke, M.
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
College/School:College of Science and Engineering > School of Computing Science
Publisher:ACM Press
ISBN:1595933697
Copyright Holders:Copyright © 2006 ACM Press
First Published:First published in Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher including additional information statement.

University Staff: Request a correction | Enlighten Editors: Update this record