Transferring Learning To Rank Models for Web Search

Macdonald, C. , Dincer, B. T. and Ounis, I. (2015) Transferring Learning To Rank Models for Web Search. In: ICTIR 2015: 5th ACM SIGIR International Conference on the Theory of Information Retrieval, Northampton, MA, USA, 27-30 Sep 2015, pp. 41-50. ISBN 9781450338332 (doi:10.1145/2808194.2809463)

Macdonald, C. , Dincer, B. T. and Ounis, I. (2015) Transferring Learning To Rank Models for Web Search. In: ICTIR 2015: 5th ACM SIGIR International Conference on the Theory of Information Retrieval, Northampton, MA, USA, 27-30 Sep 2015, pp. 41-50. ISBN 9781450338332 (doi:10.1145/2808194.2809463)

[img]
Preview
Text
108081.pdf - Accepted Version

191kB

Abstract

Learning to rank techniques provide mechanisms for combining document feature values into learned models that produce effective rankings. However, issues concerning the transferability of learned models between different corpora or subsets of the same corpus are not yet well understood. For instance, is the importance of different feature sets consistent between subsets of a corpus, or whether a learned model obtained on a small subset of the corpus effectively transfer to the larger corpus? By formulating our experiments around two null hypotheses, in this work, we apply a full-factorial experiment design to empirically investigate these questions using the ClueWeb09 and ClueWeb12 corpora, combined with queries from the TREC Web track. Among other observations, our experiments reveal that Clue-Web09 remains an effective choice of training corpus for learning effective models for ClueWeb12, and also that the importance of query independent features varies among the ClueWeb09 and ClueWeb12 corpora. In doing so, this work contributes an important study into the transferability of learning to rank models, as well as empirically-derived best practices for effective retrieval on the ClueWeb12 corpus.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Ounis, Professor Iadh and Macdonald, Dr Craig
Authors: Macdonald, C., Dincer, B. T., and Ounis, I.
College/School:College of Science and Engineering > School of Computing Science
ISBN:9781450338332
Copyright Holders:Copyright © 2015 ACM
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record