Evaluating reward and risk for vertical selection

Zhou, K., Cummins, R., Lalmas, M. and Jose, J. M. (2012) Evaluating reward and risk for vertical selection. In: CIKM 2012: 21st ACM International Conference on Information and Knowledge Management, Maui HI, USA, 29 Oct - 2 Nov 2012, pp. 2631-2634. (doi: 10.1145/2396761.2398709)

Full text not currently available from Enlighten.

Publisher's URL: http://dx.doi.org/10.1145/2396761.2398709

Abstract

The aggregation of search results from heterogeneous verticals (news, videos, blogs, etc) has become an important consideration in search. When aiming to select suitable verticals, from which items are selected to be shown along with the standard "ten blue links", there exists the potential to both help (selecting relevant verticals) and harm (selecting irrelevant verticals) the existing result set.<p></p> In this paper, we present an approach that considers both reward and risk within the task of vertical selection (VS). We propose a novel risk-aware VS evaluation metric that incorporates users' risk-levels and users' individual preference of verticals. Using the proposed metric, we present a detailed analysis of both reward and risk of current resource selection approaches within a multi-label classification framework. The results bring insights into the effectiveness and robustness of current vertical selection approaches.<p></p>

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Jose, Professor Joemon and Zhou, Mr Ke and Lalmas, Professor Mounia and Cummins, Dr Ronan
Authors: Zhou, K., Cummins, R., Lalmas, M., and Jose, J. M.
College/School:College of Science and Engineering > School of Computing Science
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record