Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol'2017 @ CHIIR)

Azzopardi, L., Pickens, J., Shah, C., Soulier, L. and Tamine, L. (2017) Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol'2017 @ CHIIR). ACM SIGIR Forum, 51(3), pp. 122-127. (doi: 10.1145/3190580.3190599)

[img]
Preview
Text
158108.pdf - Accepted Version

386kB

Abstract

The 2nd workshop on the evaluation of collaborative information retrieval and seeking (ECol) was held in conjunction with the ACM SIGIR Conference on Human Information Interaction & Retrieval (CHIIR) in Oslo, Norway. The workshop focused on discussing the challenges and difficulties of researching and studying collaborative information retrieval and seeking (CIS/CIR). After an introductory and scene setting overview of developments in CIR/CIS, participants were challenged with devising a range of possible CIR/CIS tasks that could be used for evaluation purposes. Through the brainstorming and discussions, valuable insights regarding the evaluation of CIR/CIS tasks become apparent ? for particular tasks efficiency and/or effectiveness is most important, however for the majority of tasks the success and quality of outcomes along with knowledge sharing and sense-making were most important ? of which these latter attributes are much more difficult to measure and evaluate. Thus the major challenge for CIR/CIS research is to develop methods, measures and methodologies to evaluate these high order attributes.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Azzopardi, Dr Leif
Authors: Azzopardi, L., Pickens, J., Shah, C., Soulier, L., and Tamine, L.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:ACM SIGIR Forum
Publisher:Association for Computing Machinery (ACM)
ISSN:0163-5840
Published Online:22 February 2018
Copyright Holders:Copyright © 2017 ACM
First Published:First published in ACM SIGIR Forum 51(3): 122-127
Publisher Policy:Reproduced in accordance with the publisher copyright policy

University Staff: Request a correction | Enlighten Editors: Update this record