Azzopardi, L., Pickens, J., Shah, C., Soulier, L. and Tamine, L. (2017) Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol'2017 @ CHIIR). ACM SIGIR Forum, 51(3), pp. 122-127. (doi: 10.1145/3190580.3190599)
|
Text
158108.pdf - Accepted Version 386kB |
Abstract
The 2nd workshop on the evaluation of collaborative information retrieval and seeking (ECol) was held in conjunction with the ACM SIGIR Conference on Human Information Interaction & Retrieval (CHIIR) in Oslo, Norway. The workshop focused on discussing the challenges and difficulties of researching and studying collaborative information retrieval and seeking (CIS/CIR). After an introductory and scene setting overview of developments in CIR/CIS, participants were challenged with devising a range of possible CIR/CIS tasks that could be used for evaluation purposes. Through the brainstorming and discussions, valuable insights regarding the evaluation of CIR/CIS tasks become apparent ? for particular tasks efficiency and/or effectiveness is most important, however for the majority of tasks the success and quality of outcomes along with knowledge sharing and sense-making were most important ? of which these latter attributes are much more difficult to measure and evaluate. Thus the major challenge for CIR/CIS research is to develop methods, measures and methodologies to evaluate these high order attributes.
Item Type: | Articles |
---|---|
Status: | Published |
Refereed: | Yes |
Glasgow Author(s) Enlighten ID: | Azzopardi, Dr Leif |
Authors: | Azzopardi, L., Pickens, J., Shah, C., Soulier, L., and Tamine, L. |
College/School: | College of Science and Engineering > School of Computing Science |
Journal Name: | ACM SIGIR Forum |
Publisher: | Association for Computing Machinery (ACM) |
ISSN: | 0163-5840 |
Published Online: | 22 February 2018 |
Copyright Holders: | Copyright © 2017 ACM |
First Published: | First published in ACM SIGIR Forum 51(3): 122-127 |
Publisher Policy: | Reproduced in accordance with the publisher copyright policy |
University Staff: Request a correction | Enlighten Editors: Update this record