When Relevance Judgement is Happening?

Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F. E. , Jose, J. M. and Pasi, G. (2015) When Relevance Judgement is Happening? In: 38th Annual ACM SIGIR Conference (SIGIR '15), Santiago, Chile, 9-13 Aug 2015, pp. 719-722. ISBN 9781450336215 (doi: 10.1145/2766462.2767811)

Abstract

Relevance is a central notion in Information Retrieval, but it is considered to be a difficult concept to define. We analyse brain signals for the first 800 milliseconds (ms) of a relevance assessment process to answer the question "when relevance is happening in the brain?" with the belief that it will lead to better operational definitions of relevance. For this purpose, we devised a user study in which we captured the brain response of 20 participants. Using a 64-channel EEG device, we measured the electrophysiological activity of the brain while the subjects were in the phase of giving an explicit judgement about the relevance of presented images according to a given topic. Analyses were then performed over different time windows of the recorded EEG signals using repeated measures ANOVA. Data reveal significant variation between relevance and non-relevance within the EEG signals from the presentation of the image to 800 milliseconds afterwards. At an early stage these differences were located at frontal and posterior electrode sites. However, at later stages these differences were located in central, centro-parietal and centro-frontal areas.Our findings are an important step towards (i) a better understanding of the concept of relevance and (ii) a more effective implicit feedback systems.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Jose, Professor Joemon and Pollick, Professor Frank and Moshfeghi, Dr Yashar
• Authors: Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F. E., Jose, J. M., and Pasi, G.
• College/School: College of Science and Engineering > School of Computing Science; College of Science and Engineering > School of Psychology
• ISBN: 9781450336215

Related URLs

• Organisation