Effective Hierarchical Information Threading using Network Community Detection

Narvala, H. , McDonald, G. and Ounis, I. (2023) Effective Hierarchical Information Threading using Network Community Detection. In: 45th European Conference on Information Retrieval (ECIR'23), Dublin, Ireland, 02-06 Apr 2023, pp. 701-706. ISBN 9783031282430 (doi: 10.1007/978-3-031-28244-7_44)

Abstract

With the tremendous growth in the volume of information produced online every day (e.g. news articles), there is a need for automatic methods to identify related information about events as the events evolve over time (i.e., information threads). In this work, we propose a novel unsupervised approach, called HINT, which identifies coherent Hierarchical Information Threads. These threads can enable users to easily interpret a hierarchical association of diverse evolving information about an event or discussion. In particular, HINT deploys a scalable architecture based on network community detection to effectively identify hierarchical links between documents based on their chronological relatedness and answers to the 5W1H questions (i.e., who, what, where, when, why & how). On the NewSHead collection, we show that HINT markedly outperforms existing state-of-the-art approaches in terms of the quality of the identified threads. We also conducted a user study that shows that our proposed network-based hierarchical threads are significantly (p<0.05 ) preferred by users compared to cluster-based sequential threads.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: McDonald, Dr Graham and Narvala, Hitarth and Ounis, Professor Iadh
• Authors: Narvala, H., McDonald, G., and Ounis, I.
• College/School: College of Science and Engineering > School of Computing Science
• ISSN: 0302-9743
• ISBN: 9783031282430
• Copyright Holders: Copyright © The Author(s), under exclusive license to Springer Nature Switzerland AG 2023
• First Published: First published in Advances in Information Retrieval. ECIR 2023. Lecture Notes in Computer Science 13980:701-706
• Publisher Policy: Reproduced in accordance with the publisher copyright policy