Crowdsourced Rumour Identification During Emergencies

Mccreadie, R. , Macdonald, C. and Ounis, I. (2015) Crowdsourced Rumour Identification During Emergencies. In: 24th International Conference on World Wide Web, Florence, Italy, 18-22 May 2015, pp. 965-970. ISBN 9781450334730 (doi: 10.1145/2740908.2742573)

115000.pdf - Accepted Version



When a significant event occurs, many social media users leverage platforms such as Twitter to track that event. Moreover, emergency response agencies are increasingly looking to social media as a source of real-time information about such events. However, false information and rumours are often spread during such events, which can influence public opinion and limit the usefulness of social media for emergency management. In this paper, we present an initial study into rumour identification during emergencies using crowdsourcing. In particular, through an analysis of three tweet datasets relating to emergency events from 2014, we propose a taxonomy of tweets relating to rumours. We then perform a crowdsourced labeling experiment to determine whether crowd assessors can identify rumour-related tweets and where such labeling can fail. Our results show that overall, agreement over the tweet labels produced were high (0.7634 Fleiss Kappa), indicating that crowd-based rumour labeling is possible. However, not all tweets are of equal difficulty to assess. Indeed, we show that tweets containing disputed/controversial information tend to be some of the most difficult to identify.

Item Type:Conference Proceedings
Keywords:crowdsourcing, emergency management, rumor identification, social media, super project
Glasgow Author(s) Enlighten ID:Mccreadie, Dr Richard and Macdonald, Professor Craig and Ounis, Professor Iadh
Authors: Mccreadie, R., Macdonald, C., and Ounis, I.
College/School:College of Science and Engineering > School of Computing Science
Publisher:International World Wide Web Conferences Steering Committee
Copyright Holders:Copyright © 2015 ACM
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
624701SUPERIadh OunisEuropean Commission (EC)606853COM - COMPUTING SCIENCE