Mccreadie, R. , Macdonald, C. and Ounis, I. (2015) Crowdsourced Rumour Identification During Emergencies. In: 24th International Conference on World Wide Web, Florence, Italy, 18-22 May 2015, pp. 965-970. ISBN 9781450334730 (doi: 10.1145/2740908.2742573)
|
Text
115000.pdf - Accepted Version 704kB |
Abstract
When a significant event occurs, many social media users leverage platforms such as Twitter to track that event. Moreover, emergency response agencies are increasingly looking to social media as a source of real-time information about such events. However, false information and rumours are often spread during such events, which can influence public opinion and limit the usefulness of social media for emergency management. In this paper, we present an initial study into rumour identification during emergencies using crowdsourcing. In particular, through an analysis of three tweet datasets relating to emergency events from 2014, we propose a taxonomy of tweets relating to rumours. We then perform a crowdsourced labeling experiment to determine whether crowd assessors can identify rumour-related tweets and where such labeling can fail. Our results show that overall, agreement over the tweet labels produced were high (0.7634 Fleiss Kappa), indicating that crowd-based rumour labeling is possible. However, not all tweets are of equal difficulty to assess. Indeed, we show that tweets containing disputed/controversial information tend to be some of the most difficult to identify.
| Item Type: | Conference Proceedings |
|---|---|
| Keywords: | crowdsourcing, emergency management, rumor identification, social media, super project |
| Status: | Published |
| Refereed: | Yes |
| Glasgow Author(s) Enlighten ID: | Mccreadie, Dr Richard and Macdonald, Professor Craig and Ounis, Professor Iadh |
| Authors: | Mccreadie, R., Macdonald, C., and Ounis, I. |
| College/School: | College of Science and Engineering > School of Computing Science |
| Publisher: | International World Wide Web Conferences Steering Committee |
| ISBN: | 9781450334730 |
| Copyright Holders: | Copyright © 2015 ACM |
| Publisher Policy: | Reproduced in accordance with the copyright policy of the publisher |
| Related URLs: |
University Staff: Request a correction | Enlighten Editors: Update this record
Funder and Project Information
Funder and Project Information