Allan, J., Gupta, R., and Khandelwal, V. (2001). “Temporal summaries of new topics”. In: Proceedings of the 24th
annual international ACM SIGIR conference on Research and development in information retrieval, pp. 10–18.
Aslam, J., Diaz, F., Ekstrand-Abueg, M., McCreadie, R., Pavlu, V., and Sakai, T. (2015). Trec 2014 temporal summa-
rization track overview. Tech. rep. NATIONAL INST OF STANDARDS and TECHNOLOGY GAITHERSBURG
MD.
Baumgartner, J., Zannettou, S., Keegan, B., Squire, M., and Blackburn, J. (May 2020). “The Pushshift Reddit
Dataset”. In: Proceedings of the International AAAI Conference on Web and Social Media 14.1, pp. 830–839.
Buckley, C. and Voorhees, E. M. (2004). “Retrieval evaluation with incomplete information”. In: Proceedings of
the 27th annual international ACM SIGIR conference on Research and development in information retrieval,
pp. 25–32.
Castillo, C. (2016). Big crisis data: social media in disasters and time-critical situations. Cambridge University
Press.
Castillo, C., Peterson, S., Rufolo, P., Fincons, S. A., Pajarito, D., and Buntain, C. (2021). “Social Media for
Emergency Management : Opportunities and Challenges at the Intersection of Research and Practice”. In: 18th
International Conference on Information Systems for Crisis Response and Management. May, pp. 772–777.
Denis, L. S., Mietkiewicz, N., Short, K., Buckland, M., and Balch, J. (Dec. 2022). “ICS-209-PLUS - An all-hazards
dataset mined from the US National Incident Management System 1999-2020”. In.
Diakopoulos, N., De Choudhury, M., and Naaman, M. (2012). “Finding and assessing social media information
sources in the context of journalism”. In: Proceedings of SIGCHI. New York, NY, USA: ACM.
Dutta, S., Chandra, V., Mehra, K., Ghatak, S., Das, A. K., and Ghosh, S. (2019). “Summarizing microblogs during
emergency events: A comparison of extractive summarization algorithms”. In: Emerging Technologies in Data
Mining and Information Security: Proceedings of IEMIS 2018, Volume 2. Springer, pp. 859–872.
Imran, M., Elbassuoni, S., Castillo, C., Diaz, F., and Meier, P. (2013). “Extracting information nuggets from
disaster-related messages in social media.” In: Proceedings of ISCRAM.
Khattab, O. and Zaharia, M. (2020). “Colbert: Efficient and effective passage search via contextualized late
interaction over bert”. In: Proceedings of the 43rd International ACM SIGIR conference on research and
development in Information Retrieval, pp. 39–48.
Li, C., Xu, W., Li, S., and Gao, S. (2018). “Guiding generation for abstractive text summarization based on key
information guide network”. In: Proceedings of the 2018 Conference of the North American Chapter of the
Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pp. 55–60.
Lin, J., Roegiest, A., Tan, L., McCreadie, R., Voorhees, E., and Diaz, F. (2016). “Overview of the TREC 2016
real-time summarization track”. In: Proceedings of the 25th text retrieval conference, TREC. Vol. 16.
MacAvaney, S., Yates, A., Feldman, S., Downey, D., Cohan, A., and Goharian, N. (2021). “Simplified Data
Wrangling with ir datasets”. In: SIGIR.
McCreadie, R., Buntain, C., and Soboroff, I. (2019). “TREC Incident Streams: Finding Actionable Information on
Social Media”. In: Proceedings of the 16th International Conference on Information Systems for Crisis Response
and Management (ISCRAM).
McCreadie, R., Buntain, C., and Soboroff, I. (2020). “Incident Streams 2019 : Actionable Insights and How to Find
Them”. In: Proceedings of the 17th International Conference on Information Systems for Crisis Response And
Management. May.
Munot, N. and Govilkar, S. S. (2014). “Comparative study of text summarization methods”. In: International
Journal of Computer Applications 102.12.
Nenkova, A. and McKeown, K. (2012). “A survey of text summarization techniques”. In: Mining text data, pp. 43–76.
Ofli, F., Alam, F., and Imran, M. (May 2020). “Analysis of Social Media Data using Multimodal Deep Learning
for Disaster Response”. In: 17th International Conference on Information Systems for Crisis Response and
Management. ISCRAM. ISCRAM.
Olteanu, A., Castillo, C., Diaz, F., and Vieweg, S. (2014). “CrisisLex: A Lexicon for Collecting and Filtering
Microblogged Communications in Crises.” In: Proceedings of ISCRAM.
Overview Paper – CrisisFACTS
Proceedings of the 31st Text Retrieval Conference (TREC 2022)
Ian Soboroff and Angela Ellis, eds.
McCreadie et al. CrisisFACTS 2022
Pavlu, V., Rajput, S., Golbus, P. B., and Aslam, J. A. (2012). “IR system evaluation using nugget-based test
collections”. In: Proceedings of the fifth ACM international conference on Web search and data mining, pp. 393–
402.
Reuter, C. and Kaufhold, M. - A. (2018). “Fifteen years of social media in emergencies: a retrospective review and
future directions for crisis informatics”. In: Journal of Contingencies and Crisis Management 26.1.
Robertson, S. (2008). “On the history of evaluation in IR”. In: Journal of Information Science 34.4, pp. 439–456.
Robertson, S. E., Walker, S., Jones, S., Hancock-Beaulieu, M. M., Gatford, M., et al. (1995). “Okapi at TREC-3”.
In: Nist Special Publication Sp 109.
Rudra, K., Banerjee, S., Ganguly, N., Goyal, P., Imran, M., and Mitra, P. (2016). “Summarizing situational tweets in
crisis scenario”. In: Proceedings of the 27th ACM conference on hypertext and social media, pp. 137–147.
St. Denis, L. A., Mietkiewicz, N. P., Short, K. C., Buckland, M., and Balch, J. K. (Feb. 2020). “All-hazards dataset
mined from the US National Incident Management System 1999–2014”. In: Scientific Data 7.1, p. 64.
Truelove, M., Vasardani, M., and Winter, S. (2015). “Towards credibility of micro-blogs: characterising witness
accounts”. In: GeoJournal 80.3.
Voorhees, E. M., Harman, D. K., et al. (2005). TREC: Experiment and evaluation in information retrieval. Vol. 63.
Citeseer.
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., and Artzi, Y. (2020). “BERTScore: Evaluating text generation
with BERT”. In: ICLR.