Disaster Tweet Corpus 2020

<p>This dataset&nbsp;consists of tweets collected during 48&nbsp;disasters over 10 disaster types&nbsp;with human annotations denoting if a tweet is related to this disaster or not. This collection is intended as a benchmarking dataset for filtering algorithms.&nbsp;</p> <p>&nbsp;</p> <p><strong>Dataset Specification</strong></p> <p>Tweets are separated into files based on individual disasters, where each file contains a balanced number of positive and negative examples. The naming scheme is as follows:</p> <pre><code>&lt;disaster type&gt;-&lt;name or region&gt;[-&lt;sub-type&gt;]-&lt;year&gt;.ndjson</code></pre> <p>Each line in the data files is a complete json-object, containing the tweet-id, the text, and the annotations as:</p> <pre><code class="language-json">{"id": "12345", "text": "let's all pray for nepal!", "relevance": 1}</code></pre> <p>&nbsp;</p> <p><strong>References</strong></p> <p>To reference this collection as a whole, please use the following citation:</p> <p>Wiegmann, M., Kersten, J., Klan, F., Potthast, M., Stein, B. (2020).&nbsp;Analysis of Filtering Models for<br> Disaster-Related Tweets. Proceedings of the&nbsp;17th ISCRAM.&nbsp;</p> <p>&nbsp;</p> <p>This dataset compiles tweets collected, annotated, and published in several other works. Please consider to cite those too:</p> <p>1.&nbsp;Imran, M., Castillo, C., Lucas, J., Meier, P., and Vieweg, S. (2014). AIDR: artificial intelligence for disaster response. In: WWW (Companion Volume).&nbsp;</p> <p>2.&nbsp;Olteanu, A., Castillo, C., Diaz, F., and Vieweg, S. (2014). CrisisLex: A Lexicon for Collecting and Filtering<br> Microblogged Communications in Crises. Proceedings of the 8th ICWSM.</p> <p>3.&nbsp;Olteanu, A., Vieweg, S., and Castillo, C. (2015). What to Expect When the Unexpected Happens: Social<br> Media Communications Across Crises. Proceedings of the 18th ACM Conference on Computer Supported<br> Cooperative Work &amp; Social Computing.</p> <p>4.&nbsp;Imran, M., Mitra, P., and Srivastava, J. (2016). Enabling Rapid Classification of Social Media Communications<br> During Crises. IJISCRAM 8.</p> <p>5.&nbsp;Alam, F., Ofli, F., and Imran, M. (2018). CrisisMMD: Multimodal Twitter Datasets from Natural Disasters. Proceedings of the 12th ICWSM.</p> <p>6.&nbsp;Stowe, K., Palmer, M., Anderson, J., Kogan, M., Palen, L., Anderson, K. M., Morss, R., Demuth, J., and Lazrus,<br> H. (2018). Developing and Evaluating Annotation Procedures for Twitter Data during Hazard Events.&nbsp;Proceedings of the LAW-MWE-CxG-2018.</p> <p>7.&nbsp;McMinn, A. J., Moshfeghi, Y., and Jose, J. M. (2013). Building a Large-scale Corpus for Evaluating Event<br> Detection on Twitter. Proceedings of the 22nd ACM CIKM.&nbsp;</p>