Dataset for Evaluating Abstractive Summaries of Crisis-Related Social Media

<p>The dataset created for evaluation of summaries generated from social media posted during five natural disasters.</p> <p>The dataset contains:</p> <ul> <li> <p>ground truth reports created by human assessor based on ERCC Echo Flash reports (5 events);</p> </li> <li> <p>summaries generated by extractive and abstractive state-of-the-art with manual annotation of category-relevant and crisis-relevant claim.</p> </li> </ul> <p>The dataset with annotated social media postings &mdash; <a href="https://doi.org/10.5281/zenodo.7714014">link</a></p> <p>The full description of used summarization methods, sources of data and evaluation metrics available in the paper &mdash; <a href="https://dl.acm.org/doi/abs/10.1145/3511095.3531279">link</a></p>