Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
104
datasets available to search
ShareScore release 0.9.0
Dataset results
104 results for “Twitter dataset”
Twitter Dataset for "Will You Take the Knee? Italian Twitter Echo Chambers' Genesis During EURO 2020"
<p>Echo chambers can be described as situations in which individuals encounter and interact only with viewpoints that confirm their own, thus moving, as a group, to more polarized and extreme positions. Recent literature mainly focuses on characterizing such entities via static observations, thus disregarding their temporal dimension. In this work, distancing from such a trend, we study, at multiple topological levels, echo chambers genesis related to the social discussions that took place in Italy during the EURO 2020 Championship. Our analysis focuses on a well-defined topic (i.e., BLM/racism) discussed on Twitter during a perfect temporally bound (sporting) event. Such characteristics allow us to track the rise and evolution of echo chambers in time, thus relating their existence to specific episodes.</p>
Twitter dataset of flood-related images for September 2021, Thailand and June/July 2021, Nepal floods
<p>Twitter dataset related to flood events onsets in Thailand and Nepal, focused on September 26/27, 2022, June 16/17 2021 and July 01/02 2021. The dataset has been processed with a VisualCit pipeline in order to automatically filter a relevant subset of posts through automated image analysis, using deep learning techniques. The posts were then geolocated using the CIME algorithm. Additional information about the data collection and data processing are described in <a href="http://arxiv.org/abs/2202.12014">http://arxiv.org/abs/2202.12014</a></p>
Twitter Dataset for ≈15,000 accounts over a 1 day period
<p>This is almost 15,000 accounts on Twitter. Accounts were collected from a 1% sampled stream over a 24-hour period, from 2022-07-02T04:18:23.000Z to 2022-07-03T04:18:23.000Z.</p> <p>This data includes data from labeled data from https://doi.org/10.5281/zenodo.2653137, with an additional random sample of accounts from the stream to get to 15,000 accounts. Private profiles were removed.</p> <p>This data was collected with the intention of using it for unsupervised machine learning. You are free to do what you want with proper citation.</p>
Dia-Pol: A large scale BlackLivesMatter and MeToo Twitter dataset
<p>This dataset (tweets_id_list.json) contains 258609 number of tweets sent in English extracted from Twitter API using the query word “#blacklivesmatter.” The dataset spans the period from 2020-01-01 to 2021-12-31 and was retrieved on 2022-06-10.</p>
SenTopX: A Benchmark Twitter Dataset for User Sentiment on Various Topics
<p>This is a longitudinal Twitter dataset of 143K users during the period 2017-2021. The following is the detail of all the files:</p> <ul> <li><a href="11243662" target="_blank" rel="noopener noreferrer">SenTopX_userIDs.txt</a>: contains user IDs of 143K Twitter users.</li> <li><a href="../api/records/11243662/draft/files/userIDs_tweetIDs.zip/content" target="_blank" rel="noopener noreferrer">userIDs_tweetIDs.zip</a>: contains Tweet IDs of users, the name of the file is the user ID and the file contains the list of all the tweet IDs.</li> <li><a href="../api/records/11243662/draft/files/users_16_perspective_toxicity_scores.csv/content" target="_blank" rel="noopener noreferrer">users_16_perspective_toxicity_scores.csv</a> contains user IDs and 16 median Perspective API scores, the vector is shared as mean, median, and Gini Index of scores calculated over all tweets of a user.</li> <li><a href="../api/records/11243662/draft/files/LDAvis_top30_words_for_extracted_topics.csv/content" target="_blank" rel="noopener noreferrer">LDAvis_top30_words_for_extracted_topics.csv</a> contains the top 30 most relevant words extracted from each topic extracted by tweet-level topic modeling using the BERTweet topic model.</li> <li><a href="../api/records/11243662/draft/files/topic_modelling_statistics_per_user.csv/content" target="_blank" rel="noopener noreferrer">topic_modelling_statistics_per_user.csv</a> contains important and relevant statistics related to topic modeling results: <ul> <li> <p>1. user: This column represents the identifier for the user. Each row in the CSV corresponds to a specific user, and this column helps to track and differentiate between the users.</p> <p>2. avg_topic_probability: This column contains the average probability of the topics for each user calculated across all of the tweets in order to compare users in a meaningful way. It represents the average likelihood that a particular user discusses various topics over the observed period.</p> <p>3. maximum_topic_avg: This column holds the value of the highest average probability among all topics for each user. It indicates the topic that the user most frequently discusses, on average.</p> <p>4. index_max_avg_topic_probability_200: This column specifies the index or identifier of the topic with the highest average probability out of 200 possible topics. It shows which topic (out of 200) the user discusses the most.</p> <p>5. global_avg: This column includes the global average probability of topics across all users. It provides a baseline or overall average topic probability that can be used for comparative purposes.</p> <p>6. max_global_avg: This column contains the maximum global average probability across all topics for all users. It identifies the most discussed topic across the entire user base.</p> <p>7. index_max_global_avg: This column shows the index or identifier of the topic with the highest global average probability. It indicates which topic (out of 200) is the most popular across all users.</p> <p>8. entropy_200_topic: This column represents the entropy of the topics for each user, calculated over 200 topics. Entropy measures the diversity or unpredictability in the user's discussion of topics, with higher entropy indicating more varied topic discussion.</p> <p>In summary, these columns are used to analyze the topic engagement and preferences of users on a platform, highlighting the most frequently discussed topics, the variability in topic discussions, and how individual user behavior compares to overall trends.</p> </li> </ul> </li> </ul>
[Dataset] Analysis of ego-networks of two CS-related Twitter accounts
<p><strong>Explanation/Overview:</strong></p> <p>This is the dataset for the analyses and results on Twitter Ego-Networks of two CS-related accounts (<a href="https://twitter.com/EuCitSci">@EuCitSci</a> & <a href="https://twitter.com/SciStarter">@SciStarter</a>). The username have been anonymised.</p> <p><strong>Purpose:</strong></p> <p>The purpose of this dataset is to provide the basis to reproduce the results reported in the associated deliverable. As such, it <strong>does not</strong> represent <strong>raw data</strong>, but rather files that already include certain analysis steps (like calculated degrees or other SNA-related measures), ready for analysis, visualisation and interpretation with R or any other network visualisation software (e.g., Gephi). The edges represent the follow relation and were retrieved using the Twitter API. All usernames except those of the two ego-accounts were anonymised by assigning a random number to each node. Due to the size of the network, we do not include any <code>.gexf </code>or <code>.gml </code>files in this upload, but rather resort to node and edge lists in the <code>.json</code> format</p> <p><strong>Relatedness:</strong></p> <p>The networks are the ego-networks for two related public accounts that are associated with citizen science (<a href="https://twitter.com/EuCitSci">@EuCitSci</a> & <a href="https://twitter.com/SciStarter">@SciStarter</a>).</p> <p><strong>Content:</strong></p> <p>In this Zenodo entry, two files can be found.</p> <ul> <li><code>edges.json</code></li> </ul> <p>Represents the edge list, with the columns:</p> <table> <tbody> <tr> <td><code>source</code></td> <td><code>target</code></td> <td><code>wherefrom</code></td> <td><code>account</code></td> </tr> <tr> <td>EuCitSci</td> <td>23929</td> <td>friendslist</td> <td>EuCitSci</td> </tr> </tbody> </table> <p><code>Source</code> and <code>target</code> are the necessary columns for the network creation and in this example indicate that EuCitSci follows 23929. <code>wherefrom </code>indicates the origin of this relation in the crawling (i.e., whether it was retrieved using the friends or follower list) and <code>account </code>indicates the ego-account it belongs to. Thus, the edges can also be separated using this <code>account </code>attribute as they represent two distinct networks.</p> <ul> <li><code>nodes.json</code></li> </ul> <p>Represents the nodes in the networks. The following data fields are contained:</p> <table> <tbody> <tr> <td><code>username</code></td> <td><code>CS</code></td> <td><code>followers_count</code></td> <td><code>friends_count</code></td> <td>...</td> </tr> <tr> <td>1116</td> <td>CS</td> <td>689</td> <td>514</td> <td>...</td> </tr> </tbody> </table> <table> <tbody> <tr> <td>...</td> <td><code>favourites_count</code></td> <td><code>listed_count</code></td> <td><code>statuses_count</code></td> <td>...</td> </tr> <tr> <td>...</td> <td>2601</td> <td>18</td> <td>2141</td> <td>...</td> </tr> </tbody> </table> <table> <tbody> <tr> <td>...</td> <td><code>degree</code></td> <td><code>in_degree</code></td> <td><code>out_degree</code></td> <td>...</td> </tr> <tr> <td>...</td> <td>21</td> <td>5</td> <td>16</td> <td>...</td> </tr> </tbody> </table> <table> <tbody> <tr> <td>...</td> <td><code>reciprocity</code></td> <td><code>account</code></td> </tr> <tr> <td>...</td> <td>0.48</td> <td>EuCitSci</td> </tr> </tbody> </table> <p> </p> <p><code>Username </code>represents the numerical and anonymised username, <code>CS</code> the community-membership. The different counts (e.g., <code>followers_count</code>) indicate the number of followers the user had at the time of the retrieval by the Twitter API. <code>degree</code> refers to the degree in the network (similarly the <code>in-</code> and <code>out_degree</code>), while <code>reciprocity</code> refers to the number of mutual edges in respect to the total number of edges per node (see <a href="https://networkx.org/documentation/stable/reference/algorithms/generated/networkx.algorithms.reciprocity.reciprocity.html">here</a>). <code>Account</code> is similar as described above.</p> <p> </p> <p><strong>Grouping:</strong></p> <p>The data is grouped according the ego-account it is associated to, as can be read above (i.e., the <code>account</code> attribute).</p>
VaxxHesitancy: A Dataset for Studying Hesitancy Towards COVID-19 Vaccination on Twitter
<p>We create a publicly available dataset of over 3,100 COVID-19 vaccine-related tweets labeled as one of four stance categories: <em>pro-vaxx, anti-vaxx</em>, <em>vaxx-hesitant</em>,<em> or irrelevant</em>.</p> <p><strong>***</strong></p> <p><strong>Please use the V2 version.</strong></p> <p><strong>***</strong></p> <p>We split our dataset into two separate files:</p> <p>(1) VaccineHesitancy_train_v2.csv (Single + Double annotated)</p> <p>(2) VaccineHesitancy_test.csv (Double annotated)</p> <p>We present the details of this dataset here:</p> <p>VaxxHesitancy: A Dataset for Studying Hesitancy Towards COVID-19 Vaccination on Twitter (ICWSM 2023)</p> <p><strong>Our Pre-trained model</strong> (GateNLP/covid-vaccine-twitter-bert) : https://huggingface.co/GateNLP/covid-vaccine-twitter-bert</p> <p><strong>Paper</strong>: https://ojs.aaai.org/index.php/ICWSM/article/view/22213/21992</p> <p> </p> <pre>@inproceedings{mu2023vaxxhesitancy, title={VaxxHesitancy: A Dataset for Studying Hesitancy Towards COVID-19 Vaccination on Twitter}, author={Mu, Yida and Jin, Mali and Grimshaw, Charlie and Scarton, Carolina and Bontcheva, Kalina and Song, Xingyi}, booktitle={Proceedings of the International AAAI Conference on Web and Social Media}, volume={17}, pages={1052--1062}, year={2023} } </pre> <p> </p> <p> </p> <p> </p>
Public Dataset for "Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior"
<p>Dataset for the "Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior" paper, published in ICWSM 2018. The full text of the paper can be found <a href="https://arxiv.org/pdf/1802.00393.pdf">here</a>. </p> <p>The dataset provided here includes an updated version of the original dataset, with ~100k tweets annotated using the CrowdFlower platform: </p> <ul> <li> <p>hatespeech_id_label_PUBLIC_100K.csv: contains ~100K rows, where every row consists of a unique Tweet ID. </p> </li> <li> <p>hatespeech_text_label_vote_RESTRICTED_100K.csv: contains ~100K rows, where every row consists of the tweet text, its label according to majority annotation and the number of majority annotators. Available only <a href="https://zenodo.org/record/3706866#.Xmkh6i97FQI">here</a>.</p> </li> <li> <p>retweets.csv: contains ~2K rows, where every row consists of the row number in the hatespeech_text_label_vote_RESTRICTED_100K.csv file which is the first occurrence of a Tweet text followed by comma-separated row numbers of all other occurrences of the same Tweet text in the same file. There are ~8K other occurrences due to retweets. Available only <a href="https://zenodo.org/record/3706866#.Xmkh6i97FQI">here</a>.</p> </li> </ul> <p> </p> <p>UPDATE: It has come to our understanding that a number of the tweets are not available anymore for download on Twitter. Therefore, we provide <a href="https://zenodo.org/record/3706866#.YYLG6S8RqjQ">here </a>the hatespeech_text_label_vote_RESTRICTED_100K file with the full ~100K tweet texts, their associated majority label, and the number of votes for the majority label. The tweets are shuffled so that there is no connection between tweet IDs and texts (in order to be in line with the T&C of Twitter). </p> <p>Please cite the paper in any published work that uses any of these resources. </p> <p>@inproceedings{founta2018large, <br> title={Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior}, <br> author={Founta, Antigoni-Maria and Djouvas, Constantinos and Chatzakou, Despoina and Leontiadis, Ilias and Blackburn, Jeremy and Stringhini, Gianluca and Vakali, Athena and Sirivianos, Michael and Kourtellis, Nicolas}, <br> booktitle={11th International Conference on Web and Social Media, ICWSM 2018}, <br> year={2018}, <br> organization={AAAI Press} <br> } </p> <p>For any further questions contact a.m.founta at gmail dot com AND markos.charalambous at eecei dot cut dot ac dot cy </p>
Digital Narratives of Covid-19: a Twitter Dataset
<p>We are releasing a Twitter dataset connected to our project <a href="https://covid.dh.miami.edu/"><em>Digital Narratives of Covid-19</em> </a>(DHCOVID) that -among other goals- aims to explore during one year (May 2020-2021) the narratives behind data about the coronavirus pandemic.</p> <p>In this first version, we deliver a Twitter dataset organized as follows:</p> <ul> <li>Each folder corresponds to daily data (one folder for each day): YEAR-MONTH-DAY</li> <li>In every folder there are 9 different plain text files named with "dhcovid", followed by date (YEAR-MONTH-DAY), language ("en" for English, and "es" for Spanish), and region abbreviation ("fl", "ar", "mx", "co", "pe", "ec", "es"): <ol> <li>dhcovid_YEAR-MONTH-DAY_es_fl.txt: Dataset containing tweets geolocalized in South Florida. The geo-localization is tracked by tweet coordinates, by place, or by user information.</li> <li>dhcovid_YEAR-MONTH-DAY_en_fl.txt: We are gathering only tweets in English that refer to the area of Miami and South Florida. The reason behind this choice is that there are multiple projects harvesting English data, and, our project is particularly interested in this area because of our home institution (University of Miami) and because we aim to study public conversations from a bilingual (EN/ES) point of view.</li> <li>dhcovid_YEAR-MONTH-DAY_es_ar.txt: Dataset containing tweets from Argentina.</li> <li>dhcovid_YEAR-MONTH-DAY_es_mx.txt: Dataset containing tweets from Mexico.</li> <li>dhcovid_YEAR-MONTH-DAY_es_co.txt: Dataset containing tweets from Colombia.</li> <li>dhcovid_YEAR-MONTH-DAY_es_pe.txt: Dataset containing tweets from Perú.</li> <li>dhcovid_YEAR-MONTH-DAY_es_ec.txt: Dataset containing tweets from Ecuador.</li> <li>dhcovid_YEAR-MONTH-DAY_es_es.txt: Dataset containing tweets from Spain.</li> <li>dhcovid_YEAR-MONTH-DAY_es.txt: This dataset contains all tweets in Spanish, regardless of its geolocation.</li> </ol> </li> </ul> <p>For English, we collect all tweets with the following keywords and hashtags: covid, coronavirus, pandemic, quarantine, stayathome, outbreak, lockdown, socialdistancing. For Spanish, we search for: covid, coronavirus, pandemia, quarentena, confinamiento, quedateencasa, desescalada, distanciamiento social.</p> <p>The corpus of tweets consists of a list of Tweet Ids; to obtain the original tweets, you can use "<a href="https://github.com/DocNow/hydrator">Twitter hydratator</a>" which takes the id and download for you all metadata in a csv file.</p> <p>We started collecting this Twitter dataset on April 24th, 2020 and we are adding daily data to our GitHub repository. There is a detected problem with file 2020-04-24/dhcovid_2020-04-24_es.txt, which we couldn't gather the data due to technical reasons.</p> <p>For more information about our project visit <a href="https://covid.dh.miami.edu/">https://covid.dh.miami.edu/</a></p> <p>For more updated datasets and detailed criteria, check our GitHub Repository: <a href="https://github.com/dh-miami/narratives_covid19/">https://github.com/dh-miami/narratives_covid19/</a></p>
#retweetthe8th: twitter dataset from the 2018 Referendum to repeal the 8th Amendment of the Constitution of Ireland
<p>This dataset contains the tweet ids of 2,108,782 tweets related to the referendum to repeal the 8th Amendment of the Constitution of Ireland and replace it with the Thirty-sixth Amendment of the Constitution of Ireland on May 25, 2018. </p> <p>They were collected between March 9th, 2018 and May 30th, 2018 from the Twitter filter stream API using Twarc (<a href="https://github.com/DocNow/twarc">https://github.com/DocNow/twarc</a>). The set of terms that were used for the search were: #repealthe8th, #together4yes, #8thref, #savethe8th, #hometovote, #togetherforyes, #repealedthe8th, #loveboth, #voteyes, #voteno, #lovebothvoteno, #repealtheeighth.</p> <p>Note that the terms changed during the course of data collection and that the searches were not exhaustive.</p> <p>The GET statuses/lookup method supports retrieving the complete tweet for a tweet id (known as hydrating). Twarc can also be used to hydrate tweets.</p> <p>Per Twitter’s Developer Policy, tweet ids may be publicly shared for academic purposes; tweets may not.</p> <p>There are several practical reasons to leave the retweets, as it allows researchers to trace important tweets and their dissemination. </p> <p>However, for researchers that might be interested in NLP tasks for which retweets are not required, a set of 411,213 tweet ids without their retweets is also included in the zip file.</p> <p>Questions about this dataset can be sent to Emmet Ó Briain: <a href="mailto:emmet@quiddity.ie">emmet@quiddity.ie</a> .</p> <p>(24-05-20)</p>
CMU-MisCov19: A Novel Twitter Dataset for Characterizing COVID-19 Misinformation
<p>From conspiracy theories to fake cures and fake treatments, COVID-19 has become a hot-bed for the spread of misinformation online. It is more important than ever to identify methods to debunk and correct false information online. Detection and characterization of misinformation requires an availability of annotated datasets. Most of the published COVID-19 Twitter datasets are generic, lack annotations or labels, employ automated annotations using transfer learning or semi-supervised methods, or are not specifically designed for misinformation. Annotated datasets are either only focused on "fake news", are small in size, or have less diversity in terms of classes.</p> <p>Here, we present a novel Twitter misinformation dataset called <strong>"CMU-MisCov19"</strong> with 4573 annotated tweets over 17 themes around the COVID-19 discourse. We also present our annotation codebook for the different COVID-19 themes on Twitter, along with their descriptions and examples, for the community to use for collecting further annotations. Further details related to the dataset, and our analysis based on this dataset can be found at <a href="https://arxiv.org/abs/2008.00791">https://arxiv.org/abs/2008.00791</a>. In adherence to the Twitter’s terms and conditions, we do not provide the full tweet JSONs but provide a ".csv" file with the tweet IDs so that the tweets can be rehydrated. We also provide the annotations, and the date of creation for each tweet for the reproduction of the results of our analyses.</p> <p><strong>Note: If for any reason, you are not able to rehydrate all the tweets, reach out to Shahan Ali Memon at (shahan@nyu.edu).</strong></p> <p>If you use this data, please cite our paper as follows: </p> <p><em>"Shahan Ali Memon and Kathleen M. Carley. Characterizing COVID-19 Misinformation Communities Using a Novel Twitter Dataset, In Proceedings of The 5th International Workshop on Mining Actionable Insights from Social Networks (MAISoN 2020), co-located with CIKM, virtual event due to COVID-19, 2020."</em></p>
MAVIS Twitter dataset: A collection of tweets and sentiment analysis in Spanish about vaccines and diseases during the period 2015-2018
<p>MAVIS dataset comprises a full knowledge base regarding Twitter messages published in Spanish during the period 2015-2018, in the context of sentiment analysis of specific vaccines and their related diseases. Such diseases and vaccines are summarized as follows:</p> <ul> <li>Invasive meningococcal disease (“EMI” in Spanish): Bexsero, Trumenba, Nimenrix</li> <li>Invasive pneumococcal disease (“ENI” in Spanish)</li> <li>Influenza</li> <li>Hepatitis</li> <li>Rotavirus: Rotarix, Rotateq</li> <li>Measles (“Sarampión” in Spanish) and MMR (“Triple vírica” in Spanish)</li> <li>Sepsis</li> <li>Whooping cough (“Tosferina” in Spanish)</li> <li>Chickenpox (“Varicela” in Spanish): Varivax, Varilrix; and Shingles (“Zoster” in Spanish)</li> <li>Human papillomavirus infection (“VPH” in Spanish): Cervarix, Gardasil</li> </ul> <p>Tweets have been manually classified as having a negative or non-negative sentiment by 5 experts. Moreover, an automatic classification has been performed by 3 different tools: IBM Watson (now Watson Tone Analyzer, <a href="https://www.ibm.com/watson/services/tone-analyzer/">https://www.ibm.com/watson/services/tone-analyzer/</a>), Google Cloud Natural Language (<a href="https://cloud.google.com/natural-language">https://cloud.google.com/natural-language</a>), and Meaning Cloud (<a href="https://www.meaningcloud.com/">https://www.meaningcloud.com/</a>). IBM Watson and Google Cloud Natural Language returned a numerical sentiment score ranging from -1 to 1, while Meaning Cloud returned a categorical variable with the values ‘P+’, ‘P’, ‘NEU’, ‘N’ and ‘N+’, which were converted to 1, 2, 3, 4 and 5 respectively.</p> <p>With these variables (IBM Watson, Google Cloud Natural Language, and Meaning Cloud annotations and the experts’ classification as the target label), a machine learning metamodel was developed. Tweets were also annotated with the sentiment output given by this classifier. </p> <p>The provided data includes intrinsic tweets information, intrinsic information regarding the users that posted the tweets, the keywords mentioned in each tweet, and the annotations that the experts, the tools, and the model gave to each tweet.</p> <p><strong>Funding</strong>: This dataset was obtained with funding from MSD, Spain under MAVIS Study (VEAP ID: 7789).</p> <p><strong>Current studies using this dataset at the moment of the publication</strong>:</p> <ul> <li>Rodríguez-González et al., “Creating a metamodel based on machine learning to identify the sentiment of vaccine and disease-related messages in Twitter: the MAVIS study” in 2020 IEEE 33st International Symposium on Computer-Based Medical Systems (CBMS), Jul. 2020, p. 6. DOI: 10.1109/CBMS49503.2020.00053</li> <li>Rodríguez-González et al., "Identifying Polarity in Tweets from an Imbalanced Dataset about Diseases and Vaccines Using a Meta-Model Based on Machine Learning Techniques" in Applied Sciences, 2020, 10. DOI: 10.3390/app10249019</li> </ul>
#IndonesiaHumanRightsSOS Twitter Hashtag Tweets Dataset
<p>Dataset ini merupakan hasil dari scraping pada media sosial twitter dengan menggunakan aplikasi twint yang ditujukan pada hashtag #IndonesiaHumanRightsSOS. Scraping data dilakukan untuk cuitan yang dibuat dari tanggal 18 Desember 2020 10:59 AM s/d 19 Desember 2020 23:18 PM.</p> <p>Pada dataset mengandung 106.903 Row data dengan informasi terkait: User ID, Username, Twitter Name,Tweets, dsb.</p> <p>Selain itu dilampirkan juga contoh data yang telah dianalisis berupa wordcloud,username cloud, 100 most used word & most active username.</p> <p>-</p> <p>This dataset is the result of scraping on social media twitter using the twint application aimed at the hashtag #IndonesiaHumanRightsSOS. Data scraping is done for tweets made from December 18 2020 10:59 AM to December 19 2020 23:18 PM.</p> <p>The dataset contains 106,903 rows of data with related information: User ID, Username, Twitter Name, Tweets, etc.</p> <p>Also there is an example of the data that has been analyzed in the form of wordcloud, username cloud, 100 most used words & most active username.</p>
Antisemitism on Twitter: A Dataset for Machine Learning and Text Analytics
<h1><strong><span><span>Dataset from the Institute for the Study of Contemporary Antisemitism (ISCA) at Indiana University: </span></span></strong></h1> <p> </p> <div> <div> <p><span><span>The </span><span>Social Media</span><span> & Hate research lab at the Institute for the Study of Contemporary Antisemitism compiled this dataset using an annotation portal (Jikeli, Soemer, and Karali 2024), which was used to label tweets as either antisemitic or non-antisemitic, among other labels. Note that annotation was done on live data, including images and context, such as threads. All data was annotated by two experts, and all discrepancies were discussed</span><span> (Jikeli et al. 2023)</span><span>.</span></span><span> </span></p> </div> </div> <p><br><strong>Content: </strong></p> <p><span><span>This dataset </span><span>contains</span> <span>1</span><span>1</span><span>311</span><span> tweets </span><span>covering</span><span> a wide range of topics common in conversations about Jews, Israel, and antisemitism between January 2019 and </span><span>April 2023</span><span>. </span><span>The dataset consists of random samples of relevant keywords during this </span><span>time period</span><span>.</span><span> 1,</span><span>953</span><span> tweets (1</span><span>7</span><span>%) </span><span>are antisemitic </span><span>according to </span><span>the IHRA definition of antisemitism.</span><span> </span></span><span> </span></p> <div> <p><span><span>The distribution of tweets by year is as follows:</span><span> 1499 (</span><span>13</span><span>%) from 2019, 371</span><span>2</span><span> (</span><span>33</span><span>%) from 2020, </span><span>2591</span><span> (2</span><span>3</span><span>%) from 2021</span><span>, 2644 from 2022 </span><span>(23%)</span> <span>and 865 </span><span>(8%)</span> <span>f</span><span>rom 2023</span><span>. </span><span>6365</span><span> (</span><span>56</span><span>%) </span><span>contain</span><span> the keyword "Jews,"</span><span> 4134 </span><span>(</span><span>3</span><span>7</span><span>%) include "Israel," 529 (</span><span>5</span><span>%) feature the derogatory term "</span><span>ZioNazi</span><span>*," and 283 (</span><span>3</span><span>%) use the slur "K---s." Some tweets may </span><span>contain</span><span> multiple keywords. </span></span><span> </span></p> </div> <div> <p><span><span>725</span><span> out of the </span><span>6365</span><span> tweets with the keyword "Jews" (11%) and </span><span>664</span><span> out of the </span><span>4134</span><span> tweets with the keyword "Israel" (1</span><span>6</span><span>%) were classified as antisemitic. 97 out of the 283 tweets using the antisemitic slur "K---s" (34%) are antisemitic.</span> <span>Interestingly, many tweets featuring the slur "K---s" actually </span><span>call out</span><span> its u</span><span>s</span><span>e.</span><span> In contrast, </span><span>the majority of</span><span> tweets </span><span>using</span><span> the derogatory term "</span><span>ZioNazi</span><span>*" are antisemitic, with 467 out of 529 (88%) being classified as such. </span></span><span> </span></p> </div> <p> </p> <p><strong>File Description: </strong></p> <div> <div> <p><span><span>The dataset is provided in a csv file format, with each row </span><span>representing</span><span> a single message, including replies, quotes, and retweets. The file </span><span>contains</span><span> the following columns: </span></span><span> </span></p> </div> <div> <p><span><span> </span></span><span><span> </span><br></span><span><span>‘ID’:</span> <span>Represents</span><span> the tweet ID. </span></span><span> </span></p> </div> <div> <p><span><span>‘Username’: </span><span>Represents</span><span> the username </span><span>that posted </span><span>the tweet</span><span>. </span></span><span> </span></p> </div> <div> <p><span><span>‘Text’: </span><span>Represents</span><span> the full text of the tweet (not pre-processed).</span></span><span> </span></p> </div> <div> <p><span><span>‘</span><span>CreateDate</span><span>’: </span><span>Represents</span><span> the date </span><span>on which </span><span>the tweet was created</span><span>. </span></span><span> </span></p> </div> <div> <p><span><span>‘Biased’: </span><span>Represents</span><span> the label given by our annotations as to whether the tweet </span><span>is antisemitic or no</span><span>t</span><span>.</span></span><span> </span></p> </div> <div> <p><span><span>‘Keyword’: </span><span>Represents</span><span> the keyword that was used in the query. The keyword can be in the text, including </span><span>hashtags, </span><span>mentioned </span><span>users</span><span>, or the username</span><span> itself.</span><span> </span></span><span> </span></p> </div> </div> <p> </p> <p>Licences </p> <p>Data is published under the terms of the "Creative Commons Attribution 4.0 International" licence (https://creativecommons.org/licenses/by/4.0) </p> <p> </p> <p>Acknowledgements </p> <p>We are grateful for the support of Indiana University’s Observatory on Social Media (OSoMe) (Davis et al. 2016) and the contributions and annotations of all team members in our Social Media & Hate Research Lab at Indiana University’s Institute for the Study of Contemporary Antisemitism, especially Grace Bland, Elisha S. Breton, Kathryn Cooper, Robin Forstenhäusler, Sophie von Máriássy, Mabel Poindexter, Jenna Solomon, Clara Schilling, and Victor Tschiskale. </p> <p>This work used Jetstream2 at Indiana University through allocation HUM200003 from the Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support (ACCESS) program, which is supported by National Science Foundation grants #2138259, #2138286, #2138307, #2137603, and #2138296.</p>
TWikiL - Twitter Wikipedia Link Dataset
<p>The Twitter Wikipedia Link (TWikiL) dataset contains all Tweets posted on Twitter that contain a Wikipedia URL. The data was collected via Twitters academic research access and spans 15 years of Tweets from March 2006 to January 2021. TWikiL comes in two versions: <strong>TWikiL_raw</strong> is a list of Tweet IDs in CSV format. <strong>TWikiL_curated</strong> is an SQLite database, which is a curated version of TWikiL containing only links to Wikipedia articles. The curated version has been augmented with the language edition that the URL in the Tweet links to, the Wikidata identifier and a Wikipedia topic category. <br> <br> TWikiL raw contains 44,945,098 Tweet IDs<br> TWikiL curated contains 35,252,782 URLs/Wikidata concepts with 34,543,612 unique Tweets and 474,577 Tweets linking to multiple Wikipedia articles.</p>
A Multilingual Dataset of COVID-19 Vaccination Attitudes on Twitter
<p>This dataset consists of the IDs of 2,198,090 tweets collected from Western Europe, of which 17,934 are annotated with labels indicating the originators' affective vaccination stances, including Positive (PO), Negative (NG), Positive but dissatisfaction (PD), Neutral (NE) and Off-topic (OT).</p> <p>all_tweets.txt contains all the ids of the collected tweets, annotated_tweets.txt contains the ids of the annotated tweets and the categories they are annotated to.</p> <p> </p>
Twitter Account Dataset - 10,000 accounts tested through the Botometer API
<p>This dataset contains 10,420 accounts extracted from Twitter from tweets containing the word "vaccine". We verified each one through the Botometer API.</p> <p>Includes:</p> <ul> <li>Account ID</li> <li>Echo Chamber Score (0-5)</li> <li>Fake Follower Score (0-5)</li> <li>Financial Score (0-5)</li> <li>Self Declared Score (0-5)</li> <li>Spammer Score (0-5)</li> <li>Other Score (0-5)</li> <li>Overall Score (0-5)</li> </ul> <p>Those appearing with an 'X' correspond to deleted, modified or private accounts.</p>
Public Dataset for "Did State-sponsored Trolls Shape the 2016 US Presidential Election Discourse? Quantifying Influence on Twitter"
<p>Dataset for the "Did State-sponsored Trolls Shape the 2016 US Presidential Election Discourse? Quantifying Influence on Twitter" paper. </p> <p>The full text of the paper can be found <a href="https://zenodo.org/record/4699959#.YngKatNBy3K">here</a>.</p> <p>The folder "Tweet_IDs" contains the complete list of the 152,514,929 tweet IDs (together with their timestamps) which we used for the analysis in the study: "Did State-sponsored Trolls Shape the 2016 US Presidential Election Discourse? Quantifying Influence on Twitter"</p> <p>by Nikos Salamanos, Michael J. Jensen, Costas Iordanou and Michael Sirivianos</p> <p>We have split the tweets into separate .zip files based on the date listed in their timestamps.</p> <p>The crawling took place from September 21 to November 7, 2016 (47 days; we did not collect data on 02/10/2016).</p> <p>Each "tweet_day_X.zip" file contains the file "tweet_day_X.csv", where X in [1,2,...,47]. For instance, the file "tweets_day_1.zip" contains the tweets of the 1st day: 09/21/2016.</p> <p>Please cite the paper in any published work that uses any of these resources. </p> <p>@misc{nikos_salamanos_2021_4699959,<br> author = {Nikos Salamanos and<br> Michael J. Jensen and<br> Costas Iordanou and<br> Michael Sirivianos},<br> title = {{Did State-sponsored Trolls Shape the 2016 US <br> Presidential Election Discourse? Quantifying<br> Influence on Twitter}},<br> month = apr,<br> year = 2021,<br> publisher = {Zenodo},<br> version = 3,<br> doi = {10.5281/zenodo.4699959},<br> url = {https://doi.org/10.5281/zenodo.4699959}<br> }</p>
Dataset: Characterizing Anti-Asian Rhetoric During The COVID-19 Pandemic: A Sentiment Analysis Case Study on Twitter
<p>This is the dataset, trained model, and software companion for the paper titled: Characterizing Anti-Asian Rhetoric During The COVID-19 Pandemic: A Sentiment Analysis Case Study on Twitter accepted for the Workshop on Data for the Wellbeing of Most Vulnerable of the ICWSM 2022 conference.</p> <p>The COVID-19 pandemic has shown a measurable increase in the usage of sinophobic comments or terms on online social media platforms. In the United States, Asian Americans have been primarily targeted by violence and hate speech stemming from negative sentiments about the origins of the novel SARS-CoV-2 virus. While most published research focuses on extracting these sentiments from social media data, it does not connect the specific news events during the pandemic with changes in negative sentiment on social media platforms. In this work we combine and enhance publicly available resources with our own manually annotated set of tweets to create machine learning classification models to characterize the sinophobic behavior. We then applied our classifier to a pre-filtered longitudinal dataset spanning two years of pandemic related tweets and overlay our findings with relevant news events.</p>
MMoveT15: A Twitter Dataset for Extracting and Analysing Migration-Movement Data of the European Migration Crisis 2015
<p>In the 2015 migration crisis thousands of refugees and migrants crossed the border to Hungary, Austria and Germany. The movements of these people are reflected in social media, especially on Twitter. We present a dataset of 3275 Tweets form the months September and October 2015. These Tweets are annotated regarding their relevance to the quantitative movement of refugees/migrants into Hungary, Austria and Germany. We present this dataset for a posterior analysis of the 2015 migration crisis or as a basis for an early warning or forecasting system</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.