Find research datasets worth reusing

opencc-by-4.0Nov 2024View details →

Disinformation on YouTube: A dataset of YouTube comments on videos related to claims made by Trump and Vance on Haitian immigrants

<div> <div> <div> <div> <div> The corpus contains three files. First, the youtube_haitian_disinformation_videos_meta.csv file includes comments and YouTube video metadata. Data is organized around per video information. The columnar values are:  </div> </div> </div> <div> <ul> <li> video_id    </li> <li> date (video publication date)    </li> <li> title    </li> <li> description    </li> <li> channel_title    </li> <li> transcript    </li> <li> transcript_str (Video transcript without timestamps)    </li> <li> views    </li> <li> likes    </li> <li> comments (all comments per video)  </li> </ul> </div> <div> <div> <div> Second, the youtube_haitian_disinformation_comment_reply_metadata.csv file includes comments, replies, and comment metadata. Each comment occupies its own row in the spreadsheet. The columnar field are:  </div> </div> </div> <div> <ul> <li> video_id    </li> <li> comment    </li> <li> comment_date    </li> <li> comment_like_count    </li> <li> author    </li> <li> comment_id    </li> <li> in_reply_to    </li> <li> neg, neu, pos, compound (VADER polarity scores)    </li> <li> named_entities (spaCy named entity tags with tokens)    </li> <li> emoji (spaCy Emojis and token spans)  </li> </ul> </div> </div> <div> <div> <div> <div> Comments and associated metadata are represented in individual rows.  </div> <div> The third file contains the results of the TFIDF analysis described herein. The TFIDF analysis features the top 5000 terms weights for the comments to each video in a .csv file.  </div> </div> </div> <div> <ul> <li> youtube_disinfo_comments_tfidf_results_per_video.csv  </li> </ul> </div> </div> </div>

opencc-by-4.0Jul 2019View details →

Hybrid Approaches to Detect Comments Violating Macro Norms on Reddit

[Content warning: Files may contain instances of highly inflammatory and offensive content.] This dataset was generated as an extension of our <a href="https://www.cc.gatech.edu/~eshwar3/uploads/3/8/0/4/38043045/eshwar-norms-cscw2018.pdf">CSCW 2018 paper</a>: Eshwar Chandrasekharan, Mattia Samory, Shagun Jhaver, Hunter Charvat, Amy Bruckman, Cliff Lampe, Jacob Eisenstein, and Eric Gilbert. 2018. The Internet’s Hidden Rules: An Empirical Study of Reddit Norm Violations at Micro, Meso, and Macro Scales. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 32. Description: Working with over 2M removed comments collected from 100 different communities on Reddit (subreddit names listed in data/study-subreddits.csv), we identified 8 macro norms, i.e., norms that are widely enforced on most parts of Reddit. We extracted these macro norms by employing a hybrid approach—classification, topic modeling, and open-coding—on comments identified to be norm violations within at least 85 out of the 100 study subreddits. Finally, we labelled over 40K Reddit comments removed by moderators according to the specific type of macro norm being violated, and make this dataset publicly available (also available on <a href="https://github.com/ceshwar/reddit-norm-violations">Github</a>). For each of the labeled topics, we identified the top 5000 removed comments that were best fit by the LDA topic model. In this way, we identified over 5000 removed comments that are examples of each type of macro norm violation described in the paper. The removed comments were sorted by their topic fit, stored into respective files based on the type of norm violation they represent, and are made available on this repo. Here we make the following datasets publicly available: * 1 file containing the log of over 2M removed comments obtained from the top 100 subreddits between May 2016 to March 2017, after filtering out the following comments: 1) comments by u/AutoModerator, 2) replies to removed comments (i.e., children of the poisoned tree - refer to the paper for more information), and 3) non-readable comments (not utf-8 encoded). * 8 files, each containing 5000+ removed comments obtained from Reddit, are stored in: data/macro-norm-violations/ , and they are split into different files based on the macro norm they violated. Each new line in the files represent a comment that was posted on Reddit between May 2016 to March 2017, and subsequently removed by subreddit moderators for violating community norms. All comments were preprocessed using the script in code/preprocessing-reddit-comments.py , in order to do the following: 1. remove new lines, 2. convert text to lowercase, and 3. strip numbers and punctuations from comments. Description of 1 file containing over 2M removed comments from 100 subreddits. <ul> <li>"reddit-removal-log.csv" - all comments that were removed from the 100 study subreddits during the study period described above (post-filtering).</li> </ul> Descriptions of each file containing 5059 comments (that were removed from Reddit, and preprocessed) violating macro norms present in data/macro-norm-violations/: <ul> <li>"macro-norm-violations-n10-t0-misogynistic-slurs.csv" - Comments that use misogynistic slurs.</li> <li>"macro-norm-violations-n15-t2-hatespeech-racist-homophobic.csv" - Comments containing hate speech that is racist or homophobic.</li> <li>"macro-norm-violations-n10-t3-opposing-political-views-trump.csv", "macro-norm-violations-n15-t10-opposing-political-views-trump.csv" - Comments with opposing political views around Trump (depends on originating sub).</li> <li>"macro-norm-violations-n10-t4-verbal-attacks-on-Reddit.csv" - Comments containing verbal attacks on Reddit or specific subreddits.</li> <li>"macro-norm-violations-n10-t5-porno-links.csv" - Comments with pornographic links.</li> <li>"macro-norm-violations-n10-t8-personal-attacks.csv", "macro-norm-violations-n10-t9-personal-attacks.csv"- Comments containing personal attacks.</li> <li>"macro-norm-violations-n15-t3-abusing-and-criticisizing-mods.csv" - Comments abusing and criticisizng moderators.</li> <li>"macro-norm-violations-n15-t9-namecalling-claiming-other-too-sensitive.csv" - Comments with name-calling, or claiming that the other person is too sensitive.</li> </ul> More details about the dataset can be found on arXiv: <a href="https://arxiv.org/abs/1904.03596">https://arxiv.org/abs/1904.03596</a>

opencc-by-4.0Sep 2024View details →

Croatian Coronavirus News Comments Corpus News-CommHR

A corpus of readers' news comments posted below news articles on the topic of the covid-19 pandemic, published in major Croatian daily newspapers and news portals in the six-month early pandemic period  (March 2020 to September 2020). <div>The corpus is designed to facilitate research on crisis discourses, crisis communication, as well as pandemic-time linguistic innovation. It is available in plain text version and XML with full metadata. The corpus complements a separate corpus of news articles Croatian Coronavirus Corpus NewsHR. Parallel versions from Slovenia and Serbia are also available.</div> <div> </div> <div>The project leading to this publication has received funding from the European Union’s Horizon 2020 research and innovation programme under the <a href="https://cordis.europa.eu/programme/id/H2020-EU.4./en">H2020-EU.4. - SPREADING EXCELLENCE AND WIDENING PARTICIPATION </a>programme Widening fellowships grant agreement No 101038047.</div>

opencc-by-4.0Nov 2024View details →

Dataset: Systematics of the color-polymorphic spider genus Cybaeolus, with comments on the phylogeny of the family Hahniidae (Araneae)

Phylogenetic analysis of the spiders of the genus Cybaeulus, with outgroups in the marronoid clade. Data from six DNA markers, analyzed with maximum likelihood and parsimony. PHYLOGENETIC ANALYSIS We obtained sequences from 26 samples of the three known species of Cybaeolus, and of five additional species of Hahniidae. To these, we added legacy sequences of Cybaeolus and of other genera of Hahniidae, as well as representatives of the remaining families in the marronoid clade. For the new sequences, the extraction and amplification of DNA was made in the Laboratory of Molecular Tools at Museo Argentino de Ciencias Naturales (MACN), from tissues preserved in absolute alcohol at -18ºC. We targeted the markers histone H3 (H3), cytochrome oxidase subunit I (CO1), 28S ribosomal RNA (28S) and 16S ribosomal RNA (16S), previously used to estimate relationships of marronoid spiders (Wheeler et al., 2017). Details of extraction, primers and PCR protocols are the same as in Magalhaes & Ramírez (2022). Sequencing was outsourced to Macrogen Inc., South Korea. The resulting chromatograms were analyzed individually to detect contaminated sequences or ambiguous portions. In addition to these sequences obtained in the laboratory, we combined our data with additional sequences from previous work (Wheeler et al., 2017; Rivera-Quiroz et al., 2020), using the markers mentioned above plus 12S ribosomal RNA (12S) and 18S ribosomal RNA (18S). For the CO1 marker, additional sequences obtained by the Arachnology Division at MACN and deposited in the BOLDSYSTEMS platform (https://www.boldsystems.org/) were also used. Sequences were aligned with MAFFT Online v.7.463 (Katoh & Standley, 2013), using the L-INS-I algorithm. See Table 1 for list of vouchers and sequence identifiers. Maximum likelihood For the maximum likelihood analyses we used the program IQ-TREE 2.2.0 (Minh et al., 2020), partitioning the data by marker, and selecting the best combination of partitions and evolution models by Bayesian information criterion (best fitting models were TPM2+I+G4 for H3, GTR+F+I+G4 for 18S, GTR+F+I+G4 for 16S and 12S together, GTR+F+I+G4 for CO1, and GTR+F+I+G4 for 28S). Since the relationships of outgroup taxa in the resulting trees were slightly different to that found in recent phylogenomic studies, we used the study of Gorneau et al. (2023) based on ultraconserved elements as a backbone topology to constrain our tree search, considering only the taxa in common with our analysis (see supplementary Fig. S1); this means that all the rest of the taxa are free to move anywhere during tree search. Support for groups (branches) was estimated by 1000 cycles of ultrafast bootstrapping. Ten independent runs were performed; of those, six converged into nearly identical log likelihood values (-57417.7725 to -57417.9604) and identical topologies; the tree with top-ranking log likelihood is presented in Results, after collapsing branches with bootstrap below 0.5. To estimate the support of an alternative topology with Cybaeolus as sister to the rest of the hahniids, we used TNT 1.6 (Goloboff & Morales, 2023) to modify the optimal tree placing Cybaeolus in such position, and asked for the frequency of the branch of interest (all hahniids except Cybaeolus) in the 1000 bootstrapped trees previously saved by IQTREE. Ancestral character states for the arrangement of spinnerets (grouped; separated in a transversal line) were estimated by maximum likelihood on the optimal tree, using the R packages phytools and ape, under the models ER and ARD, and the best fitting model selected by the Akaike information criterion.  Parsimony For the parsimony analyses we used TNT 1.6. For the equal weights analysis, a heuristic search was made using a driven search with the default parameters of the “new technologies”, aiming for 10 independent hits to minimum length. The resulting trees were then submitted to an additional round of tree-bisection reconnection (TBR) branch swapping. These results were compared to a simpler search strategy of 300 random addition sequences, each followed by TBR, which produced 20 hits to minimal length. As both strategies reached the same trees with multiple independent hits, it is likely that the optimal trees were found. Finally, the strict consensus of all the optimal trees was obtained, and on this consensus the support values were calculated by means of 1000 bootstrap pseudoreplicates.

opencc-by-4.0Mar 2023View details →

Youtube comments on Smart Farming

Please cite the following paper, if you are working on or using the above dataset. https://www.mdpi.com/2624-7402/4/2/29 Farming Dataset The datasets are taken from the following 16 YouTube videos related to farming: 1. How Japan Is Reshaping Its Agriculture By Harnessing Smart Farming Technology- Science Insider 2. Europe has the best regenerative farmers in the world - Richard Perkins 3. The Futuristic Farms That Will Feed the World - Freethink 4. Vertical farms could take over the world - Freethink 5. India’s largest Precision Farm - Simply Fresh Discover Agriculture 6. Solar Panels Plus Farming? Agrivoltaics Explained Undecided with Matt Ferell 7. 7 Israeli Agriculture Technologies Israel 8. The CNH Industrial Autonomous Tractor Concept (Full Version CNH Industrial 9. IoT Smart Plant Monitoring System Viral Science -the home of creativity 10. Singapore’s Bold Plan to Build the Farms of the Future Tomorrow’s Build 11. Smart Vertical Farms in Sharjah Episode Up 12. Drones, robots, and super sperm – the future of farming DW Documentary 13. Simply Fresh - India’s Largest State Of The Art Precision Farm 14. RIPPA The Farm Robot Exterminates Pests And Weeds- ABC Science 15. Top 10 Agritech Startups Empowering Indian Farmers Backstage With Millionaires 16. This Farm of the Future Uses No Soil and 95% Less Water Stories Total counts: 7334 The comments have been divided into the following labels: 1. Praising (970 comments) 2. Opinion (3224 comments), 3. Suggestion (231 comments), 4. Undefined (1386 comments), 5. Queries (1007 comments) 6. Hybrid (516 comments). The file includes: 1. Comment 2. Label

opencc-by-4.0May 2023View details →

Figure data and code used in Technical comment on "Fairness considerations in global mitigation investments"

The package contains the data and code to create the figure in the associated technical comment in Science published at <a href="https://www.science.org/doi/10.1126/science.adg5893">https://www.science.org/doi/10.1126/science.adg5893</a>

opencc-by-4.0Feb 2022View details →

QuerTCI: A Tool Integrating GitHub Issue Querying with Comment Classification

Issue tracking systems enable users and developers to comment on problems plaguing a software system. Empirical Software Engineering (ESE) researchers study (open-source) project issues and the comments and threads within to discover---among others---challenges developers face when, e.g., incorporating new technologies, platforms, and programming language constructs. However, issue discussion threads accumulate over time and thus can become unwieldy, hindering any insight that researchers may gain.  While existing approaches alleviate this burden by classifying issue thread comments, there is a gap between searching popular open-source software repositories (e.g., those on GitHub) for issues containing particular keywords and feeding the results into a classification model. In this paper, we demonstrate a research infrastructure tool called QuerTCI that bridges this gap by integrating the GitHub issue comment search API with the classification models found in existing approaches. Using queries, ESE researchers can retrieve GitHub issues containing particular keywords, e.g., those related to a certain programming language construct, and subsequently classify the kinds of discussions occurring in those issues.  Using our tool, our hope is that ESE researchers can uncover challenges related to particular technologies using certain keywords through popular open-source repositories more seamlessly than previously possible. A tool demonstration video may be found at: https://youtu.be/fADKSxn0QUk.

openDec 2023View details →

A Dataset of Multilingual Facebook Comments on Moros and Armed Conflict in the Southern Philippines

This dataset is a collection of 12,478 social media comments found on the official Facebook pages of ten Philippine newspapers, The Philippine Daily Inquirer, Manila Bulletin, The Philippine Star, The Manila Times, Sunstar Cebu, Sunstar Davao, Cebu Daily News, The Freeman, Sunstar Davao, MindaNews, and The Mindanao Times, spanning the years 2015, 2017 and 2019. The comments contain terms related to the Moro identity and the Mamasapano Clash, the Marawi Siege and the establishment of BARMM in the southern Philippines, allowing researchers to study semantic fields with regard to Muslims and the relationship between the texts and the source newspaper, their region of origin, and political administration, among other variables. All comments in the dataset were downloaded through Facebook's Graph API via Facepager (Jünger & Keyling, 2019). One CSV file (MMB151719SOCMED_v2.csv) is provided, along with a codebook that contains descriptions of the variables and codes used in the CSV file, and a Readme document with a changelog.  Each social media comment is annotated with the following metadata:  <ol> <li>object_id: identifier associated with the comment;</li> <li>message: the textual string of the comment;</li> <li>message_proc: the textual string of the comment after pre-processing;</li> <li>lang_label: categorical value for the language of the comment (Tagalog (Filipino), Cebuano, English, Taglish, Bislog, Bislish, Trilingual or Other);</li> <li>from_name:  identifier of public pages (not profiles of individuals) leaving comments (NaN for profiles of individuals, 'NAME' for public pages besides the newspapers, otherwise, the page name of the newspaper);</li> <li>created_time: Facebook Graph API's-generated string for the date and time the comment was posted;   </li> <li>month_year: categorical value in the form string+YY (e.g. Jun-15) of the month and year when the comment was posted;</li> <li>year: numerical value in the form YY; </li> <li>newspaper: categorical value for the newspaper Facebook page under which the comment was found;</li> <li>corpus: categorical value for comments from the main corpus or the side (control) corpus;</li> <li>administration: categorical value for political administration (pbsa = President Benigno Aquino III, prrd = President Rodrigo Roa Duterte);</li> <li>count: numerical value referring to the number of string sequences without spaces;</li> </ol> The dataset may only be used for non-commercial purposes and is licensed under the <a href="https://creativecommons.org/licenses/by-nc-sa/4.0/" target="_blank" rel="noopener">CC BY-NC-SA 4.0 DEED.</a> _____________________________________________________________________________________ V2 - 05/06/2024 Corrections <ul> <li>Corrections made to region to include Luzon, Visayas and Mindanao (as opposed to Mindanao, non-Mindanao);</li> <li>Corrections made to administration coding. </li> </ul>   This dataset is described by:  Cruz, F. A. (2024). A Multilingual Collection of Facebook Comments on the Moro Identity and Armed Conflict in the Southern Philippines. Journal of Open Humanities Data, 10(1), 41. DOI: <a href="https://doi.org/10.5334/johd.219" target="_blank" rel="noopener">https://doi.org/10.5334/johd.219</a>   Bibiliography <div> <div>Jünger, J., & Keyling, T. (2019). Facepager: An application for automated data retrieval on the web (4.5.3) [Computer software]. <a href="https://github.com/strohne/Facepager/">https://github.com/strohne/Facepager/</a></div> <div> </div> <div> </div> </div>

opencc-bySep 2021View details →

Customer experience dimension in service provider commenters (bahasa)

A dataset containing customer commenters that obtain from user-generated content on Twitter and Instagram @byu_id. The dataset is used Bahasa, and it includes 32.684 raws. The following is an explanation of the variables in each column: - comment: comments using Indonesian obtained from January 1 to June 30, 2021. This comment has been through a preprocessing process. - sentiment: consists of neutral, positive, and negative sentiments of customers. - dimension: there are six dimensions using customer experience proposed by Malviya and Varma (2012).

opencc-by-4.0Mar 2019View details →

Online Real-Time Delphi Survey for the research project "MENARA" - Compilation of all Comments to Closed and Open Questions

Looking into the Futures: Delphi Survey about the MENA region In order to get a more realistic overview of the situation and trends, of the potentials, problems and potentials of the countries of the MENA region a Real Time Delphi survey was conducted. This is an important tool of modern future research. It was managed by the IZT- Institute for Future Studies in Berlin. A group of 139 experts and researchers from different institutes and organizations were invited to participate at the Online Real-Time Delphi Survey (RTD) about possible and likely futures of the MENA region. The experts were asked to answer questions and provide their opinions on twelve topics such as social unrest, youth unemployment, urbanization, gender equality, security etc. In this dataset all comments to the closed and the open questions are compiled. The output was one of the basic material used for the creation of future regional scenarios for mid-term (2025) and long-term (2050) time horizons. Focus scenarios were produced in order to exemplify selected characteristic and important future options, in terms of chances and risks (e.g. energy futures).

opencc-by-4.0May 2023View details →

Dataset for 'Comment on "Glassy Dynamics in Chiral Fluids" '

Data sets from which figures of Dataset for 'Comment on "Glassy Dynamics in Chiral Fluids" ' were obtained, along with python code for produing the figures (in file 'correlations_matrix.ipynb').

opencc-by-4.0Apr 2019View details →

Online supplementary data linked to the publication "Aubenas-les-Alpes (S-E France). Part III – Last and final part of the mammalian assemblage with some comments on the palaeoenvironment and palaeobiogeography" doi:10.1016/j.annpal.2019.03.001

Online supplementary appendix including the list of Oligocene localities and associated faunal lists compared to Aubenas-les-Alpes, and the size estimation of the non-predatory species for the construction of Fig.10.

opencc-by-4.0Jul 2018View details →

Fig. 5 in Description of a new species of Moenkhausia (Characiformes: Characidae) from the upper Paraguay basin, Central Brazil, with comments on its phylogenetic relationships

Fig. 5. Map showing the localities of Moenkhausia flava. Red star represents the type locality. Black square represents the Salto das Nuvens fall and the white square represents Salto Maciel fall.

opencc-by-4.0Aug 2009View details →

Figure 4. Skelosophusa prolixa. A dorsal view B frontal view C sternal view D in A new species of Foza Reed & Cumberlidge, 2006 from northern Madagascar (Decapoda, Brachyura, Potamoidea, Potamonautidae), with a redescription of F. goudoti (H. Milne Edwards, 1853) comb. n., and comments on Skelosophusa prolixa Ng & Takeda, 1994

Figure 4. Skelosophusa prolixa. A dorsal view B frontal view C sternal view D major (left) cheliped. Adult male (NHM 2009.122), CW 29.3 mm.

opencc-by-4.0Aug 2009View details →

Figure 2 in A new species of Foza Reed & Cumberlidge, 2006 from northern Madagascar (Decapoda, Brachyura, Potamoidea, Potamonautidae), with a redescription of F. goudoti (H. Milne Edwards, 1853) comb. n., and comments on Skelosophusa prolixa Ng & Takeda, 1994

Figure 2. Foza ambohitra sp. n. A dorsal view B frontal view C sternal view D major (right) cheliped. A, B adult female (FMNH 11056), CW 43.1 mm C, D holotype, adult male, CW 39.5 mm.

opencc-by-4.0Nov 2009View details →

Figure 2 in A new species of Habralictus (Hymenoptera, Halictidae) from the Island of Grenada (Lesser Antilles) with comments on the insular species of the genus

Figure 2. Terminalia of the male of H. insularis sp. n.: a T6 b S7+S8 c genital capsule: left, ventral view, right, dorsal view.

Fig. 3 in New collections of freshwater crabs from northern Madagascar, with the description of a new species of Foza Reed & Cumberlidge, 2006 (Brachyura, Potamonautidae), and comments on their conservation status

Fig. 3. Foza manonae sp. nov. Holotype, adult ♂, CW 43.7 mm, Ankarana Special Reserve, Madagascar (ZSM A20145003). Entire animal. A. Dorsal view. B. Frontal view. C. Sternal view. Scale bar: 14.6 mm.

Fig. 2 in New collections of freshwater crabs from northern Madagascar, with the description of a new species of Foza Reed & Cumberlidge, 2006 (Brachyura, Potamonautidae), and comments on their conservation status

Fig. 2. Foza manonae sp. nov. Holotype, adult ♂, CW 43.7 mm, Ankarana Special Reserve, Madagascar (ZSM A20145003). A. Left and right G1 and G2 shown in situ in ventral view. B. Left G1, dorsal view. C. Left G1, ventral view. D. Sternum and abdomen, ventral view. E. Left mandibular palp, superior view. F. Left mandibular palp, frontal view. Scale bar: 14 mm (A–B, E), 23.2 mm (C–D).

Fig. 4 in New collections of freshwater crabs from northern Madagascar, with the description of a new species of Foza Reed & Cumberlidge, 2006 (Brachyura, Potamonautidae), and comments on their conservation status

Fig. 4. Distribution map of northern Madagascar showing the seven localities (black circles) where freshwater crabs were collected in the present study: Foza manonae sp. nov. (white circles), F. ambohitra (triangle), and Madagapotamon humberti (squares).

Fig. 1 in New collections of freshwater crabs from northern Madagascar, with the description of a new species of Foza Reed & Cumberlidge, 2006 (Brachyura, Potamonautidae), and comments on their conservation status

Fig. 1. Foza manonae sp. nov. Holotype, adult ♂, CW 43.7 mm, Ankarana Special Reserve, Madagascar (ZSM A20145003). A. Carapace, frontal view. B. Carapace, dorsal view. C. Third maxilliped, ventral view. D. Carpus and merus of cheliped, dorsal view. E. Carpus and merus of cheliped, ventral view. F. Right cheliped, frontal view. G. Left cheliped, frontal view.