Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
21
datasets available to search
ShareScore release 0.9.0
Dataset results
21 results for “co-occurrence analysis”
Research Data and Code for "Interdisciplinarity in the 17th Century? A Co-Occurrence Analysis of Early Modern German Dissertation Titles"
<p>This dataset documents results and code for the paper "Interdisciplinarity in the 17th Century? A Co-Occurrence Analysis of Early Modern German Dissertation Titles" by Stefan Heßbrüggen-Walter, forthcoming in *Synthese*. The data to be processed are contained in four files, derived from a larger dataset related to German dissertations and sourced from the national bibliography of 17th century German prints *VD 17* that will be released at a later date. More information can be found in the file `README.md`. </p>
Sentiment analysis of tech media articles using VADER package and co-occurrence analysis during the COVID-19 pandemic (01.2020-06.2020)
<p><strong>Sources: </strong></p> <ul> <li>Euractiv</li> <li>The Conversation</li> <li>Politico Europe </li> <li>IEEE Spectrum </li> <li>Techforge </li> <li>Fastcompany </li> <li>The Guardian (Tech) </li> <li>Arstechnica </li> <li>Reuters </li> <li>Gizmodo </li> <li>ZDNet </li> <li>The Register </li> <li>The Verge </li> <li>TechCrunch </li> </ul> <p> </p> <p><strong>Methodology</strong></p> <p>The sentiment analysis has been prepared using VADER*, an open-source lexicon and rule-based sentiment analysis tool. VADER is specifically designed for social media analysis, but can be also applied for other text sources. The sentiment lexicon was compiled using various sources (other sentiment data sets, Twitter etc.) and was validated by human input. The advantage of VADER is that the rule-based engine includes word-order sensitive relations and degree modifiers.</p> <p>As VADER is more robust in the case of shorter social media texts, the analysed articles have been divided into paragraphs. The analysis have been carried out for the social issues presented in the co-occurrence exercise.</p> <p>The process included the following main steps:</p> <ul> <li>The 100 most frequently co-occurring terms are identified for every social issue (using the co-occurrence methodology)</li> <li>The articles containing the given social issue and co-occurring term are identified</li> <li>The identified articles are divided into paragraphs</li> <li>Social issue and co-occurring words are removed from the paragraph</li> <li>The VADER sentiment analysis is carried out for every identified and modified paragraph</li> <li>The average for the given word pair is calculated for the final result</li> </ul> <p>Therefore, the procedure has been repeated for 100 words for all identified social issues.</p> <p>The sentiment analysis resulted in a compound score for every paragraph. The score is calculated from the sum of the valence scores of each word in the paragraph, and normalised between the values -1 (most extreme negative) and +1 (most extreme positive). Finally, the average is calculated from the paragraph results. Removal of terms is meant to exclude sentiment of the co-occurring word itself, because the word may be misleading, e.g. when some technologies or companies attempt to solve a negative issue. The neighbourhood's scores would be positive, but the negative term would bring the paragraph's score down.</p> <p>The analysed paragraphs are selected the following way:</p> <ul> <li>The articles containing the given social issue are identified</li> <li>The paragraphs containing the social issue are selected for sentiment analysis</li> </ul> <p>*Hutto, C.J. & Gilbert, E.E. (2014). VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. Eighth International Conference on Weblogs and Social Media (ICWSM-14). Ann Arbor, MI, June 2014.</p>
Sentiment analysis of tech media articles using VADER package and co-occurrence analysis
<p><strong>Sentiment analysis of tech media articles using VADER package and co-occurrence analysis</strong></p> <p><strong>Sources</strong>: Above 140k articles (01.2016-03.2019):</p> <ul> <li>Gigaom 0.5%</li> <li>Euractiv 0.9%</li> <li>The Conversation 1.3%</li> <li>Politico Europe 1.3%</li> <li>IEEE Spectrum 1.8%</li> <li>Techforge 4.3%</li> <li>Fastcompany 4.5%</li> <li>The Guardian (Tech) 9.2%</li> <li>Arstechnica 10.0%</li> <li>Reuters 11%</li> <li>Gizmodo 17.5%</li> <li>ZDNet 18.3%</li> <li>The Register 19.5%</li> </ul> <p><strong>Methodology</strong></p> <p>The sentiment analysis has been prepared using VADER*, an open-source lexicon and rule-based sentiment analysis tool. VADER is specifically designed for social media analysis, but can be also applied for other text sources. The sentiment lexicon was compiled using various sources (other sentiment data sets, Twitter etc.) and was validated by human input. The advantage of VADER is that the rule-based engine includes word-order sensitive relations and degree modifiers.</p> <p>As VADER is more robust in the case of shorter social media texts, the analysed articles have been divided into paragraphs. The analysis have been carried out for the social issues presented in the co-occurrence exercise.</p> <p>The process included the following main steps:</p> <ul> <li>The 100 most frequently co-occurring terms are identified for every social issue (using the co-occurrence methodology)</li> <li>The articles containing the given social issue and co-occurring term are identified</li> <li>The identified articles are divided into paragraphs</li> <li>Social issue and co-occurring words are removed from the paragraph</li> <li>The VADER sentiment analysis is carried out for every identified and modified paragraph</li> <li>The average for the given word pair is calculated for the final result</li> </ul> <p>Therefore, the procedure has been repeated for 100 words for all identified social issues.</p> <p>The sentiment analysis resulted in a compound score for every paragraph. The score is calculated from the sum of the valence scores of each word in the paragraph, and normalised between the values -1 (most extreme negative) and +1 (most extreme positive). Finally, the average is calculated from the paragraph results. Removal of terms is meant to exclude sentiment of the co-occurring word itself, because the word may be misleading, e.g. when some technologies or companies attempt to solve a negative issue. The neighbourhood's scores would be positive, but the negative term would bring the paragraph's score down.</p> <p>The presented tables include the most extreme co-occurring terms for the analysed social issue. The examples are chosen from the list of words with 30 most positive and 30 most negative sentiment. The presented graphs show the evolution of sentiments for social issues. The analysed paragraphs are selected the following way:</p> <ul> <li>The articles containing the given social issue are identified</li> <li>The paragraphs containing the social issue are selected for sentiment analysis</li> </ul> <p>*Hutto, C.J. & Gilbert, E.E. (2014). VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. Eighth International Conference on Weblogs and Social Media (ICWSM-14). Ann Arbor, MI, June 2014.</p> <p> </p> <p><strong>Files</strong></p> <p>sentiments_mod11.csv sentiment score based on chosen unigrams</p> <p>sentiments_mod22.csv sentiment score based on chosen bigrams</p> <p>sentiments_cooc_mod11.csv, sentiments_cooc_mod12.csv, sentiments_cooc_mod21.csv, sentiments_cooc_mod22.csv combinations of co-occurrences: unigrams-unigrams, unigrams-bigrams, bigrams-unigrams, bigrams-bigrams</p> <p> </p>
Sentiment analysis of tech media articles using VADER package and co-occurrence analysis (01.2016-12.2019)
<p>Sentiment analysis of tech media articles using VADER package and co-occurrence analysis</p> <p>Sources with weights:</p> <ul> <li>Euractiv 5%</li> <li>The Conversation 5%</li> <li>Politico Europe 5 %</li> <li>IEEE Spectrum 5 %</li> <li>Techforge 5%</li> <li>Fastcompany 5%</li> <li>The Guardian (Tech) 12%</li> <li>Arstechnica 5%</li> <li>Reuters 5%</li> <li>Gizmodo 9%</li> <li>ZDNet 9%</li> <li>The Register 12%</li> <li>The Verge 9%</li> <li>TechCrunch 9%</li> </ul> <p>Methodology</p> <p>The sentiment analysis has been prepared using VADER*, an open-source lexicon and rule-based sentiment analysis tool. VADER is specifically designed for social media analysis, but can be also applied for other text sources. The sentiment lexicon was compiled using various sources (other sentiment data sets, Twitter etc.) and was validated by human input. The advantage of VADER is that the rule-based engine includes word-order sensitive relations and degree modifiers.</p> <p>As VADER is more robust in the case of shorter social media texts, the analysed articles have been divided into paragraphs. The analysis have been carried out for the social issues presented in the co-occurrence exercise.</p> <p>The process included the following main steps:</p> <ul> <li>The 100 most frequently co-occurring terms are identified for every social issue (using the co-occurrence methodology)</li> <li>The articles containing the given social issue and co-occurring term are identified</li> <li>The identified articles are divided into paragraphs</li> <li>Social issue and co-occurring words are removed from the paragraph</li> <li>The VADER sentiment analysis is carried out for every identified and modified paragraph</li> <li>The average for the given word pair is calculated for the final result</li> </ul> <p>Therefore, the procedure has been repeated for 100 words for all identified social issues.</p> <p>The sentiment analysis resulted in a compound score for every paragraph. The score is calculated from the sum of the valence scores of each word in the paragraph, and normalised between the values -1 (most extreme negative) and +1 (most extreme positive). Finally, the average is calculated from the paragraph results. Removal of terms is meant to exclude sentiment of the co-occurring word itself, because the word may be misleading, e.g. when some technologies or companies attempt to solve a negative issue. The neighbourhood's scores would be positive, but the negative term would bring the paragraph's score down.</p> <p> </p> <p>*Hutto, C.J. & Gilbert, E.E. (2014). VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. Eighth International Conference on Weblogs and Social Media (ICWSM-14). Ann Arbor, MI, June 2014.</p>
Sentiment analysis of tech media articles using VADER package and co-occurrence analysis (01.2016-04.2021)
<p>Sentiment analysis of tech media articles using VADER package and co-occurrence analysis</p> <p>Sources with weights:</p> <ul> <li>Euractiv 5%</li> <li>The Conversation 5%</li> <li>Politico Europe 5 %</li> <li>IEEE Spectrum 5 %</li> <li>Techforge 5%</li> <li>Fastcompany 5%</li> <li>The Guardian (Tech) 12%</li> <li>Arstechnica 5%</li> <li>Reuters 5%</li> <li>Gizmodo 9%</li> <li>ZDNet 9%</li> <li>The Register 12%</li> <li>The Verge 9%</li> <li>TechCrunch 9%</li> </ul> <p>Methodology</p> <p>The sentiment analysis has been prepared using VADER*, an open-source lexicon and rule-based sentiment analysis tool. VADER is specifically designed for social media analysis, but can be also applied for other text sources. The sentiment lexicon was compiled using various sources (other sentiment data sets, Twitter etc.) and was validated by human input. The advantage of VADER is that the rule-based engine includes word-order sensitive relations and degree modifiers.</p> <p>As VADER is more robust in the case of shorter social media texts, the analysed articles have been divided into paragraphs. The analysis have been carried out for the social issues presented in the co-occurrence exercise.</p> <p>The process included the following main steps:</p> <ul> <li>The 100 most frequently co-occurring terms are identified for every social issue (using the co-occurrence methodology)</li> <li>The articles containing the given social issue and co-occurring term are identified</li> <li>The identified articles are divided into paragraphs</li> <li>Social issue and co-occurring words are removed from the paragraph</li> <li>The VADER sentiment analysis is carried out for every identified and modified paragraph</li> <li>The average for the given word pair is calculated for the final result</li> </ul> <p>Therefore, the procedure has been repeated for 100 words for all identified social issues.</p> <p>The sentiment analysis resulted in a compound score for every paragraph. The score is calculated from the sum of the valence scores of each word in the paragraph, and normalised between the values -1 (most extreme negative) and +1 (most extreme positive). Finally, the average is calculated from the paragraph results. Removal of terms is meant to exclude sentiment of the co-occurring word itself, because the word may be misleading, e.g. when some technologies or companies attempt to solve a negative issue. The neighbourhood's scores would be positive, but the negative term would bring the paragraph's score down.</p> <p> </p> <p>*Hutto, C.J. & Gilbert, E.E. (2014). VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. Eighth International Conference on Weblogs and Social Media (ICWSM-14). Ann Arbor, MI, June 2014.</p>
Implementing social network analysis to understand the socio-ecology of wildlife co-occurrence and joint interactions with humans in anthropogenic environments
Open the record for dataset details and reuse information.
Data and analysis scripts for: Co-occurrence patterns at four spatial scales implicate reproductive processes in shaping community assembly in clovers
Open the record for dataset details and reuse information.
Sentiment analysis of tech media articles using VADER package and co-occurrence analysis (01.2016-04.2019)
<p>Sentiment analysis of tech media articles using VADER package and co-occurrence analysis</p> <p><strong>Sources with weights:</strong></p> <ul> <li>Euractiv 5%</li> <li>The Conversation 5%</li> <li>Politico Europe 5 %</li> <li>IEEE Spectrum 5 %</li> <li>Techforge 5%</li> <li>Fastcompany 5%</li> <li>The Guardian (Tech) 12%</li> <li>Arstechnica 5%</li> <li>Reuters 5%</li> <li>Gizmodo 9%</li> <li>ZDNet 9%</li> <li>The Register 12%</li> <li>The Verge 9%</li> <li>TechCrunch 9%</li> </ul> <p><strong>Methodology</strong></p> <p>The sentiment analysis has been prepared using VADER*, an open-source lexicon and rule-based sentiment analysis tool. VADER is specifically designed for social media analysis, but can be also applied for other text sources. The sentiment lexicon was compiled using various sources (other sentiment data sets, Twitter etc.) and was validated by human input. The advantage of VADER is that the rule-based engine includes word-order sensitive relations and degree modifiers.</p> <p>As VADER is more robust in the case of shorter social media texts, the analysed articles have been divided into paragraphs. The analysis have been carried out for the social issues presented in the co-occurrence exercise.</p> <p>The process included the following main steps:</p> <ul> <li>The 100 most frequently co-occurring terms are identified for every social issue (using the co-occurrence methodology)</li> <li>The articles containing the given social issue and co-occurring term are identified</li> <li>The identified articles are divided into paragraphs</li> <li>Social issue and co-occurring words are removed from the paragraph</li> <li>The VADER sentiment analysis is carried out for every identified and modified paragraph</li> <li>The average for the given word pair is calculated for the final result</li> </ul> <p>Therefore, the procedure has been repeated for 100 words for all identified social issues.</p> <p>The sentiment analysis resulted in a compound score for every paragraph. The score is calculated from the sum of the valence scores of each word in the paragraph, and normalised between the values -1 (most extreme negative) and +1 (most extreme positive). Finally, the average is calculated from the paragraph results. Removal of terms is meant to exclude sentiment of the co-occurring word itself, because the word may be misleading, e.g. when some technologies or companies attempt to solve a negative issue. The neighbourhood's scores would be positive, but the negative term would bring the paragraph's score down.</p> <p>The presented tables include the most extreme co-occurring terms for the analysed social issue. The examples are chosen from the list of words with 30 most positive and 30 most negative sentiment. The presented graphs show the evolution of sentiments for social issues. The analysed paragraphs are selected the following way:</p> <ul> <li>The articles containing the given social issue are identified</li> <li>The paragraphs containing the social issue are selected for sentiment analysis</li> </ul> <p>*Hutto, C.J. & Gilbert, E.E. (2014). VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. Eighth International Conference on Weblogs and Social Media (ICWSM-14). Ann Arbor, MI, June 2014.</p>
The spatial analysis of biological interactions: morphological variation responding to the co-occurrence of competitors and resources
By sharing geographic space, species are forced to interact with one another and the contribution of this process to evolutionary and ecological patterns of individual species is not fully understood. At the same time, species turnover makes that species composition varies from one area to another, so the analysis of biological interaction cannot be uncoupled from the spatial context. This is particularly important for clades that show high degree of specialization such as hummingbirds, where any variation in biotic pressures might lead to changes in morphology. Here, we describe the influence of biological interactions on the morphology of Hylocharis leucotis by simultaneously considering potential competition and diet resources. We characterized the extent of local potential competition and local available floral resources by correlating two measurements of hummingbird diversity, floral resources and the size of morphological space of H. leucotis along its geographic distribution. We found that H. leucotis shows an important morphological variability across its range and two groups can be recognized. Surprisingly, morphological variation is not always linked to local hummingbird richness or the phylogenetic similarity of. Only in the southern part of its distribution, H. leucotis is morphologically more variable in those communities where it coexist with closely related hummingbird species. We also found that morphological variation in H. leucotis is independent from the availability of floral resources. Our results suggest that abiotic factors might be responsible for morphological differences across populations in Hylocharis leucotis being biological interactions of minor importance.
Data from: Seasonal dynamics and co-occurrence patterns of honey bee pathogens revealed by high-throughput RT-qPCR analysis
The health of the honey bee Apis mellifera is challenged by introduced parasites that interact with its inherent pathogens and cause elevated rates of colony losses. To elucidate co-occurrence, population dynamics and synergistic interactions of honey bee pathogens, we established an array of diagnostic assays for a high-throughput qPCR platform. Assuming that interaction of pathogens requires co-occurrence within the same individual, single worker bees were analyzed instead of collective samples. Eleven viruses, four parasites and three pathogenic bacteria were quantified in more than one thousand single bees sampled from sixteen disease-free apiaries in Southwest Germany. The most abundant viruses were Black Queen Cell Virus (84%), Lake Sinai Virus 1 (42%), and Deformed Wing Virus B (35%). Forager bees from asymptomatic colonies were infected with two different viruses in average, and simultaneous infection with four to six viruses was common (14%). Also the intestinal parasites Nosema ceranae (96%) and Crithidia mellificae/Lotmaria passim (52%) occurred very frequently. These results indicate that low-level infections in honey bees are more common than previously assumed. All viruses showed seasonal variation, while N. ceranae did not. The foulbrood bacteria Paenibacillus larvae and Melissococcus plutonius were regionally distributed. Spearman's correlations and multiple regression analysis indicated possible synergistic interactions between the common pathogens, particularly for Black Queen Cell Virus. Beyond its suitability for further studies on honey bees, this targeted approach may be, due to its precision, capacity and flexibility, a viable alternative to more expensive, sequencing-based approaches in non-model systems.
Figure 2 Co-occurrence analysis
Open the record for dataset details and reuse information.
The spatial analysis of biological interactions: morphological variation responding to the co-occurrence of competitors and resources
Open the record for dataset details and reuse information.
Tropical palm endophytes exhibit low competitive structuring when assessed using co-occurrence and antipathogen activity analysis
Open the record for dataset details and reuse information.
Data from: Seasonal dynamics and co-occurrence patterns of honey bee pathogens revealed by high-throughput RT-qPCR analysis
Open the record for dataset details and reuse information.
Data from: Phylogenomic analysis of transcriptome data elucidates co-occurrence of a paleopolyploid event and the origin of bimodal karyotypes in Agavoideae (Asparagaceae)
PREMISE OF THE STUDY: The stability of the bimodal karyotype found in Agave and closely related species has long interested botanists. The origin of the bimodal karyotype has been attributed to allopolyploidy, but this hypothesis has not been tested. Next Generation transcriptome sequence data were used to test whether a paleopolyploid event occurred on the same branch of the Agavoideae phylogenetic tree as the origin of the Yucca-Agave bimodal karyotype. METHODS: Illumina RNAseq data were generated for phylogenetically strategic species in Agavoideae. Paleopolyploidy was inferred in analyses of frequency plots for synonymous substitutions per synonymous site (Ks) between Hosta, Agave and Chlorophytum paralogous and orthologous gene pairs. Phylogenies of gene families including paralogous genes for these species and outgroup species were estimated in order to place inferred paleopolyploid events on a species tree. KEY RESULTS: Ks frequency plots suggested paleopolyploid events in the history of the genera Agave, Hosta and Chlorophytum. Phylogenetic analyses of gene families estimated from transcriptome data revealed two polyploid events: one predating the last common ancestor of Agave and Hosta and one within the lineage leading to Chlorophytum. CONCLUSIONS: We found that allopolyoidy and the origin of the Yucca-Agave bimodal karyotype co-occur on the same lineage consistent with the hypothesis that the bimodal karyotype is a consequence of allopolyploidy. We discuss this and alternative mechanisms for the formation of the Yucca-Agave bimodal karyotype. More generally, we illustrate how the use of next generation sequencing technology is a cost-efficient means for assessing genome evolution in non-model species.
Data from: Taxon abundance, diversity, co-occurrence and network analysis of the ruminal microbiota in response to dietary changes in dairy cows
The effects of sunflower oil (SO) (0 or 50 g/kg diet dry matter), supplemented to diets contrasting in the proportion of forage and concentrate (FC) (65:35 vs 35:65), were evaluated for their influence on rumen microbiome. Four multiparous Nordic Red dairy cows fitted with rumen cannulae were used in a 4 × 4 Latin square with a 2 × 2 factorial arrangement of treatments and four 35-d periods. Ruminal digesta samples were collected on d 22 and d 24 of each experimental period and DNA was extracted from a combined sample. Diet effect on rumen microbial community was explored by qPCR, T-RFLP and metabarcoding sequencing. QPCR analysis showed that the total amounts of bacteria, archaea or ciliate protozoa were not significantly altered either by FC ratio or addition of SO. Only fungi were reduced by half in high concentrate (H) compared to high forage (L) diets (P=0.03). Further significant reduction of fungi was observed due to SO in both HSO and LSO diets but the effect was stronger in HSO (H vs HSO by 10.5x, P=0.03; L vs LSO by 1.9x, P=0.04). Metabarcoding sequencing analysis showed that SO affected bacterial, archaeal, ciliate protozoa and fungal community structure and diversity and the effect was FC ratio dependent. As expected, Simpson's index of diversity was higher in diets containing higher proportion of forage. These diets were dominated by Firmicutes, while Bacteroidetes and Proteobacteria were more abundant in H diets. Methanobrevibacter ruminantium and Methanobrevibacter gottschalkii dominated archaea community but they were in negative relation to each other. Methanobrevibacter gottschalkii was more abundant in L, while Methanobrevibacter ruminantium in H diet. The strongest diet effect was observed on fungal community, represented by both well classified and novel fungal groups. Both, increase in concentrate and supplementation of SO significantly reduced fungal diversity. We explored microbial interactions by building taxa co-occurrence networks. Our results suggest that studying entire rumen microbiome simultaneously is needed aiming to better understand how diet induced changes within microbial community are associated with microbial function, subsequently leading to better understanding of rumen fermentation and methanogenesis.
Data from: Phylogenomic analysis of transcriptome data elucidates co-occurrence of a paleopolyploid event and the origin of bimodal karyotypes in Agavoideae (Asparagaceae)
Open the record for dataset details and reuse information.
Data from: Taxon abundance, diversity, co-occurrence and network analysis of the ruminal microbiota in response to dietary changes in dairy cows
Open the record for dataset details and reuse information.
Gene expression analysis of pheochromocytoma samples carrying co-occurrent mutations in NF1 and DLST.
GEO Series GSE217206. Homo sapiens. 2 samples. Type: Expression profiling by high throughput sequencing.
Analysis of pheochromocytoma samples carrying co-occurrent mutations in NF1 and DLST
GEO Series GSE217208. Homo sapiens. 3 samples. Type: Expression profiling by high throughput sequencing; Methylation profiling by array.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.