Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
3
datasets available to search
ShareScore release 0.9.0
Dataset results
3 results for “English corpora”
Files and code for English dictionaries, gold and silver standard corpora for biomedical natural language processing related to SARS-CoV-2 and COVID-19
<p><span lang="EN-GB">Automated information extraction with natural language processing (NLP) tools is required to gain systematic insights from the large number of COVID-19 publications, reports and social media posts, which far exceed human processing capabilities. </span></p> <p><span lang="EN-GB">Here we present an NLP toolbox comprising COVID-19-related dictionaries and annotated corpora in English as well as useful code and workflows for their update and use. The dictionaries contain terms referring to the COVID-19 disease, the SARS-CoV-2 virus, its variants and common mutations, respectively. They were used together with the EasyNER NLP tool to extract and annotate all 764 398 abstracts in the CORD-19 dataset, creating a very large silver standard corpus (named Lund-Annotated-CORD-19 corpus). This was complemented with a small gold standard corpus consisting of PubMed abstracts manually annotated for key entity classes such as disease, virus, symptom, protein/gene, cell type, chemical and species terms. </span></p> <p><span lang="EN-GB">The toolbox can support various text analysis tasks related to COVID-19 such as named entity recognition and co-mention analysis. A preliminary version of the toolbox, which was released early in the pandemic, was</span><span lang="EN-GB"> for example already used to create a COVID-19 knowledge graph and study the evolution and variation of COVID-19-related terminology. In addition, the toolbox can be applied in the development of other NLP tools, for example to train and evaluate large language models.</span></p> <p><span lang="EN-GB">When using the toolbox, please cite this record and the associated article.</span></p> <p> </p> <p> </p>
VladislavKaryukin/kk_en_corpora: The Kazakh - English parallel corpora
<p>The full corpora of 380 thousand parallel sentences</p>
PoeTree. Poetry Corpora in Czech, English, French, German, Hungarian, Italian, Norwegian, Portuguese, Russian, Slovenian, and Spanish
<p>PoeTree is a dataset comprising nearly 335,000 poems / 90,000,000 tokens in 11 languages (Czech, English, French, German, Hungarian, Italian, Norwegian, Portuguese, Spanish, Slovenian, and Russian). Each corpus has been deduplicated, enriched with Universal Dependencies, provided with additional metadata and converted into a unified JSON structure (schema available at <a href="https://versologie.cz/poetree/json-schema">https://versologie.cz/poetree/json-schema</a>).</p> <ul> <li>cs (~80k poems) <ul> <li>derived from <a href="https://github.com/versotym/corpusCzechVerse" target="_blank" rel="noopener">Corpus of Czech Verse</a></li> </ul> </li> <li>de (~74k poems) <ul> <li>derived from <a href="https://metricalizer.de/" target="_blank" rel="noopener">Metricalizer</a> and <a href="https://github.com/tnhaider/DLK" target="_blank" rel="noopener">Deutsches Lyrik Korpus</a></li> </ul> </li> <li>en (~40k poems) <ul> <li>based on texts from <a href="https://gutenberg.org/" target="_blank" rel="noopener">Project Gutenberg</a></li> </ul> </li> <li>es (~9k poems) <ul> <li>derived from <a href="https://github.com/bncolorado/CorpusSonetosSigloDeOro" target="_blank" rel="noopener">Corpus of Spanish Golden-Age Sonnets</a> and <a href="https://github.com/pruizf/disco" target="_blank" rel="noopener">Diachronic Spanish Sonnet Corpus</a></li> </ul> </li> <li>fr (~18k poems) <ul> <li>derived from <a href="https://crisco4.unicaen.fr/verlaine" target="_blank" rel="noopener">Malherbə</a></li> </ul> </li> <li>hu (~13k poems) <ul> <li>derived from <a href="https://github.com/ELTE-DH/poetry-corpus/" target="_blank" rel="noopener">ELTE Poetry Corpus</a></li> </ul> </li> <li>it (~40k poems) <ul> <li>derived from <a href="http://www.bibliotecaitaliana.it/" target="_blank" rel="noopener">Biblioteca Italiana</a></li> </ul> </li> <li>no (~3k poems) <ul> <li>derived from <a href="https://github.com/norn-uio/norn-poems" target="_blank" rel="noopener">NORN Poems</a></li> </ul> </li> <li>pt (~5k poems) <ul> <li>derived from <a href="https://github.com/adiel-mittmann/poemas" target="_blank" rel="noopener">Poemas</a></li> </ul> </li> <li>ru (~45k poems) <ul> <li>derived from <a href="https://ruscorpora.ru/en/" target="_blank" rel="noopener">Corpus of Russian Poetry</a></li> </ul> </li> <li>sl (~5k poem)<br> <ul> <li>based on texts from <a href="https://en.wikisource.org/" target="_blank" rel="noopener">wikisource</a></li> </ul> </li> </ul> <p><em>new in v. 1.0.0:</em></p> <ul> <li><em>PoeTree.no added</em></li> <li><em>PoeTree.(cs,de,en,fr,hu,it,ru,sl) enriched with geolocation mentions</em></li> <li><em>Updated and corrected metadata in PoeTree.(de,en,es,ru)</em></li> <li><em>Multiple text corrections in PoeTree.ru</em></li> </ul>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.