Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
187
datasets available to search
ShareScore release 0.9.0
Dataset results
187 results for “Language Data”
Data set of "Context-sensitive Requirements Search in Natural Language Specifications"
<p>We use this data set for the evaluation of our Context-sensitive Requirements Search approach. It contains three files and 15 searches.</p> <p> </p> <p><strong>Attribution</strong></p> <p>The foundation of this data set is PURE:<br> A. Ferrari, G. O. Spagnolo, and S. Gnesi. <em>PURE: a Dataset of Public Requirements Documents</em>. Version 1.0. Sept. 2018.<br> Available at: <a href="https://doi.org/10.5281/zenodo.1414117">https://doi.org/10.5281/zenodo.1414117</a></p> <p>The original data is licensed under <a href="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International</a></p> <p> </p> <p><strong>Annotations</strong></p> <ul> <li>Each of the provided files contains annotations that we created with Label Studio for the corresponding file of the PURE data set.</li> <li>These annotations depict the search results of Plain Keyword Search (PKS) and the corresponding gold standard.</li> <li>The following is an example of an annotation in the .json file:</li> </ul> <pre><code class="language-json">{ "id": "UnaxUjB6oY", "meta": { "text": ["0"] }, "type": "labels", "value": { "end": "/text()[2]", "text": "speed", "start": "/text()[2]", "labels": ["speed: train speed profile"], "endOffset": 364, "startOffset": 359, "globalOffsets": { "end": 1403, "start": 1398 } }, "origin": "manual", "to_name": "text", "from_name": "ner" },</code></pre> <p> </p> <p><strong>Important Json attributes to consider</strong></p> <p><strong>Meta</strong></p> <p>We encode the relevance of each result in its metadata.</p> <p><em>Example:</em></p> <pre><code class="language-json">"meta": { "text": ["0"] },</code></pre> <ul> <li>1 = relevant for this search and found by PKS</li> <li>0 = irrelevant for this search but found by PKS</li> <li>-1 = relevant for this search and not found by PKS</li> </ul> <p> </p> <p><strong>Labels</strong></p> <p>This element is the search identifier we use in Label Studio. It corresponds to the table in the thesis that describes each search in detail.</p> <p><em>Example:</em></p> <pre><code class="language-json">"labels": ["speed: train speed profile"],</code></pre> <p> </p> <p><strong>GlobalOffsets</strong></p> <p>"globalOffsets" describes the position of a label in the text.</p> <p><em>Example:</em></p> <pre><code class="language-json">"globalOffsets": { "end": 1403, "start": 1398 }</code></pre> <p> </p>
Chirila: Language Data Files
<p>Archival data export of Chirila database files, version Jan 2, 2022 (prior to migration out of filemaker pro</p> <p>Funded by NSF grants BCS-0844550 and BCS-1423711</p>
Data for: Unraveling the influence of essential climatic factors on the number of tones through an extensive database of languages in China
Open the record for dataset details and reuse information.
Data from: experiment using Large Language Models for unit testing generation
Open the record for dataset details and reuse information.
WMT-SLT FocusNews: Training data for the WMT shared task on sign language translation
<p>This is data from a former Deaf online TV channel, FocusFive. We provide news episodes (FocusNews) that were broadcast between 2008 and 2014. Each episode is about 5 minutes long. For a more extended description of the data, visit <a href="https://www.wmt-slt.com/data">https://www.wmt-slt.com/data.</a></p>
WMT-SLT SRF: Training data for the WMT shared task on sign language translation (poses)
<p>These are Standard German daily news (Tagesschau) and Swiss German weather forecast (Meteo) episodes broadcast and interpreted into Swiss German Sign Language by hearing interpreters (among them, children of Deaf adults, CODA) via Swiss National TV (Schweizerisches Radio und Fernsehen, SRF) (<a href="https://www.srf.ch/play/tv/sendung/tagesschau-in-gebaerdensprache?id=c40bed81-b150-0001-2b5a-1e90e100c1c0">https://www.srf.ch/play/tv/sendung/tagesschau-in-gebaerdensprache?id=c40bed81-b150-0001-2b5a-1e90e100c1c0</a>). For a more extended description of the data, visit <a href="http://These are Standard German daily news (Tagesschau) and Swiss German weather forecast (Meteo) episodes broadcast and interpreted into Swiss German Sign Language by hearing interpreters (among them, children of Deaf adults, CODA) via Swiss National TV (Schweizerisches Radio und Fernsehen, SRF) (https://www.srf.ch/play/tv/sendung/tagesschau-in-gebaerdensprache?id=c40bed81-b150-0001-2b5a-1e90e100c1c0). For a more extended description of the data, visit https://www.wmt-slt.com/data.">https://www.wmt-slt.com/data</a>.</p> <p> </p> <p> </p>
Accompanying data distribution for "Contextualizing biological perturbation experiments through language"
<p>Please see the README.md file.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.