Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
558
datasets available to search
ShareScore release 0.7.1
Dataset results
558 results for “training data”
Dataset of behavioral and neurophysiological data of a virtual sailing task published in: "Providing task instructions during motor training enhances performance and modulates attentional brain networks"
<p>Dataset belonging to the behavioral and neurophysiological data of the publication: "Providing task instructions during motor training enhances performance and modulates attentional brain networks". The two uploaded Zip files contain kinematic and electroencephalographic data of 36 participants for the Obstacle and HorizonTask.</p>
Generated Data for the Manuscript "Nonideality-Aware Training for Accurate and Robust Low-Power Memristive Neural Networks"
<p>The file contains data generated and referred to in the text and the figures of the manuscript.</p>
Training data for 'Preparing genomic data for phylogeny reconstruction' (Galaxy Training Material)
<p>This data is used for Galaxy Training Network training 'Preparing genomic data for phylogeny reconstruction'. There are four nucleotide sequences from chromosome 5 of four strains of S. cerevisiae. The GenBank annotated sequenced were produced using 'funannotate predict annotation' (Galaxy Version 1.8.9+galaxy2) on the nucleotide sequences sequences. References: DOI: 10.1126/science.274.5287.546; DOI: 10.1126/science.1189015; DOI: 10.1016/j.cell.2016.08.020</p>
POC detection training data and weights
<p>The data and labels used to train the POC detection <a href="https://github.com/climate-processes/poc-detection">algorithm </a>used in support of this publication: https://doi.org/10.1029/2020GL092213. The associated model weights were also saved after training to aid reproducibility.</p>
Phase Object Reconstruction for 4D-STEM using Deep Learning, (4D-STEM Training Data)
<p><strong>Overview </strong></p> <p>This repository contains 742,688 samples of simulated Convergent Beam Electron Diffraction patterns (CBEDs); the training data for the paper <a href="https://arxiv.org/abs/2202.12611">"Phase Object Reconstruction for 4D-STEM using Deep Learning"</a>. The folder contains multiple hdf5 datasets. Each dataset has a corresponding Excel-sheet containing detailed information and simulation parameters for every datapoint, as well as a summary-report containing the parameter distributions, hdf5-infos and random number generator settings. This makes every dataset reproducible, using the simulation codes provided in <a href="https://github.com/ThFriedrich/ap_data_generation">https://github.com/ThFriedrich/ap_data_generation</a>.</p> <p><strong>Technical details</strong></p> <p>Every Datapoint consists of a 3x3 set of adjacent Convergent Beam Electron Diffraction pattern (CBEDs), the coherent exit wave phase and amplitude in real and reciprocal space, and the probe functions phase and amplitude in real space. All patterns are 64x64 pixel in 16 bit unsigned integer data format.</p> <p>Every hdf5 file has the following structure:</p> <table> <tbody> <tr> <td>Attributes</td> <td>'Seed': 6108236<br> 'State': 251786606 ...<br> 'Type': 'twister'<br> 'arch': 'glnxa64'<br> 'gpu': 'NVIDIA GeForce RTX 3080'<br> 'matlab_ver': '2021a'</td> </tr> <tr> <td>Dataset 'features'</td> <td> <p>Size: 64x64x9x5000<br> Datatype: H5T_STD_U16LE (uint16)</p> </td> </tr> <tr> <td>Dataset 'labels_k'</td> <td> <p>Size: 64x64x2x5000<br> Datatype: H5T_STD_U16LE (uint16)</p> </td> </tr> <tr> <td>Dataset 'labels_r'</td> <td> <p>Size: 64x64x2x5000<br> Datatype: H5T_STD_U16LE (uint16)</p> </td> </tr> <tr> <td>Dataset 'probe_r'</td> <td> <p>Size: 64x64x2x5000<br> Datatype: H5T_STD_U16LE (uint16)</p> </td> </tr> <tr> <td>Dataset 'meta'</td> <td> <p>Size: 19x5000<br> Datatype: H5T_IEEE_F32LE (single)</p> </td> </tr> </tbody> </table> <p>The data was written to hdf5 in matlab. When reading from these files consider possibly different storage conventions (Row major vs. column major format). Data may need to be transposed accordingly. The integer arrays were scaled to use the full range of the uint16 datatype. The scaling values are stored under "meta". To restore the original values in floating point numbers, convert the arrays like this:</p> <p>Matlab:</p> <pre><code>hdf_file = ['db_h5_b_5_Training.h5']; n = 128; % load `n` k-space exit waves x = single(h5read(hdf_file, '/labels_k', [1,1,1,1], [64,64,2,n])); % `meta` contains parameters and scaling factors for a given datapoint in following order: [E_0(keV), cond_lens_outer_aper_ang(mrad), collection angle(rA), step_size(A), scale_cbed_1 ... scale_cbed_9, scale_phase_k, scale_amp_k, scale_phase_r, scale_amp_r, scale_probe_phase_r, scale_probe_amp_r] s = h5read(hdf_file, '/meta', [14,1], [2,n]); amplitude = zeros(64,64,n); phase = zeros(64,64,n); for ix = 1:n phase(:,:,n) = (x(:,:,1,n)*s(1,ix) / 65536) - pi; amplitude(:,:,n) = (x(:,:,2,n)*s(2,ix)) / 65536; end % The 9 CBEDs correspond to a 3x3 kernel of patterns. The order in [x,y] is: %[[3, 6, 9]; % [2, 5, 8]; % [1, 4, 7]] </code></pre>
StarDist Adipocyte Segmentation Training data, Training Notebook and Model
<p>Data from H&E human bone marrow whole slide scanner images used in the paper: "MarrowQuant 2.0: a digital pathology workflow assisting bone marrow evaluation in clinical and experimental hematology" (https://doi.org/10.21203/rs.3.rs-1860140/v1)</p> <p> </p> <p>292 image patches</p> <p>Ground truth were manually annotated using QuPath and split into 263 images for training and 29 for validation.</p> <p>Training in StarDist was done on a Windows 10 PC with an RTX 2080 GPU. The requirements file for installing a Python 3.7 environment to run the attached notebooks is provided (<strong>stardist-val.txt</strong>).</p> <p>The StarDist model configuration can be found in the Jupyter Notebook :</p> <pre><code>Adipocyte Training.ipynb</code></pre> <p>Model validation and metrics can be performed by running the notebook after finishing the <strong>Adipocyte Training</strong> notebook.</p> <pre><code>Quality Control.ipynb</code></pre> <p> </p>
Data and analysis supplement for: Functional imagery training versus motivational interviewing for weight loss: a randomised controlled trial of brief individual interventions for overweight and obesity.
<p>This submission provides the data and code for analyses reported in our publication.</p>
Big Data to Knowledge (BD2K) Training Coordinating Center (TCC) Educational Resource Discovery Index (ERuDIte) as Linked Data
<p>This is a release of the Big Data to Knowledge (BD2K) Training Coordinating Center (TCC) Educational Resource Discovery Index (ERuDIte) as Linked Data.<br> <br> ERuDIte contains over 11,000 training resources on data science including courses (MOOCs), video tutorials, conference talks, and other materials. The metadata of these resources is described uniformly using schema.org. In addition, we use machine learning techniques to tag each resource with concepts from the Data Science Education Ontology (DSEO), which we developed to further describe the contents of the training resources. Resource relevance and tags are curated by experts to ensure high quality. Finally, we map the references to people and organizations in the learning resource metadata to entities in DBpedia, DBLP, and ORCID, thus embedding our collection in the web of linked data. Our collection is continually growing. We hope that ERuDIte will provide a framework to foster open linked educational resources on the web.<br> <br> Distributed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (https://creativecommons.org/licenses/by-nc-sa/4.0/)</p>
Data files for In situ training of feedforward and recurrent convolutional memristor networks
<p>MATLAB data files for the manuscript "<em>In situ training of feedforward and recurrent convolutional memristor networks" </em>published on Nature Machine Intelligence, 2019.</p> <p>The MATLAB data file "exp_mnist.mat" consists of all experimental data on implementing the convolutional neural network with the 1-transistor 1-memristor array that is used for plotting the Figure 1 and 2 of the manuscript.</p> <p>The MATLAB data file "exp_mnistsequence.mat" consists of all experimental data on implementing the convolutional long short-term memory network on the 1-transistor 1-memristor array that is used for plotting the Figure 3 and 4 of the manuscript.</p> <p>The code that generated these data files are provided by the link within the manuscript. Alternatively, the code can be accessed via <a href="https://github.com/zhongruiwang/memristorCNN">https://github.com/zhongruiwang/memristorCNN</a>.</p>
Eleven years of training data for south foehn for two valleys in the Eastern Alps
<p>This south foehn training data is suited for machine learning purposes. </p> <p>It was created by applying objective foehn classification (OFC, Vergeiner 2004) on hourly data of various stations in the Eastern Alps in Austria. The two valleys Rhine and Inn and two intensities are available on a daily basis, where</p> <ul> <li>0.0 means no foehn on that day,</li> <li>0.5 means localised foehn on that day (at least one third and up to half the stations in the region responded to OFC),</li> <li>1.0 means widespread foehn on that day (more than half the stations in the region responded to OFC),</li> </ul> <p>provided for each valley individually.</p> <p>A paper, where the process of creation is described, is in preperation and will be linked as soon as it is reviewed. </p>
SAGE Rejected Article Tracker Training Data
<p>The enclosed dataset shows metadata for ArXiv preprints uploaded to ArXiv in 2012.</p> <p>For each preprint, there are 2 rows of search data:</p> <ul> <li>ArXiv preprint metadata plus the CrossRef API data for the <em>correct</em> search result (which is the metadata for the published version of that preprint).</li> <li>ArXiv preprint metadata and the metadata for the top <em>incorrect</em> CrossRef API search result for the title and author-names associated with the preprint.</li> </ul> <p>ArXiv preprints are referred to as 'query' documents and CrossRef documents are referred to as 'match' documents.</p> <p>This dataset is created using the <a href="https://github.com/sagepublishing/rejected_article_tracker_pkg">SAGE Rejected Article Tracker</a> and is supplementary to that project. Similar custom datasets can be created using the SAGE Rejected Article Tracker with different parameters (e.g. different timeframes).</p>
Named-Entity Recognition for Modern Tibetan Newspapers: Tagset, Guidelines and Training Data
<p>This dataset, tagset and guidelines were the output of a six-month incubator project on the feasibility of developing Named-Entity Recognition (NER) for modern Tibetan, primarily for use with contemporary Tibetan-language newspapers and media published inside the PRC. The project was carried out by the Mongolian and Inner Asian Studies Unit at Cambridge University’s Department of Social Anthropology. It was funded by an incubator grant from Cambridge Language Sciences. The project title was “Named-Entity Recognition in Tibetan and Mongolian Newspapers.” The Project PI was Dr Hildegard Diemberger (Cambridge), the Coordinator and Lead Author was Dr Robert Barnett (SOAS), and Senior Advisers were Dr Nathan Hill (SOAS), Dr Marieke Meelen (Cambridge), and Dr Thomas White (Cambridge). <br> <br> Although some forms of NER and other NLP procedures have been developed within China for modern Tibetan (see Liu, Nuo <em>et al</em>, 2011), the data underlying those initiatives have not been made publicly available and their findings cannot be tested or reproduced. Significant work on developing NLP for Tibetan has been carried out outside China, but has focused largely on classical Tibetan and religious texts (see Hill & Garrett, Edward, 2017). </p> <p>The Cambridge incubator project therefore produced a tagset, guidelines and training data for developing NER for modern Tibetan, with a focus on historical and political analysis of contemporary newspapers, media and other public documents in Tibetan. We compiled 3.11m syllables of data in Tibetan extracted from articles downloaded from Chinese-language news aggregator sites within China, primarily tibet.cpc.people.com.cn and tibet.people.com.cn. From this data, we selected texts containing 280,000 syllables in Tibetan, grouped in 26,000 utterances/sentences (available on request). Using Lighttag, an online annotation site, we developed a tagset for NER consisting of 17 tags (and one for wrong segmentation if using segmented data). We annotated approximately 186,000 syllables, leading to 9,884 annotations. Of these, after discounting flawed data, we produced training data containing c.6,700 annotations. We carried out the secondary, manual review offline (for our method of converting Lighttag data for offline review, see the attached report “Using Spreadsheets to Review Annotations Offline.pdf”), and found an error rate of 3.6%. The final total of reviewed annotations was 6,624. </p> <p>The dataset, tagset, guidelines and reports were developed and documented by Robert Barnett, with assistance from Tsering Samdrup, Dr Hill and Dr Meelen. Primary annotation was by Tsering Samdrup, assisted by Dr Barnett.<br> <br> The datasets published here include: </p> <ol> <li>The <strong>tagseet guidelines and annotation manual</strong>, including the 17-tag tagset, guidelines, and recommendations ("NER for Modern Tibetan-tagset and guidelines.pdf").</li> <li>The <strong>tagged training data </strong>in .csv format ("Tibetan NER Training Data-tagged, reviewed wth context-v10-UTF-8.csv") and .xls format ("Tibetan NER Training Data-tagged with context-v10-UTF-8.xlsx"). This includes 6,624 reveiwed annotations, arranged according to the Tibetan alphabet together with the tags and context (utterance) for each annotation.</li> <li>The <strong>raw annotation results </strong>downloaded from Lighttag as .json files ("Raw Training Data for NER in Modern Tibetan -Jobs2-11-JSON.zip") and as .xls files ("Training Data for NER in Modern Tibetan -Jobs2-11-XLS.zip"). These include 10 "tasks" or datasets of articles scraped from Tibetan-language websites within Tibet. </li> <li>A <strong>guide to preparing Lighttag annotation results for manual review offline </strong>(“Using Spreadsheets to Review Annotations Offline.pdf”).</li> </ol> <p>The project's findings regarding the status of NER and NLP for vertical Mongolian are available at DOI: 10.5281/zenodo.5103499.</p>
Data for Project 'Feasibility, Usability and Acceptance of a Newly Developed Exergame-Based Training Concept for Older Adults with Mild Neurocognitive Disorder - A Pilot Randomized Controlled Trial'
<p>Data for Project 'Feasibility, Usability and Acceptance of a Newly Developed Exergame-Based Training Concept for Older Adults with Mild Neurocognitive Disorder - A Pilot Randomized Controlled Trial' (trial registered at clinicaltrials.gov (<a href="https://clinicaltrials.gov/ct2/show/NCT04996654">NCT04996654</a>; date of registration: 11 July 2021), consisting of:</p> <p>(1) the original and complete data set for all primary outcomes ('Data_Primary-Outcomes_Brain-IT-Pilot-Feasibility-RCT_for-publication.xlsx');</p> <p>(2) the original and complete data set for all secondary outcomes ('Data_Secondary-Outcomes_Brain-IT-Pilot-Feasibility-RCT_for-publication.xlsx');</p> <p>(3) the original and complete data set for all other outcomes (i.e. baseline factors (demographic data, type of usual care interventions) and training heart rate; 'Data_Other-Outcomes_Brain-IT-Pilot-Feasibility-RCT_for-publication.xlsx');</p> <p>(4) folder including the raw and processed heart rate variability (HRV) and electroencephalography (EEG) data for all participants and measurements (HRV-and-EEG_raw-and-processed-data.zip);</p> <p>(5) a corresponding README file including (a) general information, (b) data and file overview, (c) sharing and access information, (d) methodological information, and (e) data-specific information.</p>
ShiftCrypt training data set for training ConforMine
<p>Data set containing the ShiftCrypt values of the proteins used for training ConforMine. This set is not to be confused the the Molecular Dynamics (MD) data set, also used for training of this model. </p> <p>The data set also contains a python script which recreates the filtering of sequences performed in the training steps of ConforMine, which discards all proteins for which no valid ShiftCrypt predictions were obtained. </p>
Galaxy Training Material for Mass spectrometry: GC-MS data processing (with XCMS, RAMClustR, RIAssigner, and matchms)
<p>This dataset contains the training data for the <strong>Mass spectrometry: GC-MS data processing (with XCMS, RAMClustR, RIAssigner, and matchms)</strong> GTN tutorial. It includes 3 GC-[EI+]-HRMS files from seminal plasma samples, the RECETOX Metabolome HR-[EI+]-MS library collected from mostly endogoenous compounds from MetaSci Human Metabolite Library, reference alkanes, sample metadata table, and preprocessed XCMS object.</p>
Data deposit accompanying Accurate Energy Barriers for Catalytic Reaction Pathways: An Automatic Training Protocol for Machine Learning Force Fields
<p>Dataset accompanying the paper: <em>"Accurate Energy Barriers for Catalytic Reaction Pathways: An Automatic Training Protocol for Machine Learning Force Fields"</em>. Contains the training sets curated during active learning as well as .xyz files used for creating the Figures. <br> <br> The paper highlights that the computational efficiency of ML force fields not only results in decreased computational costs for routine catalytic investigations but also facilitates more comprehensive exploration of catalytic pathways.</p> <p><strong>Published in NPJ Computational Materials</strong>: <a href="https://www.nature.com/articles/s41524-023-01124-2">https://www.nature.com/articles/s41524-023-01124-2</a><br> Formerly on Arxiv: <a href="https://arxiv.org/abs/2301.09931">https://arxiv.org/abs/2301.09931</a></p>
Training data for 'Exome sequencing data analysis' tutorial (Galaxy Training Material)
<p>The data used in this tutorial are a subset of the data published previously in <a href="https://zenodo.org/record/3243160">Training material for the course "Exome analysis with GALAXY"</a>. Credit for uploading the original data goes to Paolo Uva and Gianmauro Cuccuru!</p> <p>Specifically, you may need the following datasets for following the tutorial:</p> <p><strong>Raw sequencing reads</strong></p> <ul> <li><a href="https://zenodo.org/record/3243160/files/father_R1.fq.gz?download=1">https://zenodo.org/record/3243160/files/father_R1.fq.gz</a></li> <li><a href="https://zenodo.org/record/3243160/files/father_R2.fq.gz?download=1">https://zenodo.org/record/3243160/files/father_R2.fq.gz</a></li> <li><a href="https://zenodo.org/record/3243160/files/mother_R1.fq.gz?download=1">https://zenodo.org/record/3243160/files/mother_R1.fq.gz</a></li> <li><a href="https://zenodo.org/record/3243160/files/mother_R2.fq.gz?download=1">https://zenodo.org/record/3243160/files/mother_R2.fq.gz</a></li> <li><a href="https://zenodo.org/record/3243160/files/proband_R1.fq.gz?download=1">https://zenodo.org/record/3243160/files/proband_R1.fq.gz</a></li> <li><a href="https://zenodo.org/record/3243160/files/proband_R2.fq.gz?download=1">https://zenodo.org/record/3243160/files/proband_R2.fq.gz</a></li> </ul> <p><strong>Premapped sequencing reads</strong></p> <ul> <li><a href="https://zenodo.org/record/3243160/files/mapped_reads_father.bam?download=1">https://zenodo.org/record/3243160/files/mapped_reads_father.bam</a></li> <li><a href="https://zenodo.org/record/3243160/files/mapped_reads_mother.bam?download=1">https://zenodo.org/record/3243160/files/mapped_reads_mother.bam</a></li> <li><a href="https://zenodo.org/record/3243160/files/mapped_reads_proband.bam?download=1">https://zenodo.org/record/3243160/files/mapped_reads_proband.bam</a></li> </ul> <p><strong>Reference sequence (human chromosome 8)</strong></p> <ul> <li><a href="https://zenodo.org/record/3243160/files/hg19_chr8.fa.gz?download=1">https://zenodo.org/record/3243160/files/hg19_chr8.fa.gz</a></li> </ul> <p> </p> <p>If you would just like to play with GEMINI rather than work through the full tutorial, you'll find below a prebuilt GEMINI database (for GEMINI version 0.20.1) for the family trio. You can start exploring this database without having to run GEMINI load and, in fact, without having to install GEMINI's bundled annotation data.</p>
Training Data for 'ewas_suite' Analysis
<p>The data provided here are part of a Galaxy Training Network tutorial that analyzes EWAS data from a study published by Hugo, Willy, et al., 2015 (DOI: <a href="https://doi.org/10.1016/j.cell.2015.07.061">10.1016/j.cell.2015.07.061</a>) to identify differentially methylated regions and positions associated with melanoma MAPKi resistance.</p>
Netflow data without sampling for training (D1)
<p>NetFlow traffic generated using <strong>DOROTHEA</strong> (<strong>DO</strong>cker-based f<strong>R</strong>amework f<strong>O</strong>r ga<strong>TH</strong>ering n<strong>E</strong>tflow tr<strong>A</strong>ffic)</p> <p>NetFlow is a network protocol developed by Cisco for the collection and monitoring of network traffic flow data generated. A flow is defined as a unidirectional sequence of packets with some common properties that pass through a network device.</p> <p>NetFlow flows have been captured without sampling at the packet level. A sampling means that 1 out of every X packets is selected to be flow while the rest of the packets are not valued.</p> <p>The version of NetFlow used to build the datasets is 5.</p> <p>In the construction of the datasets, different percentages of flows considered attacks and flows considered normal traffic have been used.</p> <p>These datasets have been used to train machine learning models.</p>
Data management planning - Training for trainers, part I-III: answers to per-assignments
<p>The data have been collected as part of data management planning training for trainers. Data consists participants answers to pre-assignments.</p> <p>Consent for data sharing</p> <ul> <li>First session: Consent for datat sharing was asked afterwards by email</li> <li>Second and third session: Consent was asked when collecting answers on the e-form.</li> </ul> <p>The slides of the DMP training fro trainers is available on SlideShare:</p> <ul> <li>Session I: <a href="https://www2.slideshare.net/MariKuusniemi/part-i-data-management-planning-training-for-trainers">https://www2.slideshare.net/MariKuusniemi/part-i-data-management-planning-training-for-trainers</a></li> <li>Session II: <a href="https://www2.slideshare.net/MariKuusniemi/data-management-planning-training-for-trainers-part-ii">https://www2.slideshare.net/MariKuusniemi/data-management-planning-training-for-trainers-part-ii</a></li> <li>Session III: <a href="https://www2.slideshare.net/MariKuusniemi/data-management-planning-training-for-trainers-part-iii">https://www2.slideshare.net/MariKuusniemi/data-management-planning-training-for-trainers-part-iii</a></li> </ul> <p>The training was organised by Tuuli Office.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.