Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
33
datasets available to search
ShareScore release 0.9.0
Dataset results
33 results for “machine learning, training data”
Data deposit accompanying Accurate Energy Barriers for Catalytic Reaction Pathways: An Automatic Training Protocol for Machine Learning Force Fields
<p>Dataset accompanying the paper: <em>"Accurate Energy Barriers for Catalytic Reaction Pathways: An Automatic Training Protocol for Machine Learning Force Fields"</em>. Contains the training sets curated during active learning as well as .xyz files used for creating the Figures. <br> <br> The paper highlights that the computational efficiency of ML force fields not only results in decreased computational costs for routine catalytic investigations but also facilitates more comprehensive exploration of catalytic pathways.</p> <p><strong>Published in NPJ Computational Materials</strong>: <a href="https://www.nature.com/articles/s41524-023-01124-2">https://www.nature.com/articles/s41524-023-01124-2</a><br> Formerly on Arxiv: <a href="https://arxiv.org/abs/2301.09931">https://arxiv.org/abs/2301.09931</a></p>
Weather data (forecast and observation) at three locations in France over 2021 for Machine Learning Training
<p>The data provided data are historical weather measurement and forecast at three location in France.</p> <p>Measurements are inside files named OBS_xxx</p> <p>Forecasts are inside files names YYY_xxx, with YYY is the name of the forecast simultion (GFS0.25, WRF12km or WRF3KM).</p> <p>In the two cases, xxx is the name of the site (Site 1, Site2 or Site3).</p> <p><br> <strong>Description of OBS_xxx files:</strong><br> - One line per measurement with hourly resolution<br> - columns are: Date(TU),Temperature2m_degC,WindSpeed10m_m/s,WindDirection10m_m/s<br> Date = date of measurement in TU and format DD/MM/YYYY HH:MM<br> Temperature2m_degC = air temperature at 2m height in °Celsius<br> WindSpeed10m_m/s = wind speed at 10m height in m/s<br> WindDirection10m_deg = wind direction at 10m height in deg. (0 or 360 = wind from north to south, 45°=wind from east to east, ....)<br> If measurement is not available for a specific hour for one parameter, the value "-999" is used.</p> <p>The observation data go:<br> from 16/04/2021 00H <br> to 31/01/2022 23H</p> <p><br> <strong>Description of YYY_xxx files:</strong><br> - One line per forecast with hourly resolution<br> - columns are: First date run (TU),forecast hour,Temperature2m_degC,WindSpeed10m_m/s,WindDirection10m_m/s<br> First date run (TU) = date of start of the forecast in TU and format DD/MM/YYYY HH:MM. HH could be 00 and 12 according to the cycle of forecast start.<br> forecast hour = forecast hour from the start of the forecast date. 00 = forecast for "first date run". 01 = forecast for "First date run" + 1 hour. .... 95 = forecast for "First date run" + 95 hours.<br> For GFS0.25, forecast hour go from 00 to 95<br> For WRF12km, forecast hour go from 00 to 95<br> For WRF3m, forecast hour go from 00 to 95<br> Temperature2m_degC = air temperature at 2m height in °Celsius<br> WindSpeed10m_m/s = wind speed at 10m height in m/s<br> WindDirection10m_deg = wind direction at 10m height in deg. (0 or 360 = wind from north to south, 45°=wind from east to east, ....)<br> If measurement is not available for a specific hour for one parameter, the value "-999" is used.</p> <p>The forecast data go:<br> from 13/04/2021 00H + 72H = first forecast for the 16/04/2021 00H<br> to 31/01/2022 12H + 11H = last forecast for the 31/01/2022 23H</p>
Cellpose training data and scripts from "Machine learning for histological annotation and quantification of cortical layers"
<p>This Workflow contains all the material necessary to reproduce the cells detection, thanks to the QuPath performed in the paper</p> <p> "<strong>Machine learning for histological annotation and quantification of cortical layers</strong>"</p> <p>Inside this workflow and dataset, you will find the following folders</p> <ol> <li><strong>QuPath Training Project</strong>: A QuPath 0.5.0 project containing all the manual annotations (ground truths) used to train the cellpose model, as well as the script to start the training</li> <li><strong>Training Images</strong> and <strong>Demo Images</strong>: The raw whole slide scanner images needed by the above QuPath project</li> <li><strong>Model</strong>: The fodler containing the trained cellpose model</li> <li><strong>cellpose-training Folder</strong>: The exported raw and ground truth images that the above cellpose model was trained on</li> <li><strong>Scripts</strong>: The QuPath scripts, also located in their respective QuPath projects, that were created for this whole workflow</li> <li><strong>QC</strong>: A Jupyter notebook, based on ZeroCostDL4Mic that computes quality metrics in order to assess the performance of the trained cellpose model. The folder also contains the resulting metrics.</li> </ol> <p>Installation and Use</p> <p>If you are going to use the QuPath projects, you need a local QuPath Installation https://qupath.github.io/ that is configured to run the QuPath Cellpose Extension https://github.com/BIOP/qupath-extension-cellpose as well as a working Cellpose installation https://github.com/MouseLand/cellpose</p> <p>Instructions for installation are available from the links above.</p> <p>After that, you should be able to open the QuPath project, navigate to the "Automate > Project scripts" menu and locate the script you wish to run.</p> <p><br>1. train a cell segmentation algorithm in the context of the rat brain Layer <br>Boundaries project </p> <p>2. trigger cell segmentation from a QuPath project in a semi-automated pipeline</p>
2021 UN Open GIS Challenge 1 - Training on Satellite Data Analysis and Machine Learning with QGIS (Satellite_QGIS)
<p>This dataset is part of the <a href="https://www.osgeo.org/foundation-news/2021-osgeo-un-committee-educational-challenge/?fbclid=IwAR0UvwkPO2pay7C0tJawb63eewjBGfeL9TIQpYUFccza9OIo6HAolmHXLWE">2021 UN Open GIS Challenge 1 - Training on Satellite Data Analysis and Machine Learning with QGIS (Satellite_QGIS)</a>,</p> <p>Exercise 1: Supervised Change Detection: Monitoring deglaciation in Huascaran, Peru.</p>
Training data from: Machine learning predicts which rivers, streams, and wetlands the Clean Water Act regulates
Open the record for dataset details and reuse information.
Data and code for training and evaluating machine learning models for thunderstorm prediction from reanalysis data
<p>FIXED Data and Python code for training and evaluating machine learning models for predicting thunderstorms, associated with the paper:</p> <p>"Evaluation of machine learning classifiers for predicting deep convection"</p> <p>by Peter Ukkonen and Antti Mäkelä (to appear in JAMES)</p> <p>The data (preprocessed inputs and outputs) is stored as netCDF files and .mat files which can be loaded with Python. </p>
Global snow water equivalent product derived from machine learning model trained with in situ measurement data
<p>This dataset is a global snow water equivalent dataset using machine learning trained with in-situ measurements. The temporal resolution of the SWEML product is daily, and the spatial resolution is 0.25˚ (approximately 25km). It covers latitudes of 90S to 90N and longitudes of 180W to 180E with global scales, excluding Antarctica. The dataset is provided in NetCDF format, organized by year. Each year contains daily SWE data, including leap days in leap years.</p>
Automated bio-AFM generation of large mechanome data set and their analysis by machine learning to classify prostatic cell lines_Training base 100 PC3-GFP
Open the record for dataset details and reuse information.
Data for the paper "PETScML: Second-Order Solvers for Training Regression Problems in Scientific Machine Learning"
Open the record for dataset details and reuse information.
Weather data (forecast and observation) at 48 locations in France for beginning of 2024 for Machine Learning Training
<p>The data provided data are historical weather measurement and forecast at 48 locations in France and its boundary.</p> <p>Measurements are inside files named MES_YYYY.csv with YYYY is the id code of the station.</p> <p>The file "Station_list.csv" contains the list of the 45 locations with the id code, the name and then the latitude and longitude.</p> <p><br>Forecasts are inside files named XXX_YYYY.csv with YYYY the id code corresponding of the location of the grid ouput close to the associated observation location.<br>XXX is the id of the numerical forecast:<br> "GFS0.25-Complet" for GFS file at 0.25° resolution<br> "LEXIS" for WRF produced by EVEREST project using the LEXIS chain<br> "WRF3KM-Complet" for WRF at 3km resolution produced by NUMTECH<br> "WRF12KM-Complet" for WRF at 12km resolution produced by NUMTECH</p> <p><br>Description of MES-YYYY files:<br>- One line per measurement with hourly resolution<br>- columns are: Date(TU),Temperature2m_degC,WindSpeed10m_m/s,WindDirection10m_m/s<br> Date = date of measurement in TU and format DD/MM/YYYY HH:MM<br> Temperature2m_degC = air temperature at 2m height in °Celsius<br> WindSpeed10m_m/s = wind speed at 10m height in m/s<br> WindDirection10m_deg = wind direction at 10m height in deg. (0 or 360 = wind from north to south, 45°=wind from east to east, ....)<br>If measurement is not available for a specific hour for one parameter, the value "-999" is used.</p> <p>The observation data gocfrom 28/01/2024 00HTU to 17/03/2024 23HTU</p> <p><br>Description of XXX_YYYY forecast files:<br>- One line per forecast with hourly resolution<br>- columns are: First date run (TU),Forecast date,Temperature2m_degC,WindSpeed10m_m/s,WindDirection10m_m/s<br> First date run (TU) = date of start of the forecast in TU and format DD/MM/YYYY HH:MM. HH could be 00 and 12 according to the cycle of forecast start.<br> Forecast date = date of the forecast in TU and format DD/MM/YYYY HH:MM. HH go from 00 to 23. <br> Temperature2m_degC = air temperature at 2m height in °Celsius<br> WindSpeed10m_m/s = wind speed at 10m height in m/s<br> WindDirection10m_deg = wind direction at 10m height in deg. (0 or 360 = wind from north to south, 45°=wind from east to east, ....)<br>If forecast is not available for a specific hour for one parameter, the value "-999" is used.</p> <p>The forecast data go from 28/01/2024 00HTU to 17/03/2024 23HTU</p>
Training data for "Machine learning: classification and regression"
<p>The data provided here are part of a Galaxy Training Network tutorial for "Machine learning: classification and regression".</p>
Training data composition determines machine learning generalization and biological rule discovery
<p>Github: https://github.com/csi-greifflab/negative-class-optimization</p> <p>Preprint: https://www.biorxiv.org/content/10.1101/2024.06.17.599333v1</p>
Code and extensive data for training neural networks for radiation, used in "Implementation of a machine-learned gas optics parameterization in the ECMWF Integrated Forecasting System: RRTMGP-NN 2.0""
<p>Data and code used in a paper submitted to JAMES titled :<em> Implementation of a machine-learned gas optics parameterization in the ECMWF Integrated Forecasting System</em></p> <p>1) The files <strong>ml_training_*.7z</strong> contain extensive datasets (in NetCDF format) for training neural network versions of the RRTMGP gas optics scheme as described in the paper. The datasets are read by <a href="https://github.com/peterukk/rte-rrtmgp-nn/blob/main/examples/rrtmgp-nn-training/ml_train.py">ml_train.py.</a></p> <p>2) The ML datasets were in turn generated using the input profiles (in NetCDF format) inside <strong>inputs_to_RRTMGP.zip </strong>by running the Fortran programs <code>rrtmgp_sw_gendata_rfmipstyle.F90 and rrtmgp_lw_gendata_rfmipstyle.F90 </code>in <em>rte-rrtmgp-nn/examples/rrtmgp-nn-training</em>, which call the RRTMGP gas optics scheme, The input profiles contain <strong>millions of columns, hundreds of perturbation experiments (including hypercube-sampled gas concentrations), are derived from several different data sources (including CAMS reanalysis, GCM, and CKDMIP-MMM), and span present-day, preindustrial, and future atmospheric conditions.</strong> They could be used to generate training data for developing emulators of the full RTE+RRTMGP radiation scheme, not just gas optics (see nn_dev on the <a href="https://github.com/peterukk/rte-rrtmgp-nn">RTE+RRTMGP-NN repository on Github</a>, used in a previous paper where different emulation methods were compared)</p> <p>3) The Fortran and Python code used for data generation and NN training are found in<a href="https://github.com/peterukk/rte-rrtmgp-nn/tree/main/examples/rrtmgp-nn-training"> <em>rte-rrtmgp-nn/examples/rrtmgp-nn-training</em> </a>on the main branch on Github; <strong>an archived version is also included here </strong>(<strong>rte-rrtmgp-nn-2.0.zip</strong>). See the readme in the above sub-directory for further information.</p> <p> </p>
Data from: Training data from SPCAM for machine learning in moist physics
Open the record for dataset details and reuse information.
MME-only models trained with clean data for JAMES paper "Machine-learned uncertainty quantification is not magic"
<p>This tar file contains all 100 trained models in the MME-only ensemble from Experiment 1 (i.e., those trained with clean data, not with lightly perturbed data). To read one of the models into Python, you can use the method neural_net.read_model in the ml4rt library.</p>
MME-only models trained with lightly perturbed data for JAMES paper "Machine-learned uncertainty quantification is not magic"
<p>This tar file contains all 100 trained models in the MME-only ensemble from Experiment 2 (i.e., those trained with lightly perturbed data). To read one of the models into Python, you can use the method neural_net.read_model in the ml4rt library.</p>
MME/CRPS models trained with clean data for JAMES paper "Machine-learned uncertainty quantification is not magic"
<p>This tar file contains all 100 trained models in the MME/CRPS ensemble from Experiment 1 (i.e., those trained with clean data, not with lightly perturbed data). To pare the ensemble down to 50 models, we randomly select 50. To read one of the models into Python, you can use the method neural_net.read_model in the ml4rt library.</p>
MME/CRPS models trained with lightly perturbed data for JAMES paper "Machine-learned uncertainty quantification is not magic"
<p>This tar file contains all 100 trained models in the MME/CRPS ensemble from Experiment 2 (i.e., those trained with lightly perturbed data). To pare the ensemble down to 50 models, we randomly select 50. To read one of the models into Python, you can use the method neural_net.read_model in the ml4rt library.</p>
Potential and training data for 'Structure-property relations of silicon oxycarbides studied using a machine learning interatomic potential'
<p>Fitted potential, training and testing data.</p>
AIMD training data for H2 adsorption on MoxCy facets for machine learning model
<p>This data is used to train the MACE model for modeling hydrogen dissociation on molybdenum carbide surfaces.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.