Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
29
datasets available to search
ShareScore release 0.9.0
Dataset results
29 results for “model tuning”
Tuning-less Object Naming with a Foundation Model - Data recorded during testing
<p>We implement a real-time object naming system that enables learning a set of named entities never seen. Our approach employs an existing foundation model that we consider ready to see anything before starting. It turns seen images into relatively small feature vectors that we associate with index to a gradually built vocabulary without any training of fine-tuning of the model. Our contribution is using the association mechanism known from transformers as attention. It has features that support generalization from irrelevant information for distinguishing the entities and potentially enable associating with much more than indices to vocabulary. As a result, the system can work in a one-shot manner and correctly name objects named in different contents. We also outline implementation details of the system modules integrated by a blackboard architecture. Finally, we investigate the<br>system's quality, mainly how many objects it can handle in this way.</p>
Hyperparameter tuning and performance assessment of statistical and machine-learning models using spatial data.
<p>This is a research compendium (RC) for the publication "Hyperparameter tuning and performance assessment of statistical and machine-learning algorithms using spatial data".</p> <p>The code (including figures, appendices and the manuscript) is packed in <strong>pathogen-modeling-3.zip </strong>or can be found directly in the <a href="https://github.com/pat-s/pathogen-modeling">Github repository</a>.</p> <ul> <li><strong>Publication figures</strong>: analysis/paper/submission/3/latex-source-files/</li> <li><strong>Appendices</strong>: analysis/paper/submission/3/</li> </ul> <p>This RC represents a static snapshot at the time of submission. The Github repository will receive changes after the publication was published.</p> <p><strong>Data sources</strong></p> <ul> <li>Atlas Climatico: <a href="http://opengis.uab.es/wms/iberia/index.htm">http://opengis.uab.es/wms/iberia/index.htm</a></li> <li>DEM: ftp://ftp.geo.euskadi.eus/lidar/MDE_LIDAR_2016_ETRS89/</li> <li>Lithology: <a href="http://www.geo.euskadi.eus/geonetwork/srv/spa/main.home">http://www.geo.euskadi.eus/geonetwork/srv/spa/main.home</a></li> <li>pH: <a href="https://esdac.jrc.ec.europa.eu/content/soil-ph-europe#tabs-0-description=0">https://esdac.jrc.ec.europa.eu/content/soil-ph-europe#tabs-0-description=0</a></li> <li>soil: <a href="https://www.isric.org/explore/soilgrids">https://www.isric.org/explore/soilgrids</a></li> </ul> <p><strong>Licenses</strong></p> <p>All files are shared via the given license with the exception of "soil.tif" which is shared via the <strong>ODbL </strong>license<strong>.</strong></p>
Transfer fine-tuned BERT models by paraphrases
<p>Transfer fine-tuned BERT models by phrasal paraphrases. </p> <ul> <li>transferFT_bert-base-uncased.pkl bases on the bert-base-uncased model</li> <li>transferFT_bert-large-uncased.pkl bases on the bert-large-uncased model</li> </ul> <p>For usage, please refer to our GitHub page.</p> <p><a href="https://github.com/yukiar/TransferFT">https://github.com/yukiar/TransferFT</a></p> <p>For details of these models, please refer to our paper.</p> <p>Yuki Arase and Junichi Tsujii. 2019. Transfer Fine-Tuning: A BERT Case Study. in Proc. of Conference on Empirical Methods in Natural Language Processing (EMNLP 2019).</p> <p><a href="https://arxiv.org/abs/1909.00931">https://arxiv.org/abs/1909.00931</a></p>
Data associated to the article "A semiclassical Thomas–Fermi model to tune the metallicity of electrodes in molecular simulations"
<p>Contains input files and data used to generate the figures of the article:</p> <p>A semiclassical Thomas–Fermi model to tune the metallicity of electrodes in molecular simulations</p> <p>Laura Scalfi, Thomas Dufils, Kyle G. Reeves, Benjamin Rotenberg and Mathieu Salanne, J. Chem. Phys. 153, 174704 (2020)</p> <p>https://doi.org/10.1063/5.0028232</p> <p>The folder typical_input_files contains typical MetalWalls input files used to perform the simulations.</p> <p>The folder DATA_FIGURES contains the processed data used to plot all the figures of the paper.</p>
PRICER: Leveraging Few-Shot Learning with Fine-Tuned Large Language Models for Unstructured Economic Data
<p>Describes the taxonomy used in the paper "PRICER: Leveraging Few-Shot Learning with Fine-Tuned Large Language Models for Unstructured Economic Data", presented at the Second Workshop on Semantic Technologies and Deep Learning Models for Scientific, Technical and Legal Data<em> </em>at the Extended Semantic Web Conference (ESWC) 2024.</p>
Processed Sentinel 1, Sentinel 2 and Copernicus Emergency Management Service data for fine tuning and predicting flood extent with IBM's granite-geospatial-uki-flood-detection model
<p>This dataset contains processed Sentinel 1 Sentinel 2 imagery together with flood event labels extracted from the Copernicus Emergency Management Service. It has been assembled to demonstrate fine tuning and inference of flood event segmentation using granite geospatial foundation models developed by IBM Research. Please see <a href="https://huggingface.co/ibm-granite/granite-geospatial-uki-flooddetection">https://huggingface.co/ibm-granite/granite-geospatial-uki-flooddetection</a> for more information on models and use.</p> <p>Sentinel-1</p> <p>The European Space Agency. 2014. Sentinel-1 Mission. <a href="https://sentinel.esa.int/web/sentinel/copernicus/sentinel-1">https://sentinel.esa.int/web/sentinel/missions/sentinel1</a>. Accessed: 2024-11-25.</p> <p>Sentinel-2</p> <p>The European Space Agency. 2015. Sentinel-2 Mission. <a href="https://sentinel.esa.int/web/sentinel/copernicus/sentinel-2">https://sentinel.esa.int/web/sentinel/missions/sentinel2</a>. Accessed: 2024-11-25.</p> <p>Copernicus Emergency Management Service</p> <p><a href="https://emergency.copernicus.eu/mapping/list-of-activations-rapid">https://emergency.copernicus.eu/mapping/list-of-activations-rapid</a>. Accessed: 2024-11-25. </p> <p><strong>Attribution</strong></p> <p>Contains modified Copernicus Sentinel data [2019-2024]</p> <p>Contains modified Copernicus Service information [2019-2023]</p>
Fine-tuning of predictive microbiology models through microlocal characterization of foods by Nuclear Magnetic Resonance (NMR)
<p>Fine-tuning of predictive microbiology models through microlocal characterization of foods by Nuclear Magnetic Resonance (NMR)</p>
Comprehensive large-scale datasets for 26 viral families for fine-tuning BERT-infect models
<p>These datasets were constructed in the paper "Hidden Challenges in Evaluating Spillover Risk of Zoonotic Viruses using Machine Learning Models" (doi: https://doi.org/10.1101/2024.04.25.591033). The details were also described in the git-hub (https://github.com/Junna-Kawasaki/BERT-infect_2024).</p> <ul> <li>The compressed files, such as ${virus}.tar.xz, contain fasta and genbank files.</li> </ul>
Large Language Models for Human-Machine Collaborative Particle Accelerator Tuning through Natural Language
<p>Autonomous tuning of particle accelerators is an active and challenging field of research with the goal of enabling novel accelerator technologies cutting-edge high-impact applications, such as physics discovery, cancer research and material sciences. A key challenge with autonomous accelerator tuning remains that the most capable algorithms require an expert in optimisation, machine learning or a similar field to implement the algorithm for every new tuning task. In this work, we propose the use of large language models (LLMs) to tune particle accelerators. We demonstrate on a proof-of-principle example the ability of LLMs to successfully and autonomously tune a particle accelerator subsystem based on nothing more than a natural language prompt from the operator, and compare the performance of our LLM-based solution to state-of-the-art optimisation algorithms, such as Bayesian optimisation (BO) and reinforcement learning-trained optimisation (RLO). In doing so, we also show how LLMs can perform numerical optimisation of a highly non-linear real-world objective function. Ultimately, this work represents yet another complex task that LLMs are capable of solving and promises to help accelerate the deployment of autonomous tuning algorithms to the day-to-day operations of particle accelerators.</p>
(supplementary material) Fine-Tuning and Prompt Engineering for Large Language Models-based Code Review Automation
<div> <div> <div> <div>Supplementary material for paper <strong>"Fine-Tuning and Prompt Engineering for Large Language Models-based Code Review Automation"</strong></div> <div> </div> <div> <div> <div>The script for the paper can be found in this GitHub repository: https://github.com/awsm-research/LLM-for-code-review-automatiton</div> </div> </div> </div> </div> </div>
Improving stratocumulus cloud amounts in a 200-m resolution multi-scale modeling framework through tuning of its interior physics Part 2
<p>This dataset includes model outputs averaged from day 2 to day 15 using the multiscale modeling framework (MMF, also referred to as ``superparameterization'') for</p> <ul> <li>Low-resolution MMF (LR): SP_newsst_long_fluxout_L125_ERA5_2008_F-MMF1_frontera_ne16pg2_r05_oQU240_CRM1_32_x_120z1200m.5s_crm_nx_rad_16_np_768_nlev_125.frontera.cam.h0.2008-10_2To15.nc <ul> <li>crm_nx = 32, crm_ny = 1, crm_dx = 1200 m, crm_dt = 5s, crm_nx_rad = 16, crm_ny_rad=1</li> </ul> </li> <li>High-resolution MMF (HR): UP_newsst_long_fluxout_L125_ERA5_2008_F-MMF1_frontera_ne16pg2_r05_oQU240_CRM1_64_x_120z200m.0.5s_crm_nx_rad_16_np_768_nlev_125.frontera.cam.h0.2008-10_2To15.nc <ul> <li>crm_nx = 64, crm_ny = 1, crm_dx = 200 m, crm_dt = 0.5s, crm_nx_rad = 16, crm_ny_rad=1</li> </ul> </li> <li>Same as HR, but considers hyperviscosity with tau = 30s (HRh30): UPhyperlag30_newsst_fluxout_L125_ERA5_2008_F-MMF1_frontera_ne16pg2_r05_oQU240_CRM1_64_x_120z100m.0.5s_crm_nx_rad_16_np_768_nlev_125.frontera.cam.h0.2008-10_2To15.nc</li> <li>Same as HR, but considers hyperviscosity with tau = 150s (HRh15): UPhyperlag15_newsst_fluxout_L125_ERA5_2008_F-MMF1_frontera_ne16pg2_r05_oQU240_CRM1_64_x_120z100m.0.5s_crm_nx_rad_16_np_768_nlev_125.frontera.cam.h0.2008-10_2To15.nc</li> <li>Same as HRh, but considers both hyperviscosity and sedimentation (HRhs15) with tau = 30s and sigmag = 1.5: HPhyper_sedi15_long_newsst_fluxout_L125_ERA5_2008_F-MMF1_frontera_ne16pg2_r05_oQU240_CRM1_64_x_120z200m.0.5s_crm_nx_rad_16_np_768_nlev_125.frontera.cam.h0.2008-10_2To15.nc</li> <li>Same as HRh, but considers both hyperviscosity and sedimentation (HRhs12) with tau = 30s and sigmag = 1.2: HPhyper_sedi12_long_newsst_fluxout_L125_ERA5_2008_F-MMF1_frontera_ne16pg2_r05_oQU240_CRM1_64_x_120z200m.0.5s_crm_nx_rad_16_np_768_nlev_125.frontera.cam.h0.2008-10_2To15.nc</li> </ul>
Improving stratocumulus cloud amounts in a 200-m resolution multi-scale modeling framework through tuning of its interior physics Part 1
<p>This dataset includes 6-month simulations using the ne30pg2 grid. Monthly averaged output files from six experiments are included.</p> <ul> <li>E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1 <ul> <li>The config options for this control simulation is <pre>CAM_CONFIG_OPTS = -mach summit -phys default -use_MMF -crm samxx -nlev 60 -crm_nz 50 -crm_dt 10 -crm_dx 2000 -crm_nx 64 -crm_ny 1 -crm_nx_rad 4 -crm_ny_rad 1 -rad rrtmgp -rrtmgpxx -MMF_microphysics_scheme sam1mom -chem none -nlev 125 -crm_nz 115 -crm_dt 2 -crm_dx 200 -crm_nx 256 -crm_ny 1 -crm_nx_rad 4 -crm_ny_rad 1 -use_MMF_VT -cppdefs ' -DMMF_ESMT -DMMF_USE_ESMT -DMMF_HYPERVISCOSITY -DMMF_SEDIMENTATION ' </pre> </li> </ul> </li> <li>E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED <ul> <li>The HV.SED control case is the same as the control (E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1), but considered both hyperciscosity and sedimentation processes.</li> </ul> </li> <li>E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED.QW_1E-04 <ul> <li>Same as the HV.SED control case (E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED), but changed the autoconversion thresholds for liquid from QW_1E-03 (default) to QW_1E-04.</li> </ul> </li> <li>E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED.QW_5E-04 <ul> <li>Same as the HV.SED control case (E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED), but changed the autoconversion thresholds for liquid from QW_1E-03 (default) to QW_5E-04.</li> </ul> </li> <li>E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED.QW_5E-04_QI_5E-05 <ul> <li>Same as the HV.SED control case (E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED), but changed the autoconversion thresholds for liquid from QW_1E-03 (default) to QW_1E-04 and ice from QI_1E-04 (default) to QI_5E-05.</li> </ul> </li> <li>E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED.QW_5E-04_QI_8E-05 <ul> <li>Same as the HV.SED control case (E3SM.INCITE2022-LOW-CLD-00.ne30pg2.F2010-MMF1.L125_115.NXY_256x1.HV.SED), but changed the autoconversion thresholds for liquid from QW_1E-03 (default) to QW_1E-04 and ice from QI_1E-04 (default) to QI_8E-05.</li> </ul> </li> </ul>
"An efficient ptychography reconstruction strategy through fine-tuning of large pre-trained deep learning model" train and test data
<ul><li>Model for the article "An efficient ptychography reconstruction strategy through fine-tuning of large pre-trained deep learning model".</li><li>The .pth file is the pre-trained PtyNet-S model and the fine-tuned PtyNet-B model.</li><li>Please contact panxy@ihep.ac.cn if you have any questions.</li></ul>
Benchmarks for the paper "A Comprehensive Timing Model for Accurate Frequency Tuning in Dataflow Circuits"
<p>The zip file contains the benchmarks used for the results presented in<br> <br> ```<br> Carmine Rizzi, Andrea Guerrieri, Paolo Ienne, and Lana Josipović. "A Comprehensive Timing Model for Accurate Frequency Tuning in Dataflow Circuits". In Proceedings of the 32nd International Conference on Field-Programmable Logic and Applications (FPL’22)<br> ```<br> <br> Feel free to download and test them following the instructions present in the README<br> <br> If you have any questions, do not hesitate to send an email to crizzi@ethz.ch</p>
Modeling fluid flow in ship systems for controller tuning using an artificial neural network
<p>Dataset used to develop ANN NARX models</p>
Black-box Membership Inference Attacks against Fine-tuned Diffusion Models
<p>We have provided some fine-tuned model checkpoints and datasets to help readers reproduce the experiments presented in the paper.</p>
No More In-Context Learning? Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models
<p>Data and models part of the replication package of the ICSE 24 submission entitled "<em>No More In-Context Learning? Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models</em>".</p>
Data for ICSE 2024 paper "Learning in the Wild: Towards Leveraging Unlabeled Data for Effectively Tuning Pre-trained Code Models".
Open the record for dataset details and reuse information.
CodeQual: A dataset for fine-tuning Large Language Models for code quality assessment task
Open the record for dataset details and reuse information.
Accuracy can Lie: On the Impact of Surrogate Model in Configuration Tuning (Supplementary Material)
<p>The detailed data for model-impact survey</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.