Skip to main content
Powered by ShareScore

Find research datasets worth reusing

Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.

137

datasets available to search

ShareScore release 0.9.0

Reset

Dataset results

137 results for “preprocessing”

Learn how ShareScore rates datasets ↗
zenodo32/100

Preprocessed Penn Tree Bank

<p><a href="https://catalog.ldc.upenn.edu/LDC99T42">Penn Tree Bank</a> is originally a corpus of English sentences with linguistic structure annotations. This is a variant originally distributed by Mikolov <a href="http://www.fit.vutbr.cz/~imikolov/rnnlm/simple-examples.tgz">here</a> and Zaremba <a href="https://github.com/wojzaremba/lstm">here</a> which omits the annotation and splits the dataset into raining, validation, and test.</p> <p>The dataset consists of <strong>929k</strong> <strong>training</strong> words, <strong>73k</strong> <strong>validation</strong> words, and <strong>82k</strong> test words. As part of the preprocessing, words were <strong>lower-cased</strong>, <strong>numbers</strong> were replaced with <strong>N</strong>, newlines were replaced with <strong>&lt;eos&gt;</strong>, and all other punctuation was removed. The vocabulary is the most frequent <strong>10k</strong> words with the rest of the tokens replaced by an <strong>&lt;unk&gt;</strong> token.</p> <p>&nbsp;</p>

openother-openJun 2020View details →
zenodo32/100

ShallowChrome – preprocessed data

<p>Preprocessed data to reproduce results in:</p> <p>Frasca F., Matteucci M., Leone M., Morelli M. J. and Masseroli M. &quot;Accurate and highly interpretable prediction of gene expression from histone modifications&quot;, 2021</p> <p>Code repository at: https://github.com/DEIB-GECO/ShallowChrome</p>

opencc-by-4.0Jan 2021View details →
zenodo32/100

Hacker News lda2vec preprocessed text

<p>Raw data: https://zenodo.org/record/45901</p> <p>Preprocessed dataset into tokenized forms with noun chunks</p>

opencc-zeroApr 2016View details →
zenodo32/100

PAMAP2 dataset preprocessed v0.1.0

<p><strong> Processed PAMAP2 dataset</strong><br> This dataset is based on the [PAMAP2 Dataset for Physical Activity Monitoring](https://archive.ics.uci.edu/ml/datasets/PAMAP2+Physical+Activity+Monitoring).</p> <p>The data is processed with the code in the [mcfly repository]</p> <p>(https://github.com/NLeSC/mcfly/blob/master/tutorial/tutorial_pamap2.py).</p> <p>The preprocessing is similar to that in the paper of Reiss and Stricker, 2012. Windows of length 512 were extracted from within the activity period.</p> <p>Only the variables from the 16g accelerometers on hand, ankle and chest are selected.</p> <p>Only the activities that were performed by all subjects were selected.</p> <p><br> <strong>References</strong><br> A. Reiss and D. Stricker. Introducing a New Benchmarked Dataset for Activity Monitoring. The 16th IEEE International Symposium on Wearable Computers (ISWC), 2012. </p>

opencc-by-4.0Mar 2017View details →
zenodo32/100

PAMAP2 dataset preprocessed v0.3.0

<p># Processed PAMAP2 dataset<br> This dataset is based on the [PAMAP2 Dataset for Physical Activity Monitoring](https://archive.ics.uci.edu/ml/datasets/PAMAP2+Physical+Activity+Monitoring).</p> <p>Compared to v0.2.0, this preprocessed dataset contains fewer activities. It only includes: lying, sitting, standing, walking, cycling, vaccuum_cleaning and ironing</p> <p>The data is processed with the code from [this script]https://github.com/NLeSC/mcfly-tutorial/blob/master/utils/tutorial_pamap2.py), with the following function call:</p> <p>```python<br> columns_to_use = ['hand_acc_16g_x', 'hand_acc_16g_y', 'hand_acc_16g_z',<br>                 'ankle_acc_16g_x', 'ankle_acc_16g_y', 'ankle_acc_16g_z',<br>                   'chest_acc_16g_x', 'chest_acc_16g_y', 'chest_acc_16g_z']<br> exclude_activities = [5, 7, 9, 10, 11, 12, 13, 18, 19, 20, 24, 0]<br> outputpath = tutorial_pamap2.fetch_and_preprocess(directory_to_extract_to,columns_to_use,<br>                                         exclude_activities=exclude_activities,<br>                                            val_test_size=(100, 1000))<br> <br> ```</p> <p>## References<br> A. Reiss and D. Stricker. Introducing a New Benchmarked Dataset for Activity Monitoring. The 16th IEEE International Symposium on Wearable Computers (ISWC), 2012. </p>

opencc-by-4.0Mar 2017View details →
zenodo32/100

preprocessed training data

Open the record for dataset details and reuse information.

opencc-by-4.0Mar 2024View details →
zenodo32/100

topiocqa_preprocessed

<p>Data of TopiOCQA preprocessed.</p>

opencc-by-4.0Apr 2022View details →
zenodo32/100

Preprocessed TCGA Breast Cancer data for BKB learning

<p>Preprocessed TCGA Breast Cancer data for BKB learning. Data is compressed pickled with lz4 compression. To load:</p> <pre><code class="language-python">import compress_pickle with open('path/to/dataset', 'rb') as data_file: data, feature_states, srcs = compress_pickle.load(data_file, compression='lz4')</code></pre> <p>&nbsp;</p>

opencc-by-4.0May 2022View details →
zenodo32/100

Preprocessed KEEL data for BKB learning

<p>Preprocessed KEEL data for BKB learning. All files are compressed pickles with lz4 compression. Load with:</p> <pre><code class="language-python">import compress_pickle with open('path/to/dataset', 'rb') as data_file: data, feature_states, srcs = compress_pickle.load(data_file, compression='lz4')</code></pre> <p>&nbsp;</p>

opencc-by-4.0May 2022View details →
zenodo32/100

Raw and preprocessed data on the explosions of crankcases in marine main propulsion engines (1972-2018)

<table> <tbody> <tr> <td>Document title:</td> <td>Raw and preprocessed data on the explosions of crankcases in marine main propulsion engines (1972-2018)</td> </tr> <tr> <td>Author:</td> <td>Leszek Chybowski</td> </tr> <tr> <td>e-mail:</td> <td><a href="mailto:l.chybowski@am.szczecin.pl">l.chybowski@am.szczecin.pl</a></td> </tr> <tr> <td>&nbsp;</td> <td>&nbsp;</td> </tr> <tr> <td>Affiliation:&nbsp;</td> <td>Maritime University of Szczecin, Szczecin, Poland</td> </tr> <tr> <td>City:</td> <td>Szczecin, Poland</td> </tr> <tr> <td>Year:</td> <td>2022</td> </tr> <tr> <td>&nbsp;</td> <td>&nbsp;</td> </tr> <tr> <td>Grant:</td> <td>The research was prepared under Grant 1/S/KPBMIM/22 financed by the Ministry of Science and Higher Education of Poland.</td> </tr> <tr> <td>&nbsp;</td> <td>&nbsp;</td> </tr> <tr> <td>Licence:</td> <td>CC BY-NC 2.0</td> </tr> </tbody> </table>

opencc-ncMay 2022View details →
zenodo32/100

Model Zoo: A Dataset of Diverse Populations of Neural Network Models - STL10 - Preprocessed Datasets

<p><strong>Abstract</strong></p> <p>In the last years, neural networks have evolved from laboratory environments to the state-of-the-art for many real-world problems. Our hypothesis is that neural network models (i.e., their weights and biases) evolve on unique, smooth trajectories in weight space during training. Following, a population of such neural network models (refereed to as &ldquo;model zoo&rdquo;) would form topological structures in weight space. We think that the geometry, curvature and smoothness of these structures contain information about the state of training and can be reveal latent properties of individual models. With such zoos, one could investigate novel approaches for (i) model analysis, (ii) discover unknown learning dynamics, (iii) learn rich representations of such populations, or (iv) exploit the model zoos for generative modelling of neural network weights and biases. Unfortunately, the lack of standardized model zoos and available benchmarks significantly increases the friction for further research about populations of neural networks. With this work, we publish a novel dataset of model zoos containing systematically generated and diverse populations of neural network models for further research. In total the proposed model zoo dataset is based on six image datasets, consist of 24 model zoos with varying hyperparameter combinations are generated and includes 47&rsquo;360 unique neural network models resulting in over 2&rsquo;415&rsquo;360 collected model states. Additionally, to the model zoo data we provide an in-depth analysis of the zoos and provide benchmarks for multiple downstream tasks as mentioned before.</p> <p><strong>Dataset</strong></p> <p>This dataset is part of a larger collection of model zoos and contains the zoos trained on the labelled samples from STL10. All zoos with extensive information and code can be found at www.modelzoos.cc.</p> <p>This repository contains the preprocessed model zoos wrapped in a custom pytorch dataset class (filenames beginning with &quot;dataset&quot;). Zoos are trained with small and large CNN models, in three configurations varying the seed only (seed), varying hyperparameters with fixed seeds (hyp_fix) or varying hyperparameters with random seeds (hyp_rand). Due to the large filesize, the raw datasets are hosted in a separate repository. The index_dict.json files contain information on how to read the vectorized models.</p> <p>For more information on the zoos and code to access and use the zoos, please see www.modelzoos.cc.</p>

opencc-by-4.0Jun 2022View details →
zenodo32/100

Example dataset for HoloNet: preprocessed public Visium data

<p>The preprocessed public spatial datasets, with cell-type annotation, can be used as the input of our &#39;HoloNet&#39; Python package.</p>

opencc-by-4.0Jun 2022View details →
zenodo32/100

preprocessed_data

<p>Preprocessed data files from&nbsp;Milisav et al., 2022 &quot;Resolving inter-regional communication capacity in the human connectome&quot;</p>

opencc-by-4.0Oct 2022View details →
zenodo32/100

International data (WB, UNDP, JMP) Nov. 2017. Preprocessed with R (code included).

<p>Preprocess of the following data for use with R:</p> <ul> <li>JMP, http://washdata.org/data [Nov. 2017]</li> <li>UNDP, http://hdr.undp.org/en/data [Nov. 2017]</li> <li>WB, http://data.worldbank.org/data-catalog/world-development-indicators [Nov. 2017]</li> </ul> <p>&nbsp;</p> <p>R files:</p> <p>-&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; DATA2017_Part0.R : It reads the .csv files and writes three .Rdata with the tables with country data and description of variables, one for each data source. The WB pairs indicator-year are dropped if they do not have a minimum of records available. The selection is time consuming. Because of this, an auxiliary table with the number of records for all indicator-years has been saved separately from main results. &nbsp;Also, specific outputs for two thresholds have been already computed (200 and 250). &nbsp;A correspondence between country names used by UNDP and JMP-WB is provided in a .csv file.</p> <p>-&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; DATA2017_Part0B.R : Here, the three tables of data and the three ones with description of the indicators are merged. The countries are kept in the final list only if they are present in the three sources.&nbsp;</p> <p>-&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; DATA2017_Part0C.R : First, data available for year 2015 are collected.. The WB records are kept only if they have less than 40 empty cases. Second, the indicators with time evolution data from 2000-2010 are merged in a single table (WB and JMP data).&nbsp;</p> <p>&nbsp;</p> <p>Directories:</p> <ul> <li>csv/</li> <li>data_org/</li> <li>data_org/JMP/</li> <li>data_org/UNDP/</li> <li>data_org/WB/</li> <li>Rdata/&nbsp;</li> </ul>

opencc-by-4.0Dec 2017View details →
zenodo32/100

Supplementary collection of preprocessed and analysed data objects for the paper: "Gene-level alignment of single cell trajectories"

<p>Supplementary collection of h5ad data files containing preprocessed and analysed single-cell reference and query datasets discussed in the case studies of the paper:<em><strong>"Gene-level alignment of single cell trajectories"</strong></em> (<a href="https://doi.org/10.1101/2023.03.08.531713" rel="nofollow">https://doi.org/10.1101/2023.03.08.531713</a>).</p> <p>Our artificial thymic organoid raw sequencing data are available from ArrayExpress (E-MTAB-12720).</p> <p>Below lists the original sources of the literature datasets we downloaded prior to our own preprocessing and trajectory analysis.</p> <ul> <li> <p>Original pan fetal reference data from:&nbsp;Suo, C. et al. (2022) "Mapping the developing human immune system across organs" (<a href="https://doi.org/10.1126/science.abo0510">https://doi.org/10.1126/science.abo0510</a><a href="http://paperpile.com/b/XTpgLG/TQtQ3">), </a>downloaded from <a href="https://developmental.cellatlas.io/fetal-immune">https://developmental.cellatlas.io/fetal-immune</a>.</p> </li> </ul> <ul> <li> <p>Original healthy/IPF data from:&nbsp;Adams, T. S. et al. (2020), "Single-cell RNA-seq reveals ectopic and aberrant lung-resident cell populations in idiopathic pulmonary fibrosis" (<a href="https://doi.org/10.1126/sciadv.aba1983">https://doi.org/10.1126/sciadv.aba1983</a>), downloaded from GEO (GSE136831).</p> </li> </ul> <p>We have run our scripts in&nbsp;<a href="https://github.com/Teichlab/G2G_notebooks">https://github.com/Teichlab/G2G_notebooks</a> to generate new latent embeddings and infer pseudotime trajectories for the above datasets, and used them to model trajectory alignments with our newly developed framework: &lsquo;Genes2Genes&rsquo; <a href="https://github.com/Teichlab/Genes2Genes">https://github.com/Teichlab/Genes2Genes</a>.&nbsp;&nbsp;</p>

openMay 2024View details →
zenodo32/100

Preprocessed Natural Viewing Dataset

<p>This is a version of the Natural Viewing Dataset which was preprocessed by us for the task of decoding BOLD from EEG signals. The original data is available in Telesford, Q.K., Gonzalez-Moreira, E., Xu, T.&nbsp;<em>et al.</em>&nbsp;An open-access dataset of naturalistic viewing using simultaneous EEG-fMRI.&nbsp;<em>Sci Data</em>&nbsp;<strong>10</strong>, 554 (2023). https://doi.org/10.1038/s41597-023-02458-8 . If you use our preprocessed data please also credit original dataset authors.</p>

openMay 2024View details →
zenodo32/100

Raw and Preprocessed Data for the Paper "A chemogenetic approach for dopamine imaging with tunable sensitivity"

<p>This Dataset includes matlab variables as well as Excel tables containing all raw and preprocessed data</p>

opencc-by-4.0Apr 2024View details →
zenodo32/100

Preprocessed adult height GWAS summary statistics and estimated LD matrices

<p>This dataset contains preprocessed&nbsp;adult height genome-wide association study (GWAS) summary statistics and estimated linkage disequilibrium (LD) matrices, which were created and analyzed in the following publication.</p> <p>Zhu, Xiang; Stephens, Matthew. Bayesian large-scale multiple regression with summary statistics from genome-wide association studies. Ann. Appl. Stat. 11 (2017), no. 3, 1561--1592. doi:10.1214/17-AOAS1046. https://projecteuclid.org/euclid.aoas/1507168840</p> <p>For more information on this dataset, please see&nbsp;https://stephenslab.github.io/rss/Height2014.</p>

opencc-by-4.0Oct 2018View details →
zenodo32/100

ChemBioSim Recalibration: Twelve Preprocessed ChEMBL Data Sets

<p><strong>Studying and mitigating the effects of data drifts on ML model performance at the example of chemical toxicity data</strong></p> <p><strong>Project description</strong></p> <p>Machine learning models are powerful tools for the prediction of molecular properties or the biological activity of chemical compounds. However, to make these models useful and applicable, the confidence in the predictions should also be specified. For that purpose, models may be integrated in a conformal prediction (CP) framework that adds a calibration step to estimate the confidence of the predictions. CP models offer the advantage of ensuring a predefined error rate, as long as the test and training sets are exchangeable.</p> <p>In cases where the test data presents a drift from the descriptor space of the training data, or where assay setups change, this assumption may not be fulfilled and the models are not guaranteed to be valid.&nbsp;</p> <p>In this study, the performance of internally valid CP models was evaluated upon application to either newer time-split data or to external data. More specifically, temporal data drifts were analysed based on time-splits of twelve toxicity-related datasets from the ChEMBL database. Moreover, models trained on publicly available data for liver toxicity and MNT in vivo were applied on proprietary data to evaluate the discrepancies. In general it was observed that the training and (holdout) test sets were not exchangeable in the studied set-ups, and the models were therefore not applicable (i.e. non-valid CP models).</p> <p>To recover the validity of the models on the holdout test set, a strategy for updating the calibration set with data more similar to the holdout set was investigated. Restored validity is the main requisite for applying the CP models with confidence. However, this comes at the cost of decreased model efficiency, as more predictions are identified as inconclusive.</p> <p>&nbsp;</p> <p><strong>Dataset</strong></p> <p>The uploaded file contains the ChEMBL data used in the work for the manuscript &ldquo;Studying and mitigating the effects of data drifts on ML model performance at the example of chemical toxicity data&rdquo;.</p> <p>Twelve preprocessed datasets containing molecule chembl ID, SMILES, binary activity (i.e. 1 if active, 0 if inactive), publication year, and CHEMBIO descriptors are available for the following ChEMBL endpoints, extracted from ChEMBL Version 26:</p> <ul> <li> <p>CHEMBL220: Acetylcholinesterase (human), 2673 compounds</p> </li> <li> <p>CHEMBL4078: Acetylcholinesterase (fish), 3811 compounds</p> </li> <li> <p>CHEMBL5763: Cholinesterase, 2755 compounds</p> </li> <li> <p>CHEMBL203: EGFR erbB1, 4059 compounds</p> </li> <li> <p>CHEMBL206: Estrogen receptor alpha, 1416 compounds</p> </li> <li> <p>CHEMBL279: VEGFR 2, 5174 compounds</p> </li> <li> <p>CHEMBL230: Cyclooxygenase-2, 2020 compounds</p> </li> <li> <p>CHEMBL340: Cytochrome P450 3A4, 3316 compounds</p> </li> <li> <p>CHEMBL240: HERG, 4976 compounds</p> </li> <li> <p>CHEMBL2039: Monoamine oxidase B, 2534 compounds</p> </li> <li> <p>CHEMBL222: Norepinephrine transporter, 1566 compounds</p> </li> <li> <p>CHEMBL228: Serotonin transporter, 2111 compounds</p> </li> </ul> <p>&nbsp;</p> <p><strong>Usage</strong></p> <p>This dataset can be used as input&nbsp; to run the notebooks available at&nbsp;&nbsp;</p> <p><a href="https://github.com/volkamerlab/CPRecalibration_manuscript_SI">https://github.com/volkamerlab/CPRecalibration_manuscript_SI</a></p> <ol> <li> <p>Clone the GitHub repository.</p> </li> <li> <p>Download the dataset provided here.</p> </li> <li> <p>Copy the dataset (don&rsquo;t extract) into the data folder of the cloned GitHub repository.</p> </li> <li> <p>Follow the instructions on GitHub.</p> </li> </ol>

opengpl-3.0Aug 2021View details →
zenodo32/100

Neural preprocessed data associated to "Decoding grasp and speech signals from the cortical grasp circuit in a tetraplegic human"

<p>This dataset is composed of electrophysiology data from a tetraplegic human participant implanted with three 96 channel Utah arrays (Blackrock) in the supramarginal gyrus (SMG), ventral premotor cortex (PMV) and&nbsp;somatosensory cortex.&nbsp;The dataset includes preprocessed (spike sorted)&nbsp;firing rate data for 96 recorded channels, as described in Wandelt et al (2022), &quot;Decoding grasp and speech signals from the cortical grasp circuit in a tetraplegic human&quot; published in Neuron (<a href="https://doi.org/10.1016/j.neuron.2022.03.009">10.1016/j.neuron.2022.03.009</a>).</p> <p>To run the code associated with the processed data, download it here https://zenodo.org/record/6330179.</p>

opencc-by-4.0Mar 2022View details →

ScienceDex guides

Understand access before you commit

These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.

Compare curated datasets

Allen Brain Atlas

Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.

allen-brain-atlas
neuroscienceopenDocumentation, web resources, and API references are available online.
Last verified 2026-04-30Open record

Annotated Behaviour and Observability Dataset (ABODe)

ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.

abode-home-cage
behavioral-neuroscienceopenThe DataShare record exposes download links for annotations, documentation, license text, and the zipped per-snippet data directory.
Last verified 2026-04-30Open record

DANDI Archive for NWB datasets

DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.

dandi-nwb
electrophysiologyopenPublished Dandiset metadata and archive endpoints are available through the production DANDI API.
Last verified 2026-04-30Open record

International Brain Laboratory public data

The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.

ibl
behavioral-neuroscienceopenPublic sessions can be searched and loaded from the IBL public data server through ONE.
Last verified 2026-04-29Open record

OpenNeuro

OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.

openneuro
neuroscienceopenPublished datasets are available on demand over the internet.
Last verified 2026-04-29Open record

ScienceDex for faculty

Your academic CV and NIH biosketch

Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.