Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
80
datasets available to search
ShareScore release 0.9.0
Dataset results
80 results for “feature learning”
Transfer learning for galaxy feature detection: Finding Giant Star-forming Clumps in low redshift galaxies using Faster R-CNN
<p>This repository contains the data released in the paper 'Transfer learning for galaxy feature detection: Finding Giant Star-forming Clumps in low redshift galaxies using Faster R-CNN' <em>(DOI: <a href="https://doi.org/10.1093/rasti/rzae013">10.1093/rasti/rzae013</a>).</em></p> <p>We release a detailed catalogue of Giant Star-forming Clumps (GSFCs), detected for the full set of Galaxy Zoo: Clump Scout galaxies observed by SDSS using the Faster R-CNN architecture with the Zoobot classification-CNN as a feature extraction backbone.</p> <p>The final models and code are made publicly available via Github: <a href="https://github.com/ou-astrophysics/Faster-R-CNN-for-Galaxy-Zoo-Clump-Scout">https://github.com/ou-astrophysics/Faster-R-CNN-for-Galaxy-Zoo-Clump-Scout</a>.</p> <p>We will release updates if needed via Zenodo versioning. We recommend using the latest version of this repository. You can check the version you are currently viewing on the right-hand sidebar.</p> <p>Please cite the paper (DOI: <a href="https://doi.org/10.1093/rasti/rzae013">10.1093/rasti/rzae013</a>) when using the data in this repository.</p> <p>The csv-file <em>FRCNN_Zoobot_SDSS_GZCS_detections.csv</em> has the following columns. Alternatively, the file <em>FRCNN_Zoobot_SDSS_GZCS_detections.gzip</em> contains the same data but stored as a parquet-file.</p> <table> <tbody><tr> <th>Column name</th> <th>Description</th> </tr> </tbody><tbody> <tr> <td>specobjid</td> <td>SDSS spec object ID</td> </tr> <tr> <td>dr7objid</td> <td>SDSS DR7 object ID</td> </tr> <tr> <td>clump_id</td> <td>Clump index</td> </tr> <tr> <td>clump_label_id</td> <td>Clump label ID (1 or 2)</td> </tr> <tr> <td>clump_label_name</td> <td>Clump label name</td> </tr> <tr> <td>clump_score</td> <td>Detection score for the clump</td> </tr> <tr> <td>clump_centre_ra</td> <td>Clump centroid RA in degrees</td> </tr> <tr> <td>clump_centre_dec</td> <td>Clump centroid dec in degrees</td> </tr> <tr> <td>clump_flux_u</td> <td>Clump u-band flux in Jy</td> </tr> <tr> <td>clump_flux_g</td> <td>Clump g-band flux in Jy</td> </tr> <tr> <td>clump_flux_r</td> <td>Clump r-band flux in Jy</td> </tr> <tr> <td>clump_flux_i</td> <td>Clump i-band flux in Jy</td> </tr> <tr> <td>clump_flux_z</td> <td>Clump z-band flux in Jy</td> </tr> <tr> <td>clump_flux_err_u</td> <td>Clump u-band flux error in Jy</td> </tr> <tr> <td>clump_flux_err_g</td> <td>Clump g-band flux error in Jy</td> </tr> <tr> <td>clump_flux_err_r</td> <td>Clump r-band flux error in Jy</td> </tr> <tr> <td>clump_flux_err_i</td> <td>Clump i-band flux error in Jy</td> </tr> <tr> <td>clump_flux_err_z</td> <td>Clump z-band flux error in Jy</td> </tr> <tr> <td>clump_mag_u</td> <td>Clump u-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_g</td> <td>Clump g-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_r</td> <td>Clump r-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_i</td> <td>Clump i-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_z</td> <td>Clump z-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_ext_mag_u</td> <td>Clump u-band extinction (E(B-V), AB-mag)</td> </tr> <tr> <td>clump_ext_mag_g</td> <td>Clump g-band extinction (E(B-V), AB-mag)</td> </tr> <tr> <td>clump_ext_mag_r</td> <td>Clump r-band extinction (E(B-V), AB-mag)</td> </tr> <tr> <td>clump_ext_mag_i</td> <td>Clump i-band extinction (E(B-V), AB-mag)</td> </tr> <tr> <td>clump_ext_mag_z</td> <td>Clump z-band extinction (E(B-V), AB-mag)</td> </tr> <tr> <td>clump_mag_corr_u</td> <td>Clump corrected u-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_corr_g</td> <td>Clump corrected g-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_corr_r</td> <td>Clump corrected r-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_corr_i</td> <td>Clump corrected i-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_corr_z</td> <td>Clump corrected z-band magnitude (AB-mag)</td> </tr> <tr> <td>clump_mag_corr_u_g</td> <td>Clump colour (u-g)</td> </tr> <tr> <td>clump_mag_corr_g_r</td> <td>Clump colour (g-r)</td> </tr> <tr> <td>clump_mag_corr_r_i</td> <td>Clump colour (r-i)</td> </tr> <tr> <td>clump_mag_corr_i_z</td> <td>Clump colour (i-z)</td> </tr> <tr> <td>clump_flux_ratio</td> <td>Est. clump/galaxy near-UV flux ratio (u-band)</td> </tr> <tr> <td>is_clump_3pct</td> <td>Flag (True/False) if clump/galaxy flux ratio is >3%</td> </tr> <tr> <td>is_clump_8pct</td> <td>Flag (True/False) if clump/galaxy flux ratio is >8%</td> </tr> <tr> <td>galaxy_ra</td> <td>Host galaxy RA in degrees</td> </tr> <tr> <td>galaxy_dec</td> <td>Host galaxy dec in degrees</td> </tr> <tr> <td>galaxy_z</td> <td>Host galaxy redshift</td> </tr> <tr> <td>galaxy_mag_u</td> <td>Host galaxy u-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_g</td> <td>Host galaxy g-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_r</td> <td>Host galaxy r-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_i</td> <td>Host galaxy i-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_z</td> <td>Host galaxy z-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_err_u</td> <td>Host galaxy u-band magnitude error (AB-mag)</td> </tr> <tr> <td>galaxy_mag_err_g</td> <td>Host galaxy g-band magnitude error (AB-mag)</td> </tr> <tr> <td>galaxy_mag_err_r</td> <td>Host galaxy r-band magnitude error (AB-mag)</td> </tr> <tr> <td>galaxy_mag_err_i</td> <td>Host galaxy i-band magnitude error (AB-mag)</td> </tr> <tr> <td>galaxy_mag_err_z</td> <td>Host galaxy z-band magnitude error (AB-mag)</td> </tr> <tr> <td>galaxy_flux_u</td> <td>Host galaxy u-band flux in Jy</td> </tr> <tr> <td>galaxy_flux_g</td> <td>Host galaxy g-band flux in Jy</td> </tr> <tr> <td>galaxy_flux_r</td> <td>Host galaxy r-band flux in Jy</td> </tr> <tr> <td>galaxy_flux_i</td> <td>Host galaxy i-band flux in Jy</td> </tr> <tr> <td>galaxy_flux_z</td> <td>Host galaxy z-band flux in Jy</td> </tr> <tr> <td>galaxy_expAB_r</td> <td>Host galaxy axis ratio from SDSS</td> </tr> <tr> <td>galaxy_expRad_r</td> <td>Host galaxy exponential fit scale radius from SDSS</td> </tr> <tr> <td>galaxy_lmass</td> <td>Host galaxy log mass in MSun</td> </tr> <tr> <td>galaxy_lssfr</td> <td>Host galaxy log specific SFR</td> </tr> <tr> <td>galaxy_mag_corr_u</td> <td>Host galaxy corrected u-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_corr_g</td> <td>Host galaxy corrected g-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_corr_r</td> <td>Host galaxy corrected r-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_corr_i</td> <td>Host galaxy corrected i-band magnitude (AB-mag)</td> </tr> <tr> <td>galaxy_mag_corr_z</td> <td>Host galaxy corrected z-band magnitude (AB-mag)</td> </tr> </tbody> </table> <p> </p>
Machine Learning Features from Proton Therapy Treatment Simulations with the Bergen DTC Prototype for Range Verification
<p>Extracted features from the simulation data found at DOI: <a href="https://doi.org/10.5281/zenodo.8192778">10.5281/zenodo.8192778</a></p> <p>Each simulation constitutes a single data sample. The following features were extracted.</p> <p>Detector features:</p> <ul> <li>Total number of active pixels</li> <li>Total number of clusters (hits)</li> <li>Number of clusters over threshold (5, 20 pixels)</li> <li>Mean and standard deviation of cluster sizes</li> <li>The number of clusters of any given size (1–72)</li> <li>Mean and standard deviation of x- and y-coordinates over each layer (0–42), and the entire detector</li> <li>Number of active pixels in each layer (0–42)</li> <li>Number of clusters (hits) in each layer (0–42)</li> <li>Total energy deposition of the hits in each layer (0–42)</li> </ul> <p>Higher-level detector features, i.e., function fits (linear, cubic, exponential) with their mean squared residuals over the following quantities:</p> <ul> <li>Active pixels over layer</li> <li>Number of clusters over layer</li> <li>Total deposited energy over layer</li> </ul> <p>201 RSP features extracted from the beam spot, the phantom rotation, and its 3D RSP image.</p> <p>Two datasets are included in two separate archive files:</p> <ul> <li><strong>features.tar.gz:</strong> 715-HN phantom by CIRS Inc. (Norfolk, VA, United States), digitized by Giacometti et al. (2017).</li> <li><strong>features-vhf.tar.gz:</strong> The Visible Human Female (VHF) Head phantom (Ackermann et al. 1995), courtesy of the U.S. National Library of Medicine, resampled to 1 mm voxels and scaled down to 80% size in the simulation.</li> </ul> <p>After extracting features, some outliers were removed from the datasets: 14 samples for 715-HN and 3 samples for VHF. The rest of the samples were split into train (70%), validation (10%), and test (20%) sets, for both phantoms separately, which can be found in separate CSV files: features_train.csv, features_val.csv, features_test.csv (715-HN) and features-vhf_train.csv, features-vhf_val.csv, features-vhf_test.csv (VHF).</p> <p>The last file (features_shifted_test.csv (715-HN) and features-vhf_shifted_test.csv (VHF)) contains 40 additional samples for each data point in the respective test set, representing a simulated lateral shift between 1 mm and 10 mm in 1 mm intervals in all directions along the x- and y-axis of the beam.</p>
A Replication Package of Learning Features that Predict Developer Responses for iOS App Store Reviews
<p>This replication package contains the dataset and script used in our paper "<em>Learning Features that Predict Developer Responses for iOS App Store Reviews.</em>" The paper has been accepted at the ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), 2020. For further modification and versioning of the dataset (as well as the preprint) please go to <a href="https://github.com/Kamonphop/ESEM20-Replication">https://github.com/Kamonphop/ESEM20-Replication</a></p>
Accelerated MRI reconstructions via variational network and feature domain learning
<p>Reconstructed Images using E2E VarNet, Feature VarNet, FI VarNet and ablations for multiple acceleration factors.</p> <p>The input data were from the fastMRI dataset.</p>
BRAIN Journal-Automatic Anthropometric System Development Using Machine Learning-Figure 6. The result of building a 3D model based on RF and SVM classification with "Important features".
<p>From the chart of figure 6, we found that "Important Features" gave the best 3D model, which fits with the object in the image. The pattern is close to 90% compared with the true size. Apply classification algorithm RF increases the accuracy of the results and reduces computing time for the program. There are many methods for data classifying. One of them is the method of the support vector machine (SVM). The SVM method is represented by Vladimir N. Vapnik (1995) in Support Vector Machines (SVM) - a set of learning algorithms similar with the supervisor has two main tasks: the classification and the regression analysis. In this article we use the method of the SVM classification problem for the size of the human body with 5 classes to compare the performance between SVM methods and Random Forest algorithm. </p>
Visualizing histopathologic deep learning classification and anomaly detection using nonlinear feature space dimensionality reduction
<p>Representative Testing/Validation WSIs used in the manuscript "Visualizing histopathologic deep learning classification and anomaly detection using nonlinear feature space dimensionality reduction"</p>
Visualizing histopathologic deep learning classification and anomaly detection using nonlinear feature space dimensionality reduction
<p>Training image dataset used in the manuscript "Visualizing histopathologic deep learning classification and anomaly detection using nonlinear feature space dimensionality reduction"</p>
SLDeep: Statement-Level Software Defect Prediction Using Deep-Learning Models on Static Code Features
<p>Software defect prediction (SDP) seeks to estimate fault-prone areas of the code to focus testing activities on more suspicious portions. Consequently, high-quality software is released with less time and effort. The current SDP techniques however work at coarse-grained units, such as a module or a class, putting some burden on the developers to locate the fault. To address this issue, we propose Statement-Level software defect prediction using Deep-learning model (SLDeep). To reify our proposal, we defined a suite of 32 statement-level metrics, such as the number of binary and unary operators used in a statement. Then, we applied as learning model, long short-term memory (LSTM). The significance of SLDeep for intelligent and expert systems is that it demonstrates a novel use of deep-learning models to the solution of a practical problem faced by software developers. We conducted experiments using more than 100,000 C/C++ programs within the Code4Bench. The programs total 2,356,458 lines of code with 292,064 faulty lines. The benchmark comprises diverse set of programs and versions, written by thousands of developers. Therefore, it tends to give a model that can be used for cross-project SDP. In the experiments, our trained model could successfully classify the unseen data with average performance measures 0.945, 0.971, and 0.976 in terms of recall, precision, and accuracy, respectively. These experimental results suggest that SLDeep is effective for statement-level SDP. The impact of this work is twofold. Working at statement-level further alleviates developer’s burden in pinpointing the fault locations. Second, cross-project feature of SLDeep helps defect prediction research become more industrially-viable</p> <p>for more information visit <a href="https://github.com/sldeep/SLDeep">https://github.com/sldeep/SLDeep</a></p>
Multilingual Bottle-Neck Feature Learning from Untranscribed data for track 1 in zerospeech2017 (system 1 -- without VTLN)
<p>We investigate the extraction of bottle-neck features (BNFs) for multiple languages without access to manual transcription. Multilingual BNFs are derived from a multi-task learning deep neural network which is trained with unsupervised phoneme-like labels. The unsupervised phoneme-like labels are obtained from language-dependent Dirichlet process Gaussian mixture models separately trained on untranscribed speech of multiple languages.</p>
Pairwise Learning using Unsupervised Bottleneck Features for Zero-Resource Speech Challenge 2017 (System 1)
<p>The system is for track1 alone. We trained an antoencoder using unsupervised bottleneck features with word-pair information from Switchboard. The unsupervised bottleneck features was extracted from an extractor of multi-task learning deep neural networks (MTL-DNN). The word-pair information was the ground truth from Switchboard. The final features are obtained from the third layer in our pairwise trained autoencoder.</p>
Pairwise Learning using Unsupervised Bottleneck Features for Zero-Resource Speech Challenge 2017 (System 3)
<p>The system is for track1 alone. We trained an antoencoder using unsupervised bottleneck features with word-pair information from unsupervised term detection (UTD) on all corpora of five languages. The unsupervised bottleneck features was extracted from an extractor of multi-task learning deep neural networks (MTL-DNN). The word-pair was found by UTD. The UTD process was built on ZRTools. The final features are obtained from the third layer in our pairwise trained autoencoder.</p>
Pairwise Learning using Unsupervised Bottleneck Features for Zero-Resource Speech Challenge 2017 (System 2)
<p>The system is for track1 alone. We trained an antoencoder using unsupervised bottleneck features with word-pair information from unsupervised term detection (UTD) only on the give ENGLISH corpus. The unsupervised bottleneck features was extracted from an extractor of multi-task learning deep neural networks (MTL-DNN). The word-pair was found by UTD. The UTD process was built on ZRTools. The final features are obtained from the third layer in our pairwise trained autoencoder.</p>
Discriminative feature learning for Zero resource spoken term discovery (system #1)
<p>This is a preliminary version. More details about the STD system can be found here:<br> <a href="http://raiith.iith.ac.in/5161/1/1476.PDF">http://raiith.iith.ac.in/5161/1/1476.PDF</a><br> <a href="https://pdfs.semanticscholar.org/d235/7870f53eed854fc65b6b0f78fc62b968f0c6.pdf">https://pdfs.semanticscholar.org/d235/7870f53eed854fc65b6b0f78fc62b968f0c6.pdf</a></p>
Discriminative feature learning for Zero resource spoken term discovery (system #1)
<p>This is a preliminary version. More details about the STD system can be found here:<br> <a href="http://raiith.iith.ac.in/5161/1/1476.PDF">http://raiith.iith.ac.in/5161/1/1476.PDF</a><br> <a href="https://pdfs.semanticscholar.org/d235/7870f53eed854fc65b6b0f78fc62b968f0c6.pdf">https://pdfs.semanticscholar.org/d235/7870f53eed854fc65b6b0f78fc62b968f0c6.pdf</a></p>
Engineering Machine Learning features to predict adsorption of carbon dioxide and nitrogen in metal-organic frameworks
<p>This repository contains CIF files for metal-organic frameworks and Grand canonical Monte Carlo (GCMC) simulation results for the article <em>Engineering Machine Learning features to predict adsorption of carbon dioxide and nitrogen in metal-organic frameworks</em> by Zijun Deng and Lev Sarkisov.</p>
Quantum mechanical electronic and geometric parameters for DNA k-mers as features for machine learning
<p>With the development of advanced predictive modelling techniques, we are witnessing a steep increase in model development initiatives in genomics that employ high-end machine learning methodologies. Of particular interest are models that predict certain genomic or biological characteristics based solely on DNA sequence information. These models, however, treat the DNA sequence as a mere collection of four, A, T, G and C, letters, thus dismissing the past physico-chemical advancements in science that can enable the use of more intricate information about nucleic acid sequences. Here, we provide a comprehensive database of quantum mechanical and geometric features for all the permutations of 7-meric DNA in their representative B, A and Z conformations. The database is generated by employing the applicable high-cost and time-consuming quantum mechanical methodologies. This can thus make it seamless to associate a wealth of novel molecular features to any DNA sequence, by scanning it with a matching k-meric window and pulling the pre-computed values from our database for further use in modelling. We demonstrate the usefulness of our deposited features through their exclusive use in developing a model for A to C mutation rate constants.</p> <p>The DNA k-mer quantum mechanical parameters can also be found <a href="https://github.com/SahakyanLab/DNAkmerQM" target="_blank" rel="noopener">https://github.com/SahakyanLab/DNAkmerQM</a>, the corresponding research and development code from <a href="https://github.com/SahakyanLab/NucleicAcidsQM" target="_blank" rel="noopener">https://github.com/SahakyanLab/NucleicAcidsQM</a>, and the associated pre-print from <a href="https://doi.org/10.1101/2023.01.25.525597" target="_blank" rel="noopener">https://doi.org/10.1101/2023.01.25.525597</a>.</p>
Improving Generalization of ML-based IDS with Lifecycle-based Dataset, Auto-Learning Features, and Deep Learning
<p>The dataset and CNN model used in this paper:</p> <p>Improving Generalization of ML-based IDS with Lifecycle-based Dataset, Auto-Learning Features, and Deep Learning</p>
Feature Re-calibration based Multiple Instance Learning for Whole Slide Image Classification - Features
<p>A release of the sources employed in the FRMIL work - "Feature Re-calibration based Multiple Instance Learning for Whole Slide Image Classification", presented at MICCAI 2022.</p> <p>We release the Camelyon16 Whole Slide Image (WSI) extracted patch-level features for reproducibility.</p>
Two-dimensional Energy Histograms as Features for Machine Learning to Predict Adsorption in Diverse Nanoporous Materials
<p>This repo contains the supplementary data sets for the to-be-published paper entitled "Two-dimensional Energy Histograms as Features for Machine Learning to Predict Adsorption in Diverse Nanoporous Materials".</p> <p> </p> <p>This repo contains the following data sets:</p> <p>1. CIF files for amorphous porous materials (activated carbon, hyper-cross-linked polymers, Kerogen, PIMs).</p> <p>2. Grand canonical Monte Carlo (GCMC) simulation results for single-component adsorption isotherms in ToBaCCo1.0 MOFs and in amorphous porous materials. Gas molecules include Kr, Xe, ethane, propane, butane, n-hexane, and 2,2-dimethylbutane.</p> <p>3. Textural properties of ToBaCCo1.0 MOFs and amorphous porous materials.</p> <p>4. Trained machine learning models. R code that can work with these ML models is hosted on <a href="https://github.com/snurr-group/2D-energy-histogram">GitHub</a>. </p>
An unsupervised deep learning framework with variational autoencoders for genome-wide DNA methylation analysis and biologic feature extraction applied to breast cancer
<p>Supplemental data for the paper titled "An unsupervised deep learning framework with variational autoencoders for genome-wide DNA methylation analysis and biologic feature extraction applied to breast cancer"</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.