Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
156
datasets available to search
ShareScore release 0.9.0
Dataset results
156 results for “explorative modeling”
Data from: Exploring rainforest diversification using demographic model testing in the African foam-nest treefrog (Chiromantis rufescens)
Open the record for dataset details and reuse information.
Models from: Exploring ensemble applications for multi-sequence myocardial pathology segmentation
<p>Trained models for the MyoPS2020 challenge http://www.sdspeople.fudan.edu.cn/zhuangxiahai/0/MyoPS20/</p> <p>As described in the publication: "Exploring ensemble applications for multi-sequence myocardial pathology segmentation"</p> <p>Source code available at: https://github.com/chfc-cmi/miccai2020-myops</p>
Data for GMD article: "Towards an improved treatment of cloud-radiation interaction in weather and climate models: exploring the potential of the Tripleclouds method for various cloud types using libRadtran 2.0.4"
<p>Dataset for the publication by Nina Črnivec and Bernhard Mayer: "Towards an improved treatment of cloud-radiation interaction in weather and climate models: exploring the potential of the Tripleclouds method for various cloud types using libRadtran 2.0.4" submitted to Geoscientific Model Development in 2020.</p> <p>The repository contains data for stratocumulus, cirrus and cumulonimbus cloud case studies. It also contains MYSTIC benchmark radiation data (including atmosphering heating rate and net surface flux) for the aforementioned cloud cases. See README for additional information and description of data files.</p>
Data from: Worldwide exploration of the microbiome harbored by the cnidarian model, Exaiptasia pallida (Agassiz in Verrill, 1864) indicates a lack of bacterial association specificity at a lower taxonomic rank
Examination of host-microbe interactions in early diverging metazoans, such as cnidarians, is of great interest from an evolutionary perspective to understand how host-microbial consortia have evolved. To address this problem, we analyzed whether the bacterial community associated with the cosmopolitan and model sea anemone Exaiptasia pallida shows specific patterns across worldwide populations ranging from the Caribbean Sea, and the Atlantic and Pacific oceans. By comparing sequences of the V1–V3 hypervariable regions of the bacterial 16S rRNA gene, we revealed that anemones host a complex and diverse microbial community. When examined at the phylum level, bacterial diversity and abundance associated with E. pallida are broadly conserved across geographic space with samples, containing largely Proteobacteria and Bacteroides. However, the species-level makeup within these phyla differs drastically across space suggesting a high-level core microbiome with local adaptation of the constituents. Indeed, no bacterial OTU was ubiquitously found in all anemones samples. We also revealed changes in the microbial community structure after rearing anemone specimens in captivity within a period of four months. Furthermore, the variation in bacterial community assemblages across geographical locations did not correlate with the composition of microalgal Symbiodinium symbionts. Our findings contrast with the postulation that cnidarian hosts might actively select and maintain species-specific microbial communities that could have resulted from an intimate co-evolution process. The fact that E. pallida is likely an introduced species in most sampled localities suggests that this microbial turnover is a relatively rapid process. Our findings suggest that environmental settings, not host specificity, seem to dictate bacterial community structure associated with this sea anemone. More than maintaining a specific composition of bacterial species some cnidarians associate with a wide range of bacterial species as long as they provide the same physiological benefits towards the maintenance of a healthy host. The examination of the previously uncharacterized bacterial community associated with the cnidarian sea anemone model E. pallida is the first global-scale study of its kind.
Data from: How far can I extrapolate my species distribution model? Exploring Shape, a novel method
<p>Species distribution and ecological niche models (hereafter SDMs) are popular tools with broad applications in ecology, biodiversity conservation, and environmental science. Many SDM applications require projecting models in environmental conditions non-analog to those used for model training (extrapolation), giving predictions that may be statistically unsupported and biologically meaningless. We introduce a novel method, Shape, a model-agnostic approach that calculates the extrapolation degree for a given projection data point by its multivariate distance to the nearest training data point. Such distances are relativized by a factor that reflects the dispersion of the training data in environmental space. Distinct from other approaches, Shape incorporates an adjustable threshold to control the binary discrimination between acceptable and unacceptable extrapolation degrees. We compared Shape's performance to five extrapolation metrics based on their ability to detect analog environmental conditions in environmental space and improve SDMs suitability predictions. To do so, we used 760 virtual species to define different modeling conditions determined by species niche tolerance, distribution equilibrium condition, sample size, and algorithm. All algorithms had trouble predicting species niches. However, we found a substantial improvement in model predictions when model projections were truncated independently of extrapolation metrics. Shape's performance was dependent on extrapolation threshold used to truncate models. Because of this versatility, our approach showed similar or better performance than the previous approaches and could better deal with all modeling conditions and algorithms. Our extrapolation metric is simple to interpret, captures the complex shapes of the data in environmental space, and can use any extrapolation threshold to define whether model predictions are retained based on the extrapolation degrees. These properties make this approach more broadly applicable than existing methods for creating and applying SDMs. We hope this method and accompanying tools support modelers to explore, detect, and reduce extrapolation errors to achieve more reliable models.</p>
Exploring Localized Geomagnetic Disturbances in Global MHD: Physics and Numerics (Model Data)
<p>Model Data to reproduce plots from article "Exploring Localized Geomagnetic Disturbances in Global MHD: Physics and Numerics". README contains information on where to access model and visualization tools.</p>
Data from: Exploring the multi-level impacts of a youth-led comprehensive sexuality education model in Madagascar using human-centered design methods
<p>Comprehensive sexuality education (CSE) is recognized as a critical tool for addressing sexuality and reproductive health challenges among adolescents. However, little is known about the broader impacts of CSE on populations beyond adolescents, such as schools, families, and communities. This study explores multi-level impacts of an innovative CSE program in Madagascar, which employs young adult CSE educators to teach a three-year curriculum in government middle schools across the country. The two-phased study embraced a participatory approach and qualitative Human-centered Design (HCD) methods. In phase 1, 90 school principals and administrators representing 45 schools participated in HCD workshops, which were held in six regional cities. Phase 2 took place one year later, which included 50 principals from partner schools, and focused on expanding and validating findings from phase 1. From the perspective of school principals and administrators, the results indicate several areas in which CSE programming is having spill-over effects, beyond direct adolescent student sexuality knowledge and behaviors. In the case of this youth-led model in Madagascar, the program has impacted the lives of students (e.g., increased academic motivation and confidence), their parents (e.g., strengthened family relationships and increased parental involvement in schools), their<br>schools (e.g., increased perceived value of schools and teacher effectiveness), their communities (e.g., increased community connections), and impacted broader structural issues (e.g., improved equity and access to resources such as menstrual pads). While not all impacts of the CSE program were perceived as positive (e.g., students start experimenting with sex and love), the findings uncovered opportunities for targeting investments and refining CSE programming to maximize positive impacts at family, school, and community levels.</p>
Ryanodine receptor model exploration in Virtual Reality with UnityMol
<p>Here we provide supplementary material to our article on integrative modeling. We explor one of the models generated for the ryanodine receptor.</p> <p> </p> <p>In particular, we show ryanodine receptor model exploration in Virtual Reality with UnityMol, demonstrating also some features of the software.</p> <p> </p> <p>The exploration looks at the overall structure, the packing integrity of the subunits, the channel pore, the channel constriction, the S6 helix and the transmembrane domain in particular.</p>
Exploring Hierarchy and Dependency of Rules for Consistency Checking Between Code and Model (Evaluation Data)
<p>This repository contains the data related to the protocol and results of the evaluation conducted on the HiDeoCR approach. </p>
Exploring Jupiter's Polar Deformation Lengths with High Resolution Shallow Water Modeling
<p>Movies for simulations of non-dimensional eddy potential vorticity generated using the Pencil Code for the article "Exploring Jupiter's Polar Deformation Lengths with High Resolution Shallow Water Modeling". These movies show the Jovian North polar region in the co-rotating frame using the shallow water approximation with the gamma-plane approximation. Simulations named with a preceding A correspond to Case A (Figure 2 in the article), while those with B correspond to Case B (Figure 5 in the article). Red indicates cyclonic behavior and blue indicates anticyclonic behavior.</p> <p>Long term trends are clear for most cases as early as day 10,000. However, the dynamical behavior of the system continues to evolve well past energy equilibration. For more details regarding these simulations, please read the parent article in the Planetary Science Journal.</p>
Additional Figures for winning models for sample in A Comparative L-dwarf Sample Exploring the Interplay Between Atmospheric Assumptions and Data Properties
<p>Additional Figures for winning models for sample in <em>A Comparative L-dwarf Sample Exploring the Interplay Between Atmospheric Assumptions and Data Properties (<a href="https://arxiv.org/pdf/2209.02754.pdf">https://arxiv.org/pdf/2209.02754.pdf</a>).</em></p> <p>Model naming key: NC = cloud-free, d2_89 = power-law deck cloud</p> <p>SDSS J1416+1348A: Winning model: power-law deck cloud</p> <p>Spectral Type Comparison J1526+2043 Winning model: Cloud-free</p> <p>Temperature Comparisons</p> <p>J1539-0520 Winning model: Power-law deck cloud and cloud-free tied.</p> <p>J0539-0059 Winning model: Power-law deck cloud and cloud-free tied. </p> <p><br> </p>
The code and data for the paper entitled 'Facilitating Efficient Discovery: A GUI-Oriented Approach for Exploring Functionality using Machine Learning Model'
<h2><strong>Code</strong></h2> <p><strong><span>dataCollection.py</span></strong></p> <p><span>The collection of app data is primarily accomplished by processing and storing XML files and screenshots of the app. Firstly, the uiautomator is utilized to connect to the smart device and obtain screenshots and XML files. Subsequently, the XML files are analyzed to identify clickable functions within the GUI, and the textual information contained within the functions, along with their specific locations, is extracted. Finally, the Python file also includes handling of interface elements, such as determining if elements are obscured and verifying the legitimacy of the text.</span></p> <p><strong><span>tagData.py</span></strong></p> <p><span>The main implementation involves volunteers annotating app functionalities, including HTML generation, user data analysis, and retrieval. Flask framework is employed, presenting one GUI to the user each time while randomly prompting them to click on three functionalities. Ultimately, the time taken by users to locate these three functionalities is collected.</span></p> <p><strong><span>userPersonalization.py</span></strong></p> <p><span>Separating out the data annotated by each user facilitates personalized analysis. This process involves extraction, storage, and loading of individual user annotations.</span></p> <p><strong><span>dataPreprocessing.py</span></strong></p> <p><span>For a user-annotated functionality, completing the conversion from user time to either "hard-to-find" or "easy-to-find" involves several steps. First, the functionalities are vectorized, extracting relevant parameters from the XML files and computing their correlation with the time users spent searching for the functionalities. These parameters are then normalized to obtain feature vectors for the functionalities. Additionally, an initial determination is made regarding whether the annotated functionalities are "hard-to-find" or "easy-to-find" for each user. Subsequently, clustering is performed on all annotated data from users, and based on the clustering results, the outcomes are filtered and adjusted.</span></p> <p><strong><span>difficultFindClassifier.py</span></strong></p> <p><span>Train the classifier and use it to predict "hard-to-find" functionalities, then display the results.</span></p> <h2><span>Data</span></h2> <p><span>The data is located in the "static" folder:</span></p> <p><span>- The "persistentData" folder contains the trained classifier.</span></p> <p><span>- The "picture" folder contains screenshots of the app.</span></p> <p><span>- The "requestTime" folder stores data for when volunteers annotate only one function in a GUI.</span></p> <p><span>- The "threeResponseTime" folder saves data for when volunteers annotate three functions in a GUI.</span></p> <p><span>- The "userData" folder stores personalized user data.</span></p> <p><span><span>- The "xml_information" folder stores XML files of the app.</span></span></p>
A synthetic dataset for the exploration of survival and classification models: prediction of heart attack or stroke within a 10-year follow-up period
<div> <div></div> </div> <div> <div> <div> <p><span>Machine learning methodologies are increasingly popular in health care research. This shift to integrated data science approaches necessitates professional development of the existing health care data analyst workforce. To enhance a smooth transition, educational resources need to be developed. Barriers to accessing real healthcare datasets, vital for health care data analyses methodologies training purposes, include financial, ethical and patient confidentiality concerns. Synthetic datasets mimicking real-world complexities offer a simpler solution.</span></p> <p>We present a synthetic dataset which mirrors routinely collected primary care data on heart attack and stroke among the adult population. The data incorporates much of the practical challenges encountered in routinely collected primary care systems such as missing data, informative censoring, interactions, variable irrelevance, and noise and can be used for training in methods which handle these difficulties. The intent is for the user to build models of heart/stroke risk using survival-based methodologies.</p> <p>By sharing this synthetic dataset openly, our goal is to contribute a transformative asset for professional training in health and social care data analysis. The dataset covers demographics, lifestyle variables, comorbidities, systolic blood pressure, hypertension treatment, family history of cardiovascular diseases, respiratory functioning, and experience of heart-attack and/or stroke. This initiative aims to bridge the gap in sophisticated healthcare datasets for training, fostering professional development of the health and social care research workforce.</p> <p>This study is funded by the National Institute for Health and Care Research ARC Wessex and the National Centre for Research Methods. The views expressed in this summary are those of the author(s) and not necessarily those of the National Institute for Health and Care Research or the Department of Health and Social Care.</p> <p> </p> </div> </div> </div>
PubChem and ChEMBL-series processed dataset used in Exhaustive local chemical space exploration using a transformer model
<p>PubChem and ChEMBL-series processed dataset used in <span>Exhaustive local chemical space exploration using </span><span>a transformer model</span></p>
Models and CAR scores reported in R. Kyle Bocinsky, Johnathan Rush, Keith W. Kintigh, and Timothy A. Kohler. Exploration and exploitation in the macrohistory of the prehispanic Pueblo Southwest. Science Advances.
<p>These are the models and CAR scores presented in reported in</p> <p>R. Kyle Bocinsky, Johnathan Rush, Keith W. Kintigh, and Timothy A. Kohler. Exploration and exploitation in the macrohistory of the prehispanic Pueblo Southwest. <em>Science Advances</em>, 2:e1501532.</p> <p>These files are R data sets. See the <a href="https://github.com/bocinsky/paleocar"><strong>paleocar</strong> package</a> for information on how to extract model uncertainty and other data from these data files.</p>
set of exploration data and parameters for h24/5ad agent based model
<p>Different set of data used for exploration, used for reproductibility, updated with HigherProp parameters</p>
Data and scripts used in: "Exploring Biological Neuronal Correlations with Quantum Generative Models"
<div>Data and script for the manuscript "Exploring Biological Neuronal Correlations with Quantum Generative Models", by Vinicius Hernandes and Eliska Greplova.</div> <h3>main scripts</h3> <div> <p><strong><em>generate_activity_dataset.py</em></strong></p> <p>reshape data in <em>neuronData.npy</em> to 50k samples of (neurons, timesteps) shape, saved in <em>activity_data.npy</em></p> <p><strong><em>create_target_distributions.py</em></strong></p> <p>based on the dataset, makes dicionary with the the target distribution for each (neurons, timesteps) pair, saved in <em>distribution_target_dictionary.pkl</em></p> <p><strong><em>create_hyperparameters_file.py</em></strong></p> <p>generates <em>hyperparameters.csv</em>, containing:</p> </div> <ul> <li>number of neurons</li> <li>number of timesteps</li> <li>number of auxiliary_qubits</li> <li>batch_size</li> <li>learning rate of generator</li> <li>learning rate of critic</li> <li>number parametrized layers</li> <li>number of training iterations</li> <li>loss type</li> </ul> <p>for each run</p> <p><strong><em>train_qgan.py</em></strong></p> <div> <p>trains models defined <em>models.py</em> using <em>activity_data.npy</em> dataset, and for the hyperparameters defined in <em>hyperparameters.csv</em></p> </div> <div>saves loss functions, and the trained models for each 10 iterations, in specific folders indexed by the run specified in the hyperparameters file</div> <div> </div> <div><strong><em>generate_fake_activity.py</em></strong></div> <div> </div> <div>uses trained models saved in <em>output/models/run{run}/i{training_step}.pth</em> for a specific <em>training_step</em> and <em>run</em> to generate fake data, and save them in <em>output/generated_data/run{run}/i{training_step}.npy</em> files</div> <div> </div> <div><strong><em>analyze_error.py</em></strong></div> <div> </div> <div>uses generated data saved in <em>output/generated_data/run{run}/i{training_step}.npy</em> to generate two statistical quantities (k-probs and firing rate), using the function in <em>metrics.py</em>, and compare the errors in those quantities between the models using k-loss and standard-loss</div> <div> </div> <div><strong><em>analyze_stats.py</em></strong></div> <div> </div> <div>uses generated data saved in <em>output/generated_data/run{run}/i{training_step}.npy</em> to generate:</div> <ul> <li>js diverge for each training step, and final distribution of generated states, stored in <em>distribution_target_dictionary.pkl</em></li> <li>other statistical quantities, using the function in <em>metrics.py</em> file</li> </ul> <h3>auxiliary scripts</h3> <div><strong><em>metrics.py</em></strong></div> <div> </div> <div>functions to calculate neuronal statistics</div> <div> </div> <div><strong><em>aux.py</em></strong></div> <div> </div> <div>auxiliary functions:</div> <ul> <li>to generate states distribution given a dataset</li> <li>custom js divergence</li> </ul> <h3>Data</h3> <p><strong><em>neuronData.npy</em></strong></p> <p>neuronal data from Marre et al., Multi-electrode array recording from salamander retinal ganglion cells (2017)</p> <p><strong><em>activity_data.npy</em></strong></p> <p>dataset obtained from <em>neuronData.npy</em>, taking 50 thousand samples of shape (neurons, timesteps)</p> <p><strong><em>output</em></strong></p> <p>results obtained from <em>train_qgan.py</em> and <em>generate_fake_activity.py</em> </p> <p>contains:</p> <ul> <li><strong><em>losses</em></strong></li> </ul> <p>generator and critic loss for all training runs and steps</p> <ul> <li><strong><em>models</em></strong></li> </ul> <p>saved torch models every 10 training steps, for all training runs</p> <ul> <li><strong><em>generated_data</em></strong></li> </ul> <p>generated data for all models saved in <em>models</em></p>
Ocean basin mask for coordinated climate model experiments to explore tropical basin interaction
<p>This is a netcdf dataset containing a basin mask for distinguishing major ocean basins (Atlantic, Pacific, etc.). It has been simplified to for use with the TBI experiments coordinated by the CLIVAR Research Focus on Tropical Basin Interaction (https://www.clivar.org/research-foci/basin-interaction). The original data can be found at https://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NODC/.WOA09/.Masks/.basin/index.html?Set-Language=en</p>
Exploring ultraweak photon emissions as optical markers of brain activity - Dataset and statistical models
Open the record for dataset details and reuse information.
DAPI images, molecules and segmentation boundaries for: A Spatiotemporal Atlas of Mouse Gastrulation and Early Organogenesis to Explore Axial Patterning and Project In Vitro Models onto In Vivo Space
<div> </div> <p><strong>Data Description</strong></p> <ol> <li><strong>Stitched & rotated DAPI images</strong> - tiff file format filename indicates sample and optical z-slice position, i.e. embryo3_z5.tif is the DAPI image for embryo 3 in optical z-slice 5. Also provided in PNG format.</li> <li><strong>Detected molecules and cell segmentation in MoleculeExperiment objects</strong> - RDS files to read data using the MoleculeExperiment format in R/Bioconductor. Filename embryo3_z5.Rds indicates MoleculeExperiment RDS file for embryo 3 in optical z-slice 5. Coordinates are provided in microns. Note that z-slices 2 and 5 are only provided for embryos 1,2,3 as they were originally provided in Lohoff et al, Nature Biotechnology, 2023.</li> <li><strong>Pixels-to-microns conversion</strong> - pixelSize.R Simple R script/text to indicate the size of each pixel in the DAPI images, this is to align the coordinate systems between the DAPI images and molecules.<br><br> <div> <h4>Project Abstract</h4> </div> <p>At the onset of murine gastrulation, pluripotent epiblast cells migrate through the primitive streak, generating mesodermal and endodermal precursors, while the ectoderm arises from the remaining epiblast. Together, these germ layers establish the body plan, defining major body axes and initiating organogenesis. Although comprehensive single cell transcriptional atlases of dissociated mouse embryos across embryonic stages have provided valuable insights during gastrulation, the spatial context for cell differentiation and tissue patterning remain underexplored. In this study, we employed spatial transcriptomics to measure gene expression in mouse embryos at E6.5 and E7.5 and integrated these datasets with previously published E8.5 spatial transcriptomics and a scRNA-seq atlas spanning E6.5 to E9.5. This approach resulted in a comprehensive spatiotemporal atlas, comprising over 150,000 cells with 88 refined cell type annotations as well as genome-wide transcriptional imputation during mouse gastrulation and early organogenesis. The atlas facilitates exploration of gene expression dynamics along anterior-posterior and dorsal-ventral axes at cell type, tissue, and organismal scales, revealing insights into mesodermal fate decisions within the primitive streak. Moreover, we developed a bioinformatics pipeline to project additional scRNA-seq datasets into a spatiotemporal framework and demonstrate its utility by analysing cardiovascular models of gastrulation3. To maximise impact, the atlas is publicly accessible via a user-friendly web portal empowering the wider developmental and stem cell biology communities to explore mechanisms of early mouse development in a spatiotemporal context.</p> </li> </ol>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.