Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
19
datasets available to search
ShareScore release 0.9.0
Dataset results
19 results for “scientific workflows”
Supplemental Data from the article "The SmARTR pipeline: a modular workflow for the cinematic rendering of 3D scientific imaging data"
<h1><strong>Please, refer to <a href="https://github.com/MeVisLab/SmARTR-Networks">this GitHub repository</a> for additional info, updates, issue reports, and discussion<br></strong></h1> <p><strong>A collection of configuration files (SmARTR networks) published in "<a href="https://doi.org/10.1016/j.isci.2024.111475">The SmARTR Pipeline: a modular workflow for the cinematic rendering of 3D scientific imaging data</a>", enabling the creation of cinematic (photorealistic) renderings of 3D data in the FREE software <a href="https://www.mevislab.de/download">MeVisLab</a><br></strong></p> <ul> <li>Each folder in the archive contains one or more SmARTR network files, the scan and mask files required for the practical examples detailed in the <a href="https://www.cell.com/cms/10.1016/j.isci.2024.111475/attachment/8d79036b-acb6-4cda-a5ff-f56317691ebc/mmc1.pdf">Supplemental Data</a> of the article, and an additional folder with LUT presets.</li> </ul>
Traces of scientific workflow instances with and without memoization
<p>This is a collection of anonymized traces describing the execution of workflows on a POWER and x86-64 cluster.</p> <p>This dataset contains the measurements we used to evaluate our workflow memoization system in:</p> <pre><code>Vassiliadis, V., Johnston, A. M., McDonagh, L. J. "Fast, Transparent, and High-Fidelity Memoization Cache-Keys for Computational Workflows." 2022 IEEE International Conference on Services Computing (SCC). IEEE, 2022.</code></pre> <p> </p>
Demonstration of Scientific Workflow Reproducibility with Hyperflow Workflow Management System
<p>This package contains the Experiment Digital Object that allows to reproduce the workflow execution experiment.</p> <p>The content of the package:<br> - Information about the experimental workflow (below).<br> - Experiment execution traces in the form of a dataframe (csv file) with description of the format (below).<br> - Visualization of the execution (png file).<br> - Python script for analysis of the execution trace (generates the visualization). <br> - Instructions describing how to reproduce the experiment (below).</p>
Artifact of the paper "An Empirical Investigation on the Challenges in Scientific Workflow Systems Development"
<p><strong><span>Scientific Workflow Systems (SWSs)</span></strong><span> play a critical role in the contemporary scientific landscape, significantly enriching research endeavors by augmenting productivity and fostering collaboration</span><span>, SWSs</span><span> elevate the standard of scholarly inquiry, fortifying its pillars of reproducibility and ethical adherence. Essentially, they </span><span>serve as</span><span> the bedrock upon which efficient, transparent, and impactful research </span><span>is built</span><span>, propelling knowledge and innovation across diverse fields. SWSs accomplish mundane yet essential tasks intrinsic to scientific inquiry—ranging from data acquisition to analysis and reporting. By liberating researchers from the shackles of manual labor, SWSs enable them to channel their energies toward more intellectually demanding pursuits, thereby enhancing the pace and quality of research outcomes. Moreover, SWSs wield a formidable influence in standardizing workflows across research cohorts, instilling a sense of uniformity in experimental methodologies and data-handling practices. This standardization not only cultivates a culture of rigor and coherence but also fosters cross-disciplinary dialogue and collaboration.</span></p> <p>Integral to the operation of SWSs is their capacity to integrate diverse tools, software, and data sources, effectively functioning as centralized hubs for research management. This integration expedites the research process and facilitates seamless data exchange and interoperability—a pivotal asset in an era characterized by the deluge of data and the imperative of interdisciplinary collaboration. Furthermore, SWSs afford researchers and project managers real-time insights into the progress of research endeavors, empowering them to identify bottlenecks, allocate resources judiciously, and optimize workflow execution. This granular oversight enhances project transparency and accountability and serves as a catalyst for informed decision-making.</p> <p>Crucially, SWSs are engineered to accommodate the complexities inherent in scientific inquiry, adeptly handling vast volumes of data and supporting parallel processing to meet the evolving demands of research projects. This scalability underscores their adaptability to diverse research paradigms, ensuring their relevance across a spectrum of scientific disciplines. Facilitating collaboration across geographic and temporal divides, SWSs offer a suite of collaborative features—including version control, shared workspaces, and communication tools—that transcend the constraints of physical proximity. By fostering a culture of inclusivity and knowledge exchange, SWSs catalyze innovation and synergy among distributed research teams.</p> <p>Moreover, SWSs serve as custodians of reproducibility, meticulously documenting each facet of the research workflow—from data sources to analysis methods—thus safeguarding the integrity of scientific inquiry. This commitment to transparency and methodological rigor underpins the credibility of research findings, engendering trust within the scientific community and beyond. The customizable nature of SWSs empowers research teams to tailor their workflows to suit their unique needs and preferences, further amplifying their utility and versatility. In essence, SWSs emerge not merely as tools of convenience but as indispensable allies in the relentless pursuit of scientific excellence.</p> <p>Numerous developers actively participate in the advancement of SWSs through diverse roles, including designing system architectures to ensure flexibility and performance, developing algorithms for data processing and analysis, crafting user-friendly interfaces, handling backend logic, integrating with external tools, and ensuring quality, security, and compliance. They address challenges such as optimizing performance and scalability by leveraging parallel processing and distributed computing techniques. To tackle these diverse tasks, developers encounter numerous challenges, often turning to crowd-sourced platforms like Stack Overflow and GitHub to discuss and address them. Stack Overflow serves as a vital resource for developers to seek solutions, learn new technologies, validate best practices, and engage with the programming community. Similarly, GitHub facilitates collaborative development by allowing developers to report problems, propose enhancements, and contribute to open-source projects. Our research draws insights from Stack Overflow discussions, GitHub issues, and pull request reports related to SWSs, reflecting the dynamic and collaborative nature of software development in this domain.</p>
Hypothetical Git workflows for simple scientific collaboration
<p>These diagrams illustrate three common workflow scenarios of a relatively simple empirical study with a maximum of three authors using Git/Github versioning tools. Their design was informed by Ram's (2013) body of work. The first scenario is the same as the three-author hypothesis proposed by Ram (2013).</p> <p>In the other two hypothetical scenarios, a single author's workflow is examined. In the first, he coordinates and manages changes with the remote repository from the start of the study, and in the second, he only does this when it comes time to publish the research's materials, data, and history of changes.</p> <p>Six .JPG files, in English (_EN) and Brazilian Portuguese (_PT), depict these three potential scenarios. The repository also contains a .PPTX file that can be edited if the reader wants to utilize any of the figures, either as a basis for additional diagrams or to change the figure's colors.</p>
reproducible geospatial scientific workflows
<p>Additional material for submission to JSS.</p> <p>Manuscript ID: TJSS-2018-0191.r1</p>
Analyzing Scientific Workflow Management Systems
<p>Contains data and scripts to reproduce the test runs that were used in the thesis "Analyzing Scientific Workflow Management Systems", and the complete result data.</p>
Figure 1d from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 1d A range of sample specimens that demonstrate the wide taxonomic range of specimens encountered in collections. They also demonstrate the diversity of label types, which include handwritten, typed, and printed labels. Note the presence of various barcodes, rulers, and a colour chart in addition to labels describing the origin of the specimen and its identity. - Fossilised animal skin (Natural History Museum 2009)
Figure 1b from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 1b A range of sample specimens that demonstrate the wide taxonomic range of specimens encountered in collections. They also demonstrate the diversity of label types, which include handwritten, typed, and printed labels. Note the presence of various barcodes, rulers, and a colour chart in addition to labels describing the origin of the specimen and its identity. - Pinned insect specimen (Natural History Museum 2018)
Figure 1c from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 1c A range of sample specimens that demonstrate the wide taxonomic range of specimens encountered in collections. They also demonstrate the diversity of label types, which include handwritten, typed, and printed labels. Note the presence of various barcodes, rulers, and a colour chart in addition to labels describing the origin of the specimen and its identity. - Microscope slide (Natural History Museum 2017)
Figure 1a from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 1a A range of sample specimens that demonstrate the wide taxonomic range of specimens encountered in collections. They also demonstrate the diversity of label types, which include handwritten, typed, and printed labels. Note the presence of various barcodes, rulers, and a colour chart in addition to labels describing the origin of the specimen and its identity. - Herbarium specimen (Natural History Museum 2007a)
Figure 11 from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 11 The distribution of languages across the specimen and herbaria. EN=English, FR=French, LA=Latin, ET=Estonian, DE=German, NL=Dutch, PT=Portuguese, ES=Spanish, SV=Swedish, RU=Russian, FI=Finnish, IT=Italian, ZZ=Unknown. The codes for the contributing herbaria are listed in Table 11 (from Dillen et al. 2019).
Supplementary material 1 from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Appendices
Figure 1e from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 1e A range of sample specimens that demonstrate the wide taxonomic range of specimens encountered in collections. They also demonstrate the diversity of label types, which include handwritten, typed, and printed labels. Note the presence of various barcodes, rulers, and a colour chart in addition to labels describing the origin of the specimen and its identity. - Liquid preserved specimen (Natural History Museum 2010)
Figure 2 from: Owen D, Groom Q, Hardisty A, Leegwater T, Livermore L, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e58030. https://doi.org/10.3897/rio.6.e58030
Figure 2 A possible semi-automatic digitisation workflow to extract data from the labels of collection specimens.
Figure 13 from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 13 Gold standard versus NER output.
Figure 12 from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 12 An example of a specimen label.
Figure 10 from: Owen D, Livermore L, Groom Q, Hardisty A, Leegwater T, van Walsum M, Wijkamp N, Spasić I (2020) Towards a scientific workflow featuring Natural Language Processing for the digitisation of natural history collections. Research Ideas and Outcomes 6: e55789. https://doi.org/10.3897/rio.6.e55789
Figure 10 Results per field from Google Cloud Vision.
Traces of scientific workflows
<p>This is an anonymized dataset containing the traces we obtained when we executed our scientific workflows.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.