Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
1,654
datasets available to search
ShareScore release 0.7.1
Dataset results
1,654 results for “Automation”
EMS - Automated High-Frequency Methane Data
Automated high-frequency methane (CH4) in ambient air measurements were made at the Harvard Forest (HF) research site since 1992. The proximity and the relative location of the site to numerous industrial/urban areas presents the opportunity to sample air flows that have been influenced by known CH4 sources on a regular and repeatable basis and to characterize the atmospheric chemical signature of the sampling location and assess its sensitivity to both local and regional sources at different time scales.
Dataset related to the manuscript: "An open-source integrated framework for the automation of citation collection and screening in systematic reviews"
<p>Dataset related to the manuscript: “An open-source integrated framework for the automation of citation collection and screening in systematic reviews”, to be used together with the code stored at https://github.com/AD-Papers-Material/BART_SystReviewClassifier to reproduce the results.</p> <p>There are three datasets:<br> - The Record data collected from the online scientific databases;<br> - The session journal which describes the search session, i.e., how many records were collected and from which source, for each query/session pairs.<br> - The session data which is the outcome of the classification and review tasks;</p>
SQLite database to accompany the paper, "Statistical learning mitigation of false positives from template-detected data in automated acoustic wildlife monitoring"
<p>This dataset is a SQLite database that accompanies methods and analysis described in the paper, "Statistical learning mitigation of false positives from template-detected data in automated acoustic wildlife monitoring" (Balantic & Donovan 2019, Bioacoustics, https://www.tandfonline.com/doi/full/10.1080/09524622.2019.1605309). </p> <p>A Github repository containing code for using the SQLite database also accompanies this paper at: <a href="https://github.com/cbalantic/false-positive-mitigation">http://github.com/cbalantic/false-positive-mitigation</a></p>
Ground Truth and Automated Classification from Copernicus Sentinel-2 Imagery
<p>Ground-Truth and Sentinel2 imagery classification of <em>Trees Outside Forest</em> in an agroforestry landscape in Umbria, Italy.</p> <p>Location: Alfina plains, Castelgiorgio area, Umbria, Italy. Reference system: EPSG:32632 (WGS84, UTM zone 32 North) Extent: West 740609 — East 750828, South 4726490 — North 4737250</p> <p>Dataset format: geopackage, a single file <strong>data.gpkg</strong> containing 9 vector layers (in alphabetical order):</p> <ol> <li>Areas — Areas of interest, 2 polygons</li> <li>Classification — Automated classification from Sentinel2 imagery, 11781 polygons</li> <li>Hedgerows1 — Ground truth, hedgerows of Area1, 148 lines</li> <li>Hedgerows2 — Ground truth, hedgerows of Area2, 135 lines</li> <li>Sentinel2 — Sentinel2 scenes footprint, one polygon</li> <li>Trees1 — Ground truth, isolated trees of Area1, 55 points</li> <li>Trees2 — Ground truth, isolated trees of Area2, 64 points</li> <li>Woods1 — Ground truth, small forest patches of Area1, 33 polygons</li> <li>Woods2 — Ground truth, small forest patches of Area2, 37 polygons</li> </ol> <p>Accompanying map: <strong>map.qgz</strong>, Qgis 3.6 format. The geopackage dataset is supposed to be stored in the same directory of the map (relative path = ./)</p> <p>Dataset description and metadata: <strong>meta.pdf</strong> </p> <p> </p>
Interactive maps for the visualization of ESRIUM automated driving tests with various EGNSS localization solutions
<p>In order to make the test results available to a broader audience in an easy manner, we have generated interactive maps. These maps are attached to this report and can be viewed in a web-browser. </p><p>Due to the large number of datasets, we have color-coded them on the map and in the menu. An arbitrary number of datasets can be selected at a time.</p><p>Due to the high accuracy of the EGNSS receivers, one can clearly identify the lane on which the vehicle was driving, and where the vehicle was performing a lane-change. However, the satellite/areal-images are not perfectly geo-referenced, thus one can notice a slight offset between satellite/areal-images and real-world lanes.</p><p> </p><p><strong>How to use the map?</strong></p><ul><li>The map can be used in a similar manner than other map-applications, such as google maps. By using the mouse, you can set the focus on the area of your interest. By using the +/- buttons (top left), you can zoom in/out.</li><li>By hovering over the layer-symbol (top right), a popup emerges. Here, you can select different background-tiles (such as satellite/areal-images). In addition, you can select different datasets which should be visualized on the map.</li></ul><p><strong>Background-tiles:</strong></p><ul><li>Basemap – Sat - Satellite/Areal images (from Basemap) -Symbolic map with high resolution (from Basemap)</li><li>Basemap – HighDPI Symbolic map with high resolution (from Basemap)</li><li>OpenStreetMap - Symbolic map (from OpenStreetMap)</li><li>OpenTopoMap - Symbolic map including topology information (from OpenTopoMap)</li></ul><p><strong>Datasets:</strong></p><ul><li>GNSS (Vehicle) - Position of vehicle, according to on-board GPS receiver</li><li>EGNSS (AsteRx SB3 Pro+) - Position of vehicle, according to AsteRx SB3 Pro+ receiver</li><li>EGNSS (mosaic-X5) - Position of vehicle, according to mosaic-X5 receiver</li><li>EGNSS (mosaic-H) - Position of vehicle, according to mosaic-H receiver</li><li>PVT Mode: EGNSS (AsteRx SB3 Pro+) - PVT Mode of AsteRx SB3 Pro+ receiver</li><li>PVT Mode: EGNSS (mosaic-X5) - PVT Mode of mosaic-X5 receiver</li><li>PVT Mode: EGNSS (mosaic-H) - PVT Mode of mosaic-H receiver</li><li>in-lane Offset Change-Request - Position, at which an in-lane offset change (relative to middle of the current lane) was requested via C-ITS</li><li>Lane Change to left - Position, at which a lane-change towards left was performed </li><li>Lane Change to right - Position, at which a lane-change towards right was performed</li></ul><p>Interactive maps are attached are two precision levels one with 4 and the other in 7 digits. The list files and the corresponding test conditions are listed below. </p><p>Test velocities [km/h]: 90, 110, 130 </p><p>interactive map files: </p><p>speed: 90 km/h</p><ul><li>Testrun_01.html</li><li>Testrun_03.html</li><li>Testrun_04.html</li></ul><p>speed: 110 km/h</p><ul><li>Testrun_05.html</li><li>Testrun_06.html</li><li>Testrun_07.html</li></ul><p>speed: 130 km/h </p><ul><li>Testrun_08.html</li><li>Testrun_09.html</li><li>Testrun_10.html</li></ul>
Automated Literature Screening for Systematic Reviews: Dataset for Evaluation Against Human Title and Abstract and Full-Text Screening Decisions
<p>This Zenodo entry contains the supplementary material associated with the manuscript titled <em>Automated Literature Screening for Systematic Reviews: A 5-Tier Prompting Approach Meeting Cochrane’s Sensitivity Requirement of Greater Than 0.99.</em> The paper will be presented at <a href="https://dbis.rwth-aachen.de/LLMs4MI2024/">LLMsMI 2024</a> in November 2024.</p> <p>A script is provided for replicating the executed experiments, along with a comprehensive evaluation file that reports all the experiment results. Provided data files represent an extension to the original datasets as provided by [1]. For associated systematic review manuscripts and eligibility criteria, please refer to [1] as well. </p> <p>[1] Guo, Eddie; Gupta, Mehul; Deng, Jiawen; Park, Ye-Jean; Paget, Mike; Naugler, Christopher (2023). "Automated Paper Screening for Clinical Reviews Using Large Language Models." <em>Mendeley Data</em>, V1, doi: 10.17632/np79tmhkh5.1. Accessed from: <a href="https://data.mendeley.com/datasets/np79tmhkh5/1" target="_new" rel="noopener">https://data.mendeley.com/datasets/np79tmhkh5/1</a>.</p>
Quality-Assurance Package for the "Automated, Open-Source, Vendor-Independent Quality Assurance Protocol Based on the Pulseq Framework" Manuscript
<h2>Background</h2> <p>Neuroimaging research requires consistent image quality and temporal signal stability, especially for functional magnetic resonance imaging (MRI) studies that rely on detecting subtle blood-oxygen-level-dependent (BOLD) signal changes. Regular MR system performance monitoring is essential, especially for longitudinal and multi-site studies. This study aims to establish a robust quality assurance (QA) protocol to promote data comparability across scanner models, vendors, and sites, as well as over a prolonged period.</p> <p>The manuscript titled "<em>Automated, Open-Source, Vendor-Independent Quality Assurance Protocol Based on the Pulseq Framework</em>" was submitted to the Special Issue <a href="https://link.springer.com/journal/10334/updates/26638300">Reproducibility and Quality Assurance</a> of the Magnetic Resonance Materials in Physics, Biology and Medicine (MAGMA) journal.</p> <p>This QA package proposed by the manuscript hosts materials for</p> <ul> <li>all reconstructed images,</li> <li>instruction for data acquisition,</li> <li>instruction for image reconstruction,</li> <li>instruction for post-processing,</li> <li>example raw data and DICOM images, and</li> <li>images and scripts for T1/T2 fitting.</li> </ul> <p>The detailed information is listed below.</p> <h2>All reconstructed images</h2> <p>This directory contains all reconstructed images from the fBIRN phantom on three Siemens 3T scanners (Trio, Prisma.Fit, and Cima.X) and one GE (UHP) 3T scanner. It contains four sub-folders for each scanner. And each sub-folder contains (some of) the following sub-folders:</p> <ul> <li><code>product_epi_ice</code>: ICE-reconstructed product EPI images.</li> <li><code>product_epi_gt</code>: Gadgetron-reconstructed product EPI images.</li> <li><code>pulseq_epi_ice</code>: ICE-reconstructed Pulseq EPI images.</li> <li><code>pulseq_epi_gt</code>: Gadgetron-reconstructed Pulseq EPI images.</li> <li><code>product_se_ice</code>: ICE-reconstructed product spin-echo (SE) images.</li> <li><code>product_se_gt</code>: Gadgetron-reconstructed product SE images.</li> <li><code>pulseq_se_ice</code>: ICE-reconstructed Pulseq SE images.</li> <li><code>pulseq_se_gt</code>: Gadgetron-reconstructed Pulseq SE images.</li> </ul> <h2>Instruction for data acquisition</h2> <p>This directory includes the following documents:</p> <ul> <li><code>write_QA_Tran_EPIrs.m</code> to generate the <code>QA_epi.seq</code> file for EPI scans.</li> <li><code>write_QA_Tran_T1.m</code>: to generate the <code>QA_T1.seq</code> file for SE scans.</li> <li><code>20241122_QA_protocol_instruction_siemens.docx</code>: standard operating procedure for QA measurements.</li> <li><code>QA_record.xlsx</code>: Excel sheet for the record of QA measurements.</li> </ul> <h2>Instruction for image reconstruction</h2> <h3><em>Documents</em></h3> <ul> <li><code>pulseq2mrd_epi.m</code>: convert GE Pulseq EPI raw data (<code>.mat</code>) to MRD raw data (<code>.h5</code>) using the LABEL information in the <code>QA_epi.seq</code> file.</li> <li><code>pulseq2mrd_se.m</code>: convert GE Pulseq SE raw data (<code>.mat</code>) to MRD raw data (<code>.h5</code>) using the LABEL information in the <code>QA_T1.seq</code> file.</li> <li><code>siemens2mrd_epi.m</code>: convert Siemens Pulseq EPI raw data (<code>.dat</code>) to MRD raw data (<code>.h5</code>) using the information in the <code>.dat</code> raw data.</li> </ul> <ul> <li><code>default.xml</code>: Gadgetron configuration file for SE image reconstruction. This document is already in the Gadgetron container: <code>/opt/conda/envs/gadgetron/share/gadgetron/config/default.xml</code>.</li> <li><code>qc_epi.xml</code>: Gadgetron configuration file for EPI image reconstruction, which is modified from the <code>default epi.xml</code> located in the Gadgetron container: <code>/opt/conda/envs/gadgetron/share/gadgetron/config/</code>.</li> </ul> <ul> <li><code>specialCard_ICE.png</code>: Special card setting for ICE online reconstruction.</li> </ul> <h3><em>Procedures for Gadgetron offline reconstruction</em></h3> <p><strong>Step 1: Gadgetron installation (for more details, visit <a href="https://gadgetron.github.io/tutorial/">here</a>)</strong></p> <ul> <li>Download and install <a href="https://www.docker.com/">Docker</a> software. You may need to install/update the Windows Sub Linux (WSL) system for the Docker installation.</li> <li>Open your terminal (Power shell with administrative privilege in Windows) and navigate to the folder you would like to map to the Gadgetron Docker container.</li> <li>Run: <code>docker run -t --name gt_latest --detach --volume ${pwd}:/opt/data ghcr.io/gadgetron/gadgetron/gadgetron_ubuntu_rt_nocuda:latest</code>. If docker is not recognized, set <code>docker</code> to connect to <code>C:\Program Files\Docker\Docker\resources\bin</code> in the Environment Path in Windows. This will download and then launch the <a href="https://gadgetron.readthedocs.io/en/latest/building.html">latest Gadgetron version</a> in a Docker container. It will also mount your current folder as a data folder inside the container.</li> <li>Run this command: <code>docker exec -ti gt_latest /bin/bash</code>. This will execute your Gadgetron container.</li> </ul> <p><strong>Step 2: Data preparation</strong></p> <ul> <li>Place your SE/EPI <code>.dat</code>/<code>.h5</code> data in the mounted folder.</li> <li>Run the command in Terminal: <code>cd /opt/data</code> to enter the mounted folder.</li> </ul> <p><strong>Step 3: MRD conversion</strong></p> <ul> <li>For Siemens data, you can convert the <code>.dat</code> data to MRD data by using Gadgetron. If Gsdgetron doesn't work (e.g. for XA EPI data), you can then use the Matlab script <code>siemens2mrd_epi.m</code>.</li> <li>The command for Siemens SE data conversion: <code>siemens_to_ismrmrd -f meas_MID*.dat -z 2 -o se_data.h5</code>.</li> <li>The command for Siemens EPI data conversion: <code>siemens_to_ismrmrd -f meas_MID*.dat -z 2 -m IsmrmrdParameterMap_Siemens.xml -x IsmrmrdParameterMap_Siemens_EPI.xsl -o epi_data.h5</code>.</li> <li>For GE data, you can convert the <code>.mat</code> raw data to MRD data by using the Matlab scripts with the corresponding <code>.seq</code> files. For SE conversion: use <code>pulseq2mrd_se.m</code> with <code>QA_T1.seq</code>. For EPI conversion: use <code>pulseq2mrd_epi.m</code> with <code>QA_epi.seq</code>.</li> </ul> <p><strong>Step 4: Gadgetron reconstruction</strong></p> <ul> <li>SE reconstruction: <code>gadgetron_ismrmrd_client -f se_data.h5 -c default.xml -o se_out.h5</code>.</li> <li>EPI reconstruction: first, put <code>qc_epi.xml</code> to the mounted folder and then copy it to the Gadgetron container: <code>cp /opt/data/qc_epi.xml /opt/conda/envs/gadgetron/share/gadgetron/config/</code>. Then, run the reconstruction: <code>gadgetron_ismrmrd_client -f epi_data.h5 -c qc_epi.xml -o epi_out.h5</code>.</li> </ul> <p><strong>Step 5: Load Gadgetron-reconstructed images (<code>.h5</code>)</strong></p> <ul> <li>Load SE <code>.h5</code> images in Matlab:</li> </ul> <blockquote> <p>filename = 'pulseq_se_out.h5' ;</p> <p>info = hdf5info(filename) ;</p> <p>address_data_1 = info.GroupHierarchy.Groups(1).Groups.Datasets(2).Name ;</p> <p>pulseq_se_im = squeeze(double( hdf5read(filename, address_data_1) ) ) ;</p> <p>pulseq_se_im = reshape(pulseq_se_im, [256, 256, 11, 2]) ;</p> </blockquote> <ul> <li>Load EPI <code>.h5</code> images in Matlab:</li> </ul> <blockquote> <p>filename = 'pulseq_epi_out.h5';</p> <p>info = hdf5info(filename) ;</p> <p>address_data_1 = info.GroupHierarchy.Groups(1).Groups.Datasets(2).Name ;</p> <p>pulseq_epi_im = squeeze(double( hdf5read(filename, address_data_1) ) ) ;</p> <p>pulseq_epi_im = reshape(pulseq_epi_im, [64, 64, 27, 200]) ;</p> </blockquote> <h3><em>Procedures for ICE online reconstruction</em></h3> <p>Before executing the Pulseq-based sequences, you can enable ICE online Reconstruction following the procedures below:</p> <ul> <li>Navigate to the Special Card (<code>specialCard_ICE.png</code>), set <code>Data handling</code> to <code>ICE STD</code> for NUMARIS/X (e.g. XA60A and XA61A), and <code>ICE 2D</code> for NUMARIS/4 (e.g. VB, VD, and VE).</li> <li>Select <code>Sum-of-Square</code> for coil combination.</li> <li>Be sure that the maximal pixel intensity does not violate the intensity threshold of <strong>4096</strong>.</li> </ul> <h2>Instruction for post-processing</h2> <p>The example post-processing is based on the reconstructed images from Cima.X over five days.</p> <h3><em>Reconstructed images from Cima.X</em></h3> <p><strong>Note</strong>: All <code>se</code> folders contain a <code>structuralQuality_main.m</code> to call the <code>structuralQuality.m</code> function for structural quality analysis. All <code>epi</code> folders contain a <code>temporalQuality_main.m</code> to call the <code>temporalQuality.m</code> function for temporal quality analysis.</p> <ul> <li><code>product_epi_ice</code>: ICE-reconstructed product EPI images.</li> <li><code>product_epi_gt</code>: Gadgetron-reconstructed product EPI images.</li> <li><code>pulseq_epi_ice</code>: ICE-reconstructed Pulseq EPI images.</li> <li><code>pulseq_epi_gt</code>: Gadgetron-reconstructed Pulseq EPI images.</li> <li><code>product_se_ice</code>: ICE-reconstructed product SE images.</li> <li><code>product_se_gt</code>: Gadgetron-reconstructed product SE images.</li> <li><code>pulseq_se_ice</code>: ICE-reconstructed Pulseq SE images.</li> <li><code>pulseq_se_gt</code>: Gadgetron-reconstructed Pulseq SE images.</li> </ul> <h3><em>QA analysis Matlab package: </em><code><em>QA_functions</em></code></h3> <ul> <li><code>circfit.m</code>: to find the center point and radius of the phantom.</li> <li><code>makeCircleMask.m</code>: to make a circular mask based on the center point and radius.</li> <li><code>structuralQuality.m</code>: to analyze the structural quality of the SE images.</li> <li><code>temporalQuality.m</code>: to analyze the temporal quality of the EPI images.</li> </ul> <h3><em>Post-processing procedures</em></h3> <ul> <li>Step 1: Add the <code>QA_functions</code> folder to your Matlab Path.</li> <li>Step 2: Run the <code>temporalQuality_main.m</code> or <code>structuralQuality_main.m</code> script in each folder to produce the QA results of all reconstructed images inside the folder.</li> <li>Step 3: Run the <code>make_figure_epi.m</code> and <code>make_figure_se.m</code> to produce some of the tables and figures used in the manuscript.</li> </ul> <h2>Example raw data and DICOM images</h2> <p>The data and DICOM images were acquired from Cima.X on the fBIRN phantom on 06.08.2024.</p> <ul> <li>DICOM folder: contains the DICOM images for four EPI scans (the first two scans for warm-up) and two SE scans.</li> <li><code>meas*.dat</code>: Siemens raw data of two EPI scans for temporal quality analysis and two SE scans for structural quality analysis.</li> <li><code>*data.h5</code> files: the ISMRMRD data of the four raw datasets.</li> <li><code>*out.h5</code> files: the images reconstructed by Gadgetron.</li> <li><code>*.nii</code>: the NIFTI-format reconstructed images.</li> <li><code>siemens2mrd_epi.m</code>: to convert the Siemens EPI raw data to ISMRMRD data.</li> <li><code>read_image.m</code>: to convert the Gadgetron-reconstructed h5-format images to NIFTI-format images.</li> </ul> <h2>Images and scripts for T1/T2 fitting</h2> <p>This package includes DICOM images and T1/T2 fitting scripts for the fBIRN phantom. Images for T1 fitting were acquired using a product turbo spin echo sequence with an inversion recovery pulse (repetition time = 4000 ms, echo train length = 4). Images for T2 fitting were obtained using a product SE sequence (repetition time = 3500 ms). Both measurements were conducted on the Siemens Prisma.Fit 3T scanner on 05.06.2024.</p> <ul> <li><code>T1 sub-folder</code>: contains all DICOM images for T1 fitting with inversion recovery times of {50, 150, 300, 450, 600, 750, 900, 1050, 1200, 1350, 1500, 2200, 3000} ms.</li> <li><code>T2 sub-folder</code>: contains all DICOM images for T2 fitting with echo times of {7.5, 15, 30, 45, 60, 75, 90, 130, 200, 250} ms.</li> <li><code>Do_T1fit.m</code>: Matlab script for T1 fitting.</li> <li><code>Do_T2fit.m</code>: Matlab script for T2 fitting.</li> </ul> <p>For more information regarding Pulseq and the workflow for data acquisition and image reconstruction, please visit our GitHub repositories: <a href="https://github.com/pulseq/pulseq">Pulseq Matlab software</a>, <a href="https://github.com/pulseq/tutorials">Pulseq Tutorials</a>, and <a href="https://github.com/pulseq/Pulseq-Rocks-2023-24-ISMRM-Reproducibility-Challenge">Pulseq Rocks for the 2024 ISMRM Reproducibility Team Challenge</a>.</p> <p>If you need any further information or have any questions, please feel free to contact our Pulseq email address: pulseq.mr@uniklinik-freiburg.de.</p>
Datset of automated economic reasoning problems for QE / SMT
<p>This dataset is generated by 45 economics theorems "A implies H" where A are assumptions and H a hypothesis. These are taken from textbooks and papers and chosen for their suitability for automatic solution with Quantifier Elimination (QE) or Satisfiability Modulo Theory (SMT) technology. </p> <p>For each theorem three problems are generated: checking the compatibility of the assumptions; checking for the existence of an example of the theorem; and checking for the existence of a counterexample. </p> <p>There are three files:</p> <p>1. EconomicReasoningBenchmarks-Apr18-SMT2.zip</p> <p>This zip file will uncompress into a directory with 45 files, one for each theorem stating the three existence checks within the SMT2 format. Thus these files are suitable for use with any SMT solver supporting the theory.</p> <p> </p> <p>2. EconomicReasoningBenchmarks-Apr20-Redlog.txt</p> <p>This plain text file can be run with the Redlog Package for the Computer Algebra System Reduce. It contains definitions and calls to Redlog's QE command to check for a counterexample for all 45 theorems.</p> <p> </p> <p>3. EconomicReasoningBenchmarks-Apr23-Maple.txt</p> <p>This plain text file is for use with the Maple Computer Algebra System. For each theorem it provides the polynomials used in the Tarski formula to check for a counterexample. The polynomials are given as a list of lists with the outer list representing logical OR between entries and each inner list logical AND. </p> <p> </p>
Dataset Comparison of MRI-based automated segmentation methods and functional neurosurgery targeting with direct visualization of the Ventro-intermediate thalamic nucleus at 7T
<p>Scientific Reports - Nature - DOI : 10.1038/s41598-018-37825-8</p> <p>##################################<br> "Comparison of MRI-based automated segmentation methods and functional neurosurgery targeting with direct visualization of the Ventro-intermediate thalamic nucleus at 7T"<br> ##################################</p> <p>E. Najdenovska*, C. Tuleasca*, J. Jorge, P. Maeder, J.P. Marques, T. Roine, D. Gallichan, J.-P. Thiran, M. Levivier, and M. Bach Cuadra</p> <p>*Equally contributed authors</p> <p><br> Copyright (c) - All rights reserved. University of Lausanne. 2018.</p> <p><br> To reproduce the analyses presented in the referred study, in this repository you could find the MR images acquired from nine young healthy subjects (YS1-YS5), four elderly healthy subject (ES1-ES4) and two drug-resistant tremor patients treated treated with Vim radiosurgery by Gamma Knife (P1 and P2).</p> <p>The provided dataset includes the following NifTI files:</p> <p>- MPRRAGE @3T<br> - DWI @3T (together with the corresponding bvals and bvecs)<br> - MP2RAGE @7T<br> - SWI @7T<br> - binary masks of the manual delineation of both left and right Vim respectively that were done on the SWI (as NifTI files as well).</p> <p>Additionally, for the young cohort (YS1-YS5) we include as well the images used for building the quadrilateral of Guiot:<br> - T2-w @3T<br> - T2 CISS @3T</p> <p>For the patients (P1 and P2), a follow-up MPRAGE (acquired at 3T) with Gadolinium enhancement is also provided.</p> <p>——————————————<br> Notes:<br> 1. For YS3 MP2RAGE at 7T is missing, instead MPRAGE at 3T was used</p> <p>2. The code performing the thalamic nuclei clustering could be found in Zenodo (DOI: 10.5281/zenodo.123768)</p>
Data from Automated plankton image analysis using convolutional neural networks
<p>Datasets and code from Luo et al., "Automated plankton image analysis using convolutional neural networks." Limnology and Oceanography Methods.</p> <p>Data include:</p> <p>1) 42,564 item training library, sorted in 108 classes,</p> <p>2) 42,548 item test set for filtering thresholds, sorted into 38 groups. These images are independent from the training library, and are used for setting the thresholds for post-classification filtering.<br> CSV file: Luo_etal_FT_images_pred.csv contains the image name, predicted class, predicted probability, and validated group. Note that the file class_to_group.csv is needed to match up the class names to the group names.</p> <p>3) 75,000 item fully random, validated set for confusion matrix calculations, sorted into 38 groups. This set is a representation of the full dataset, selected at random after classification. <br> CSV file: Luo_etal_confusionmatrix_images.csv contains the image name, predicted class, predicted probability, and validated group. Note that the file class_to_group.csv is needed to match up the class names to the group names.</p> <p> </p> <p>Scripts and programs:</p> <p>1) Segmentation.zip contains the scripts and executables for the segmentation program.</p> <p>2) Plankton_template.zip contains the archived version of the SparseConvNet program used in manuscript (current version available at: https://github.com/btgraham/SparseConvNet or https://github.com/facebookresearch/SparseConvNet)<br> Note that google-sparsehash is necessary for running SparseConvNet.<br> Also, plankton_epoch-150.cnn are the weights from the training used in the manuscript, and should be placed in the /weights folder if you want to replicate the classifications.</p>
Identifying Coronal Mass Ejection Active Region Sources: An automated approach - Catalogue results
<p>Catalogue of Coronal Mass Ejection (CME) active region sources. Includes a database version and a simplified .csv version. For full details, refer to the source code at <a href="https://github.com/JulioHC00/cmesrc">https://github.com/JulioHC00/cmesrc</a>. We include a README file for each describing each column.</p> <p>We also include the raw data used to generate the catalogue so that results may be reproduced following the steps detailed in <a href="https://github.com/JulioHC00/cmesrc">https://github.com/JulioHC00/cmesrc</a>. This is a collection of data from other works and we provide it only to allow the results to be reproduced</p> <p>Below, we detail the data sources for the raw_data folders</p> <p>==============================<br><strong>RAW DATA SOURCES</strong><br>==============================</p> <p><strong>DIMMINGS FOLDER</strong></p> <p>Data is from Solar Demon, .csv was provided by Emil Kraaikamp through private communication.</p> <blockquote> <p>Solar Demon – an approach to detecting flares, dimmings, and EUV waves on SDO/AIA images<br>Emil Kraaikamp, Cis Verbeeck<br>J. Space Weather Space Clim. 5 A18 (2015)<br>DOI: 10.1051/swsc/2015019</p> </blockquote> <p><strong>HARPNUM_TO_NOAA FOLDER</strong></p> <p>Obtained from http://jsoc.stanford.edu/doc/data/hmi/harpnum_to_noaa/all_harps_with_noaa_ars.txt</p> <p><strong>LASCO FOLDER</strong></p> <p>This CME catalog is generated and maintained at the CDAW Data Center by NASA and The Catholic University of America in cooperation with the Naval Research Laboratory. SOHO is a project of international cooperation between ESA and NASA.</p> <p>Downloaded from https://cdaw.gsfc.nasa.gov/CME_list/</p> <p><strong>MVTS FOLDER</strong></p> <p>Data from</p> <blockquote> <p>Angryk, R.A., Martens, P.C., Aydin, B. et al. Multivariate time series dataset for space weather data analytics. Sci Data 7, 227 (2020). https://doi.org/10.1038/s41597-020-0548-x</p> </blockquote> <p>Available at the Harvard Dataverse</p> <blockquote> <p>Angryk, Rafal; Martens, Petrus; Aydin, Berkay; Kempton, Dustin; Mahajan, Sushant; Basodi, Sunitha; Ahmadzadeh, Azim; Xumin Cai; Filali Boubrahimi, Soukaina; Hamdi, Shah Muhammad; Schuh, Micheal; Georgoulis, Manolis, 2020, "SWAN-SF", https://doi.org/10.7910/DVN/EBCFKM, Harvard Dataverse, V1</p> </blockquote> <p>The DT_SWAN folder contains the same data but with extra columns obtained directly from the Joint Science Operations Center (JSOC) through the python package drms.</p>
Speculative Automated Refactoring of Imperative Deep Learning Programs to Graph Execution
<p>Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code---supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations. Our key insight is that, while DL programs typically execute sequentially, hybridizing imperative DL code resembles parallelizing sequential code in traditional systems. Inspired by this, we present an automated refactoring approach that assists developers in determining which otherwise eagerly-executed imperative DL functions could be effectively and efficiently executed as graphs. The approach features novel static imperative tensor and side-effect analyses for Python. Due to its inherent dynamism, analyzing Python may be unsound; however, the conservative approach leverages a speculative (keyword-based) analysis for resolving difficult cases that informs developers of any assumptions made. The approach is: (i) implemented as a plug-in to the PyDev Eclipse IDE that integrates the WALA Ariadne analysis framework and (ii) evaluated on nineteen DL projects consisting of 132 KLOC. The results show that 326 of 766 candidate functions (42.56%) were refactorable, and an average relative speedup of 2.16x on performance tests was observed with negligible differences in model accuracy. The results indicate that the approach is useful in optimizing imperative DL code to its full potential.</p>
Not So Weak-PICO: Leveraging weak supervision for Participants, Interventions, and Outcomes recognition for systematic review automation
<p>EBM-PICO is a widely used dataset with PICO annotations at two levels: span-level or coarse-grained and entity-level or fine-grained. Span-level annotations encompass the full information about each class. Entity-level annotations cover the more fine-grained information at the entity level, with PICO classes further divided into fine-grained subclasses. For example, the coarse-grained Participant span is further divided into participant age, gender, condition and sample size in the randomised controlled trial. This dataset comes pre-divided into a training set (n=4,933) annotated through crowd-sourcing and an expert annotated gold test set (n=191) for evaluation.</p> <p>The <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6174533/bin/NIHMS988059-supplement-Appendix.pdf">EBM-PICO annotation guidelines</a> caution about variable annotation quality. <a href="http://ceur-ws.org/Vol-2429/paper1.pdf">Abaho et al.</a> developed a framework to post-hoc correct EBM-PICO outcomes annotation inconsistencies. <a href="https://arxiv.org/pdf/1904.09557.pdf">Lee et al.</a> studied annotation span disagreements suggesting variability across the annotators. Low annotation quality in the training dataset is excusable, but the errors in the test set can lead to faulty evaluation of the downstream ML methods. We evaluate 1% of the EBM-PICO training set tokens to gauge the possible reasons for the fine-grained labelling errors and use this exercise to conduct an error-focused PICO re-annotation for the EBM-PICO gold test set. The file 'test_ebm_correctedlabels.tsv' has error corrected EBM-PICO gold test set.</p> <p> </p> <p>The upload also contains two zip files containing labelling sources mentioned in the Distant-PICO paper. </p> <ol> <li>ds_cto_dict.zip: contains the four distant supervision dictionaries (P: participant.txt, I = intervention.txt, intervetion_syn.txt, O: outcome.txt) generated from clinicaltrials.gov using the methodology described in Distant-CTO. </li> <li>handcrafted_dictionaries.zip: contains three files <ul> <li>gender_sexuality.txt: contains a list of possible genders and sexual orientations found across the web. The list is not comprehensive.</li> <li>endpoints_dict.txt: contains outcome names and the names of questionnaires used to measure outcomes assembled from PROM questionnaires and PROMs.</li> <li>comparator_dict: contains a list of idiosyncratic comparator terms like a sham, saline, placebo, etc., compiled from the literature search. The list is not comprehensive.</li> </ul> </li> </ol>
PnP module: multi-material components manufacturing by Automated Tape Laying process
<p><strong>Introduction</strong></p> <p>The Automated Tape Laying (ATL) process is an automated technique used for composites manufacturing based on fiber placement processes. This module is part of AIMEN Technology Centre Open Pilot Line focusing on manufacturing of multi-material components. This module is composed by a movement system (robot) and heating system (ATL head), which can be composed by IR system or laser source. </p> <p><strong>Asset Administration Shell</strong></p> <p>The Asset Administration Shell (AAS) modelling follows the <em>Product</em>, <em>Process</em> and <em>Resources</em> (PPR) model. The relation between the assets allows the traceability of the Product by demonstrating a Digital Thread based on AAS and how the active AAS modelling allows the Plug and Produce capabilities in a modular production scheme.</p> <p>In this repository some examples of AAS modeling (.aasx files) for a subset of assets in the shop floor (Resources), Product and Process can be found, as well as the architecture of the whole module.</p> <p><strong>Architecture</strong></p> <p>The information gathered by the central unit/industrial PC (Operational Technology) will be available in DIMOFAC platform (Information Technology) as well as the Product information related to the design and/or simulation (Engineering Technology). In the central unit the software in charge of taking the decision and allowing Plung and Produce capabilities is named “Orchestrator”, and in the product side, the software in charge of register all the information related with a specific software “Digital Thread”.</p> <p> </p> <p><strong>AAS Demonstration</strong></p> <p>A demonstration video is available: <a href="https://www.youtube.com/watch?v=aOP6QWiF5FE&t=7s">PnP module: multi-material components manufacturing by Automated Tape Laying process - YouTube</a></p>
Data for: A tool based on the Industry Foundation Classes standard for dynamic data collection and automatic generation of Building Automation Control Networks
<p>This dataset shows the results obtained for a case study at TRL4 for the research paper title <em><strong>A tool based on the Industry Foundation Classes standard for dynamic data collection and automatic generation of Building Automation Control Networks</strong></em>, with DOI: https://doi.org/10.1016/j.jobe.2023.107625</p> <p>This dataset is an enhanced IFC (Industry Foundation Classes) file with the creation of the BACN (Building Automation Control Network). This IFC file includes the devices created automatically by the BACN2BIM tool (developed by CARTIF Technology Centre) for the case study validated at TRL4. The original IFC was obtained from the Institute for Automation and Applied Informatics (IAI) / Karlsruhe Institute of Technology (KIT) https://www.ifcwiki.org/images/e/e3/AC20-FZK-Haus.ifc, under an unrestricted license, as served as one of the case studies for this research.</p> <p>*Depending on the IFC viewer used, the included sensors may not be represented correctly. In this case, it is recommended to try with another IFC viewer, for example xBIM explorer https://docs.xbim.net/downloads/xbimxplorer.html or BimCollab Zoom Free https://www.bimcollab.com/en/support/downloads/</p>
Meteorology and soil moisture data collected at multiple frequencies from the C-CALI NPP site automated monitoring stations: Jornada Basin LTER, 2013 - ongoing
This dataset contains summary data collected at the Jornada Basin LTER program's C-CALI NPP site weather station and associated soil substation at several temporal scales. Precipitation data are collected at 1-second frequency during rain events, air temperature and wind at 5-minute frequency, and all sensors are measured at 30-minute, hourly and daily frequencies. Observed values include average/maximum/minimum air temperature, relative humidity, and wind speed; average wind direction; total precipitation; soil moisture, temperature and conductivity. These are measured and calculated based on 1-second scan rate of all sensors located at an automated weather station, and a nearby soil substation, installed at the site. Wind speed is measured at 75 cm, 150 cm, and 300 cm, wind direction at approximately 3m, and air temperature and relative humidity at approximately 2.5m. Soil sensors are installed at approximately 10, 20 and 30cm depths.
Meteorology and soil moisture data collected at multiple frequencies from the C-GRAV NPP site automated monitoring stations: Jornada Basin LTER, 2013 - ongoing
This dataset contains summary data collected at the Jornada Basin LTER program's C-GRAV NPP site weather station and associated soil substation at several temporal scales. Precipitation data are collected at 1-second frequency during rain events, air temperature and wind at 5-minute frequency, and all sensors are measured at 30-minute, hourly and daily frequencies. Observed values include average/maximum/minimum air temperature, relative humidity, and wind speed; average wind direction; total precipitation; soil moisture, temperature and conductivity. These are measured and calculated based on 1-second scan rate of all sensors located at an automated weather station, and a nearby soil substation, installed at the site. Wind speed is measured at 75 cm, 150 cm, and 300 cm, wind direction at approximately 3m, and air temperature and relative humidity at approximately 2.5m. Soil sensors are installed at approximately 10, 20 and 30cm depths.
Meteorology and soil moisture data collected at multiple frequencies from the C-SAND NPP site automated monitoring stations: Jornada Basin LTER, 2013 - ongoing
This dataset contains summary data collected at the Jornada Basin LTER program's C-SAND NPP site weather station and associated soil substation at several temporal scales. Precipitation data are collected at 1-second frequency during rain events, air temperature and wind at 5-minute frequency, and all sensors are measured at 30-minute, hourly and daily frequencies. Observed values include average/maximum/minimum air temperature, relative humidity, and wind speed; average wind direction; total precipitation; average and total solar incoming and reflectance; average albedo; average net radiation; soil moisture, temperature and conductivity. These are measured and calculated based on 1-second scan rate of all sensors located at an automated weather station, and a nearby soil substation, installed at the site. Wind speed is measured at 75 cm, 150 cm, and 300 cm, wind direction at approximately 3m, air temperature and relative humidity at approximately 2.5m, and solar at approximately 3m. Soil sensors are installed at approximately 10, 20 and 30cm depths.
Meteorology and soil moisture data collected at multiple frequencies from the G-BASN NPP site automated monitoring stations: Jornada Basin LTER, 2013 - ongoing
This dataset contains summary data collected at the Jornada Basin LTER program's G-BASN NPP site weather station and associated soil substation at several temporal scales. Precipitation data are collected at 1-second frequency during rain events, air temperature and wind at 5-minute frequency, and all sensors are measured at 30-minute, hourly and daily frequencies. Observed values include average/maximum/minimum air temperature, relative humidity, and wind speed; average wind direction; total precipitation; soil moisture, temperature and conductivity. These are measured and calculated based on 1-second scan rate of all sensors located at an automated weather station, and a nearby soil substation, installed at the site. Wind speed is measured at 75 cm, 150 cm, and 300 cm, wind direction at approximately 3m, and air temperature and relative humidity at approximately 2.5m. Soil sensors are installed at approximately 10, 20 and 30cm depths.
Meteorology and soil moisture data collected at multiple frequencies from the G-IBPE NPP site automated monitoring stations: Jornada Basin LTER, 2013 - ongoing
This dataset contains summary data collected at the Jornada Basin LTER program's G-IBPE NPP site weather station and associated soil substation at several temporal scales. Precipitation data are collected at 1-second frequency during rain events, air temperature and wind at 5-minute frequency, and all sensors are measured at 30-minute, hourly and daily frequencies. Observed values include average/maximum/minimum air temperature, relative humidity, and wind speed; average wind direction; total precipitation; average and total solar incoming and reflectance; average albedo; average net radiation; soil moisture, temperature and conductivity. These are measured and calculated based on 1-second scan rate of all sensors located at an automated weather station, and a nearby soil substation, installed at the site. Wind speed is measured at 75 cm, 150 cm, and 300 cm, wind direction at approximately 3m, air temperature and relative humidity at approximately 2.5m, and solar at approximately 3m. Soil sensors are installed at approximately 10, 20 and 30cm depths.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.