Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
109
datasets available to search
ShareScore release 0.9.0
Dataset results
109 results for “Data pipelines”
Polarimetric Differential Imaging with VLT/NACO. A comprehensive PDI pipeline for NACO data (PIPPIN)
<p>This dataset consists of the reduced data products generated with <strong>PIPPIN</strong> (<strong>P</strong>D<strong>I</strong> <strong>p</strong>i<strong>p</strong>el<strong>i</strong>ne for <strong>N</strong>ACO data). PIPPIN employs the Polarimetric Differential Imaging (PDI) technique to distinguish the polarised scattered light from the (largely) un-polarised stellar light. As a result, circumstellar dust can be uncovered around young stellar objects. PIPPIN was specifically developed to reduce the archival polarimetric observations made by the <a href="https://www.eso.org/sci/facilities/paranal/decommissioned/naco.html">VLT/NACO</a> instrument. During its operation, NACO employed different instrument configurations (e.g. half-wave plate or de-rotator usage, Wollaston beam-splitter or wiregrid observations) which are appropriately handled by PIPPIN. As part of the PDI reduction, PIPPIN performs various levels of corrections for instrumental polarisation and crosstalk.</p> <p>Documentation for the PIPPIN pipeline can be found <a href="https://pippin-naco.readthedocs.io/">here</a>. If you use PIPPIN or PIPPIN-reduced data products for your publication, we ask you to cite our <a href="https://www.aanda.org/10.1051/0004-6361/202348736%20">paper</a>. </p> <p> </p> <p>The dataset is sorted per (potential) young stellar object and sub-divided into the respective nights of observation (if applicable). Within the <em>pipeline_output/</em> directories, the data are sorted by the utilised observing strategy (<em><OBS_ID>_<EXPTIME>_<FILTER>/</em>). The <em>_beams.fits</em> files comprise the sky-subtracted, cropped images that are used to generate the PDI data products in the <em>PDI/</em> directory.</p> <p>Depending on the observations, the <em>PDI/</em> directory contains the following files:</p> <p><strong>Total intensities:</strong></p> <ul> <li><strong><em>I.fits</em></strong>: Total intensity <span>\(I = \frac{1}{2}(I_{Q}+I_{U})\)</span>.<br>[<em>CUBE_I</em>, <em>MEDIAN_I</em>, <em>CUBE_I_CTC</em>, <em>MEDIAN_I_CTC</em>]</li> <li><strong><em>I_Q.fits</em></strong>: Intensity as <span>\(I_Q = \frac{1}{2}(I_{Q^+}+I_{Q^-})\)</span>.<br>[<em>CUBE_I_Q</em>, <em>MEDIAN_I_Q</em>]</li> <li><strong><em>I_Q+.fits</em></strong>: Intensity of <span>\(Q^+\)</span> measurements.<br>[<em>CUBE_I_Q+</em>, <em>MEDIAN_I_Q+</em>]</li> <li><strong><em>I_Q-.fits</em></strong>: Intensity of <span>\(Q^-\)</span> measurements.<br>[<em>CUBE_I_Q-</em>, <em>MEDIAN_I_Q-</em>]</li> <li><strong><em>I_U.fits</em></strong>: Intensity as <span>\(I_U = \frac{1}{2}(I_{U^+}+I_{U^-})\)</span>.<br>[<em>CUBE_I_U</em>, <em>MEDIAN_I_U</em>, <em>CUBE_I_U_CTC</em>, <em>MEDIAN_I_U_CTC</em>]</li> <li><strong><em>I_U+.fits</em></strong>: Intensity of <span>\(U^+\)</span> measurements.<br>[<em>CUBE_I_U+</em>, <em>MEDIAN_I_U+</em>, <em>CUBE_I_U+_CTC</em>, <em>MEDIAN_I_U+_CTC</em>]</li> <li><strong><em>I_U-.fits</em></strong>: Intensity of <span>\(U^-\)</span> measurements.<br>[<em>CUBE_I_U-</em>, <em>MEDIAN_I_U-</em>, <em>CUBE_I_U+_CTC</em>, <em>MEDIAN_I_U-_CTC</em>]</li> </ul> <p><strong>Stokes parameters:</strong></p> <ul> <li><strong><em>Q.fits</em></strong>: Stokes <span>\(Q = \frac{1}{2}(Q^+-Q^-)\)</span>. <br>[<em>CUBE_Q</em>, <em>MEDIAN_Q</em>, <em>MEDIAN_Q_IPS</em>, <em>MEDIAN_Q_CTC_IPS</em>]</li> <li><strong><em>Q+.fits</em></strong>: Stokes <span>\(Q^+=I_\mathrm{ord}-I_\mathrm{ext}\)</span>.<br>[<em>CUBE_Q+</em>, <em>MEDIAN_Q+</em>]</li> <li><strong><em>Q-.fits</em></strong>: Stokes <span>\(Q^-=I_\mathrm{ord}-I_\mathrm{ext}\)</span>. <br>[<em>CUBE_Q-</em>, <em>MEDIAN_Q-</em>]</li> <li><strong><em>U.fits</em></strong>: Stokes <span>\(U = \frac{1}{2}(U^+-U^-)\)</span>.<br>[<em>CUBE_U</em>, <em>MEDIAN_U</em>, <em>MEDIAN_U_IPS</em>, <em>MEDIAN_U_CTC_IPS</em>]</li> <li><strong><em>U+.fits</em></strong>: Stokes <span>\(U^+=I_\mathrm{ord}-I_\mathrm{ext}\)</span>.<br>[<em>CUBE_U+,</em> <em>MEDIAN_U+</em>]</li> <li><strong><em>U-.fits</em></strong>: Stokes <span>\(U^-=I_\mathrm{ord}-I_\mathrm{ext}\)</span>. <br>[<em>CUBE_U-</em>, <em>MEDIAN_U-</em>]</li> </ul> <p><strong>Final polarised light products:</strong></p> <ul> <li><strong><em>PI.fits</em></strong>: Polarised intensity <span>\(PI = \sqrt{Q^2+U^2}\)</span>.<br>[<em>PI</em>, <em>PI_R2</em>, <em>PI_IPS</em>, <em>PI_IPS_R2</em>, <em>PI_CTC_IPS</em>, <em>PI_CTC_IPS_R2</em>]</li> <li><strong><em>Q_phi.fits</em></strong>: Azimuthal Stokes parameter <span>\(Q_\phi = -Q\cos 2\phi - U\sin 2\phi\)</span>.<br>[<em>Q_PHI</em>, <em>Q_PHI_R2</em>, <em>Q_PHI_IPS</em>, <em>Q_PHI_IPS_R2</em>, <em>Q_PHI_CTC_IPS</em>, <em>Q_PHI_CTC_IPS_R2</em>, <em>Q_PHI_UPC_CTC_IPS</em>, <em>Q_PHI_UPC_CTC_IPS_R2</em>]</li> <li><strong><em>U_phi.fits</em></strong>: Azimuthal Stokes parameter <span>\(U_\phi = +Q\sin 2\phi - U\cos 2\phi\)</span>.<br>[<em>U_PHI</em>, <em>U_PHI_R2</em>, <em>U_PHI_IPS</em>, <em>U_PHI_IPS_R2</em>, <em>U_PHI_CTC_IPS</em>, <em>U_PHI_CTC_IPS_R2</em>, <em>U_PHI_UPC_CTC_IPS</em>, <em>U_PHI_UPC_CTC_IPS_R2</em>]</li> </ul> <p>The values given in brackets [] are the fits extensions. <em>CUBE_</em> extensions are given for each cycle, while <em>MEDIAN_</em> indicates the median-combination of the <em>CUBE_</em> images. The extension <em>_IPS</em> gives the instrumental-polarisation subtracted result, <em>_CTC</em> gives the crosstalk-corrected image, and <em>_UPC</em> gives the <span>\(U_\phi\)</span>-minimised result. <em>_R2</em>-products are scaled by the squared projected radius.</p> <p><em>_EXTENDED</em> data products are generated if the position angle was rotated, rather than the half-wave plate, to obtain the linear Stokes parameters. The position-angle rotation permits a broader coverage of the sky, which results in images with the characteristic shape of an eight-pointed star.</p>
Figure data for Hansen et al. 2023, Global warming in the pipeline, OOCC
<p>Raw data used to produce the figures in Hansen et al. 2023, Global warming in the pipeline, published in Oxford Open Climate Change.</p>
Reproducible data, example subsets, and analysis pipeline for the extended TAaCGH study of breast cancer genomic and transcriptomic profiles
Open the record for dataset details and reuse information.
Data from: A reusable pipeline for large-scale fiber segmentation on unidirectional fiber beds using fully convolutional neural networks
Open the record for dataset details and reuse information.
Data for Mahgoub et al. analytic pipeline
<p>Data for Mahgoub et al. analytic pipeline</p>
Informing antenna design for Global 21-cm experiments using a simulated Bayesian data analysis pipeline (supplementary data)
<p>These are the posterior files, foreground simulation data sets and chromaticity factor values used to produce the results for <a href="https://arxiv.org/abs/2106.10193">arXiv:2106.10193</a>.</p> <p>Plots of the fitted signal and residuals for each case are included, as is a plotting function to reproduce key figures.</p> <p>Naming conventions:</p> <ul> <li>f0: Centre frequency of the 21cm signal present in the simulated data</li> <li>A: Amplitude of the simulated 21cm signal present in the simulated data</li> <li>M_sig: Model being fit to the data includes a 21cm signal</li> <li>M_nosig: Model being fit to the data is a foreground only</li> </ul> <p>Software used:</p> <ul> <li><a href="https://github.com/PolyChord/PolyChordLite/tree/839292290a7747dbee82933bb9f7f955ac45c3ca">PolyChord</a></li> </ul> <p> </p>
Example data and pipelines for OptiNiSt
<p>Content revision resulting from the update of OptiNiSt (ver. 2.0).</p>
Data and script pipeline for: Common to rare transfer learning (CORAL) enables inference and prediction for a quarter million rare Malagasy arthropods
<p>The scripts and the data provided in this depository demonstrate how to apply the approach described in the paper "<strong>Common to rare transfer learning (CORAL) enables inference and prediction for a quarter million rare Malagasy arthropods</strong>" by Ovaskainen et al. Here we summarize how to use the software with a small, simulated dataset, with running time less than a minute in a typical laptop (Demo 1); (2) how to apply the analyses presented in the paper for a small subset of the data, with running time of ca. one hour in a powerful laptop (Demo 2); how to reproduce the full analyses presented in the paper, with running time up to several days, depending on the computational resources (Demo 3). The Demos 1 and 2 are aimed to be user-friendly starting points for understanding and testing how to implement CORAL. The Demo 3 is included mainly for reproducibility.</p> <p> </p> <p><strong><u>System requirements</u></strong></p> <p> </p> <p>· The software can be used in any operating system where R can be installed.</p> <p>· We have developed and tested the software in a windows environment with R version 4.3.1.</p> <p>· Demo 1 requires the R-packages phytools (2.1-1), MASS (7.3-60), Hmsc (3.3-3), pROC (1.18.5) and MCMCpack (1.7-0).</p> <p>· Demo 2 requires the R-packages phytools (2.1-1), MASS (7.3-60), Hmsc (3.3-3), pROC (1.18.5) and MCMCpack (1.7-0).</p> <p>· Demo 3 requires the R-packages phytools (2.1-1), MASS (7.3-60), Hmsc (3.3-3), pROC (1.18.5) and MCMCpack (1.7-0), jsonify (1.2.2), buildmer (2.11), colorspace (2.1-0), matlib (0.9.6), vioplot (0.4.0), MLmetrics (1.1.3) and ggplot2 (3.5.0).</p> <p>· The use of the software does not require any non-standard hardware.</p> <p> </p> <p><strong><u>Installation guide</u></strong></p> <p> </p> <p>· The CORAL functions are implemented in Hmsc (3.3-3). The software that applies the is presented as a R-pipeline and thus it does not require any installation other than installation of R.</p> <p> </p> <p><strong><u>Demo 1: Software demo with simulated data</u></strong></p> <p><strong> </strong></p> <p>The software demonstration consists of two R-markdown files:</p> <p> </p> <p>· <strong>D01_software_demo_simulate_data.</strong> This script creates a simulated dataset of 100 species on 200 sampling units. The species occurrences are simulated with a probit model that assumes phylogenetically structured responses to two environmental predictors. The pipeline saves all the data needed to data analysis in the file allDataDemo.RData: XData (the first predictor; the second one is not provided in the dataset as it is assumed to remain unknown for the user), Y (species occurrence data), phy (phylogenetic tree), studyDesign (list of sampling units). Additionally, true values used for data generation are save in the file trueValuesDemo.RData: LF (the second environmental predictor that will be estimated through a latent factor approach), and beta (species responses to environmental predictors).</p> <p>· <strong>D02_software_demo_apply_CORAL</strong>. This script loads the data generated by the script D01 and applies the CORAL approach to it. The script demonstrates the informativeness of the CORAL priors, the higher predictive power of CORAL models than baseline models, and the ability of CORAL to estimate the true values used for data generation.</p> <p> </p> <p>Both markdown files provide more detailed information and illustrations. The provided html file shows the expected output. The running time of the demonstration is very short, from few seconds to at most one minute.</p> <p> </p> <p><strong><u>Demo 2: Software demo with a small subset of the data used in the paper</u></strong></p> <p><strong> </strong></p> <p>The software demonstration consists of one R-markdown file:</p> <p> </p> <p><strong>MA_small_demo.</strong> This script uses the CORAL functions in HMSC to analyze a small subset of the Malagasy arthropod data. In this demo, we define rare species as those with prevalence at least 40 and less than 50, and common species as those with prevalence at least 200. This leaves 51 species to the backbone model and 460 rare species modelled through the CORAL approach. The script assess model fit for CORAL priors, CORAL posteriors, and null models. It further visualizes the responses of both the common and the rare species to the included predictors.</p> <p> </p> <p><strong><u>Scripts and data for reproducing the results presented in the paper (Demo 3)</u></strong></p> <p> </p> <p>The input data for the script pipeline is the file “allData.RData”. This file includes the metadata (meta), the response matrix (Y), and the taxonomical information (taxonomy). Each file in the pipeline below depends on the outputs of previous files: they must be run in order. The first six files are used for fitting the backbone HMSC model and calculating parameters for the CORAL prior:</p> <p> </p> <p>· <strong>S01_define_Hmsc_model</strong> - defines the initial HMSC model with fixed effects and sample- and site-level random effects.</p> <p>· <strong>S02_export_Hmsc_model</strong> - prepares the initial model for HPC sampling for fitting with Hmsc-HPC. Fitting of the model can be then done in an HPC environment with the bash file generated by the script. Computationally intensive.</p> <p>· <strong>S03_import_posterior</strong> – imports the posterior distributions sampled by the initial model.</p> <p>· <strong>S04_define_second_stage_Hmsc_model</strong> - extracts latent factors from the initial model and defines the backbone model. This is then sampled using the same S02 export + S03 import scripts. Computationally intensive.</p> <p>· <strong>S05_visualize_backbone_model</strong> – check backbone model quality with visual/numerical summaries. Generates Fig. 2 of the paper.</p> <p>· <strong>S06_construct_coral_priors</strong> – calculate CORAL prior parameters.</p> <p> </p> <p>The remaining scripts evaluate the model:</p> <p>· <strong>S07_evaluate_prior_predictionss </strong>– use the CORAL prior to predict rare species presence/absences and evaluate the predictions in terms of AUC. Generates Fig. 3 of the paper.</p> <p>· <strong>S08_make_training_test_split</strong><em> </em>– generate train/test splits for cross-validation ensuring at least 40% of positive samples are in each partition.</p> <p>· <strong>S09_cross-validate</strong><em> </em>– fit CORAL and the baseline model to the train/test splits and calculate performance summaries. Note: we ran this once with the initial train/test split and then again with on the inverse split (i.e., <em>training = ! training</em> in the code, see comment). The paper presents the average results across these two splits. Computationally intensive.</p> <p>· <strong>S10_show_cross-validation_results</strong><em> </em>– Make plots visualizing AUC/Tjur’s R<sup>2</sup> produced by cross-validation. Generates Fig. 4 of the paper.</p> <p>· <strong>S11a_fit_coral_models</strong><em> </em>– Fit the CORAL model to all 250k rare species. Computationally intensive.</p> <p>· <strong>S11b_fit_baseline_models</strong><em> </em>– Fit the baseline model to all 250k rare species. Computationally intensive.</p> <p>· <strong>S12_compare_posterior_inference</strong><em> ­­</em>– compare posterior climate predictions using CORAL and baseline models on selected species, as well as variance reduction for all species. Generates Fig. 5 of the paper.</p> <p> </p> <p>Pre-processing scripts:</p> <p>· <strong>P01_preprocess_sequence_data.R </strong>– Reads in the outputs of the bioinformatics pipeline and converts them into R-objects.</p> <p>· <strong>P02_download_climatic_data.R </strong>– Downloads the climatic data from "sis-biodiversity-era5-global” and adds that to metadata.</p> <p>· <strong>P03_construct_Y_matrix.R </strong>– Converts the response matrix from a sparse data format to regular matrix. Saves “allData.RData”, which includes the metadata (meta), the response matrix (Y), and the taxonomical information (taxonomy).</p> <p> </p> <p>Computationally intensive files had runtimes of 5-24 hours on high-performance machines. Preliminary testing suggests runtimes of over 100 hours on a standard laptop.</p> <p><em> </em></p> <p><strong><u>ENA Accession numbers</u></strong></p> <p>All raw sequence data are archived on mBRAVE and are publicly available in the European Nucleotide Archive (ENA; https://www.ebi.ac.uk/ena; project accession number PRJEB86111; run accession numbers ERR15018787-ERR15009869; sample IDs for each accession and download URLs are provided in the file ENA_read_accessions.tsv).</p>
Replication data for estimating the below-ground leak rate of a natural gas pipeline using above-ground downwind measurements: THE ESCAPE−1 MODEL
<p>Gas leak detectors are currently used to survey for below-ground leaks. However, measurements from gas detectors are not precise in quantifying the below-ground leak rate—data in this submission aimed to quantify the below-ground leak rate of a Natural Gas pipeline.</p>
MIntO: a Modular and Scalable Pipeline for Microbiome Metagenomic and Metatranscriptomic Meta-omics Data Integration
<p>To illustrate the use of MIntO, a set of 91 human fecal metagenomes from the Inflammatory Bowel Disease Multi’omics Database was selected (IBDMDB). We selected six participants diagnosed as non-IBD (P6018 (nIBD1), M2072 (nIBD2)); Crohn’s disease (H4006 (CD1) and H4020 (CD2)); and ulcerative colitis (H4019 (UC1) and H4035 (UC2)) that were followed for one year each. </p> <p>Here, we present the results from the <em>genome-based assembly-dependent</em> mode, where we used 91 metagenomic high-quality reads<strong> </strong>to recover 163 high-quality MAGs, which constituted a set of non-redundant genomes.</p>
Proccessed Data for the Pipelines of the Project "Multiomics and quantitative modelling disentangle diet, host, and microbiota contributions to the host metabolome"
<p><strong>Proccessed and Input Data for the Pipelines of the Project "Multiomics and quantitative modelling disentangle diet, host, and microbiota contributions to the host metabolome"</strong></p> <p>-----------------------------------------------------------------------------------------------------</p> <p>Contents:</p> <p>-----------------------------------------------------------------------------------------------------</p> <p>Folder /ProcessedData/metabolomics/ contains processed metabolomics data from the project:</p> <p>/metabolomics/metabolites_allions_combined_norm_intensity.csv - file containing normalized intensities of ions detected across tissues with six measurement methods.<br> /metabolomics/metabolites_allions_combined_formulas_with_metabolite_filters_spatial100clusters_with_mean.csv - file containing metabolite attribution to spatial clusters and mean intensity values across tissues and conditions.</p> <p>Other files are described in README_ProcessedData.md.</p> <p>-----------------------------------------------------------------------------------------------------</p> <p>Folder /ProcessedData/sequencing/ contains raw and normalized counts of metagenomics and metatransriptomics data mapped to bacterial genomes.</p> <p>Folder /ProccessedData/util/ contains files used for data preprocessing and attribution to chemical classes and pathways.</p> <p>Folder /ProcessedData/example_output/ contains example output of the pipelines:</p> <p>/output/model_results_SMOOTH_raw_2LIcoefHost1LIcoefbact_allions.csv - file containing estimated model parameters (intestinal flux and metabolic flux values) for the forward problem for metabolomics measurements in the GIT.<br> /output/model_results_SMOOTH_normbyabsmax_reciprocal_problem_allions.csv - file containing estimated model parameters for the reverse problem (metabolite intensities) for the parameters estimated with the forward problem.<br> /output/model_results_SMOOTH_normbyabsmax_2LIcoefHost1LIcoefbact_allions.csv - file containing estimated model parameters (intestinal flux and metabolic flux values) for the forward problem for metabolomics measurements in the GIT, normalized by absolute maximum value.<br> /output/model_results_SMOOTH_normbyabsmax_ONLYMETCOEF_2LIcoefHost1LIcoefbact_allions.csv - file containing estimated model parameters (only metabolic flux values) for the forward problem for metabolomics measurements in the GIT, normalized by absolute maximum value.<br> /output/table_hierarchical_clustering_groups.csv - file containing attribution of the annotated metabolites to groups according to hierarchical clustering of the normalized model parameters.<br> /output/cgo_clustergrams_of_model_coefficients.mat - matlab object containing clustergram of the normalized model parameters and manually derived sub-clustergrams corresponding to different largest parameter values.</p> <p>Description of other files is provided in the file README_ProcessedData.md.</p> <p>-----------------------------------------------------------------------------------------------------</p> <p>Folder /InputData/ contains HMDB and KEGG tables used for metabolite annotations and chemical group analysis.</p> <p>Folder InputData_KEGGreaction_path contains matlab files with metabolite-metabolite paths calculated from KEGG reaction-pair information (Each matrix contains a subset of paths). These files are used by the script workflow_extract_keggECpathes_for_SPpairs_final.m.</p> <p>Folder InputData_metabolomics_data contains raw metabolomics data from six methods (three LC columns: C08, C18 and HILIC, and positive and negative acquisition modes) and file tissue_weights.txt with tissue weight information used for normalization.</p> <p>Folder InputData_sequencing_data contains folders ballgown_DNA and ballgown_RNA with results of metagenomic and metatranscriptomic data analysis (raw counts, GetMM normalized counts, EdgeR and DeSeq2 analysis). </p> <p>Description of folders is provided in the file readme_InputData.md.</p> <p>-----------------------------------------------------------------------------------------------------</p>
Benchmark datasets for testing AIRR-seq data processing with pyIgMap pipeline
<p>This is a set of raw FASTQ files produced by various AIRR-seq protocols, stored here for benchmark conveinience and for reference purposes.</p> <p>Currently it contains the following datasets:</p> <table> <tbody> <tr> <td><strong>id</strong></td> <td><strong>fastq</strong></td> <td><strong>reference</strong></td> <td><strong>method</strong></td> <td><strong>description</strong></td> </tr> <tr> <td>allergy</td> <td> <p>ERR7425614_1.fastq.gz,</p> <p>ERR7425614_2.fastq.gz</p> </td> <td>https://doi.org/10.7554/eLife.79254</td> <td>5'RACE, UMI, long MiSeq reads, IGH w/ isotype</td> <td>Longitudinal full-length IGH repertoire profiling and clonal lineage dynamics in memory B cells, plasmablasts and plasma cells of human peripheral blood</td> </tr> <tr> <td>covid</td> <td> <p>fmba_TRAB_R1.fastq.gz,</p> <p>fmba_TRAB_R2.fastq.gz</p> </td> <td> <p>https://doi.org/10.1101/2023.11.08.566227</p> </td> <td>DNA multiplex, UMI, TRA+TRB mix, NextSeq</td> <td>TCR sequencing in COVID-19 convalescent and healthy donors</td> </tr> <tr> <td>natprot</td> <td> <p>PMID27490633_R1.fastq.gz,</p> <p>PMID27490633_R2.fastq.gz</p> </td> <td> <p>https://doi.org/10.1038/nprot.2016.093</p> </td> <td>5'RACE, UMI, long MiSeq reads, high-quality overlap, IGH no isotype</td> <td>High-quality full-length immunoglobulin profiling with unique molecular barcoding</td> </tr> <tr> <td>brnaseq</td> <td> <p>SRR3743469_R1.fastq.gz,</p> <p>SRR3743469_R2.fastq.gz</p> </td> <td> <p>https://doi.org/10.1016/j.immuni.2016.08.012</p> </td> <td>RNA-Seq, all chains, B-cells</td> <td>Primary human mature naïve B-cells (IgD+CD38lo; NB) and GCB-cells (CD77+CD38hi; GCB) were purified from tonsils of healthy individuals. RNA-seq libraries were prepared using the Illumina TruSeq RNA sample kits according to the manufacturer.</td> </tr> <tr> <td>uhrr</td> <td> <p>UHRR_full_R1.fastq.gz,</p> <p>UHRR_full_R2.fastq.gz</p> </td> <td> <p>https://doi.org/10.1038/s41598-021-04583-z</p> </td> <td>RNA-Seq, bulk</td> <td>Universal Human Reference RNA</td> </tr> <tr> <td>10x</td> <td> <p>10x_bcr_R1.fastq.gz,</p> <p>10x_bcr_R2.fastq.gz,</p> <p>10x_tcr_R1.fastq.gz,</p> <p>10x_tcr_R2.fastq.gz</p> </td> <td> <p>https://www.10xgenomics.com/datasets/human-pbmc-from-a-healthy-donor-10-k-cells-v-2-2-standard-5-0-0</p> </td> <td>10x Genomics vdj</td> <td>See reference. AIRR-seq is split into TCR and BCR parts</td> </tr> </tbody> </table> <p> </p>
AMIA Pipeline Test Data
<p>The first datasets in the HIV-1C_ZA folder contains the initial Human Immuniodefeciency Virus 1C (HIV-1C) Integrase (IN) amino acid mutations associated with patient sequence data extrapoloated in a previous research project conducted by R. Chitongo (DOI: 10.1371/journal.pone.0223464). This dataset is curated in a standard Comma Separated Variable (.csv) file with each of the mutations associated with a particular patient listed benath a random identifier with no direct or indirect patient information present. These random identifiers do not correlate to a specific patient either and have just been assigned for differential purposes between which mutations were present in a particular patient. This also includes the protein homology model generated in our study present in the standar Protein Data Bank (PDB) format of the HIV-1C IN. The second variant_ouputs folder contains the various datasets and files generated from the initial phase of the AMIA pipeline which is further elaborated upon in the published literature.</p> <p> </p> <p> </p>
Example data set for the ChIPexo Pipeline
<p>Example data set for the ChIP-exo Analytical Pipeline available through GitHub</p> <p>https://github.com/SysBioChalmers/ChIPexo_Pipeline</p>
A performance comparison of Dask and Spark for data-intensive neuroimaging pipelines (Interactive Gantt chart)
<p>Interactive Gantt chart for the paper "A performance comparison of Dask and Spark for data-intensive neuroimaging pipelines".</p>
Data bundle for powerd-data: A transparent and reproducible data processing pipeline for energy system modeling based on egon-data
<div> <p><strong>powerd-data</strong> provides a transparent and reproducible open data based data processing pipeline for generating data models suitable for energy system modeling. Is is a fork from the open-source tool <strong>egon-data</strong>. </p> <p>powerd-data and egon-data retrieve and process data from several different external input sources. As not all data dependencies can be downloaded automatically from external sources, we provide a data bundle to be downloaded by egon-data.</p> <p>The following data sets are part of the available data bundle:</p> <ol> <li>district_heating_shares: <ul> <li>Assumed district heating share for all European countries in 2050</li> <li>Source: Own representation</li> <li>License: Attribution 4.0 International (CC BY 4.0)</li> </ul> </li> <li>egon_demandregio_cts_ind:<br> <ul> <li>Industrial and CTS demands per branch and NUTS3 region in Germany for the year 2050</li> <li>Source: egon-data, based on data from DemandRegio disaggregator tool</li> <li>License: Data license Germany – © FfE 2019, © Statistisches Bundesamt (Destatis), 2008-2017 – version 2.0</li> </ul> </li> <li>industrial_gas_demand: <ul> <li>This folder contains 5 files. The files CH4_for_industry_eGon100RE.json, CH4_for_industry_eGon2035.json, H2_for_industry_eGon100RE.json and H2_for_industry_eGon2035.json contain the industrial hourly demands for hydrogen and methane in NUTS3 resolution for the scenarios eGon100RE and eGon2035. The file region_corr.json provides information that make it possible to correlate each load to a geographical position.</li> <li>License: Attribution 4.0 International (CC BY 4.0) © FfE, eXtremOS Project</li> </ul> </li> </ol> <p> </p> </div>
Data for: A computational pipeline to observe the flexibility and dynamics of (plant) cytochrome P450 binding sites
<p>Binding site flexibility and dynamics strongly affect the ability of proteins to accommodate substrates and inhibitors. The significance of these properties is particularly pronounced for proteins that are inherently flexible, such as cytochrome P450 enzymes (CYPs). While the research on human CYPs provides detailed knowledge on both structural and functional level, such analyses are still lacking for their plant counterparts. This study aims to bridge this gap. Firstly, we use molecular dynamics (MD) simulations to capture the full conformational ensemble for a certain plant CYP. Subsequently, we developed and applied a comprehensive methodology to analyse a number of binding site properties - size, flexibility, shape, hydrophobicity, and accessibility - using the fpocket and mdpocket packages on MD-generated trajectories. This led to a first categorization of 15 chosen plant CYPs based on their binding site's (dis)similarities. The workflow was tested and verified on human CYPs 1A2, 2A6, and 3A4 as their binding site characteristics are well known. In addition to confirming known binding site properties, we identified and named previously unseen binding site channels for CYPs 1A2 and 2A6. This study gives initial insights into the largely uncharted fields plant CYP substrate specificity and facilitates a more precise understanding of their largely unknown specific biological functions. It offers new insights into the structural and functional dynamics of plant CYPs, which may facilitate a more accurate understanding of the fate of agrochemicals or the biotechnological design and exploitation of enzymes with specific functions. Additionally, it serves as a reference for future structural-functional analyses of CYP enzymes across various biological kingdoms.</p>
A new pipeline for removing paralogs in target enrichment data
<p><span><span>Target enrichment (such as Hyb-Seq) is a well-established high throughput sequencing method that has been increasingly used for phylogenomic studies. Unfortunately, current widely used pipelines for analysis of target enrichment data do not have a vigorous procedure to remove paralogs in target enrichment data. In this study, we develop a pipeline we call Putative Paralogs Detection (PPD) to better address putative paralogs from enrichment data. The new pipeline is an add-on to the existing HybPiper pipeline, and the entire pipeline applies criteria in both sequence similarity and heterozygous sites at each locus in the identification of paralogs. Users may adjust the thresholds of sequence identity and heterozygous sites to identify and remove paralogs according to the level of phylogenetic divergence of their group of interest. The new pipeline also removes highly polymorphic sites attributed to errors in sequence assembly and gappy regions in the alignment. We demonstrated the value of the new pipeline using empirical data generated from Hyb-Seq and the Angiosperm 353 kit for two woody genera <i>Castanea</i> (Fagaceae, Fagales) and <i>Hamamelis</i> (Hamamelidaceae, Saxifragales). Comparisons of datasets showed that the PPD identified many more putative paralogs than the popular method HybPiper. Comparisons of tree topologies and divergence times showed evident differences between data from HybPiper and data from our new PPD pipeline. We further evaluated the accuracy and error rates of PPD by BLAST mapping of putative paralogous and orthologous sequences to a reference genome sequence of<i> Castanea mollissima</i>. Compared to HybPiper alone, PPD identified substantially more paralogous gene sequences that mapped to multiple regions of the reference genome (31 genes for PPD compared with 4 genes for HybPiper alone). In conjunction with HybPiper, paralogous genes identified by both pipelines can be removed resulting in the construction of more robust orthologous gene datasets for phylogenomic and divergence time analyses. Our study demonstrates the value of Hyb-Seq with data derived from the Angiosperm 353 probe set for elucidating species relationships within a genus, and argues for the importance of additional steps to filter paralogous genes and poorly aligned regions (e.g., as occur through assembly errors), such as our new PPD pipeline described in this study.</span></span></p>
Automated Data Quality Assurance with GitLab pipelines and Docker
<ul> <li>The Data Validation and Quality Assurance demonstrator is a tool designed to assist with collaborative research projects, ensuring that collected data complies with established schemas and monitoring these files for unusual or unexpected values. This demonstrator attempts to show how a task of this nature can be attempted in a scalable, cloud based infrastructure, while maintaining compatibility with existing frameworks. In this presentation we will cover a brief use case, showing the results of the demonstrator on an example dataset that contains some intentionally added data quality items</li> </ul>
Data for the Demo of the Image2Reg pipeline
<p>This entry contains the two data directories required by the demo of our Image2Reg pipeline, which is described in our GitHub repository https://github.com/uhlerlab/image2reg . The data is automatically downloaded from Zenodo during the execution of the demo application. The image data contained in the repository is taken from the data from Mohammad Hossein Rohban Shantanu Singh Xiaoyun Wu Julia B Berthet Mark-Anthony Bray Yashaswi Shrestha Xaralabos Varelas Jesse S Boehm Anne E Carpenter(2017) Systematic morphological profiling of human gene and allele function via Cell Painting, eLife 6:e24060. Please cite this resource if you use our application or this data. All rights for the imaging data remain with the authors of the before mentioned publication.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.