Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
14
datasets available to search
ShareScore release 0.9.0
Dataset results
14 results for “Alignment free”
Supplementary material: Picosecond pulse-shaping for strong three-dimensional field-free alignment of generic asymmetric-top molecules
<p><strong>Supplementary material to the manuscript <em>"Picosecond pulse-shaping for strong three-dimensional field-free alignment of generic asymmetric-top molecules"</em> by Terry Mullins, Evangelos T. Karamatskos, Joss Wiese, Jolijn Onvlee, Arnaud Rouzée, Andrey Yachmenev, Sebastian Trippel, and Jochen Küpper, <em>Nat Commun</em> 13, 1431 (2022). <a href="https://doi.org/10.1038/s41467-022-28951-z">https://doi.org/10.1038/s41467-022-28951-z</a>, arXiv: <a href="https://arxiv.org/abs/2009.08157">2009.08157 </a></strong></p> <ul> <li> <em><strong>simulations_part.z*</strong> </em>is split zip archive containing simulations data for indole molecule, such as files with rotational probability density distributions computed at different times <span class="math-tex">\(t=0..1500\)</span> ps during the laser pulse and field-free evolution, and example python scripts for data retrieval.</li> <li><strong><em>rawdata_part.z*</em></strong> is split zip archive containing raw experimental data.</li> <li><strong><em>analysis_scripts.zip</em></strong> is zip archive containing experimental analysis codes.</li> </ul> <p><strong>The <em>simulations_part.zip</em> contains the following files and folders:</strong></p> <ul> <li><em><strong>prob_density_euler_angles</strong></em> contains files <em>rotdens_av_<time>.gz</em> with simulated state-averaged rotational probability density distributions in terms of Euler angles for different times <time>, ranging from the beginning of the alignment laser pulse at <span class="math-tex">\(t=0\)</span> up to <span class="math-tex">\(t=1500\)</span> ps with a time step of 1 ps.<br> Calculations of probability density distributions were done using <a href="https://github.com/CFEL-CMI/richmol">Richmol</a> program.<br> The gzipped ASCII data files <em>rotdens_av_<time>.gz</em> contain in columns the values of the Euler angles <span class="math-tex">\(\phi,\theta,\chi\)</span> followed by the normalized probability density value.</li> <li><em><strong>prob_density_atoms_xyz</strong></em> contains files <em>monte_carlo_av_<time>.h5</em> with state-averaged rotational probability density distributions of all atoms in the indole molecule in terms of their Cartesian coordinates, for different times <time>, ranging from the beginning of the alignment pulse at <span class="math-tex">\(t=0\)</span> up to <span class="math-tex">\(t=1500\)</span> ps with a time step of 1 ps.<br> Structure of <em>monte_carlo_av_<time>.h5</em> HDF5 files:<br> Key Description<br> ----- ----------------<br> 'C10' - Cartesian coordinates of carbon atom no. 10<br> 'C11' - Cartesian coordinates of carbon atom no. 11<br> 'C12' - ...<br> 'C14' - ...<br> 'C3' - ...<br> 'C6' - ...<br> 'C7' - ...<br> 'C9' - ...<br> 'N4' - ...<br> 'H1-C3' - Cartesian coordinates of a vector pointing from carbon atom no. 3 to hydrogen atom no. 1<br> 'H13-C11' - ...<br> 'H15-C12' - ...<br> 'H16-C14' - ...<br> 'H2-N4' - ...<br> 'H5-C7' - ...<br> 'H8-C9' - ...<br> 'ref_vectors' - reference molecular-frame Cartesian coordinates of all atoms<br> 'x' - coordinates of the x-axis of Principal Axes of Inertia Frame<br> 'y' - coordinates of the y-axis of Principal Axes of Inertia Frame<br> 'z' - coordinates of the z-axis of Principal Axes of Inertia Frame<br> 'pol_x' - coordinates of the x-axis of Principal Axes of Polarizability Frame<br> 'pol_y' - coordinates of the y-axis of Principal Axes of Polarizability Frame<br> 'pol_z' - coordinates of the z-axis of Principal Axes of Polarizability Frame</li> <li><em><strong>indole_deflected_states.txt</strong></em> ASCII file contains initial populations of rotational states of indole in the deflected beam.<br> The following data is arranged in columns: <em>m, J</em>, <em>id</em>, <em>energy</em>, <em>normalized population</em>. The <em>J</em> and <em>m</em> are rotational quantum numbers of the total angular momentum and its <em>Z</em>-projection, the <em>id</em> number refers to the state's index in file <em>indole_energies_j0_j20.txt</em> listing rotational states of indole.</li> <li><em><strong>indole_data.py</strong></em> Python module provides basic functions to extract information from HDF5 data files <em>monte_carlo_av_<time>.h5</em>. It can also be used to compute alignment and orientation.</li> <li><em><strong>example_cos.py</strong></em> and <em><strong>example_dens.py</strong></em> Python scripts that demonstrate how to use <em>indole_data.py</em> module for computing and plotting alignment traces and a 2D projection of the probability density distribution, respectively.</li> <li><em><strong>monte_carlo.py</strong></em> Python script that was used to compute through Monte-Carlo sampling probability density distributions for Cartesian positions of atoms in indole (<em>monte_carlo_av_<time>.h5</em> files) using probability density distribution functions in Euler angles (outputs of Richmol program <em>rotdens_av_<time>.gz</em>).</li> </ul> <p><strong>The <em>analysis_scripts.zip</em> contains the following files and folders:</strong></p> <ul> <li><strong><em>H_Plus</em></strong> folder contains codes relevant for the analysis of H<sup>+</sup> ion data. <ul> <li><strong><em>analyse_full_alignment_scans.m</em></strong>: subtracts background and combines delay scan data sets together, takes account of errors.</li> <li><em><strong>calculate_resamped_df.m</strong></em>: called by <em>analyse_full_alignment_scans.m</em> to calculate the frequency sampling.</li> <li><em><strong>unique_mean.m</strong></em>: called by <em>analyse_full_alignment_scans.m</em> when combining data sets. Combines non-unique data points into a single data point.</li> </ul> </li> <li><em><strong>C_Plus2</strong></em> folder contains codes for the analysis of C<sup>2+</sup> ion data. The file descriptions are identical to those in the <em>H_Plus</em> directory.</li> <li><em><strong>intensity/calculate_intensity.m</strong></em>: calculates peak intensity of the laser pulse from measured parameters as well as statistical error.</li> <li><em><strong>intensity/compare_exp_sim.m</strong></em>: fits experimental and theoretical tomography and delay-dependent 2D projection values.</li> <li><em><strong>intensity/nir2hdf5_kHz.py</strong></em>: converts raw data files (from <em>rawdata_part.z*</em> archive<em>)</em> into hdf5 files.</li> </ul>
InpactorDB: A Plant classified lineage-level LTR retrotransposon reference library for free-alignment methods based on Machine Learning
<p>LTR retrotransposons are mobile elements that make up the major part of most plant genomes. Their identification and annotation via bioinformatics approaches represent a major challenge in the era of massive plant genome sequencing. In addition to their involvement in the variation in genome size, these elements are also associated in the function and structure of different chromosomal regions and in the alteration of the function of coding regions, among others. Several plant retrotransposon sequence databases of LTR retrotransposons are available with public access such as PGSB, RepetDB or restricted access such as Repbase. Although they are useful for approaches to identify LTR-RTs in new genomes by similarity, the elements of these databases are not classified down to the lineage/family level. with great depth. </p> <p>Here, we present InpactorDB a semi-curated dataset composed of 130,511 elements from 195 plant genomes (belonging to 108 plant species), classified down to the lineage level. This data set has been used to train two deep neural networks (one fully connected and one convolutional) for fast classification of elements. Used in lineage-level classification approaches, we obtain a score above 98% of F1-score, precision and recall. </p> <p>In order to classify elements of the ‘LTR_STRUC’ and ‘EDTA’ datasets, we used the methodology proposed by Inpactor, which uses homology-based strategy with known coding domains belonging to LTR-RTs. We utilized the RexDB domain library as reference. LTR-RTs were classified into superfamilies, Gypsy (RLG) or Copia (RLC) and sub-classified into lineages according to the similarities of five different amino acid reference domains (GAG, AP, RT, RNAseH, and INT domains). In addition, we applied filters to remove keep only intact elements:</p> <p>1) to remove predicted elements with domains from two different superfamilies (i.e. Gypsy and Copia),</p> <p>2) or elements with domains belonging to two or more different lineages,</p> <p>3) to remove elements with lengths different than those reported by Gypsy Database (GyDB) with a tolerance of 20%,</p> <p>4) to delete incomplete elements which has less than three identified domains, and</p> <p>5) to remove elements with insertions of TE class II (reported in Repbase). </p> <p>The final non-redundant version of InpactorDB consists of 67,305 LTR retrotransposons. Both redundant and non-redundant versions of InpactorDB are available in Fasta format in which sequences have identifiers with the following general Identification code:</p> <p>>Superfamily-Lineage-plant_family-specie-source-length-ID,</p> <p>Where Superfamily can is either RLC (for Copia) or RLG (for Gypsy), Lineage/family follows following the RexDB nomenclature, source (can be Repbase, RepetDB, PGSB, LTR_STRUC or EDTA datasets), length, and ID, is a unique number which identify each element inside the InpactorDB.</p>
Reference data for "Limitations of alignment-free tools in total RNA-seq quantification"
<p>This repository contains reference data for "Limitations of alignment-free tools in total RNA-seq quantification"</p>
Alignment free identification of clones in Bcell receptor repertoires
<p>The data sets are used for the analysis of the Alignment free [1] clonal identification approach.</p> <p>[1] "Alignment free identification of clones in B cell receptor repertoires", Ofir Lindenbaum, Nima Nouri, Yuval Kluger, Steven H. Kleinstein .</p> <p>Preprint available at: https://www.biorxiv.org/content/10.1101/2020.03.30.017384v1</p>
Supplementary material 2 from: Nugent CM, Adamowicz SJ (2020) Alignment-free classification of COI DNA barcode data with the Python package Alfie. Metabarcoding and Metagenomics 4: e55815. https://doi.org/10.3897/mbmg.4.55815
File S2 – Python script for custom grid search of hyperparameters for optimization of the neural network
Supplementary material 3 from: Nugent CM, Adamowicz SJ (2020) Alignment-free classification of COI DNA barcode data with the Python package Alfie. Metabarcoding and Metagenomics 4: e55815. https://doi.org/10.3897/mbmg.4.55815
File S3 – The parameters utilized in the grid search for each of the five machine learning algorithms tested in the design of the Alfie package
Supplementary material 4 from: Nugent CM, Adamowicz SJ (2020) Alignment-free classification of COI DNA barcode data with the Python package Alfie. Metabarcoding and Metagenomics 4: e55815. https://doi.org/10.3897/mbmg.4.55815
File S4 – Jupyter notebook with tutorial demonstrating how to apply the Alfie classifier in the Python programming language, and how to train custom alignment-free classifiers using the Alfie training module
The dataset for "Force-free current sheets in the Jovian magnetodisk: a key role of electron field-aligned anisotropy"
<p>The dataset for "Force-free current sheets in the Jovian magnetodisk: a key role of electron field-aligned anisotropy" submitted to J. Geophys. Res. This dataset contains information about 18 current sheet in the Jovian magnetodisk. PDF file includes the table and eighteen figures with current sheets. The table lists corresponding dates/times of the current sheet crossings by Juno spacecraft. Archive includes ASCII flies with data plotted on these figures.</p>
Simulated pairs of nucleotide sequences for testing (alignment-free) genome distance estimate methods
<p>This repository contains 24,000 pairs of nucleotide sequences (and associated parameters) that have been simulated for testing alignment-free genome distance estimates. Given an evolutionary distance <em>d</em> varying from 0.05 to 1.00 nucleotide substitutions per character (step = 0.05), the program <a href="http://abacus.gene.ucl.ac.uk/software/indelible/"><em>INDELible</em></a> was used to simulate the evolution of 200 nucleotide sequence pairs with <em>d</em> substitution events per character under the models GTR and GTR+Γ. Each model was adjusted with three different equilibrium frequencies:</p> <ul> <li><em>f</em><sub>1</sub>: equal frequencies, i.e. freq(A) = freq(C) = freq(G) = freq(T) = 0.25,</li> <li><em>f</em><sub>2</sub>: GC-rich, i.e. freq(A) = 0.1, freq(C) = 0.3, freq(G) = 0.4, freq(T) = 0.2,</li> <li><em>f</em><sub>3</sub>: AT-rich, i.e. freq(A) = freq(T) = 0.4, freq(C) = freq(G) = 0.1.</li> </ul> <p>For each simulated sequence pair, model parameters (i.e. GTR: six relative rates of nucleotide substitution; GTR+Γ: six rates and one Γ shape parameter) were randomly drawn from 142 sets of parameters derived from real-case data (see file <a href="https://zenodo.org/record/4034261/files/GTR.params.trees.tsv?download=1">GTR.params.trees.tsv</a> at <a href="https://zenodo.org/record/4034261">https://zenodo.org/record/4034261</a>). Initial sequence length was 5 Mbs, and an indel rate of 0.01 was set with indel length drawn from [1, 50000] according to a Zipf distribution with parameter 1.5 (see <em>INDELible</em> <a href="http://abacus.gene.ucl.ac.uk/software/indelible/manual/model.shtml">manual</a>).</p> <p> </p> <p>For each of the 20 evolutionary distances <em>d</em> = 0.05, 0.10, ..., 1.00, six XZ-compressed files containing 200 simulation data are available:</p> <ul> <li><code>data-d-f1-nogam.tsv.xz</code> data simulated under the model GTR with equilibrium frequencies <em>f</em><sub>1</sub></li> <li><code>data-d-f1-gamma.tsv.xz</code> data simulated under the model GTR+Γ with equilibrium frequencies <em>f</em><sub>1</sub></li> <li><code>data-d-f2-nogam.tsv.xz</code> data simulated under the model GTR with equilibrium frequencies <em>f</em><sub>2</sub></li> <li><code>data-d-f2-gamma.tsv.xz</code> data simulated under the model GTR+Γ with equilibrium frequencies <em>f</em><sub>2</sub></li> <li><code>data-d-f3-nogam.tsv.xz</code> data simulated under the model GTR with equilibrium frequencies <em>f</em><sub>3</sub></li> <li><code>data-d-f3-gamma.tsv.xz</code> data simulated under the model GTR+Γ with equilibrium frequencies <em>f</em><sub>3</sub></li> </ul> <p> </p> <p>Each file is tab-delimited and contains the 18 following fields:</p> <ul> <li><code>[1] </code> integer <em>seed</em> value specified to <em>INDELible</em>,</li> <li><code>[2-5] </code> frequencies of T, C, A, G, respectively, specified to <em>INDELible</em>,</li> <li><code>[6-10] </code> C-T, A-T, G-T, A-C, C-G rate parameters, respectivly (normalized such that A-G rate = 1), specified to <em>INDELible</em>,</li> <li><code>[11] </code> Γ shape parameter <em>alpha</em> (= 0 in the <code>nogam</code> files, i.e. GTR substitution model without Γ) specified to <em>INDELible</em>,</li> <li><code>[12] </code> length <em>lgt1</em> of the first sequence <em>seq1</em> (i.e. no. A, C, G, T in <em>seq1</em>),</li> <li><code>[13] </code> length <em>lgt2</em> of the second sequence <em>seq2</em> (i.e. no. A, C, G, T in <em>seq2</em>),</li> <li><code>[14] </code> no. <em>sites</em> in aligned sequences <em>seq1</em> and <em>seq2</em> (i.e. no. A, C, G, T and gap character states in <em>seq1</em> or <em>seq2</em>),</li> <li><code>[15] </code> no. non-gapped sites (<em>core</em> sites) in aligned sequences <em>seq1</em> and <em>seq2</em>,</li> <li><code>[16] </code> observed <em>p-distance</em> between aligned sequences <em>seq1</em> and <em>seq2</em> (i.e. no. nucleotide mismatches divided by no. <em>core</em> sites),</li> <li><code>[17] </code> aligned <em>seq1</em> (containing indel gaps),</li> <li><code>[18] </code> aligned <em>seq2</em> (containing indel gaps).</li> </ul> <p>Of note, <em>seq1</em> and <em>seq2</em> (fields <code>[17-18]</code>) being aligned, these two entries are two strings with identical no. <em>sites</em> (field <code>[14]</code>). Gap character states (<code>-</code>) should be removed from <em>seq1</em> and <em>seq2</em> to obtain the unaligned sequences.</p> <p>_____</p> <p>Criscuolo A (2020) <em>On the transformation of MinHash-based uncorrected distances into proper evolutionary distances for phylogenetic inference</em>. F1000Research, 9:1309. <a href="https://doi.org/10.12688/f1000research.26930.1">doi:10.12688/f1000research.26930.1</a></p>
Supplementary material 1 from: Nugent CM, Adamowicz SJ (2020) Alignment-free classification of COI DNA barcode data with the Python package Alfie. Metabarcoding and Metagenomics 4: e55815. https://doi.org/10.3897/mbmg.4.55815
File S1 – Training, test, and validation data sets used in model training and analysis
Simulated nucleotide sequences for testing alignment-free genome distance estimates
<p>This repository contains (12×500=)6,000 pairs of nucleotide sequences that have been simulated for testing alignment-free genome distance estimates, as described in <a href="https://riojournal.com/article/36178/">Criscuolo (2019)</a>. Given an evolutionary distance <em>d</em> varying from 0.05 to 0.60 (step = 0.05), the program <a href="http://tree.bio.ed.ac.uk/software/seqgen/">SeqGen</a> was used to simulate the evolution of 500 nucleotide sequence pairs with <em>d</em> substitution events per character (GTR+Γ evolutionary model).</p> <p>For each of the 12 evolutionary distances <em>d</em> = 0.05, 0.10, ..., 0.60, an XZ-compressed file containing 500 lines is available. Each line contains 18 fields separated by blank spaces:<br> [1] seed value used during simulation,<br> [2] true evolutionary distance <em>d</em> between the two simulated sequences,<br> [3] total number of simulated characters,<br> [4] number of non-indel characters with nucleotide mismatch,<br> [5] number of non-indel characters,<br> [6-9] A, C, G, T frequencies used during simulation,<br> [10-15] GTR parameters used during simulation,<br> [16] Γ distribution parameter used during simulation,<br> [17-18] two simulated sequences with indel events as gaps.</p> <p>Of note, each pair of aligned sequences without gaps can be regenerated using <a href="http://tree.bio.ed.ac.uk/software/seqgen/">SeqGen</a> v1.3.4 with parameters from fields [1,3,6-16] and the following two-leaf model tree:</p> <pre>(t1:d,t2:0.000);</pre> <p>where <em>d</em> is given in field [2].</p> <p>___</p> <p>Criscuolo A (2019) <em>A fast alignment-free bioinformatics procedure to infer accurate distance-based phylogenetic trees from genome assemblies</em>. Research Ideas and Outcomes, 5:e36178. doi:<a href="https://doi.org/10.3897/rio.5.e36178">10.3897/rio.5.e36178</a></p>
Alignment-free methods for polyploid genomes: quick and reliable genetic distance estimation
<p>Polyploid genomes pose several inherent challenges to population genetic analyses. While alignment-based methods are fundamentally limited in their applicability to polyploids, alignment-free methods bypass most of these limits. We investigated the use of Mash, a k-mer analysis tool that uses the MinHash method to reduce complexity in large genomic datasets, for basic population genetic analyses of polyploid sequences. We measured the degree to which Mash correctly estimated pairwise genetic distance in simulated haploid and polyploid short-read sequences with various levels of missing data. Mash-based estimates of genetic distance were comparable to alignment-based estimates, and were less impacted by missing data. We also used Mash to analyze publicly available short-read data for three polyploid and one diploid species, then compared Mash results to published results. For both simulated and real data, Mash accurately estimated pairwise genetic differences for polyploids as well as diploids as much as 476 times faster than alignment-based methods, though we found that Mash genetic distance estimates could be biased by per-sample read depth. Mash may be a particularly useful addition to the toolkit of polyploid geneticists for rapid confirmation of alignment-based results and for basic population genetics in reference-free systems or those with only poor quality sequence data available.</p>
Alignment-free methods for polyploid genomes: quick and reliable genetic distance estimation
Open the record for dataset details and reuse information.
Seeker: Alignment-free identification of bacteriophage genomes by deep learning
<p>Training and testing data.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.