Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
11
datasets available to search
ShareScore release 0.9.0
Dataset results
11 results for “Nexus file”
68 image lysozyme dataset recorded on the Jungfrau 16M detector at SwissFEL and formatted as a NeXus file
<p>Data provided by Meitian Wang at PSI and master file revised May 2020 for full NXmx compliance.</p> <p>To create a new NeXus master file, assuming DIALS is installed in the folder $DIALS, use this command:</p> <p>libtbx.python $DIALS/modules/cctbx_project/xfel/swissfel/jf16m_cxigeom2nexus.py unassembled_file=lyso009a_0087.JF07T32V01.h5 geom_file=16M_bernina_backview_optimized_adu_quads.geom wavelength=1.368479 detector_distance=97.830 mask_file=lyso009a_0087.JF07T32V01.mask.h5 nexus_details.start_time=2018-01-00T00:00:00.000 nexus_details.end_time=2018-01-00T00:00:02.720Z nexus_details.end_time_estimated=2018-01-00T00:00:02.720Z nexus_details.sample_name=Lysozyme nexus_details.total_flux=1000000000000</p> <p>Some notes about the parameters:<br> - Geometry file is in CrystFEL format but has been realigned to group the modules hierarchically into quadrants.<br> - Wavelength is a single wavelength for the whole dataset, but options exist to do 1 wavelength per image, or a whole spectrum per image.<br> - Start and end times are example timestamps for illustration. End times are estimated for 68 frames using a 25 Hz recording rate.<br> - Total flux of 1e12 photons is an estimate.</p> <p>View the data using DIALS: dials.image_viewer lyso009a_0087.JF07T32V01_master.h5</p> <p>Process the data using DIALS, treating the images as stills, assuming 64 cores available on the system:<br> dials.stills_process mp.nproc=64 lyso009a_0087.JF07T32V01_master.h5 dispersion.gain=10 known_symmetry.space_group=P43212 known_symmetry.unit_cell=77,77,37,90,90,90 refinement_protocol.d_min_start=2.5</p> <p>Download DIALS at dials.github.io.</p>
4 image lysozyme dataset recorded on the Jungfrau 16M detector at SwissFEL and formatted as a NeXus file
<p>This is a 4 image lysozyme datasets derived from https://doi.org/10.5281/zenodo.3352357. The specific 4 images are able to be processed by the software package DIALS using commands in the linked dataset above. The images were rounded to integer and compressed to save file space using this script:</p> <pre><code class="language-python">import shutil, h5py import numpy as np shutil.copyfile('../lyso009a_0087.JF07T32V01_master.h5', 'lyso009a_0087.JF07T32V01_master_4img.h5') h5 = h5py.File('lyso009a_0087.JF07T32V01_master_4img.h5', 'r+') data = h5["entry/data/data"][()] del h5["entry/data/data"] h = h5["entry/data"] subset = data[5:9].astype(np.int32) h.create_dataset("data", subset.shape, subset.dtype, subset, compression="gzip", compression_opts=9) h5.close()</code></pre> <p>The .expt file was created by dials.import and is useful for regression testing in DIALS.</p>
NEXUS file describing the taxonomic relationships of the 466 species for which genome sequencing was underway at Tree of Life, Wellcome Sanger Institute, at 31 December 2020
<p>This NEXUS file shows the taxonomic relationships of 466 species of eukaryote. The taxonomy derives from the NCBI TaxonomyDB. The species are those for which genome sequencing is underway at the Tree of Life programme, Wellcome Sanger Institute, as of 31st Decemnber 2020. The NEXUS file includes a figtree block generated in FigTree [<strong><a href="https://github.com/rambaut/figtree">https://github.com/rambaut/figtree</a>] </strong>that informs display of the data as a circular tree with species coloured by taxonomic Family, and Families with more than one species represented as triangles. The figure is used in publications and presentations describing the activities of the Tree of Life programme and the projects in which Tree of Life is involved, especially the Darwin Tree of Life project [https://darwintreeoflife.org].</p>
Nexus and data files for Pokemon Evolutionary Phylogeny
<p>Data files associated with the following publication:</p> <p>Matan Shelomi, Andrew Richards, Ivana Li, Yukinari Okido. (2012) “A Phylogeny and Evolutionary History of the Pokémon.” Annals of Improbable Research, 18(4): 15-17.</p> <p>Free to use for educators and researchers hoping to use the Pokémon to teach evolution, phylogenetics, etc. Cite in publications as you see fit.<br /> These datasets contain Pokémon up to the 5th generation. Researchers are welcome to produce new, updated datasets so long as they cite our original work, either this dataset and/or the Annals of Improbable Research paper.</p>
Nexus-formatted text file of ISSR band presence/absence for 75 loci in Corallorhiza bentleyi
<p class="MsoNoSpacing">Mycoheterotrophic plants derive most or all carbon and nutrients from fungal partners and represent poorly understood components of forest biodiversity. Many are rare or endangered yet can be ecological indicators of forest ecosystem function due to their often highly specific fungal host requirements. One such species is the IUCN red-listed ('vulnerable'), fully mycoheterotrophic orchid, <i>Corallorhiza bentleyi</i>. This recently described species is among the rarest plants in Appalachia, known from five counties in Virginia and West Virginia, USA. The species has a restricted range, small population size, and is self-pollinating. Here, an integrative approach was taken in conservation genetic assessment of <i>C. bentleyi</i> using floral morphometrics, simple-sequence repeats, and fungal host DNA to characterize variation within and among sampling localities. Morphology reveals some differentiation among individuals from six sampling localities. Surprisingly, most genetic variation is found within localities, contrary to the expectation for a selfing species. Fungal host DNA reveals extreme specificity upon a few genotypes of a single ectomycorrhizal host species, <i>Tomentella fuscocinerea,</i> across all localities. The conservation implications of morphological, genetic, and symbiotic diversity in this vulnerable species are discussed, and additional assessment of conservation status is recommended based on: an obligate reproductive mode of selfing, preventing benefits of outcrossing among genetically non-identical individuals; extreme host specificity, severely restricting niche space; and highly fragmented habitat under threat from anthropogenic disturbance. This study underscores the importance of integrative conservation assessment, analyzing multiple data sources, and reveals patterns not readily apparent from census-based assessments alone.</p>
Nexus file of alignment for phylogeny of Philopteroides s. lat.
Open the record for dataset details and reuse information.
NeXus How-To Creation and Validation of NeXus File
<p>These Files are used as examples in a How-To, which explains, how to create a NeXus file and how to validate them. This is related for the FAIRmat project, which helps to spread FAIR data structure for solid state physics related science.</p>
Nexus-formatted text file of ISSR band presence/absence for 75 loci in Corallorhiza bentleyi
Open the record for dataset details and reuse information.
Nexus file for: Molecular diversification of hummingbirds
Open the record for dataset details and reuse information.
Wife of Bath's Prologue Nexus File
<p>This nexus file was generated within Textual Communities (textualcommunities.org) from the regularized apparatus of the Wife of Bath's Prologue. </p>
68 image lysozyme dataset recorded on the Jungfrau 16M detector at SwissFEL and formatted as a NeXus file, revised for clean cnxvalidate error report
<p>This kit includes an additional revised master file, lyso009a_0087.JF07T32V01_master_rev.h5 that provides compliance with the October 2019 NXmx specification as proposed in https://github.com/HDRMX/definitions.git</p> <p>To create a new NeXus master file, assuming DIALS is installed in the folder $DIALS, use this command:</p> <p>libtbx.python $DIALS/modules/cctbx_project/xfel/swissfel/jf16m_cxigeom2nexus.py unassembled_file=lyso009a_0087.JF07T32V01.h5 geom_file=16M_bernina_backview_optimized_adu_quads.geom wavelength=1.368479 detector_distance=97.830 mask_file=lyso009a_0087.JF07T32V01.mask.h5</p> <p>Geometry file is in CrystFEL format but has been realigned to group the modules hierarchically into quadrants.</p> <p>View the data using DIALS: dials.image_viewer lyso009a_0087.JF07T32V01_master.h5</p> <p>Process the data using DIALS, treating the images as stills, assuming 64 cores available on the system:<br> dials.stills_process mp.nproc=64 lyso009a_0087.JF07T32V01_master.h5 dispersion.gain=10 known_symmetry.space_group=P43212 known_symmetry.unit_cell=77,77,37,90,90,90 refinement_protocol.d_min_start=2.5</p> <p>Download DIALS at dials.github.io.</p> <p>After the DIALS run, for full NXmx compliance you will need the jungfrau portions of the script that was used to generate lyso009a_0087.JF07T32V01_master_rev.h5</p> <p> </p> <pre>#!/bin/bash cp Therm_6_2.nxs Therm_6_2_rev.nxs cp Therm_6_2_master.h5 Therm_6_2_master_rev.h5 cp jungfrau/lyso009a_0087.JF07T32V01_master.h5 jungfrau/lyso009a_0087.JF07T32V01_master_rev.h5 export curdat=`date +%FT%T.%3` export LD_LIBRARY_PATH=$HOME/lib export HDF5_PLUGIN_PATH=$HOME/lib export PATH=$HOME/bin:$PATH h5copy -i Therm_6_2_rev.nxs -o Therm_6_2_master_rev.h5 -s /entry/instrument/name -d /entry/instrument/name -f ref h5copy -i Therm_6_2_rev.nxs -o Therm_6_2_master_rev.h5 -s /entry/instrument/source -d /entry/source -f ref h5copy -i Therm_6_2_rev.nxs -o Therm_6_2_rev.nxs -s /entry/instrument/source -d /entry/source -f ref h5copy -i jungfrau/lyso009a_0087.JF07T32V01_master.h5 -o jungfrau/lyso009a_0087.JF07T32V01_master_rev.h5 -s /entry/sample/beam -d /entry/instrument/beam -f ref export end_time=`h5dump -d "/entry/end_time" Therm_6_2_master.h5 | grep ":" | sed 's/^.........//'|sed 's/.\$//'` echo "end_time: $end_time" python << 'EOL' import h5py as h5 import numpy as np import os end_time=os.environ['end_time'] curdat=os.environ['curdat'] fvds = h5.File('Therm_6_2_rev.nxs','r+') fmaster = h5.File('Therm_6_2_master_rev.h5','r+') jungfrau= h5.File('jungfrau/lyso009a_0087.JF07T32V01_master_rev.h5','r+') fvds_keys=fvds.keys() fmaster_keys=fmaster.keys() jungfrau_keys=jungfrau.keys() fvds_entry=fvds['entry'] fmaster_entry=fmaster['entry'] jungfrau_entry=jungfrau['entry'] fvds_entry_keys=fvds_entry.keys() fmaster_entry_keys=fmaster_entry.keys() jungfrau_entry_keys=jungfrau_entry.keys() fvds_entry_instrument=fvds['entry']['instrument'] fmaster_entry_instrument=fmaster['entry']['instrument'] jungfrau_entry_instrument=jungfrau['entry']['instrument'] fvds_entry_instrument_keys=fvds_entry_instrument.keys() fmaster_entry_instrument_keys=fmaster_entry_instrument.keys() jungfrau_entry_instrument_keys=jungfrau_entry_instrument.keys() fvds_entry_instrument_name=(fvds['entry']['instrument']['name']) fmaster_entry_instrument_name=(fmaster['entry']['instrument']['name']) jungfrau['entry']['instrument'].create_dataset("name", data=np.string_("Paul Scherrer Institute SwissFEL Aramis 1 (Alvra)")) jungfrau_entry_instrument_name=(jungfrau['entry']['instrument']['name']) fvds_entry_instrument_short_name=fvds_entry_instrument.attrs['short_name'] fmaster_entry_instrument_short_name=fmaster_entry_instrument.attrs['short_name'] jungfrau_entry_instrument_name.attrs.modify('short_name',np.string_("Alvra")) jungfrau_entry_instrument_short_name=jungfrau_entry_instrument_name.attrs['short_name'] zero_offset=fmaster_entry_instrument['detector']['module']['fast_pixel_direction'].attrs['offset'] fmaster_det_z=fmaster_entry_instrument['transformations']['det_z'] fvds_det_z=fvds_entry_instrument['transformations']['det_z'] print('fvds_keys: ',fvds_keys) print('fmaster_keys: ',fmaster_keys) print('jungfrau_keys: ',jungfrau_keys) print('fvds_entry_keys: ',fvds_entry_keys) print('fmaster_entry_keys: ',fmaster_entry_keys) print('jungfrau_entry_keys: ',jungfrau_entry_keys) print('fvds_entry_instrument_keys: ',fvds_entry_instrument_keys) print('fmaster_entry_instrument_keys: ',fmaster_entry_instrument_keys) print('jungfrau_entry_instrument_keys: ',jungfrau_entry_instrument_keys) print('fvds_entry_instrument_name: ',fvds_entry_instrument_name) print('fmaster_entry_instrument_name: ',fmaster_entry_instrument_name) print('jungfrau_entry_instrument_name: ',jungfrau_entry_instrument_name) print('fvds_entry_instrument_short_name: ',fvds_entry_instrument_short_name) print('fmaster_entry_instrument_short_name: ',fmaster_entry_instrument_short_name) print('jungfrau_entry_instrument_short_name: ',jungfrau_entry_instrument_short_name) print('fmaster_entry_instrument_detector_module_fast_pixel_direction_offset: ',zero_offset) print('fmaster_entry_instrument_detector_detector_z_det_z: ',fmaster_det_z) print('fmaster_entry_end_time: ',end_time) fmaster.attrs.modify('file_time',np.string_(end_time)) fmaster.attrs.modify('file_name',np.string_('Therm_6_2_master_rev.h5')) fmaster.attrs.modify('HDF5_Version',np.string_('hdf5-1.8.18')) fvds.attrs.modify('file_time',np.string_(end_time)) fvds.attrs.modify('file_name',np.string_('Therm_6_2_master_rev.h5')) fvds.attrs.modify('HDF5_Version',np.string_('hdf5-1.10.5')) jungfrau.attrs.modify('file_time',np.string_(curdat)) jungfrau.attrs.modify('file_name',np.string_('lyso009a_0087.JF07T32V01_master.h5')) jungfrau.attrs.modify('HDF5_Version',np.string_('hdf5-1.10.5')) fvds_entry_instrument_name.attrs.modify('short_name',np.string_(fvds_entry_instrument.attrs['short_name'])) fmaster_entry_instrument_name.attrs.modify('short_name',np.string_(fmaster_entry_instrument.attrs['short_name'])) fmaster_entry_instrument['attenuator']['attenuator_transmission'].attrs.modify('units',np.string_("")) fmaster_entry_instrument['detector']['count_time'].attrs.modify('units',np.string_("s")) fvds_entry_instrument_name.attrs.modify('short_name',np.string_(fvds_entry_instrument.attrs['short_name'])) fvds_entry_instrument['attenuator']['attenuator_transmission'].attrs.modify('units',np.string_("")) fvds_entry_instrument['detector']['count_time'].attrs.modify('units',np.string_("s")) fmaster_det_z.attrs.modify('offset',zero_offset) fvds_det_z.attrs.modify('offset',zero_offset) fmaster_entry['sample']['transformations']['phi'].attrs.modify('offset',zero_offset) fmaster_entry['sample']['transformations']['chi'].attrs.modify('offset',zero_offset) fmaster_entry['sample']['transformations']['sam_x'].attrs.modify('offset',zero_offset) fmaster_entry['sample']['transformations']['sam_y'].attrs.modify('offset',zero_offset) fmaster_entry['sample']['transformations']['sam_z'].attrs.modify('offset',zero_offset) fmaster_entry['sample']['transformations']['omega'].attrs.modify('offset',zero_offset) fvds_entry['sample']['transformations']['phi'].attrs.modify('offset',zero_offset) fvds_entry['sample']['transformations']['chi'].attrs.modify('offset',zero_offset) fvds_entry['sample']['transformations']['sam_x'].attrs.modify('offset',zero_offset) fvds_entry['sample']['transformations']['sam_y'].attrs.modify('offset',zero_offset) fvds_entry['sample']['transformations']['sam_z'].attrs.modify('offset',zero_offset) fvds_entry['sample']['transformations']['omega'].attrs.modify('offset',zero_offset) print(fmaster['entry']['instrument']['name'].attrs['short_name']) print(fmaster['entry']['instrument']['name'].attrs['short_name'].shape) print(fmaster['entry']['instrument']['name'].attrs['short_name'].dtype) print("/entry/instrument/ELE_D0/pixel_mask_applied :",jungfrau_entry_instrument['ELE_D0']['pixel_mask_applied']) del jungfrau_entry_instrument['ELE_D0']['pixel_mask_applied'] jungfrau_entry_instrument['ELE_D0'].create_dataset("pixel_mask_applied",dtype='int8', data=1) print("/entry/instrument/ELE_D0/pixel_mask_applied :",jungfrau_entry_instrument['ELE_D0']['pixel_mask_applied']) jungfrau_entry_source=jungfrau_entry.create_group('source') jungfrau_entry_source=jungfrau_entry['source'] jungfrau_entry_source.attrs.modify('NX_class',np.string_("NXsource")) jungfrau_entry_source.create_dataset("name",data=np.string_("Paul Scherrer Institute SwissFEL")) jungfrau_entry_source['name'].attrs.modify('short_name',np.string_("SwissFEL")) #jungfrau_entry_instrument.create_group['beam'] #jungfrau_entry_instrument['beam']=jungfrau_entry['sample']['beam'] jungfrau_entry_instrument['beam'].create_dataset('total_flux',dtype='float64',data=1000000000000.) jungfrau_entry_instrument['beam']['total_flux'].attrs.modify('units',np.string_('/pulse')) del jungfrau_entry['sample']['beam'] del fvds_entry_instrument.attrs['short_name'] del fmaster_entry_instrument.attrs['short_name'] del fmaster_entry_instrument['source'] fvds.close() fmaster.close() jungfrau.close() quit() EOL $HOME/bin/nxvalidate -a NXmx -l /home/yaya/hdrmx_rev_29Sep19/hdrmx/definitions Therm_6_2_master_rev.h5 $HOME/bin/nxvalidate -a NXmx -l /home/yaya/hdrmx_rev_29Sep19/hdrmx/definitions Therm_6_2_rev.nxs $HOME/bin/nxvalidate -a NXmx -l /home/yaya/hdrmx_rev_29Sep19/hdrmx/definitions jungfrau/lyso009a_0087.JF07T32V01_master_rev.h5 </pre> <p> </p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.