Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
2
datasets available to search
ShareScore release 0.9.0
Dataset results
2 results for “Lyman-alpha tomography surveys”
CLAMATO2017: IGM Lyman-alpha Forest Tomography Survey Public Data Release of Spectra and Maps
<p><strong>CLAMATO 2017 Data Release 1 </strong></p> <p>Public release: 2017 October 9</p> <p>Uploaded to Zenodo on 2018 June 19th after acceptance for publication in ApJS</p> <p>By Khee-Gan Lee (kglee@lbl.gov) and collaborators</p> <p>Supporting paper: https://arxiv.org/abs/1710.02894</p> <p>These are data products associated with the first data release of the COSMOS Lyman-Alpha Mapping And Tomography Observations (CLAMATO) survey with the Keck-I telescope, which mapped 3D Lyman-alpha forest absorption at 2.05<z<2.55 within the COSMOS field.</p> <p>The following is the summary of the main products:<br> - Source catalog (CL2017_VALUEADDED_RELEASE_20171009.TXT)<br> - Reduced spectra, in /spec_v0/ (blue) and /spec_v0_red (red) sub-directories<br> - Continuum-fitted 2.05<z<2.55 Lyman-alpha forest pixel data (pixel_data.bin)<br> - Wiener-reconstructed 3D absorption map (map_2017_v3.bin)</p> <p>Versions:<br> v0 (not public): Initial rough extraction for 2.15<z<2.55 <br> v1 (not public): Extended redshift range to 2.05<z<2.55 <br> v2 (not public): Caught bug that caused wrong [RA,Dec] for ~4-5 objects<br> v3 (released 2017 Oct 9): Fixed bug that caused wrong aspect ratio in output map<br> v4 (released 2018 Mar 29): Fixed bug that caused negative continua in some spectra</p> <p><br> <strong>Redshift Catalog and Spectra</strong> </p> <p>We provide our redshift catalog and reduced spectra obtained with Keck-I/LRIS</p> <p>The source catalog is provided in the ASCII file CL2017_VALUEADDED_RELEASE_20171009.TXT, with the following columns:</p> <p>- BLUE_SPEC: Blue spectrum filename (in /spec_v0/ sub-directory)<br> - TOMO_ID: CLAMATO ID number<br> - GMAG: g-magnitude (AB) per Capak et al 2007 photometric catalog<br> - CONF: Redshift confidence grade: see https://arxiv.org/abs/1710.02894<br> - ZSPEC: Spectroscopic redshift as determined from CLAMATO spectrum<br> - QSO: QSO flag (1 if QSO, 0 if non-QSO)<br> - RA: R.A. in degrees (J2000)<br> - DEC: Dec in degrees (J2000)<br> - S/N_1: Estimated Lya-forest S/N at 2.05<z<2.15, -9.0 denotes no estimate<br> - S/N_2: Estimated Lya-forest S/N at 2.15<z<2.35, -9.0 denotes no estimate<br> - S/N_2: Estimated Lya-forest S/N at 2.35<z<2.55, -9.0 denotes no estimate<br> - S/N_RED: Estimated S/N over restframe 1250 ang < lambda < 1350 ang, -9.0 denotes no estimate<br> - TOMOFLAG: Flag on whether sightline was used in tomographic map (0 for no, 1 for yes)<br> - EXPTIME: Exposure time on the spectrum, in seconds (aggregate)<br> - RED_SPEC: Red spectrum filename (in /spec_v0_red/ sub-directory), 'NA' if doesn't exist</p> <p>The tarballs spec_v0.tar.gz and spec_v0_red.tar.gz include all the reduced spectra from LRIS-Blue and LRIS-Red, respectively.</p> <p>The individual LRIS spectra are provided in FITS format, with the following HDU Extensions:<br> - HDU0: Object spectral flux density, in units of 10^{-17} ergs/s/cm^2/angstrom<br> - HDU1: Noise standard deviation<br> - HDU2: Pixel Wavelengths in angstroms</p> <p><strong>Pixel Data </strong></p> <p>The binary file PIXEL_DATA_v4.BIN stores the concatenated Lyman-alpha forest pixels at 2.05<z<2.55 that have been extracted from the 1D spectra and continuum-fitted. </p> <p>The first value in the binary is a 32-bit integer specifying the number of pixels (64332), followed by 5 double-precision floating point (64-bit) vectors storing the x, y, z, sigma_f, and delta_f of the pixels.</p> <p>An example python script to read pixel_data is as follows:<br> import numpy as np<br> with open('CLAMATO2017_public/pixel_data_v4.bin','r') as f:<br> npix = np.fromfile(f, dtype=np.int32, count=1)<br> f.seek(4)<br> pixel_data = np.fromfile(f,dtype=np.float64).reshape((npix,5))</p> <p>LIST_TOMO_INPUT_2017.TXT is a summary file of corresponding to PIXEL_DATA.BIN, listing the [x,y,z] position of the sightlines that contributed to the file as well as, in the final two columns, the index range that can be used to grab the relevant pixels from the concatenated pixel list.</p> <p><strong>Tomographic Map</strong></p> <p>The Wiener-reconstructed map of the 2.05<z<2.55 IGM within the CLAMATO field is the result of applying the dachshund algorithm (http://github.com/caseywstark/dachshund) to PIXEL_DATA.BIN, with the configuration file INPUT.CFG . (Caveat: the version of PIXEL_DATA.BIN here is not actually the right version to directly input into the dachshund code: the first integer in this file should not be present for input to dachshund). </p> <p>The reconstructed map is MAP_2017_V4.BIN, which is a 60x48x876 = 2552880 pixel double-precision binary with. The dimension that changes fastest is the z-dimension (876 pixels per dimension), followed by the y-dimension (48 pixels per dimension) and x-dimension (60 per dimension).</p> <p>Each map pixel represents a 0.5Mpc/h comoving voxel of the Ly-alpha forest absorption. See the Appendix of https://arxiv.org/abs/1710.02894 for the conversion factors to assume to switch between pixel/voxel and [RA, Dec, redshift].</p> <p>The file MAP_2017_V4_SM2.0.BIN is the same map, but smoothed with a R=2Mpc/h Gaussian kernel.</p>
CLAMATO DR2: IGM Lyman-Alpha Forest Tomography Survey Public Data Release of Spectra and Maps
<p> </p><p><strong>CLAMATO Data Release 2</strong></p><p>Updated 2023 Jan 11th by Khee-Gan Lee (<a href="mailto:kglee@ipmu.jp">kglee@ipmu.jp</a>)</p><p>Supporting paper has been published in <a href="https://ui.adsabs.harvard.edu/abs/2022ApJS..263...27H/abstract">ApJS</a> (arXiv:2109.09660)</p><p>These are data products associated with the second data release (DR2) of the COSMOS Lyman-Alpha Mapping And Tomography Observations (CLAMATO) survey with the Keck-I telescope, which mapped 3D Lyman-alpha forest absorption at 2.05<z<2.55 within the COSMOS field. This is an updated version of the original DR2 repository (https://doi.org/10.5281/zenodo.5842842), which had accidentally left out several files. The other files that was in that repository are duplicated here.</p><p>The following is the summary of the main products:</p><ul><li>Source catalog (cl2020_valueadded_release_20200602.txt)</li><li>Reduced spectra, in spec_v0 .tar.gz tarball</li><li>Continuum-fitted 2.05<z<2.55 Lyman-alpha forest pixel data (pixel_data_v0.bin)</li><li>Wiener-reconstructed 3D absorption map (map_2020_v0.bin)</li><li>Reconstructed 3D matter density field using the TARDIS-II algorithm (TARDIS_CLAMATO_DR2_v0.4_smoothed.npy)</li><li>Eigenvalues of the pseudo-deformation tensor calculated from the density field (TARDIS_eigenvalues_CLAMATO_DR2_v0.4_smoothed.npy)</li></ul><p><strong> Redshift Catalog and Spectra</strong></p><p>We provide our redshift catalog and reduced spectra obtained with Keck-I/LRIS-Blue.</p><p>The source catalog is provided in the ASCII file cl2020_valueadded_release_20200602.txt, with the following columns:</p><ul><li>SPECFIL: Filename of spectrum (within spec_v0.tar.gz)</li><li>TOMO_ID: CLAMATO ID number</li><li>GMAG: g-magnitude (AB) per Capak et al 2007 photometric catalog</li><li>CONF: Redshift confidence grade: see https://arxiv.org/abs/1710.02894</li><li>ZSPEC: Spectroscopic redshift as determined from CLAMATO spectrum</li><li>QSO: QSO flag (1 if QSO, 0 if non-QSO)</li><li>RA: R.A. in degrees (J2000)</li><li>DEC: Dec in degrees (J2000)</li><li>S/N_1: Estimated Lya-forest S/N at 2.05<z<2.15, -9.0 denotes no estimate</li><li>S/N_2: Estimated Lya-forest S/N at 2.15<z<2.35, -9.0 denotes no estimate</li><li>S/N_2: Estimated Lya-forest S/N at 2.35<z<2.55, -9.0 denotes no estimate</li><li>S/N_RED: Estimated S/N over restframe 1250 Å < \(\lambda\) < 1350 Å, -9.0 denotes no estimate</li><li>TOMOFLAG: Flag on whether sightline was used in tomographic map (0 for no, 1 for yes)</li><li>EXPTIME: Exposure time on the spectrum, in seconds (aggregate)</li></ul><p>The tarball spec_v0.tar.gz include all the reduced spectra from LRIS-Blue, with the respective filename indicated by the first column of the catalog. We decided not to make available the LRIS-Red spectra.</p><p>The individual LRIS spectra are provided in FITS format, with the following HDU Extensions:</p><ul><li>HDU0: Object spectral flux density, in units of \(10^{-17}\,\mathrm{erg\,s^{-1}\,cm^{-2}\,angstrom^{-1}}\)</li><li>HDU1: Noise standard deviation</li><li>HDU2: Pixel Wavelengths in angstroms</li></ul><p><strong>Pixel Data</strong></p><p>The binary file PIXEL_DATA_v0.BIN stores the concatenated Lyman-alpha forest pixels at 2.05<z<2.55 that have been extracted from the 1D spectra and continuum-fitted. </p><p>The first value in the binary is a 32-bit integer specifying the number of pixels (84608), followed by 5 double-precision floating point (64-bit) vectors storing the x, y, z, sigma_f, and delta_f of the pixels.</p><p>An example python script to read pixel_data is as follows:</p><p>import numpy as np with open('pixel_data_v0.bin','r') as f: npix = np.fromfile(f, dtype=np.int32, count=1) f.seek(4) pixel_data = np.fromfile(f,dtype=np.float64).reshape((npix,5))</p><p>LIST_TOMO_INPUT_2020.TXT is a summary file of corresponding to PIXEL_DATA.BIN, listing the [x,y,z] position of the sightlines that contributed to the file as well as, in the final two columns, the index range that can be used to grab the relevant pixels from the concatenated pixel list.</p><p>The origin of the map coordinates is at [RA=149.89150 deg, Dec=2.0915050 deg], where x is increasing in the R.A. dimension and y is increasing in the Dec.</p><p><strong>Tomographic Map</strong></p><p>The Wiener-reconstructed map of the 2.05<z<2.55 IGM within the CLAMATO field is the result of applying the "dachshund" algorithm (http://github.com/caseywstark/dachshund) to PIXEL_DATA.BIN, with the configuration file INPUT.CFG . (Caveat: the version of PIXEL_DATA.BIN here is not actually the right version to directly input into the dachshund code: the first integer in this file should not be present for input to dachshund). </p><p>The reconstructed map is MAP_2020_V0.BIN, which is a 68x56x876 = 3335808 pixel double-precision binary file. The dimension that changes fastest is the z-dimension along the line-of-sight (876 pixels per dimension), followed by the y-dimension in increasing Declination (56 pixels per dimension) and x-dimension along the direction of increasing R.A. (68 pixels per dimension).</p><p>Each map pixel represents a 0.5Mpc/h comoving voxel of the Ly-alpha forest absorption. See the Appendix of https://arxiv.org/abs/1710.02894 for the conversion factors to assume to switch between pixel/voxel and [RA, Dec, redshift].</p><p>Note that no additional smoothing has been applied in this binary, whereas most of the visualizations in the paper have had Gaussian smoothing applied.</p><p><strong>Reconstructed Density Field and Cosmic Web</strong></p><p>We also release the underlying matter density field in the CLAMATO volume, estimated using the TARDIS-II algorithm (https://arxiv.org/abs/2007.15994). This is in numpy format, and can be read directly into a 3D array using Python as follows:</p><p>>>> import numpy as np >>> den=np.load('TARDIS_CLAMATO_DR2_v0.4_smoothed.npy') >>> np.shape(den) (34, 28, 438) >>> eigen = np.load('TARDIS_eigenvalues_CLAMATO_DR2_v0.4_smoothed.npy') >>> np.shape(eigen) (34, 28, 438, 3)</p><p>The 3 dimensions correspond to the R.A., Declination, and line-of-sight directions, respectively. </p><p>Note that unlike the Wiener-filtered absorption map<i>, the TARDIS-II reconstruction outputs are in 1Mpc/h comoving voxels. </i>The coordinate zero-point sand line-of-sight comoving distance-redshift relationship are otherwise the same as the Wiener map. </p><p>The eigenvalues of the pseudo-deformation tensor are in TARDIS_eigenvalues_CLAMATO_DR2_v0.4_smoothed.npy, with the same array shape as the matter density, but with an additional array dimension storing the 3 sorted eigenvalues at each point in the volume. </p><p>For reference, we have included an iPython notebook (Tomographic_Maps.ipynb) that plots the Wiener-filtered absorption alongside the TARDIS-II densities and eigenvalues (e.g. Figure 8 of the main paper).</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.