Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
4
datasets available to search
ShareScore release 0.9.0
Dataset results
4 results for “DL-FRONT”
DL-FRONT MERRA-2 vectorized weather fronts over North America, 1980-2018 (netCDF format)
<p>DL-FRONT is a Deep Learning Neural Network (DLNN) that was trained to detect weather fronts using spatial grids of near-surface atmospheric variables. The dataset is composed of <a href="http://www.unidata.ucar.edu/software/netcdf/docs/">netCDF-4</a> files. Each file contains one year of hourly geospatial data grids describing the locations of four types of weather fronts—cold front, warm front, stationary front, and occluded front, over the time span 1980-2018.</p> <p>This dataset is the product of processing data from the National Aeronautics and Space Administration (NASA) <a href="https://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/">Modern-Era Retrospective analysis for Research and Applications, Version 2</a> (MERRA-2). DL-FRONT processed MERRA-2 hourly data grids of instantaneous measures of air pressure reduced to mean sea level, air temperature at 2 meters, specific humidity at 2 meters, and wind velocity at 10 meters over the time span 1980 - 2018 to produce this dataset. The original MERRA-2 data were resampled at 1 degree resolution over the spatial range 31W - 171W x 10N - 77N using bicubic interpolation.</p> <p>At each hourly time step the network produced a set of spatial grids with the same resolution and spatial range as the input, one for each of the five categories mentioned above. Each cell in a spatial grid for a given category records the network-assigned probability (from 0.0 to 1.0) that the cell is in a weather front boundary region of that category (or, for the "no front" category, the probability that the cell is not in any weather front boundary region).</p> <p>Each weather front probability map was then processed to obtain polyline skeletons of the weather front boundary regions found by DL-FRONT. These vector representations of the fronts were then written to JSON files—one file for each hour. These front polylines were then rasterized into geospatial data grids and stored by year into netCDF-4 files that conform to the <a href="http://cfconventions.org/">Climate and Forecast Metadata Conventions</a>. The front data in each file is stored in a netCDF variable with dimensions (time, front type, y, x), where x and y are geospatial dimensions. There is a 2D geospatial data grid for each time step for each of the 4 front types—cold, warm, stationary, and occluded.</p> <p>There are two large groupings of the netCDF files. One group uses a data grid based on the <a href="https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/north-american-regional-reanalysis-narr">North American Regional Reanalysis</a> (NARR) <a href="https://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html#GRID221">grid</a>, which is a Lambert Conformal Conic projection coordinate reference system (CRS) centered over North America. The NARR grid is quite close the the spatial range of data displayed on the WPC workstations used to perform surface analysis and identify front locations. The native NARR grid has grid cells which are 32 km on each side. Our grid covers the same extents with cells that are 96 km on each side.</p> <p>The other group uses a 1° latitude/longitude data grid centered over North America with extents 171W – 31W / 10N – 77 N. The files in this group are identified by the name MERRA2, because they were used with data from the NASA MERRA-2 dataset, which uses a latitude/longitude data grid.</p> <p>There are a number of files within each group. The files all follow the naming convention merra2_[masked]_<grid>_<n>wide_<year>.nc, where [masked] indicates that the presence of the word <em>masked</em> is optional and <grid> is either <em>merra2-1deg</em> or <em>narr-96km</em>. The the sequence <n>wide indicates the width with which the fronts were drawn, and <year> is the year for the data stored in the file.</p> <p>The files marked as masked had a mask applied to the data grids that corresponded to the envelope of the geospatial region where there are, on average, 40 or more front crossing of any type per year, as determined using the <a href="https://dx.doi.org/10.5281/zenodo.2651361">Coded Surface Bulletin </a>dataset.</p> <p>The <n>wide portion of the file names takes two forms—<em>1wide</em> and <em>3wide</em>. The fronts in the <em>1wide</em> files were rasterized by drawing the front polylines with a width of one grid cell. The fronts in the <em>3wide</em> files were rasterized by drawing the front polylines with a width of 3 grid cells.</p> <p>Within each grid group, there are four subsets of files:</p> <ul> <li>merra2_masked_<grid>_1wide_<year>.nc</li> <li>merra2_masked_<grid>_3wide_<year>.nc</li> <li>merra2_<grid>_1wide_<year>.nc</li> <li>merra2_<grid>_3wide_<year>.nc</li> </ul>
DL-FRONT MERRA-2 vectorized weather fronts over North America, 1980-2018 (JSON format)
<p>DL-FRONT is a Deep Learning Neural Network (DLNN) that was trained to detect weather fronts using spatial grids of near-surface atmospheric variables. The dataset is composed of hourly JSON files containing geospatial vector polylines describing the locations of four types of weather fronts—cold front, warm front, stationary front, and occluded front, over the time span 1980-2018.</p> <p>This dataset is the product of processing data from the National Aeronautics and Space Administration (NASA) <a href="https://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/">Modern-Era Retrospective analysis for Research and Applications, Version 2</a> (MERRA-2). DL-FRONT processed MERRA-2 hourly data grids of instantaneous measures of air pressure reduced to mean sea level, air temperature at 2 meters, specific humidity at 2 meters, and wind velocity at 10 meters over the time span 1980 - 2018 to produce this dataset. The original MERRA-2 data were resampled at 1 degree resolution over the spatial range 31W - 171W x 10N - 77N using bicubic interpolation.</p> <p>At each hourly time step the network produced a set of spatial grids with the same resolution and spatial range as the input, one for each of the five categories mentioned above. Each cell in a spatial grid for a given category records the network-assigned probability (from 0.0 to 1.0) that the cell is in a weather front boundary region of that category (or, for the "no front" category, the probability that the cell is not in any weather front boundary region).</p> <p>Each probability map was then processed to obtain polyline skeletons of the weather front boundary regions found by DL-FRONT. These vector representations of the fronts were then written to JSON files—one file for each hour. Each JSON file contains one top-level object composed of name/value pairs with the names issuanceDate, validDate, ColdFronts, WarmFronts, OccludedFronts, and StationaryFronts. The name/value pairs for createDate and validDate are always present. The other name/value pairs are only present if there is corresponding data. The values for issuanceDate and validDate are UTC timestamp strings.</p> <p>The ColdFronts, WarmFronts, StationaryFronts, and OccludedFronts names in the top-level object, when present, have values that are arrays. In each case, the array is composed of one or more objects. Each object represents a front of the given type. Each object is composed of five name/value pairs with the names lats, lons, cols, rows, and confidence. The value for the name confidence is a number that is the average of the values of the probability map cells intersected by the front polyline. The values associated with the names lats, lons, cols, and rows are arrays. These arrays represent the vertices of a polyline describing the location of a frontal boundary in both geospatial and grid cell coordinates.</p>
DL-FRONT MERRA-2 weather front probability maps over North America, 1980-
<p>DL-FRONT is a Deep Learning Neural Network (DLNN) that was trained to detect weather fronts using spatial grids of near-surface atmospheric variables. The dataset is composed of hourly spatial grids containing probability maps for each of five front-type categories—cold front, warm front, stationary front, occluded front, and no front.</p> <p>This dataset is the product of processing data from the National Aeronautics and Space Administration (NASA) <a href="https://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/">Modern-Era Retrospective analysis for Research and Applications, Version 2</a> (MERRA-2). DL-FRONT processed MERRA-2 hourly data grids of instantaneous measures of air pressure reduced to mean sea level, air temperature at 2 meters, specific humidity at 2 meters, and wind velocity at 10 meters over the time span 1980 - 2018 to produce this dataset. The original MERRA-2 data were resampled at 1 degree resolution over the spatial range 31W - 171W x 10N - 77N using bicubic interpolation.</p> <p>At each hourly time step the network produced a set of spatial grids with the same resolution and spatial range as the input, one for each of the five categories mentioned above. Each cell in a spatial grid for a given category records the network-assigned probability (from 0.0 to 1.0) that the cell is in a weather front boundary region of that category (or, for the "no front" category, the probability that the cell is not in any weather front boundary region).</p> <p>The DLNN was trained using MERRA-2 data and human-identified fronts from the NOAA National Weather Service (NWS) Weather Prediction Center (WPC) <a href="https://www.wpc.ncep.noaa.gov/html/sfc2.shtml">Coded Surface Bulletin</a> dataset. The training datasets covered the years 2003-2007.</p> <p>The dataset contains two sets of files. The first set contains the original front probability maps. The second set contains "one hot" versions of the front probability maps. In the one hot version the five front-type probabilities for a spatial grid cell for a given time step are replaced by the value 1 for the largest front-type probability, and by 0 for the others.</p> <p>The front probability files have names that follow the form merra2_merra2-1deg_fronts_<year>.nc. The one hot files have names that follow the form merra2_merra2-1deg_onehot_<year>.nc. Each file contains one year of hourly spatial data grids.</p>
Machine learning-based detection of weather fronts with DL-FRONT in CESM1.3
<p>These data are the results of detecting weather fronts with the machine learning algorithm DL-FRONT (see <a href="https://doi.org/10.5194/ascmo-5-147-2019">Biard and Kunkel 2019</a>) in simulations with the Community Earth System Model, version 1.3 (CESM1.3, see <a href="http://doi.org/10.1029/2019GL084057">Meehl et al. 2019</a>). The specific CESM1.3 simulations used here include: a historical climate simulation from 2000 to 2005, a simulation with Representative Concentration Pathway 2.6 (RCP2.6) forcing from 2006 to 2015, and a simulation with Representative Concentration Pathway 8.5 (RCP8.5) forcing from 2086–2100. See <a href="http://doi.org/10.1029/2022JD037038">Dagon et al. 2022</a> for a publication analyzing these machine learning detected weather fronts and associated extreme precipitation in historical and future climates.</p> <p>At each 3-hourly time step of simulation output over a North American spatial domain (10-77ºN, 171-31°W), DL-FRONT produced a set of spatial grids at 1° spatial resolution, for each of the five categories: cold front, warm front, stationary front, occluded front, and no front. Each cell in a spatial grid for a given category records the network-assigned probability (from 0.0 to 1.0) that the cell is in a weather front boundary region of that category (or, for the "no front" category, the probability that the cell is not in any weather front boundary region).</p> <p>The dataset contains three sets of files. The first set contains the original front probability maps. The second set contains "one hot" versions of the front probability maps. In the one hot version the five front-type probabilities for a spatial grid cell for a given time step are replaced by the value 1 for the largest front-type probability, and by 0 for the others. The third set contains front crossing rates (monthly, seasonal, annual) and climatologies/anomalies/standard deviations (monthly, seasonal) for each front type.</p> <p>The front probability files have names that follow the form cesm_fronts_<start_year>_<end_year>.nc for each simulation period. The one hot files have names that follow the form cesm_fronts__<start_year>_<end_year>_MaskedNetCDF_customgrid.nc. The rates files have names that follow the form cesm_fronts_<start_year>_<end_year>_frontRates_viaPolylines_customgrid.nc. For the one-hot and rates files, the historical and RCP2.6 simulation output have been combined into a single file.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.