Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
1,118
datasets available to search
ShareScore release 0.9.0
Dataset results
1,118 results for “Time series”
Portobello Marine Laboratory sea surface temperature time series
<p>This table contains the daily sea surface temperature observations taken at the Portobello Marine Laboratory wharf (LAT: -45.8160, LON: 170.6500). The first column is time in MATLAB datenum format. The second column is daily sea surface temperature recorded at 9am local time. Measurements are recorded to an accuracy of <span class="math-tex">\(\pm\)</span>0.1°C. Missing observations have been assigned the value -999. Additional station details and sampling information can be found in <a href="https://environment.govt.nz/publications/new-zealand-coastal-sea-surface-temperature/">Chiswell and Grant (2018)</a>.</p> <p>We acknowledge the foresight and dedication of the founders of this <em>in situ</em> dataset in the 1950s. We are grateful for all the people involved in the data collection. Notably these include</p> <ul> <li>Doug Mackie (data acquisition and record maintenance)</li> <li>Elizabeth (Betty) Batham who championed the long term climate sampling</li> <li>All the researchers who have assisted with sampling</li> </ul>
Arctic vegetation cover fractions derived from Landsat time series (1984-2020) for the greater Mackenzie Delta Region (Western Canadian Arctic)
<p>Data to the publication by Nill et al. (2022) "<em>Arctic shrub expansion revealed by Landsat-derived multitemporal<br> vegetation cover fractions in the Western Canadian Arctic"</em></p> <p>The dataset features Landsat-derived fractional cover estimates of Arctic plant functional types (shrub, evergreen trees, herbaceous, lichen) and other land cover (barren, water) in the greater Mackenzie Delta Region, Canada.<br> We utilized regression-based unmixing based on synthetic training data in order to build multitemporal Kernel Ridge Regression (KRR) models for estimating fractional cover and validated our predictions based on independent very-high-resolution imagery (please be referred to publication for details).<br> <br> <strong>Dataset information</strong><br> The fraction cover predictions ("krr-avg") are provided separately for each epoch (1984-1990, 1991-1996, ..., 2015-2020) and class/cover type. The decadal change images ("dec-cng") between 1984 and 2020 are provided separately for each class/cover type. The naming convention of the files is as follows:</p> <p>XXXX-XXXX_YYY-YYY_int16-10e3_class-Z-Z</p> <ul> <li>XXXX-XXXX = epoch, e.g. 2015-2020</li> <li>YYY-YYY = dataset ("krr-avg" = fraction cover, "dec-cng" = decadal fraction cover change)</li> <li>Z-Z = class ID and associated class name (sh = shrub, cf = coniferous, hb = herbaceous, lc = lichen, wt = water, br = barren)</li> </ul> <p>The fraction cover values are % scaled by 10,000. For instance, a value of 1234 refers to 12.34%. Further image metadata:</p> <ul> <li><strong>Datatype:</strong> Signed 16-bit integer (Int16) </li> <li><strong>Data format: </strong>GeoTiff (.tif)</li> <li><strong>No data value:</strong> -9999</li> <li><strong>Projection:</strong> EPSG:3573 with custom central meridian; WKT string: 'PROJCS["WGS 84 / North Pole LAEA Canada",GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433,AUTHORITY["EPSG","9122"]],AUTHORITY["EPSG","4326"]],PROJECTION["Lambert_Azimuthal_Equal_Area"],PARAMETER["latitude_of_center",90],PARAMETER["longitude_of_center",-135],PARAMETER["false_easting",0],PARAMETER["false_northing",0],UNIT["metre",1],AXIS["Easting",EAST],AXIS["Northing",NORTH]]'</li> </ul> <p><strong>Publication</strong><br> Nill, L., Grünberg, I., Ullmann, T., Gessner, M., Boike, J. & Hostert, P. (2022): Arctic shrub expansion revealed by Landsat-derived multitemporal vegetation cover fractions in the Western Canadian Arctic. Remote Sensing of Environment, 2022, 281. https://doi.org/10.1016/j.rse.2022.113228</p> <p><strong>Further information</strong><br> For further information, please see the publication or contact Leon Nill (leon.nill@geo.hu-berlin.de).<br> A web-visualization of this dataset is available <a href="https://ows.geo.hu-berlin.de/webviewer/arctic-shrub/">here</a>.</p>
Wikipedia time-series graph
<p>Wikipedia temporal graph.</p> <p>The dataset is based on two Wikipedia SQL dumps: (1) English language articles and (2) user visit counts per page per hour (aka pagecounts). The original datasets are publicly available on the Wikimedia website.</p> <p>Static graph structure is extracted from English language Wikipedia articles. Redirects are removed. Before building the Wikipedia graph we introduce thresholds on the minimum number of visits per hour and maximum in-degree. We remove the pages that have less than 500 visits per hour at least once during the specified period. Besides, we remove the nodes (pages) with in-degree higher than 8 000 to build a more meaningful initial graph. After cleaning, the graph contains 116 016 nodes (out of total 4 856 639 pages), 6 573 475 edges. The graph can be imported in two ways: (1) using edges.csv and vertices.csv or (2) using enwiki-20150403-graph.gt file that can be opened with open source Python library Graph-Tool.</p> <p>Time-series data contains users' visit counts from 02:00, 23 September 2014 until 23:00, 30 April 2015. The total number of hours is 5278. The data is stored in two formats: CSV and H5. CSV file contains data in the following format [page_id :: count_views :: layer], where layer represents an hour. In H5 file, each layer corresponds to an hour as well.</p>
Training Datasets for Epilepsy Analysis: Preprocessing and Feature Extraction from EEG Time Series
<h2>The files include the 20 training datasets, in csv format, from 20 epileptic patients. Each set of data is described by 1080 features extracted using the sliding window technique.</h2>
Merged SCIAMACHY-OMPS limb ozone time series
<p>This data set contains the time series of merged monthly mean ozone profiles retrieved at the University of Bremen from SCIAMACHY and OMPS-LP limb observations. The merging is performed on deseasonalized anomalies, but the data set contains also the reconstructed number density time series. The data set is longitudinally resolved, with a 5° latitude and 20° longitude resolution, and a vertical grid with 3.3 km spacing. </p>
Nighttime Lights PC1-4 based on the Version 4 DMSP-OLS Nighttime Lights Time Series 1997–2014
<p>Nighttime Lights PC1-4 based on the Version 4 <a href="https://ngdc.noaa.gov/eog/dmsp/downloadV4composites.html">DMSP-OLS Nighttime Lights Time Series</a> 1997–2014. Derived using SAGA GIS Principal Component analysis. Image and data processing by NOAA's National Geophysical Data Center. DMSP data collected by US Air Force Weather Agency.</p> <p>To access and visualize maps use: <a href="http://www.openlandmap.org/">OpenLandMap.org</a></p> <p>If you discover a bug, artifact or inconsistency in the maps, or if you have a question please use some of the following channels:</p> <ul> <li>Technical issues and questions about the code: <a href="https://gitlab.com/openlandmap/global-layers/issues">https://gitlab.com/openlandmap/global-layers/issues</a> </li> <li>General questions and comments: <a href="https://disqus.com/home/forums/landgis/">https://disqus.com/home/forums/landgis/</a></li> </ul>
Soil organic carbon stock (0–30 cm) in kg/m2 time-series 2001–2015 based on the land cover changes
<p>Estimated SOC loss based on the European Space Agency (ESA) Climate Change Initiative (ESACCI-LC) land cover maps 2001–2015. This only shows estimated SOC loss (in kg/m2) as a result of change in land use / land cover (assuming standard change factors based on the literature and IPCC reports). Methodology produced for the purpose of the Land Degradation Neutrality (UNCCD) project. Processing steps are described in detail <strong><a href="https://gitlab.com/openlandmap/global-layers/tree/master/soil/LDN">here</a></strong>. Antartica is not included.</p> <p>To access and visualize maps use: <a href="http://www.openlandmap.org/">OpenLandMap.org</a></p> <p>If you discover a bug, artifact or inconsistency in the maps, or if you have a question please use some of the following channels:</p> <ul> <li>Technical issues and questions about the code: <a href="https://gitlab.com/openlandmap/global-layers/issues">https://gitlab.com/openlandmap/global-layers/issues</a> </li> <li>General questions and comments: <a href="https://disqus.com/home/forums/landgis/">https://disqus.com/home/forums/landgis/</a></li> </ul> <p>All files internally compressed using "COMPRESS=DEFLATE" creation option in GDAL. File naming convention:</p> <ul> <li>sol = theme: soil,</li> <li>organic.carbon.stock = variable: soil organic carbon stock in kg/m2,</li> <li>msa.kgm2 = determination method: derived from carbon content, bulk density and coarse fragments,</li> <li>m = mean value,</li> <li>250m = spatial resolution / block support: 250 m,</li> <li>b0..30cm = vertical reference: standard layer 0-30 cm below surface,</li> <li>2014 = time reference: year 2014,</li> <li>v0.2 = version number: 0.2,</li> </ul>
Mars Odyssey Neutron Spectrometer Time Series of Corrected Cateogry 1 Counting Rates, 2002-2017
<p>Ubinned time series of derived neutron data from the Mars Odyssey Neutron Spectrometer (MONS) Category 1 data, from 200 - 2017.</p>
18S V4 rDNA sequences organized at the OTU level for the SOMLIT-Astan time-series (2009-2016)
<p>The present file includes metadata for each 18S V4<strong> rDNA OTU</strong> from the SOMLIT-Astan time series (2009-2016) including the following fields: <strong>amplicon</strong> = identifier of the representative (most abundant) sequence; <strong>total</strong> = total number of reads; <strong>spread </strong>= number of samples in which the OTU has been found; <strong>cloud </strong>= number of unique sequences constituting the OTU; <strong>sequence</strong> = nucleic acid sequence of the representative sequence; <strong>length</strong> = length of the representative sequence; <strong>quality </strong>= minimum expected error observed for the representative sequence, divided by sequence length; <strong> taxonomy</strong> = taxonomic path assigned to the representative sequence; <strong>identity</strong> = percentage of identity of the representative sequence to the closest reference sequence from PR2; <strong>references</strong> = best hit reference sequence(s) ; <strong>RA090107_02:RA161222_3 </strong>= 375 samples from January 2009 to December 2016, the first two number are the year followed by the month and the day (sampling twice a month during 8 years). Values after “_” indicate the size of the filter used for the filtration: 02 for 0.2 µm and 3 for 3 µm.</p> <p>Generation of 18S V4 rDNA Operational Taxonomic Units (OTUs) from the raw sequencing reads and their assembly into a OTUtable was obtained according to the following pipeline (https://doi.org/10.5281/zenodo.5791089). The V4 region was extracted from the 18S rDNA reference sequences from PR2 v4.12 (Guillou et al., 2013) with Cutadapt. The representative sequences of each OTU were compared to these V4 reference sequences by pairwise global alignment (usearch_global VSEARCH’s command). Each OTU inherits the taxonomy of the best hit or the last common ancestor in case of ties. OTUs with a score below 80% similarity were considered as unassigned (Mahé et al., 2017; Stoeck et al., 2010).</p> <p>The final dataset (filtered OTU table) contains 375 samples (sampled twice per month from 2009 to 2016) with a total of ~30 million sequence reads and 21,418 OTUs.</p>
CAMISIM hybrid time series data
<p>CAMISIM was used to simulate Illumina and Nanopore reads for a time series based on the genome sources from the “CAMI II challenge toy mouse gut dataset” (Meyer et al., 2021), containing 791 genomes. For this, the most recent development version of CAMISIM at the time of preparing this data was used (available at <a href="https://doi.org/10.5281/zenodo.5137751">https://doi.org/10.5281/zenodo.5137751</a>). Two groups of samples were generated by using different CAMISIM seeds, each comprising a time series of four samples.</p> <p>The sample sheet file (samplesheet.CAMISIM_hybrid.csv) can be used as direct input for the nf-core/mag pipeline, e.g. with the command:</p> <p>> nextflow run nf-core/mag -r 2.1.0 -profile <docker/singularity/podman/shifter/charliecloud/conda/institute> --input https://zenodo.org/record/5155395/files/samplesheet.CAMISIM_hybrid.csv --coassemble_group</p> <p>Note, in case of download problems, restarting the pipeline run with `-resume` or downloading the files beforehand and adjusting the paths in the sample sheet file should help.</p> <p>See <a href="https://nf-co.re/mag">https://nf-co.re/mag</a> for a comprehensive usage documentation.</p> <p> </p>
Preprocessed rat brain voxel time series
<p>Preprocessed version of voxel time-series for three rats, originally described in Becq et al., Functional connectivity is preserved but reorganized across several anesthetic regimes, NeuroImage, 2020. Used in Achard et al., Inter-regional correlation estimators for functional magnetic resonance imaging, arXiv, 2022, arXiv:2011.08269.</p> <p>The files named "coord_ROI_x.txt" contain the coordinates of the voxels inside region x (each line corresponds to one voxel).</p> <p>The files named "ts_ROI_x.txt" contain the BOLD signal time series of the voxels inside region x (each line corresponds to one voxel, each column to one timepoint). The voxels with time series equal to zero have been removed</p> <p>The files named "weight_ROI_x.txt" contain the weights associated with the voxels inside region x (each line corresponds to one voxel). Indeed, when assigning voxels to regions, some voxels end up at the border of several regions. These weights characterize the proportion of a given voxel present inside a given region. Hence, some voxels are included in several different regions. So when we compute the voxel-to-voxel inter-correlation between two regions we sometimes end up with inter-correlations equal to 1. In the current dataset this issue has been resolved and each voxel has been assigned to a single region.</p>
High-frequency, year-round time series of the carbonate chemistry in a high-Arctic fjord (Svalbard)
<p>The Arctic Ocean is subject to high rates of ocean warming and acidification, with critical implications for marine organisms as well as ecosystems and the services they provide. Carbonate system data in the Arctic realm are spotty in space and time and, until recently, there was no time-series station measuring the carbonate chemistry at high frequency in this region, particularly in coastal waters. We report here on the first high-frequency (1 h), multi-year (6 years) dataset of salinity, temperature, dissolved inorganic carbon, total alkalinity, CO2 partial pressure (pCO2) and pH at a coastal site (12 m) in Kongsfjorden, Svalbard. We show that the choice of formulations for calculating the dissociation constants of the carbonic acid remains unsettled, (2) the water column is generally somewhat stratified despite the shallow depth, (3) the saturation state of calcium carbonate is subject to large seasonal changes but never reaches undersaturation (Oa ranges between 1.4 and 3.0) and (4) pCO2 is lower than atmospheric CO2 at all seasons, making this site a sink for atmospheric CO2.</p> <p>In addition to the sources of funding findable within the Zenodo interface, this work has been supported by the Coastal Observing System for Northern and Arctic Seas (COSYNA), the two Helmholtz large-scale infrastructure projects ACROSS and MOSES, the French Polar Institute (IPEV) as well as the European Union's Horizon 2020 research and innovation programme Jericho-Next (No 871153 and 951799). <br> <br> ------ <br> <br> Column descriptions are as follows: <br> <br> date/time [UTC+0]: The date and time of sampling at UTC <br> pressure [dbar]: hydrostatic pressure (profiler) <br> s_insitu [unit]: salinity in situ (profiler) <br> s_fb [unit], salinity (FerryBox) <br> t_11m [°C]: temperature in situ (static at 11 m) <br> t_ctd [°C]: temperature in situ (profiler) <br> t_fb [°C]: temperature (FerryBox) <br> t_sf [°C]: temperature SeaFET (profiler) <br> pco2 [uatm]: Partial pressure of CO2 (FerryBox) <br> pH_sensor [total scale]: pH in situ at in situ temperature (profiler) <br> at [umol kg-1] at, total alkalinity in situ(discrete) <br> ct [umol kg-1]: dissolved inorganic carbon in situ (discrete) <br> pH_discrete [total scale]: spectrophotometric pH in situ (total scale) at in situ temperature (discrete)</p>
UDP Synthetic Dataset for training ML time series models
<p>The dataset available has been produced by the "Next-Generation IoT solutions for the universal supply chain" (iNGENIOUS) project’s consortium under EC grant agreement 957216, made publicly available as part of the Horizon 2020 Open Research Data Pilot (<a href="https://www.openaire.eu/what-is-the-open-research-data-pilot">ORD pilot</a>).<br> The European Commission is not liable for any use that may be made of the information contained herein.</p> <p>The available dataset is in csv format and contains synthetic data of UDP packets received and sent by a single User Plane Function (UPF) covering a span of 6 weeks. The format of the datafile is:</p> <ul> <li>index</li> <li>timestamp </li> <li>UDP packets_rcvd - Total number of UDP packets received</li> <li>UDP packets sent - Total number of UDP packets sent</li> </ul> <p>The simulation was performed based on behavior of UPF and 5GC Network functions inferred from stress tests performed in the iNGENIOUS project's Automated Robots with Heterogeneous Networks Use Case, as well as patterns in urban mobility taken from available UE datasets [NCS+19].</p> <p>More information on the iNGENIOUS project can be found on the project’s website: <a href="https://ingenious-iot.eu/">https://ingenious-iot.eu/</a></p> <p>[NCS+19] Noussan M, Carioni G, Sanvito FD, Colombo E. Urban Mobility Demand Profiles:<br> Time Series for Cars and Bike-Sharing Use as a Resource for Transport and Energy<br> Modeling. Data. 2019; 4(3):108. https://doi.org/10.3390/data4030108</p>
Multivariate Time Series data of Fatigued and Non-Fatigued Running from Inertial Measurement Units
<p>The data captured came from mounting a single Shimmer3 IMU on the lumbar of 19 recreational runners. The participants were all regular runners and injury free. The study protocol was reviewed and approved by the human research ethics committee at University College Dublin.<br><br>The data was collected in three segments; in the first, the participant completed a 400m run at a comfortable pace; the second segment consisted of a beep test which acted as the fatiguing protocol for this study; and the last segment where the runner was required to complete the 400m run at their comfortable pace, this time in their fatigued state. The beep test requires the runner to continuously run between two points 20m apart following an audio which produces `beeps' indicating when the person should begin running from one end to the other. The test eventually requires the runner to increase their pace as the interval between the `beeps' reduces as the test progresses. The fatiguing protocol ends when the runner is unable to keep up the increase in pace. The runs were all done on an outdoor running track. The sensor captured acceleration, angular velocity and magnetometer data throughout the three stages of the trials at a sampling rate of 256Hz. The data included here are segmented strides from the two 400m runs of each of the 19 participants. The labels on the data represent the participant number and whether it was a fatigued stride ('F') or a not fatigued stride ('NF').<br>The data used from the sensors includes data from the accelerometer in three directions (X, Y, Z) and the gyroscope in three directions (X, Y, Z). The direction of each of the axis is relative to the sensor. Two extra signals, magnitude acceleration and magnitude gyroscope were derived from the component signals and included in the analysis.</p><p>Kindly cite one of the following papers when using this data:</p><p>B. Kathirgamanathan, B. Caulfield and P. Cunningham, "Towards Globalised Models for Exercise Classification using Inertial Measurement Units," 2023 IEEE 19th International Conference on Body Sensor Networks (BSN), Boston, MA, USA, 2023, pp. 1–4, doi: 10.1109/BSN58485.2023.10331612</p><p>B. Kathirgamanathan, T. Nguyen, G. Ifrim, B. Caulfield, P. Cunningham. Explaining Fatigue in Runners using Time Series Analysis on Wearable Sensor Data, XKDD 2023: 5th International Workshop on eXplainable Knowledge Discovery in Data Mining, ECML PKDD, 2023, <a href="http://xkdd2023.isti.cnr.it/papers/223.pdf">http://xkdd2023.isti.cnr.it/papers/223.pdf</a></p>
SCShores: time-series of shorelines from Spanish Sandy beaches from citizen-science monitoring program.
<p>This repository contains 5 years of sandy beaches shorelines deriverd from a citizen-science monitoring program in the Spanish coast. The methodology and the dataset are described in:</p> <p><em><strong>González-Villanueva, R., Soriano-González, J., Alejo, I., Criado-Sudau, F., Plomaritis, T., Fernàndez-Mora, À., Benavente, J., Del Río, L., Nombela, M. Á., and Sánchez-García, E.: SCShores: a comprehensive shoreline dataset of Spanish sandy beaches from a citizen-science monitoring programme, Earth System Science Data. V. 15, 4613-4629 , <a href="https://essd.copernicus.org/articles/15/4613/2023/essd-15-4613-2023.html">https://doi.org/10.5194/essd-15-4613-2023</a>, 2023. </strong></em></p> <p>The shoreline dataset is provided in 1 GEOJSON file: SCShores.geojson. This dataset covers five<strong> </strong>sandy beaches located on the Atlantic and Mediterranean coasts of Spain where CoastSnap stations were available, and it includes a total of 1721 shorelines. The coordinate system for the geospatial layer is WGS84.</p> <ul> <li><strong><em>SCShores.geojson</em></strong>: this layer contains the sandy shorelines . Each feature in this layer is a multipoint with the following attributtes: <ul> <li><strong>site</strong>: CoastSnap station name id, e.g. agrelo, samarador, cadiz, ….</li> <li><strong>date</strong>: date and time of the shoreline, yyyyy-mm-dd hh:mm:ss</li> <li><strong>timezone</strong>: Coordinated Universal Time, UTC</li> <li><strong>timestampQuality</strong>: quality flag indicating the confidence in the date-time indicated by the image provider, e.g. 1, 2</li> <li><strong>imageSource</strong>: source of the original image from which the shoreline has been derived, e.g. Instagram, Twitter, Facebook, Email, CoastSnapApp</li> <li><strong>elevation_m:</strong> same as Z coordinate, defined by the observed tide and the tidal offset, in meters, Tide+tide offset</li> <li><strong>verticalDatum</strong>: mean sea level in Alicante, which is considered the zero topographic reference in the Spanish territory, NMMA</li> <li><strong>geometry</strong>: type of geometry used in the file, MultiPoint</li> <li><strong>coordinates</strong>: Geographic WGS84 coordinates for each point in the geometry, longitude, latitude, Z</li> </ul> </li> </ul> <p> </p>
Solar and interplanetary magnetic field data analyzed in "Optimal frequency-domain analysis for spacecraft time series: Introducing the missing-data multitaper power spectrum estimator"
<p>This dataset contains simultaneous measurements of the interplanetary magnetic field magnitude <B> and the sun's radio flux at 10.7 cm <F10.7>. <B> measurements come from a series of spacecraft located at the L1 point, while <F10.7> was measured by the ongoing monitoring program by Canada's Dominion Radio Astrophysical Observatory. Bartels rotation-averaged data were downloaded from NASA's OMNIWeb, https://omniweb.gsfc.nasa.gov/html/ow_data.html. The file contains other solar wind plasma parameters that were not used in the analysis.</p>
A harmonized Landsat Sentinel-2 (HLS) dataset for benchmarking time series reconstruction methods of vegetation indices
<p>Satellite images can be used to derive time series of vegetation indices, such as normalized difference vegetation index (NDVI) or enhanced vegetation index (EVI), at global scale. Unfortunately, recording artifacts, clouds, and other atmospheric contaminants impacts a significant portion of the produced images, requiring the usage of ad-hoc techniques to reconstruct the time series in the affected regions. In literature, several methods have been proposed to fill the gaps present in the images, and some works also presented performance comparisons between them (Roerink et al., 2000; Moreno-Martínez et al., 2020; Siabi et al., 2022). Because of the lack of a ground truth for the reconstructed images, the performance evaluation requires the creation of datasets where artificial gaps are introduced in a reference image, such that metrics like the root mean square error (RMSE) can be computed comparing the reconstructed images with the reference one. Different approaches have been used to create the reference images and the artificial gaps, but in most cases, the artificial gaps are introduced using arbitrary patterns and/or the reference image is produced artificially and not using real satellite images (e.g. Kandasamy et al., 2013; Liu et al., 2017; Julien & Sobrino, 2018). In addition, to the best of our knowledge, few of them are openly available and directly accessible allowing for fully reproducible research.</p> <p>We provide here a benchmark dataset for time series reconstruction method based on the<strong> <a href="https://hls.gsfc.nasa.gov/">harmonized Landsat Sentinel-2 (HLS)</a> </strong>collection where the artificial gaps are introduced with a realistic spatio-temporal distribution. In particular, we selected six tiles that we considered representative for most of the main climate classes (e.g. equatorial, arid, warm temperature, boreal and polar), as depicted in the preview.</p> <p>Specifically, following the <strong><a href="https://hls.gsfc.nasa.gov/products-description/tiling-system/">relative tiling system</a></strong> shown above, we downloaded the Red, NIR and F-mask bands from both the HLSL30 and HLSS30 collections for the tiles 19FCV, 22LEH, 32QPK, 31UFS, 45WFV and 49MWM. From the Red and NIR band we derived the NDVI as:</p> <p><span class="math-tex">\(NDVI = {NIR - Red \over NIR + Red}\)</span></p> <p>only for clear-sky on lend pixels (F-mask bits 1, 3, 4 and 5 equal zero), setting as not a number the remaining pixels. The images are then aggregated on a 16 days base, averaging the available values for each pixel in each temporal range. The so obtained data, are considered from us as the reference data for the benchmarking, and stored following the file naming convention</p> <p><em>HLS.T<TILE_NAME>.<YYYYDDD>.v2.0.NDVI.tif</em></p> <p>where <em>TILE_NAME</em> is one between the above specified ones, <em>YYYY</em> is the corresponding year (spanning from 2015 to 2022) and <em>DDD</em> is the day of the year from which the corresponding 16 days range starts. Finally, for each tile, we have a time series composed of <strong>184</strong> images (23 images for 8 years) that can be easily manipulated, for example using the <strong><a href="https://github.com/scikit-map/scikit-map/tree/master">Scikit-Map library</a></strong> in Python.</p> <p>Starting from those data, for each image we considered the mask of currently present gaps, we randomly rotated it by 90, 180 or 270 degrees and we added artificial gaps in the pixels of the rotated mask. Doing so, we believe that the spatio-temporal distribution will be still realistic, providing a solid benchmark for gap-filling methods that work on time series, on spatial pattern or combination of the both.</p> <p>The data including the artificial gaps are stored with the naming structure</p> <p><em>HLS.T<TILE_NAME>.<YYYYDDD>.v2.0.NDVI_art_gaps.tif</em></p> <p>following the previously mentioned convention. The performance metrics, such as RMSE or normalized RMSE (NRMSE), can be computed by applying a reconstruction method on the images with artificial gaps, and then comparing the reconstructed time series with the reference one only on the artificially created gaps locations. </p> <p>This dataset was used to compare the performance of some gap-filling methods and we provide a <strong><a href="https://github.com/OpenGeoHub/EO-benchmark/blob/main/gap_filling_methods/gap_filling_comparison.ipynb">Jupyter notebook</a></strong> that shows how to access and use the data. The files are provided in GeoTIFF format and projected in the coordinate reference system WGS 84 / UTM zone 19N (EPSG:32619). </p> <p>If you succeed to produce higher accuracy or develop a new algorithm for gap filling, please contact authors or post on our GitHub repository. May the force be with you!</p> <p>References:</p> <ol> <li> <p>Julien, Y., & Sobrino, J. A. (2018). TISSBERT: A benchmark for the validation and comparison of NDVI time series reconstruction methods. Revista de Teledetección, (51), 19-31. <a href="https://doi.org/10.4995/raet.2018.9749">https://doi.org/10.4995/raet.2018.9749</a> </p> </li> <li> <p>Kandasamy, S., Baret, F., Verger, A., Neveux, P., & Weiss, M. (2013). A comparison of methods for smoothing and gap filling time series of remote sensing observations–application to MODIS LAI products. Biogeosciences, 10(6), 4055-4071. <a href="https://doi.org/10.5194/bg-10-4055-2013">https://doi.org/10.5194/bg-10-4055-2013</a> </p> </li> <li> <p>Liu, R., Shang, R., Liu, Y., & Lu, X. (2017). Global evaluation of gap-filling approaches for seasonal NDVI with considering vegetation growth trajectory, protection of key point, noise resistance and curve stability. Remote Sensing of Environment, 189, 164-179. <a href="https://doi.org/10.1016/j.rse.2016.11.023">https://doi.org/10.1016/j.rse.2016.11.023</a> </p> </li> <li> <p>Moreno-Martínez, Á., Izquierdo-Verdiguier, E., Maneta, M. P., Camps-Valls, G., Robinson, N., Muñoz-Marí, J., ... & Running, S. W. (2020). Multispectral high resolution sensor fusion for smoothing and gap-filling in the cloud. Remote Sensing of Environment, 247, 111901.<a href="https://doi.org/10.1016/j.rse.2020.111901"> https://doi.org/10.1016/j.rse.2020.111901</a> </p> </li> <li> <p>Roerink, G. J., Menenti, M., & Verhoef, W. (2000). Reconstructing cloudfree NDVI composites using Fourier analysis of time series. International Journal of Remote Sensing, 21(9), 1911-1917. <a href="https://doi.org/10.1080/014311600209814">https://doi.org/10.1080/014311600209814</a></p> </li> <li> <p>Siabi, N., Sanaeinejad, S. H., & Ghahraman, B. (2022). Effective method for filling gaps in time series of environmental remote sensing data: An example on evapotranspiration and land surface temperature images. Computers and Electronics in Agriculture, 193, 106619.<a href="https://doi.org/10.1016/j.compag.2021.106619"> https://doi.org/10.1016/j.compag.2021.106619</a></p> </li> </ol>
Monthly aggregated Water Vapor MODIS MCD19A2 (1 km): Monthly time-series (2003-2005)
<p>This data is part of the <em>Monthly aggregated Water Vapor MODIS MCD19A2 (1 km)</em> dataset. Check the related identifiers section on the Zenodo side panel to access other parts of the dataset.</p><p><strong>General Description</strong></p><p>The monthly aggregated water vapor dataset is derived from <a href="https://ladsweb.modaps.eosdis.nasa.gov/missions-and-measurements/products/MCD19A2"><abbr title="MCD19A2 MODIS/Terra+Aqua daily product">MCD19A2 v061</abbr></a>. The Water Vapor data measures the column above ground retrieved from MODIS near-IR bands at 0.94μm. The dataset time spans from 2000 to 2022 and provides data that covers the entire globe. The dataset can be used in many applications like water cycle modeling, vegetation mapping, and soil mapping. This dataset includes:</p><ul><li><strong>Monthly time-series:</strong><br>Derived from <em>MCD19A2 v061</em>, this data provides a monthly aggregated mean and standard deviation of daily water vapor time-series data from 2000 to 2022. Only positive non-cloudy pixels were considered valid observations to derive the mean and the standard deviation. The remaining no-data values were filled using the <abbr title="Moving Window Median">TMWM</abbr> algorithm. This dataset also includes smoothed mean and standard deviation values using the Whittaker method. The quality assessment layers and the number of valid observations for each month can provide an indication of the reliability of the monthly mean and standard deviation values.</li><li><strong>Yearly time-series:</strong><br>Derived from <em>monthly time-series</em>, this data provides a yearly time-series aggregated statistics of the monthly time-series data.</li><li><strong>Long-term data (2000-2022):</strong><br>Derived from <em>monthly time-series</em>, this data provides long-term aggregated statistics for the whole series of monthly observations.</li></ul><p><strong>Data Details</strong></p><ul><li><strong>Time period:</strong> 2003–2005</li><li><strong>Type of data:</strong> Water vapor column above the ground (0.001cm)</li><li><strong>How the data was collected or derived:</strong> Derived from MCD19A2 v061 using <a href="https://earthengine.google.com">Google Earth Engine</a>. Cloudy pixels were removed and only positive values of water vapor were considered to compute the statistics. The time-series gap-filling and time-series smoothing were computed using the <a href="https://github.com/scikit-map/scikit-map">Scikit-map</a> Python package.</li><li><strong>Statistical methods used:</strong> Four statistics were derived: mean, standard deviation, smoothed mean, smoothed standard deviation.</li><li><strong>Limitations or exclusions in the data:</strong> The dataset does not include data for Antarctica.</li><li><strong>Coordinate reference system:</strong> EPSG:4326</li><li><strong>Bounding box (Xmin, Ymin, Xmax, Ymax):</strong> (-180.00000, -62.00081, 179.99994, 87.37000)</li><li><strong>Spatial resolution:</strong> 1/120 d.d. = 0.008333333 (1km)</li><li><strong>Image size:</strong> 43,200 x 17,924</li><li><strong>File format:</strong> Cloud Optimized Geotiff (COG) format.</li></ul><p><strong>Support</strong></p><p>If you discover a bug, artifact, or inconsistency, or if you have a question please use some of the following channels:</p><ul><li>Technical issues and questions about the code: <a href="https://gitlab.com/openlandmap/global-layers/-/issues">GitLab Issues</a></li><li>General questions and comments: <a href="https://disqus.com/home/forums/landgis">LandGIS Forum</a></li></ul><p><strong>Name convention</strong></p><p>To ensure consistency and ease of use across and within the projects, we follow the standard Open-Earth-Monitor file-naming convention. The convention works with 10 fields that describes important properties of the data. In this way users can search files, prepare data analysis etc, without needing to open files. The fields are:</p><ol><li>generic variable name: wv = Water vapor</li><li>variable procedure combination: mcd19a2v061.seasconv = MCD19A2 v061 with gap-filling algorithm</li><li>Position in the probability distribution / variable type: m = mean | sd = standard deviation | n = number of observations | qa = quality assessment</li><li>Spatial support: 1km</li><li>Depth reference: s = surface</li><li>Time reference begin time: 20030101 = 2003-01-01</li><li>Time reference end time: 20051231 = 2005-12-31</li><li>Bounding box: go = global (without Antarctica)</li><li>EPSG code: epsg.4326 = EPSG:4326</li><li>Version code: v20230619 = 2023-06-19 (creation date)</li></ol>
Monthly aggregated Water Vapor MODIS MCD19A2 (1 km): Monthly time-series (2021-2022)
<p>This data is part of the <em>Monthly aggregated Water Vapor MODIS MCD19A2 (1 km)</em> dataset. Check the related identifiers section on the Zenodo side panel to access other parts of the dataset.</p><p><strong>General Description</strong></p><p>The monthly aggregated water vapor dataset is derived from <a href="https://ladsweb.modaps.eosdis.nasa.gov/missions-and-measurements/products/MCD19A2"><abbr title="MCD19A2 MODIS/Terra+Aqua daily product">MCD19A2 v061</abbr></a>. The Water Vapor data measures the column above ground retrieved from MODIS near-IR bands at 0.94μm. The dataset time spans from 2000 to 2022 and provides data that covers the entire globe. The dataset can be used in many applications like water cycle modeling, vegetation mapping, and soil mapping. This dataset includes:</p><ul><li><strong>Monthly time-series:</strong><br>Derived from <em>MCD19A2 v061</em>, this data provides a monthly aggregated mean and standard deviation of daily water vapor time-series data from 2000 to 2022. Only positive non-cloudy pixels were considered valid observations to derive the mean and the standard deviation. The remaining no-data values were filled using the <abbr title="Moving Window Median">TMWM</abbr> algorithm. This dataset also includes smoothed mean and standard deviation values using the Whittaker method. The quality assessment layers and the number of valid observations for each month can provide an indication of the reliability of the monthly mean and standard deviation values.</li><li><strong>Yearly time-series:</strong><br>Derived from <em>monthly time-series</em>, this data provides a yearly time-series aggregated statistics of the monthly time-series data.</li><li><strong>Long-term data (2000-2022):</strong><br>Derived from <em>monthly time-series</em>, this data provides long-term aggregated statistics for the whole series of monthly observations.</li></ul><p><strong>Data Details</strong></p><ul><li><strong>Time period:</strong> 2021–2022</li><li><strong>Type of data:</strong> Water vapor column above the ground (0.001cm)</li><li><strong>How the data was collected or derived:</strong> Derived from MCD19A2 v061 using <a href="https://earthengine.google.com">Google Earth Engine</a>. Cloudy pixels were removed and only positive values of water vapor were considered to compute the statistics. The time-series gap-filling and time-series smoothing were computed using the <a href="https://github.com/scikit-map/scikit-map">Scikit-map</a> Python package.</li><li><strong>Statistical methods used:</strong> Four statistics were derived: mean, standard deviation, smoothed mean, smoothed standard deviation.</li><li><strong>Limitations or exclusions in the data:</strong> The dataset does not include data for Antarctica.</li><li><strong>Coordinate reference system:</strong> EPSG:4326</li><li><strong>Bounding box (Xmin, Ymin, Xmax, Ymax):</strong> (-180.00000, -62.00081, 179.99994, 87.37000)</li><li><strong>Spatial resolution:</strong> 1/120 d.d. = 0.008333333 (1km)</li><li><strong>Image size:</strong> 43,200 x 17,924</li><li><strong>File format:</strong> Cloud Optimized Geotiff (COG) format.</li></ul><p><strong>Support</strong></p><p>If you discover a bug, artifact, or inconsistency, or if you have a question please use some of the following channels:</p><ul><li>Technical issues and questions about the code: <a href="https://gitlab.com/openlandmap/global-layers/-/issues">GitLab Issues</a></li><li>General questions and comments: <a href="https://disqus.com/home/forums/landgis">LandGIS Forum</a></li></ul><p><strong>Name convention</strong></p><p>To ensure consistency and ease of use across and within the projects, we follow the standard Open-Earth-Monitor file-naming convention. The convention works with 10 fields that describes important properties of the data. In this way users can search files, prepare data analysis etc, without needing to open files. The fields are:</p><ol><li>generic variable name: wv = Water vapor</li><li>variable procedure combination: mcd19a2v061.seasconv = MCD19A2 v061 with gap-filling algorithm</li><li>Position in the probability distribution / variable type: m = mean | sd = standard deviation | n = number of observations | qa = quality assessment</li><li>Spatial support: 1km</li><li>Depth reference: s = surface</li><li>Time reference begin time: 20210101 = 2021-01-01</li><li>Time reference end time: 20221231 = 2022-12-31</li><li>Bounding box: go = global (without Antarctica)</li><li>EPSG code: epsg.4326 = EPSG:4326</li><li>Version code: v20230619 = 2023-06-19 (creation date)</li></ol>
Monthly aggregated Water Vapor MODIS MCD19A2 (1 km): Monthly time-series (2015-2017)
<p>This data is part of the <em>Monthly aggregated Water Vapor MODIS MCD19A2 (1 km)</em> dataset. Check the related identifiers section on the Zenodo side panel to access other parts of the dataset.</p><p><strong>General Description</strong></p><p>The monthly aggregated water vapor dataset is derived from <a href="https://ladsweb.modaps.eosdis.nasa.gov/missions-and-measurements/products/MCD19A2"><abbr title="MCD19A2 MODIS/Terra+Aqua daily product">MCD19A2 v061</abbr></a>. The Water Vapor data measures the column above ground retrieved from MODIS near-IR bands at 0.94μm. The dataset time spans from 2000 to 2022 and provides data that covers the entire globe. The dataset can be used in many applications like water cycle modeling, vegetation mapping, and soil mapping. This dataset includes:</p><ul><li><strong>Monthly time-series:</strong><br>Derived from <em>MCD19A2 v061</em>, this data provides a monthly aggregated mean and standard deviation of daily water vapor time-series data from 2000 to 2022. Only positive non-cloudy pixels were considered valid observations to derive the mean and the standard deviation. The remaining no-data values were filled using the <abbr title="Moving Window Median">TMWM</abbr> algorithm. This dataset also includes smoothed mean and standard deviation values using the Whittaker method. The quality assessment layers and the number of valid observations for each month can provide an indication of the reliability of the monthly mean and standard deviation values.</li><li><strong>Yearly time-series:</strong><br>Derived from <em>monthly time-series</em>, this data provides a yearly time-series aggregated statistics of the monthly time-series data.</li><li><strong>Long-term data (2000-2022):</strong><br>Derived from <em>monthly time-series</em>, this data provides long-term aggregated statistics for the whole series of monthly observations.</li></ul><p><strong>Data Details</strong></p><ul><li><strong>Time period:</strong> 2015–2017</li><li><strong>Type of data:</strong> Water vapor column above the ground (0.001cm)</li><li><strong>How the data was collected or derived:</strong> Derived from MCD19A2 v061 using <a href="https://earthengine.google.com">Google Earth Engine</a>. Cloudy pixels were removed and only positive values of water vapor were considered to compute the statistics. The time-series gap-filling and time-series smoothing were computed using the <a href="https://github.com/scikit-map/scikit-map">Scikit-map</a> Python package.</li><li><strong>Statistical methods used:</strong> Four statistics were derived: mean, standard deviation, smoothed mean, smoothed standard deviation.</li><li><strong>Limitations or exclusions in the data:</strong> The dataset does not include data for Antarctica.</li><li><strong>Coordinate reference system:</strong> EPSG:4326</li><li><strong>Bounding box (Xmin, Ymin, Xmax, Ymax):</strong> (-180.00000, -62.00081, 179.99994, 87.37000)</li><li><strong>Spatial resolution:</strong> 1/120 d.d. = 0.008333333 (1km)</li><li><strong>Image size:</strong> 43,200 x 17,924</li><li><strong>File format:</strong> Cloud Optimized Geotiff (COG) format.</li></ul><p><strong>Support</strong></p><p>If you discover a bug, artifact, or inconsistency, or if you have a question please use some of the following channels:</p><ul><li>Technical issues and questions about the code: <a href="https://gitlab.com/openlandmap/global-layers/-/issues">GitLab Issues</a></li><li>General questions and comments: <a href="https://disqus.com/home/forums/landgis">LandGIS Forum</a></li></ul><p><strong>Name convention</strong></p><p>To ensure consistency and ease of use across and within the projects, we follow the standard Open-Earth-Monitor file-naming convention. The convention works with 10 fields that describes important properties of the data. In this way users can search files, prepare data analysis etc, without needing to open files. The fields are:</p><ol><li>generic variable name: wv = Water vapor</li><li>variable procedure combination: mcd19a2v061.seasconv = MCD19A2 v061 with gap-filling algorithm</li><li>Position in the probability distribution / variable type: m = mean | sd = standard deviation | n = number of observations | qa = quality assessment</li><li>Spatial support: 1km</li><li>Depth reference: s = surface</li><li>Time reference begin time: 20150101 = 2015-01-01</li><li>Time reference end time: 20171231 = 2017-12-31</li><li>Bounding box: go = global (without Antarctica)</li><li>EPSG code: epsg.4326 = EPSG:4326</li><li>Version code: v20230619 = 2023-06-19 (creation date)</li></ol>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.