Find research datasets worth reusing

opencc-by-4.0Oct 2022View details →

Dataset: Using light and X-ray scattering to untangle complex neuronal orientations and validate diffusion MRI

This dataset supplements the research article <a href="https://doi.org/10.1101/2022.10.04.509781">"Using light and X-ray scattering to untangle complex neuronal orientations and validate diffusion MRI"</a>. It contains images and parameter maps obtained from measurements with Scattered Light Imaging (SLI), small-angle X-ray scattering (SAXS), and diffusion magnetic resonance imaging (dMRI) of a vervet monkey and a human brain sample (containing parts of the corona radiata, the cingulum, and the corpus callosum). Please refer to the research article for more information about the sample preparation, the measurement settings, and the generation of the different parameter maps - as well as for a more detailed analysis of the data. While SLI and SAXS were performed on two sections per sample (vervet monkey brain: sections no. 501 and 511; human brain: anterior section no. 20, posterior section no. 18), dMRI was performed on the entire human brain sample (3.5 x 3.5 x 1 cm³), and evaluated in the corresponding section plane of the anterior and posterior section, respectively. Pixel sizes in SLI are 3 µm, and in SAXS 100 µm (vervet) and 150 µm (human). Voxels in dMRI are 200 µm isotropic. All files are in tif-format and can be opened with standard image processing tools like ImageJ. The files labeled with "dMRI_ODF" contain a set of spherical harmonics for each voxel, describing the orientation distribution of the nerve fibers in the respective section plane obtained from the dMRI measurement, and can be visualized with MRtrix3, using the command 'mrview [filename] -odf.load_sh [filename]'. In addition to the ODFs, the dataset contains the b0-values and the dMRI-based metrics for the whole human brain sample in form of image stacks: fractional anisotropy (FA), axonal water fraction (AWF), axial/mean/radial diffusivity (AD/MD/RD), and axial/mean/radial kurtosis (AK/MK/RK). For the evaluated human brain sections (anterior/posterior), the 3D-orientations of the nerve fibers were derived from the dMRI and SAXS measurements, respectively: The files labeled with "3D-vectors" contain the unit vectors as X-Y-Z stack; the files labeled with "inclination" contain the (absolute) out-of-plane inclination of the fibers with respect to the section plane. All measurements were further evaluated with the software SLIX (https://github.com/3d-pli/SLIX) in order to derive the in-plane fiber directions (up to three fiber directions per pixel). The dataset contains the image stacks used as input (Stack) as well as the resulting parameter maps: average/maximum/minimum of the signal (avg/max/min), distance/prominence/width of peaks in the signal (peakdistance/peakprominence/peakwidth), the computed in-plane fiber directions (direction1,2,3), the fiber orientation map encoding the fiber directions in different colors (fom), as well as the vector maps (vectors) where fiber orientations of several pixels are displayed on top of each other. For the vervet brain section no. 511, the dataset also contains the parameter maps registered onto the SLI parameter maps.

opencc-by-4.0Jul 2024View details →

Dataset of report "A.2.2.6: Validation of the fitness of purpose of the performance assessment protocol developed in A2.1.4 by demonstrating its applicability for 2 terpenes using TD-GC/MS/FID and the static standards produced in A1.1.2."

Dataset of report "A.2.2.6: Validation of the fitness of purpose of the performance assessment protocol developed in A2.1.4 by demonstrating its applicability for 2 terpenes using TD-GC/MS/FID and the static standards produced in A1.1.2."

opencc-by-4.0Feb 2018View details →

275 Candidates and 149 Validated Planets Orbiting Bright Stars in K2 Campaigns 0-10

This dataset contains transit model posterior distributions and validation analyses for the 275 exoplanet candidates (in 233 systems) analyzed in Mayo et al. (2018), titled "275 Candidates and 149 Validated Planets Orbiting Bright Stars in K2 Campaigns 0-10". The dataset takes the form of 233 compressed directories each corresponding to an exoplanet system and titled after its EPIC ID. Within a given directory there are two numpy pickles named EPICXXXXXXXXX_chains.npy and EPICXXXXXXXXX_lnlikes.npy (where XXXXXXXXX is the 9 digit EPIC number) as well as n subdirectories, where n is the number of planet candidates in the system. The EPICXXXXXXXXX_chains.npy pickle is a representative sample of the posterior distribution of the transit model for a given exoplanet system. The pickle is a numpy array of size (j,k,l), where j is the number of walkers in the Markov chain Monte Carlo ensemble simulation that sampled the posterior distribution (note: we chose to fix j = 2*l), k is the number of walker steps reported in this dataset (the full posteriors were thinned down to between 750 and 10,000 steps), and l is the number of parameters in the transit model for the exoplanet system. The EPICXXXXXXXXX_lnlikes.npy pickle contains the associated ln(likelihood) values for each walker step in the previously described pickle. This pickle is a numpy array of size (j,k) where j and k are defined as above. The number of parameters will always be of the form 4 + 5*n, where n is again the number of planets in the systems. The first four parameters in the pickle are a baseline offset parameter for the normalized flux, a noise parameter to take the place of flux error bars, and two quadratic limb darkening parameters q1 and q2 based on Kipping et al. (2013). The next five parameters (and each subsequent set of five parameters in multi-candidate systems) refer to the reference epoch (a mid-transit time in BJD - 2454833), the period (in days), log10(Rp/R*), the transit duration (TIV-TI in days), and the impact parameter. It should be noted that there is no consistent ordering of the planets in the posterior samples (for example, in a three planet system parameters 5-9 may refer to planet b, planet c, or planet d). Therefore, planetary periods should be used as reference to identify candidates. All parameters and the nature of the transit model are described in detail in Mayo et al. (2018). Each subdirectory contains the input and output of the validation analysis conducted via the VESPA validation package (Morton 2012, 2015). For additional details please refer to the relevant citations or the <a href="https://github.com/timothydmorton/VESPA">VESPA github repository</a>. Each subdirectory is named after the appropriate candidate listed in Mayo et al. (2018; specifically Tables 5 and 7).

opencc-by-4.0Feb 2019View details →

The Red Queen in the Repository: metadata quality in an ever-changing environment (preprint of paper, presentation slides and dataset collection with validation schemas to IDCC2019 conference paper)

This fileset contains a preprint version of the conference paper (.pdf), presentation slides (as .pptx) and the dataset(s) and validation schema(s) for the IDCC 2019 (Melbourne) conference paper: The Red Queen in the Repository: metadata quality in an ever-changing environment. Datasets and schemas are  in .xml, .xsd , Excel (.xlsx) and .csv  (two files representing two different sheets in the .xslx -file). The validationSchemas.zip holds the additional validation schemas (.xsd), that were not found in the schemaLocations of the metadata xml-files to be validated. The schemas must all be placed in the same folder, and are to be used for validating the Dataverse dcterms records (with metadataDCT.xsd) and the Zenodo oai_datacite feeds respectively (schema.datacite.org_oai_oai-1.0_oai.xsd). In the latter case, a simpler way of doing it might be to replace the incorrect URL "http://schema.datacite.org/oai/oai-1.0/ oai_datacite.xsd" in the schemaLocation of these xml-files by the CORRECT:  schemaLocation="http://schema.datacite.org/oai/oai-1.0/ http://schema.datacite.org/oai/oai-1.0/oai.xsd"  as has been done already in the sample files here. The sample file folders testDVNcoll.zip (Dataverse), testFigColl.zip (Figshare) and testZenColl.zip (Zenodo) contain all the metadata files tested and validated that are registered in the spreadsheet with objectIDs. In the case of Zenodo, one original file feed, zen2018oai_datacite3orig-https%20_zenodo.org_oai2d%20verb=ListRecords%26metadata Prefix=oai_datacite%26from=2018-11-29%26until=2018-11-30.xml , is also supplied to show what was necessary to change in order to perform validation as indicated in the paper. For Dataverse, a corrected version of a file, dvn2014ddi-27595Corr_https%20_dataverse.harvard.edu_api_datasets_export%20 exporter=ddi%26persistentId=doi%253A10.7910_DVN_27595Corr.xml , is also supplied in order to show the changes it would take to make the file validate without error.

opencc-by-4.0Oct 2019View details →

CROSS-VALIDATION OF FUNCTIONAL MRI and PARANOID-DEPRESSIVE SCALE: BRAIN SIGNATURES FROM MULTIVARIATE ANALYSIS

Brain signatures identified by bottom-up unsupervised machine learning: three principal components based on activations yielded from the three kinds of diagnostically relevant stimuli are used in order to produce cross-validation markers which may effectively predict the variance on the level of clinical populations and eventually delineate diagnostic and classification groups.  The stimuli represent items from a paranoid-depressive self-evaluation scale, administered simultaneously with functional magnetic resonance imaging (fMRI). We have been able to separate the two investigated clinical entities – schizophrenia and recurrent depression by use of multivariate linear model and principal component analysis. This is a confirmation of the possibility to achieve bottom-up classification of mental disorders, by use of the brain signatures relevant to clinical evaluation tests.

opencc-by-4.0Jun 2024View details →

Generated WSP: Validation of a water-sensitive paper-based method for the characterization of agricultural spray droplets

Synthetic images were generated in a Python environment using the OpenCV library to replicate the distribution of droplets in WSP. The images display droplet stains represented by blue circles (255,0,0) on a yellow background (0,255,255) to enhance contrast and enable more precise analysis. The synthetic images were created in two distinct resolutions, namely 640x480 and 2560x1440 pixels, with the aim of reproducing the output of two specific digital microscopes: the Jiusion 640x480 and the Jiusion HD 2560x1440 (Shenzen, China). The resolution is chosen based on the expected practical application, ensuring that any image analysis algorithm developed can effectively process images with similar characteristics to those obtained under real conditions by these microscopes. Each pixel in this configuration corresponds to a physical size of 18.125 µm in images with a resolution of 640x480, and a size of 6.875 µm in images with a resolution of 2560x1440. Multiple patterns were created to simulate various configurations of droplet stains in WSP. The sizes of single droplet stains varied between 100 and 600 µm, with spacings of either 1000 µm or 2000 µm between drops (see attached figure). Furthermore, the same size range was utilised to generate patterns with double and overlaid droplet stains, with a consistent spacing of 2800 µm between each stain (see attached figure). The implementation of this systematic method guarantees the accurate calibration and application of image analysis algorithms in real-world situations. This allows for the representation of precise measurements and spacing that would be encountered in actual experimental conditions.

opencc-by-4.0Oct 2024View details →

Navigating deep learning strategies for large-area land cover mapping using very-high-resolution imagery in Senegal: Validation Data

Rapid advances in deep learning for land cover classification of trees, shrubs and very small agricultural fields using very high-resolution satellite data (< 2 m), has tremendous potential for resolving current challenges in quantifying land cover change in sub-Saharan African (SSA), due to growing demand for food resources. We conducted experiments with different training strategies for scaling up UNet convolutional neural network models for regional land cover mapping with multispectral WorldView (WV)-2 and –3, imagery in three distinct regions of Senegal which has complex seasonal wet/dry conditions and cropland-savanna mosaics.  The validation exercise of this research consisted in validating more than 70,000 km2 across Senegal. The infrastructure was setup in the NASA SMCE system with a total of twelve George Mason University (GMU) students participating as operators. These operators validated more than 59 WV-2 and -3 images, each consisting of 200 stratified points in 5,000 x 5,000-pixel images. This effort resulted in a total of ~35,000 aggregated observations that are available through the eo-validation API for public consumption. Each validation point from this dataset has three individual observations.

Virtual Reality Dataset used for Proof of Concept in the Validation of the Conflict Detection and Resolution Use Case (ARTIMATION)

This dataset contains the dataset used in the Virtual Reality POC for the validation of the Conflict Detection and Resolution (CD&R) use case. This dataset represent a extract of different (using K-means) candidate solution, either good or bad ones.

Solutions and Genetic algorithm dataset of the Scenarios used for the Validation of the Conflict Detection and Resolution Use Case (ARTIMATION )

This dataset contains the solution of the scenarios used for one of the validation of the ARTIMATION project: Conflict Detection and Resolution (CD&R) use case (link). The solution are computed by a Genetic Algorithm developped by Nicolas Durand. Inside, one can find: -One archive, "GA_Scenario_Solution_Dataset.zip", containing 10 couple of files (so 20 files). Each couple of file "sol_X_1.csv" and "sols_X_1.csv" are reciprocally the solutino given by the Genetic Algorithm to scenario X, and all the candidate solution explroed by the GA while solving scenario X. This archive also contain other versions of the solutions made by the GA with other parameters. -One archive, "GA_Toy_Dataset.zip" , containing solution to random scenarios, used to develop the first interfaces. Those solutions are used to developp the heatmatrix and heatmaps of the project (link), and visualisations for the validation (link).

Heatmatrix and Heatmap Layers and Alternatives used in the Validation of the Conflict Detection and Resolution Use Case (ARTIMATION)

This dataset contains the visualisations of the solutions of Conflict Detection and Resolution (CD&R) use case. The solution are computed by a Genetic Algorithm developped by Nicolas Durand. Inside, one can find: -One archive, "Heatmatrix.zip" , containing the heatmatrix creating using the solutions dataset. -One archive, "Heatmaps_Layer_Alternatives.zip", containing all the layers created and used to created the heatmaps, the heatmaps, and alternative heatmaps (with other candidate solutions). Those layers and heatmaps are used to develop other visualisation used in the validation.

Validation Videos and eXplainable levels used in the Validation of the Conflict Detection and Resolution Use Case (ARTIMATION)

This dataset contains the explaination levels and the video used in the validation of the Conflict Detection and Resolution (CD&R) use case. The solution are computed by a Genetic Algorithm developped by Nicolas Durand. Inside the dataset, one can find: -One archive, " Validation_Videos_Traffic.zip ", containing the video of traffic of every scenario. -One archive, " Validation_XAI_levels.zip", containing the Blackbox, Heatmap, and Storyboard eXplainable levels for each scenario. The videos and XAI levels are used in the validation exercice.

opencc-by-4.0Feb 2023View details →

Blind Prediction Competition - Sera.ta - Seismic Response of Masonry Cross Vaults: Shaking table tests and numerical validations

Masonry vaults play a much relevant role in the seismic response of heritage masonry buildings, ranging from housing to the greatest cathedrals. Acting as both a ceiling and a structural horizontal diaphragm with significant mass, their mechanical behaviour affects the overall seismic response of buildings, in terms of strength, stiffness, and ductility. Moreover, local damage and collapse of vaults may produce significant losses in terms of cultural assets and casualties. In spite of the importance of this topic, the evaluation of the complex three-dimensional behaviour of vaults is still an important challenge for researchers. The main objectives of the present research project are: 1)    to better understand the seismic behaviour of masonry cross vaults by means of shaking table tests on both full-scale and small-scale models; 2)    to assess the capability of different modelling/analysis approaches to predict the seismic response of these masonry structures. In particular, three sets of shaking table tests are planned: a.    Tests on a 1:1 scale model of a brick unreinforced masonry cross vault:  to investigate the behaviour of brick masonry cross vaults under different seismic inputs, in terms of damage, displacement capacity and peak acceleration. b.    Tests on a 1:1 scale model of a brick reinforced masonry cross vault: to evaluate the effectiveness of reinforcing techniques to repair the vaults tested in a). In addition to the experimental tests, a blind prediction competition is performed to assess the efficacy of different modelling strategies and analysis techniques. The final aims are to improve the safety assessment procedures proposed for historic masonry buildings in Eurocode 8.3 and to provide better seismic assessment techniques and strengthening measures.

opencc-by-4.0Mar 2023View details →

Database on Certified Reference Materials measured with PAT tools for validation and verification purposes

The H2020 PAT4Nano project aims to develop and demonstrate Process Analytical Technologies (PAT) tools for nanosuspension characterization which have sufficiently high resolution, accuracy, and speed, for real-time industrial process monitoring and control. Real time monitoring is desired for example to obtain: small, high precision, specialty batch of materials, processing monitoring of nucleation/growth/milling of materials at different scales (lab, pilot, production), and for producing feedback loops (adapt T, pH, etc.,) needed for process control. Laser diffraction (LD), Spatially Resolved Dynamic Light Scattering (SR-DLS), Cross-Correlation Dynamic Light Scattering (CC-DLS), Ultrasound Nanoparticle Sizer (UNPS), Raman, and Transmission Electron Microscopy (TEM) are the main PAT tools used in this project. For validation and verification purposes of these measurement techniques, polystyrene and silica samples (200 and 1000 nm particle size) were selected as (Certified) Reference Materials ((C))RMs) by the consortium partners. The results described in this database are particle size measurements using PAT methods in an offline mode. The particle size and particle size distribution data are presented as the D10, D50 and D90 and PDI/span measured with each PAT tool. Raman spectra of the CRMs are presented as well. Here, particle size data was extracted by using chemometric software. Lastly, TEM images of the CRMs are included in the database to cross-correlate and cross-validate the results of the spectroscopic and scattering PAT tools.

Initial Sample of HYPERNETS Hyperspectral Water Reflectance Measurements for Satellite Validation at Lake Garda, GAIT site (Italy)

The HYPERNETS project (www.hypernets.eu) has the overall aim to ensure that high quality in situ measurements are available to support the (VNIR/SWIR) optical Copernicus products. Therefore, it established a new autonomous hyperspectral spectroradiometer (HYPSTAR® - www.hypstar.eu) dedicated to land and water surface reflectance validation with instrument pointing capabilities. In the prototype phase, the instrument is being deployed at 24 sites covering a range of water and land types and a range of climatic and logistic conditions. This dataset provides the first published data for the HYPERNETS site in Lake Garda in Italy (GAIT). It is a subset of the complete data record which consists of the best quality GAIT measurements which could be used for satellite validation. The provided NetCDF files are the L2A hypernets products with water leaving radiance and reflectances, with and without NIR Similarity Correction (see Ruddick et al., 2006, DOI:<a href="http://dx.doi.org/10.2307/3841124">10.2307/3841124</a>). The reflectance in the L2A products is the Water Reflectance without NIR Similarity Correction (referred to as reflectance_nosc in the file) defined as:\(\rho_wnosc=\pi (Lu-\rho_FLd)/E_d\)where Lu is the upwelling radiance (at 40° zenith angle, and, 90° or 135° azimuth angle relative to the sun), Ld is the downwelling radiance (at 140° zenith angle, and, 90° or 135° azimuth angle relative to the sun). Ed is the (hemispherical) downwelling irradiance (i.e. including both direct solar and diffuse sky irradiance).For the GAIT site, the reflectance corrected for the NIR Similarity correction (epsilon, see Ruddick et al., 2006) is also provided:\(\rho_w=\pi (Lu-\rho_FLd)/E_d-\epsilon\)These reflectances have dimensions of wavelength and series, where each series is a set of measurements for the computation of a water reflectance measurement. In addition to variables for wavelength and bandwidth, the files also contain variables that provide for each series the acquisition time, viewing and solar angles, and quality flags (typically no flags are set in the data provided in this dataset). These NetCDF files also contain further relevant metadata as attributes. See https://hypernets-processor.readthedocs.io/ for further info.The HYPSTAR®-SR (Standard Range) instruments deployed at each land HYPERNETS site consist of a VNIR sensor and autonomously collect data between 380-1000 nm at various viewing geometries and send it to a central server for quality control and processing. The VNIR sensor spans 1330 channels between 380 and 1000 nm with a FWHM of 3 nm. The hypernets_processor (Goyens et al. 2021, DOI: <a href="https://doi.org/10.1109/IGARSS47720.2021.9553738">10.1109/IGARSS47720.2021.9553738</a>; De Vis et al. in prep.) automatically processes all this data into various products, including the L2A surface reflectance product provided here. The current dataset is limited to the 400-900 nm range. Uncertainties are not yet included.To obtain this dataset, we start from the full GAIT data record and omit all the data that do not pass all the quality checks performed as part of the hypernets_processor. In addition, an additional screening procedure was developed to supply the best quality data suitable for satellite validation:1. The coefficient of variation in water reflectance is below 10% in the 580-600 nm range2. The water reflectance (after correction for the NIR similarity) at 500 nm is below 0.1

Initial Sample of HYPERNETS Hyperspectral Water Reflectance Measurements for Satellite Validation from the LPAR site (Argentina)

The HYPERNETS project (www.hypernets.eu) has the overall aim to ensure that high quality in situ measurements are available to support the (VNIR/SWIR) optical Copernicus products. Therefore, it established a new autonomous hyperspectral spectroradiometer (HYPSTAR® - www.hypstar.eu) dedicated to land and water surface reflectance validation with instrument pointing capabilities. In the prototype phase, the instrument is being deployed at 24 sites covering a range of water and land types and a range of climatic and logistic conditions. This dataset provides the first published data for the HYPERNETS site in Rio de La Plata, LPAR, in Argentina. It is a subset of the complete data record which consists of the best quality LPAR measurements which could be used for satellite validation.  The provided NetCDF files are the L2A hypernets products with water leaving radiance and reflectances (without NIR Similarity Correction, see Ruddick et al., 2006, DOI:<a href="http://dx.doi.org/10.2307/3841124">10.2307/3841124</a>). The reflectance in the L2A products is the Water Reflectance (referred to as reflectance_nosc in the file) defined as: ρwnosc=π(Lu−ρFLd)/Ed where Lu is the upwelling radiance (at 40° zenith angle, and, 90° or 135° azimuth angle relative to the sun), Ld is the downwelling radiance (at 140° zenith angle, and, 90° or 135° azimuth angle relative to the sun). Ed is the (hemispherical) downwelling irradiance (i.e. including both direct solar and diffuse sky irradiance). These reflectances have dimensions of wavelength and series, where each series is a set of measurements for the computation of a water reflectance measurement. In addition to variables for wavelength and bandwidth, the files also contain variables that provide for each series the acquisition time, viewing and solar angles, and quality flags (typically no flags are set in the data provided in this dataset). These NetCDF files also contain further relevant metadata as attributes. See https://hypernets-processor.readthedocs.io/ for further info. The HYPSTAR®-SR (Standard Range) instruments deployed at each land HYPERNETS site consist of a VNIR sensor and autonomously collect data between 380-1000 nm at various viewing geometries and send it to a central server for quality control and processing. The VNIR sensor spans 1330 channels between 380 and 1000 nm with a FWHM of 3 nm. The hypernets_processor (Goyens et al. 2021, DOI: <a href="https://doi.org/10.1109/IGARSS47720.2021.9553738">10.1109/IGARSS47720.2021.9553738</a>; De Vis et al. in prep.) automatically processes all this data into various products, including the L2A surface reflectance product provided here. The current dataset is limited to the 400-900 nm range. Uncertainties are not yet included. To obtain this dataset, we start from the full LPAR data record and omit all the data that do not pass all of the quality checks performed as part of the hypernets_processor. In addition, an additional screening procedure was developed to supply the best quality data suitable for satellite validation: 1. The coefficient of variation in water reflectance is below 10% in the 400-900 nm range 2. The water reflectance at 500 nm is below 0.1

Initial Sample of HYPERNETS Hyperspectral Water Reflectance Measurements for Satellite Validation from the VEIT site (Italy)

The HYPERNETS project (www.hypernets.eu) has the overall aim to ensure that high quality in situ measurements are available to support the (VNIR/SWIR) optical Copernicus products. Therefore, it established a new autonomous hyperspectral spectroradiometer (HYPSTAR® - www.hypstar.eu) dedicated to land and water surface reflectance validation with instrument pointing capabilities. In the prototype phase, the instrument is being deployed at 24 sites covering a range of water and land types and a range of climatic and logistic conditions. This dataset provides the first published data for the HYPERNETS site at Aqua Alta, Venice in Italy (VEIT). It is a subset of the complete data record which consists of the best quality VEIT measurements which could be used for satellite validation.  The provided NetCDF files are the L2A hypernets products with water leaving radiance and reflectances, with and without NIR Similarity Correction (see Ruddick et al., 2006, DOI:<a href="http://dx.doi.org/10.2307/3841124">10.2307/3841124</a>). The reflectance in the L2A products is the Water Reflectance without NIR Similarity Correction (referred to as reflectance_nosc in the file) defined as: \(\rho_wnosc=\pi (Lu-\rho_FLd)/E_d\) where Lu is the upwelling radiance (at 40° zenith angle, and, 90° or 135° azimuth angle relative to the sun), Ld is the downwelling radiance (at 140° zenith angle, and, 90° or 135° azimuth angle relative to the sun). Ed is the (hemispherical) downwelling irradiance (i.e. including both direct solar and diffuse sky irradiance). For the VEIT site, the reflectance corrected for the NIR Similarity correction (epsilon, see Ruddick et al., 2006) is also provided: \(\rho_w=\pi (Lu-\rho_FLd)/E_d-\epsilon\) These reflectances have dimensions of wavelength and series, where each series is a set of measurements for the computation of a water reflectance measurement. In addition to variables for wavelength and bandwidth, the files also contain variables that provide for each series the acquisition time, viewing and solar angles, and quality flags (typically no flags are set in the data provided in this dataset). These NetCDF files also contain further relevant metadata as attributes. See https://hypernets-processor.readthedocs.io/ for further info. The HYPSTAR®-SR (Standard Range) instruments deployed at each land HYPERNETS site consist of a VNIR sensor and autonomously collect data between 380-1000 nm at various viewing geometries and send it to a central server for quality control and processing. The VNIR sensor spans 1330 channels between 380 and 1000 nm with a FWHM of 3 nm. The hypernets_processor (Goyens et al. 2021, DOI: <a href="https://doi.org/10.1109/IGARSS47720.2021.9553738">10.1109/IGARSS47720.2021.9553738</a>; De Vis et al. in prep.) automatically processes all this data into various products, including the L2A surface reflectance product provided here. The current dataset is limited to the 400-900 nm range. Uncertainties are not yet included. To obtain this dataset, we start from the full VEIT data record and omit all the data that do not pass all of the quality checks performed as part of the hypernets_processor. In addition, an additional screening procedure was developed to supply the best quality data suitable for satellite validation: 1. The coefficient of variation in water reflectance is below 10% in the 580-600 nm range 2. The water reflectance (after correction for the NIR similarity) above 800 nm is below 0.01

Initial Sample of HYPERNETS Hyperspectral Water Reflectance Measurements for Satellite Validation at Berre coastal lagoon, BEFR site (France)

The HYPERNETS project (www.hypernets.eu) has the overall aim to ensure that high quality in situ measurements are available to support the (VNIR/SWIR) optical Copernicus products. Therefore, it established a new autonomous hyperspectral spectroradiometer (HYPSTAR® - www.hypstar.eu) dedicated to land and water surface reflectance validation with instrument pointing capabilities. In the prototype phase, the instrument is being deployed at 24 sites covering a range of water and land types and a range of climatic and logistic conditions. This dataset provides the first published data for the HYPERNETS site at Etang de Berre in France (BEFR). It is a subset of the complete data record which consists of the best quality BEFR measurements which could be used for satellite validation.  The provided NetCDF files are the L2A hypernets products with water leaving radiance and reflectances, with and without NIR Similarity Correction (see Ruddick et al., 2006, DOI:<a href="http://dx.doi.org/10.2307/3841124">10.2307/3841124</a>). The reflectance in the L2A products is the Water Reflectance without NIR Similarity Correction (referred to as reflectance_nosc in the file) defined as: ρwnosc=π(Lu−ρFLd)/Ed   where Lu is the upwelling radiance (at 40° zenith angle, and, 90° or 135° azimuth angle relative to the sun), Ld is the downwelling radiance (at 140° zenith angle, and, 90° or 135° azimuth angle relative to the sun). Ed is the (hemispherical) downwelling irradiance (i.e. including both direct solar and diffuse sky irradiance). For the BEFR site, the reflectance corrected for the NIR Similarity correction (epsilon, see Ruddick et al., 2006) is also provided: ρw=π(Lu−ρFLd)/Ed−ϵ   These reflectances have dimensions of wavelength and series, where each series is a set of measurements for the computation of a water reflectance measurement. In addition to variables for wavelength and bandwidth, the files also contain variables that provide for each series the acquisition time, viewing and solar angles, and quality flags (typically no flags are set in the data provided in this dataset). These NetCDF files also contain further relevant metadata as attributes. See https://hypernets-processor.readthedocs.io/ for further info. The HYPSTAR®-SR (Standard Range) instruments deployed at each land HYPERNETS site consist of a VNIR sensor and autonomously collect data between 380-1000 nm at various viewing geometries and send it to a central server for quality control and processing. The VNIR sensor spans 1330 channels between 380 and 1000 nm with a FWHM of 3 nm. The hypernets_processor (Goyens et al. 2021, DOI: <a href="https://doi.org/10.1109/IGARSS47720.2021.9553738">10.1109/IGARSS47720.2021.9553738</a>; De Vis et al. in prep.) automatically processes all this data into various products, including the L2A surface reflectance product provided here. The current dataset is limited to the 400-900 nm range. Uncertainties are not yet included. To obtain this dataset, we start from the full BEFR data record and omit all the data that do not pass all of the quality checks performed as part of the hypernets_processor. In addition, an additional screening procedure was developed to supply the best quality data suitable for satellite validation: 1. The coefficient of variation in water reflectance is below 10% in the 500-600 nm range 2. The water reflectance (after correction for the NIR similarity) between 700-900 nm is below 0.01

Initial Sample of HYPERNETS Hyperspectral Water Reflectance Measurements for Satellite Validation at the mouth of the Gironde Estuary, MAFR site (France)

The HYPERNETS project (www.hypernets.eu) has the overall aim to ensure that high quality in situ measurements are available to support the (VNIR/SWIR) optical Copernicus products. Therefore, it established a new autonomous hyperspectral spectroradiometer (HYPSTAR® - www.hypstar.eu) dedicated to land and water surface reflectance validation with instrument pointing capabilities. In the prototype phase, the instrument is being deployed at 24 sites covering a range of water and land types and a range of climatic and logistic conditions. This dataset provides the first published data for the HYPERNETS site at the Gironde Estuary, MAGEST Network, in France (MAFR). It is a subset of the complete data record which consists of the best quality MAFR measurements which could be used for satellite validation.  The provided NetCDF files are the L2A hypernets products with water leaving radiance and reflectances without NIR Similarity Correction (see Ruddick et al., 2006, DOI:<a href="http://dx.doi.org/10.2307/3841124">10.2307/3841124</a>). The reflectance in the L2A products is the Water Reflectance without NIR Similarity Correction (referred to as reflectance_nosc in the file) defined as: ρwnosc=π(Lu−ρFLd)/Ed where Lu is the upwelling radiance (at 40° zenith angle, and, 90° or 135° azimuth angle relative to the sun), Ld is the downwelling radiance (at 140° zenith angle, and, 90° or 135° azimuth angle relative to the sun). Ed is the (hemispherical) downwelling irradiance (i.e. including both direct solar and diffuse sky irradiance). These reflectances have dimensions of wavelength and series, where each series is a set of measurements for the computation of a water reflectance measurement. In addition to variables for wavelength and bandwidth, the files also contain variables that provide for each series the acquisition time, viewing and solar angles, and quality flags (typically no flags are set in the data provided in this dataset). These NetCDF files also contain further relevant metadata as attributes. See https://hypernets-processor.readthedocs.io/ for further info. The HYPSTAR®-SR (Standard Range) instruments deployed at each land HYPERNETS site consist of a VNIR sensor and autonomously collect data between 380-1000 nm at various viewing geometries and send it to a central server for quality control and processing. The VNIR sensor spans 1330 channels between 380 and 1000 nm with a FWHM of 3 nm. The hypernets_processor (Goyens et al. 2021, DOI: <a href="https://doi.org/10.1109/IGARSS47720.2021.9553738">10.1109/IGARSS47720.2021.9553738</a>; De Vis et al. in prep.) automatically processes all this data into various products, including the L2A surface reflectance product provided here. The current dataset is limited to the 400-900 nm range. Uncertainties are not yet included. To obtain this dataset, we start from the full MAFR data record and omit all the data that do not pass all of the quality checks performed as part of the hypernets_processor. In addition, an additional screening procedure was developed to supply the best quality data suitable for satellite validation: 1. The coefficient of variation in water reflectance is below 10% in the 600-700 nm range

Initial Sample of HYPERNETS Hyperspectral Surface Reflectance Measurements for Satellite Validation from the IFEVA site in Argentina

The HYPERNETS project (www.hypernets.eu) has the overall aim to ensure that high quality in situ measurements are available to support the (VNIR/SWIR) optical Copernicus products. Therefore, it established a new autonomous hyperspectral spectroradiometer (HYPSTAR® - www.hypstar.eu) dedicated to land and water surface reflectance validation with instrument pointing capabilities. In the prototype phase, the instrument is being deployed at 24 sites covering a range of water and land types and a range of climatic and logistic conditions. This dataset provides the first published data for the  HYPERNETS site at IFEVA in Buenos Aires  Argentina (IFAR). It is a subset of the complete data record which consists of the best quality IFAR measurements which could be used for satellite validation.  The provided NetCDF files are the L2A hypernets products with surface reflectances, their associated uncertainties and error-correlation information. The reflectance in the L2A products is the Hemispherical-directional Reflectance Factor (HDRF) defined as: HDRF = π L / E where L is the directional upwelling radiance (with field of view of 5 degrees) and E is the (hemispherical) downwelling irradiance (i.e. including both direct solar and diffuse sky irradiance). These reflectances have dimensions of wavelength and series, where each series is a set of measurements for a given geometry (combination of viewing zenith and azimuth angle). In addition to variables for wavelength and bandwidth, the files also contain variables that provide for each series the acquisition time, viewing and solar angles, number of valid scans used, and quality flags (typically no flags are set in the data provided in this dataset). These NetCDF files also contain further relevant metadata as attributes. See https://hypernets-processor.readthedocs.io/ for further info. The IFAR site is a temporary test site located in the Agronomy Faculty campus in Buenos Aires city, Argentina (34.592322°S, 58.479017°W). The venue is managed by the IFEVA (Agricultural Physiology and Ecology Research Institute) and characterized by natural pastures with different treatments distributed in 16 patches of 7mx7m. The HYPSTAR®-XR sensor has been deployed in June 2021 at the top of a 2.4 m high tripod that is pointing to one of the patches where the vegetation has no specific treatment (natural) and is cut regularly every year in February. Data is collected every 30 min between 14:00 and 18:00 hs UTC (11:00 to 15:00 local time). The HYPSTAR®-XR (eXtended Range) instruments deployed at each land HYPERNETS site consist of a VNIR and a SWIR sensor and autonomously collect data between 380-1700 nm at various viewing geometries and send it to a central server for quality control and processing. The VNIR sensor spans 1330 channels between 380 and 1000 nm with a FWHM of 3 nm and the SWIR sensor has 220 channels between 1000 and 1700 nm with a FWHM of 10 nm. The hypernets_processor (Goyens et al. 2021; De Vis et al. in prep.) automatically processes all this data into various products, including the L2A surface reflectance product provided here. All of the products have associated uncertainties (divided into random and systematic uncertainties, including error-correlation information) which were propagated using the CoMet toolkit (www.comet-toolkit.org).  To obtain this dataset, we start from the full IFAR data record and omit all the data that do not pass all of the quality checks performed as part of the hypernets_processor. In addition, an additional screening procedure was developed to remove outliers and only supply the best quality data suitable for satellite validation. To remove the outliers, a sigma-clipping method is used. First reflectances are extracted in separate 2 hour windows throughout the day (to account for BRDF differences due to different solar position) for 4 different wavelengths (500, 900, 1100 and 1600 nm). Outliers in these reflectances are then identified by iteratively calculating the mean reflectance trend with time (by binning the data per maximum 30 data points), calculating the standard deviation from this trend, and masking any data that is more than 3 standard deviations away from the trend. This process is repeated on the unmasked data until the standard deviation does not vary by more than 5% between two iterations. The masks for the 4 different wavelengths are then combined (keeping only measurements for which none of the 4 wavelengths is an outlier). The reflectances and associated uncertainties for any masked series (i.e. a geometry that is masked either by the sigma-clipping procedure or from the masks of the hypernets_processor) are replaced by NaNs. Any sequence that has more than half of its series masked is removed entirely.

Initial Sample of HYPERNETS Hyperspectral Water Reflectance Measurements for Satellite Validation at the measurement tower MOW1, M1BE site (Belgium)

The HYPERNETS project (www.hypernets.eu) has the overall aim to ensure that high quality in situ measurements are available to support the (VNIR/SWIR) optical Copernicus products. Therefore, it established a new autonomous hyperspectral spectroradiometer (HYPSTAR® - www.hypstar.eu) dedicated to land and water surface reflectance validation with instrument pointing capabilities. In the prototype phase, the instrument is being deployed at 24 sites covering a range of water and land types and a range of climatic and logistic conditions. This dataset provides the first published data for the HYPERNETS site at the measurement pole near the Zeebrugge harbour 3.65km from land, often called MOW1, in Belgium (M1BE). It is a subset of the complete data record which consists of the best quality M1BE measurements which could be used for satellite validation.  The provided NetCDF files are the L2A hypernets products with water leaving radiance and reflectances, with and without NIR Similarity Correction (see Ruddick et al., 2006, DOI:<a href="http://dx.doi.org/10.2307/3841124">10.2307/3841124</a>). The reflectance in the L2A products is the Water Reflectance without NIR Similarity Correction (referred to as reflectance_nosc in the file) defined as: \(\rho_wnosc=\pi (Lu-\rho_FLd)/E_d\) where Lu is the upwelling radiance (at 40° zenith angle, and, 90° or 135° azimuth angle relative to the sun), Ld is the downwelling radiance (at 140° zenith angle, and, 90° or 135° azimuth angle relative to the sun). Ed is the (hemispherical) downwelling irradiance (i.e. including both direct solar and diffuse sky irradiance). For the M1BE site, the reflectance corrected for the NIR Similarity correction (epsilon, see Ruddick et al., 2006) is also provided: \(\rho_w=\pi (Lu-\rho_FLd)/E_d-\epsilon\) These reflectances have dimensions of wavelength and series, where each series is a set of measurements for the computation of a water reflectance measurement. In addition to variables for wavelength and bandwidth, the files also contain variables that provide for each series the acquisition time, viewing and solar angles, and quality flags (typically no flags are set in the data provided in this dataset). These NetCDF files also contain further relevant metadata as attributes. See https://hypernets-processor.readthedocs.io/ for further info. The HYPSTAR®-SR (Standard Range) instruments deployed at each land HYPERNETS site consist of a VNIR sensor and autonomously collect data between 380-1000 nm at various viewing geometries and send it to a central server for quality control and processing. The VNIR sensor spans 1330 channels between 380 and 1000 nm with a FWHM of 3 nm. The hypernets_processor (Goyens et al. 2021, DOI: <a href="https://doi.org/10.1109/IGARSS47720.2021.9553738">10.1109/IGARSS47720.2021.9553738</a>; De Vis et al. in prep.) automatically processes all this data into various products, including the L2A surface reflectance product provided here. The current dataset is limited to the 400-900 nm range. Uncertainties are not yet included. To obtain this dataset, we start from the full M1BE data record and omit all the data that do not pass all of the quality checks performed as part of the hypernets_processor. In addition, an additional screening procedure was developed to supply the best quality data suitable for satellite validation: 1. The coefficient of variation in water reflectance is below 10% in the 500-600 nm range 2. The water reflectance at 500 nm is below 0.1 The data consists of 73 spectra ranging from 20230226T1431 till 20230429T1502. Coordinates of the site are the following: site_latitude = 51.360548 site_longitude = 3.118246 The site is owned by Afdeling Kust (https://www.agentschapmdk.be/nl).