Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
4,276
datasets available to search
ShareScore release 0.9.0
Dataset results
4,276 results for “Estimation”
Measuring water quality parameters to estimate Nitrate concentration in surface water in Bonet catchment, Sligo, Ireland
<p><span>Time series data of surface water quality (temperature, pH, dissolved oxygen, oxidation-reduction potential and electrical conductivity) collected from May 2024 to September 2024 at 1m intervals. The file contains tabular data with the following columns: Date and time, Battery (%), temperature (ºC), fix Quality in fix code (Fix), Latitude (in deg), Longitude (in deg), pH,<span> </span>electrical conductivity (µS/cm), TDS (in ppm),<span> </span>Salinity in PSU(ppt), Specific Gravity (in SG), Dissolved Oxygen (in mg/L), Oxygen Saturation (in %), ORP (in mV), Altitude (in meters), Ground Speed (in m/s), Horizontal dilution, Satellites in number.</span></p>
Deep Learning Reach-level Estimates of Mean River Depth at the Conterminous United States Spatial Scale
<p>Abstract: Estimates of riverine channel geometry play a vital role in the physical representation of stream networks in models used to predict flood and drought conditions, manage water resources, and increase our knowledge of fluvial conditions under a changing climate. A well established body of literature exists that explains the relationship between channel geometry parameters width, depth, and velocity to instantaneous river discharge using a log-log linear power-law regression. In this study, a state-of-the-art deep learning regression model is presented and compared against the power-law method to evaluate their ability to estimate cross-sectional mean river depth. Results reveal three key findings, the neural network: (1) decreases RMSE by 22% verse a CONUS scale power-law equation, (2) reduces prediction variance across Strahler stream orders, and (3) generally outperforms regional power-law equations with an average decrease in RMSE of 8.7% Lastly, a reach-level CONUS dataset of estimated mean river depth is delivered.</p> <p> </p> <p>The deep learning model was trained using the following features:</p> <ul> <li>AI - Mean aridity index of unit catchment - Trabucco and Zomer, 2019</li> <li>area - Upstream drainage area (km2) - P. Lin et al., 2020</li> <li>CLY - Mean clay content (mass percentage, %) of unit catchment - Hengl et al., 2017</li> <li>DOR - Stream segment degree of dam regulation (Scale 0. – 100.) - Grill et al., 2019</li> <li>Elev - Stream segment mean elevation - P. Lin et al., 2020</li> <li>K - Mean bedrock permeability of unit catchment surrounding stream segment - Huscroft et al., 2018</li> <li>LAI - Mean leaf area index of unit catchment - Zhu et al., 2013</li> <li>order - Strahler-Horton stream order - P. Lin et al., 2020</li> <li>P - Mean bedrock porosity of unit catchment - Huscroft et al., 2018</li> <li>QMEAN - Stream segment mean annual discharge (m3/s) - P. Lin et al., 2019</li> <li>Sin - Stream segment sinuosity - P. Lin et al., 2020</li> <li>Slp - Stream segment mean longitudinal slope - P. Lin et al., 2020</li> <li>SLT - Mean silt content (mass percentage, %) of unit catchment - Hengl et al., 2017</li> <li>SND - Mean sand content (mass percentage, %) of unit catchment - Hengl et al., 2017</li> <li>stream_wdth_va - Measured stream cross-sectional width (m) - Canova et al., 2016</li> <li>Urb - Mean urban fraction of unit catchment - Liu et al., 2018</li> </ul> <p>The deep learning model was trained using the following label:</p> <ul> <li>mean_depth_va - Measured stream mean depth (m) - Canova et al., 2016</li> </ul> <p>Predictions of mean depth were made by replacing stream_wdth_va from Canova et al., (2016) with bankfull width estimates (width_m) from P. Lin et al., (2020). Missing records from the P. Lin et al., (2020) dataset were excluded when making predictions, thus there are missing reaches in the dataset.</p>
Global topsoil SOC stock from 1981 to 2018 estimated by combining process-based model and space-for-time digital soil mapping
<p>This dataset include the topsoil (0-30cm) soil organic carbon (SOC) stocks in mineral soils under major land classes (forest, grassland, shrub land, savannas, cropland, cropland/natural vegetation mosaic, and sparely vegetated land) from 1981 to 2018. The long-time series of SOC stocks were estimated by using a space-for-time digital soil mapping (DSMst) model where the RothC-simulated SOC stocks were incorporated as one of the dynamic covariates of the DSMst model.</p> <p>The detail information on the products were given below:</p> <p>Name: DSMst-RothC 5-km global topsoil SOC stock products</p> <p>Period: 1981-2018</p> <p>Spatial resolution: 0.041666667 degree</p> <p>Temporal resolution: 1 year</p> <p>CRS: geographic latitude/longitude (EPSG:4326 - WGS 84 – Geographic)</p> <p>Extent: -180°, -90°: 180°, 90°</p> <p>Data format: GeoTIFF</p> <p>Compression: LZW</p> <p>Data type: Float32</p> <p>Unit: t C ha<sup>-1</sup></p>
An EEG dataset for cross-session mental workload estimation: Passive BCI competition of the Neuroergonomics Conference 2021
<p>The dataset is part of a new open EEG database designed to answer a need for more publicly available EEG-based dataset to design and benchmark passive brain-computer interface pipelines (as detailed in [Hinss2021]). This database is currently being created and will be fully released before the end of the year. It will include data acquired over 30 participant, 4 tasks and 3 sessions. For this competition, hosted by the Neuroergonomics Conference 2021, only one task and half the participants will be analyzed. Hence, this competition focuses on a renowned task that elicits various levels of mental/cognitive workload: the Multi-Atribute Task Battery-II (MATB-II) developed by NASA (https://matb.larc.nasa.gov/). It is composed of 4 sub-tasks: system monitoring, tracking, resource management and communications. By varying the number and complexity of the sub-tasks, 3 levels of workload were elicited (verified through statistical analyzes of both subjective and objective -behavioral and cardiac- data). Each difficulty level was performed by 15 subjects (6 female; 9 average 25 y.o.) during 5 minutes per session, in a pseudo-randomized order. Each session was separated by 7 days. We used a 62 actiChamp EEG channels device (BrainProducts; electrode placement 10-20 system).</p> <p> </p> <p><strong>For the competition, your goal is to predict the mental workload for a given subject (intra-subject estimation) using the EEG data from another session (inter-session adaptation). More information on the conference website and in the documentation file.</strong></p>
ZIRFs: zero-inflated random forests for estimating gene regulatory networks from single cell RNA-seq data (assessment of predictive accuracy and VIM stability)
<p>We developed a zero-inflated random forests (ZIRFs) algorithm to produce a metric of connection strength between regulator genes and target genes. This file contains SCENIC results for the aorta and diaphragm tissue data sets from the Tabula Muris Consortium results. SCENIC is a genetic regulatory network analysis published by Aibar et al. (2017). The purpose of the data sets and R source code are described by README files in each directory.</p>
Britain Breathing 2016-2019 Air Quality and Meteorological Regional Estimates Dataset
<p>This data set is a collection of estimated daily mean and maximum values for a range of air quality and meterological measurements and model forecasts for the <em>UK and crown dependencies</em> postcode districts (e.g. 'AB') for the years 2016-2019, inclusive.</p> <p>The paper describing this dataset is available here: <a href="https://www.nature.com/articles/s41597-022-01135-6">https://www.nature.com/articles/s41597-022-01135-6</a></p> <p>The data uses a 'concentric regions' method to estimate the measurement for all regions, as follows. If measurements exist within the region, the mean of those measurements is used, if not, then a ring of neighbouring postcode regions are selected, and the mean of their measurement values used. If no measurement sites/data are found in the first ring, the process continues, taking the next ring of postcode district regions, working outwards until one or more sensors are found in a ring. As well as the measurement estimations, the number of rings required to find site data and make the estimations is also published. <strong>As a result, please note that estimations with higher ring counts ('rings') are likely to be calculated from more distant sensors. This distance depends upon the size of the postcode regions surrounding the location being estimated. Please use the ring count ('rings') to limit/filter estimations based on your required level of confidence.</strong><br> <br> The meteorological, pollen and air quality measurement data used to make the regional estimations can be found at <a href="https://zenodo.org/record/4416028#.YABxNnX7RhF">this Zenodo archive</a>. The data there contains Temperature, Relative Humidity, and Pressure data, downloaded from the Met Office MIDAS archives via the MEDMI server (https://www.data-mashup.org.uk/). Also downloaded from the MEDMI server are daily pollen measurements for the UK. PM10, PM2.5, NO2, NOx (as NO2), O3, and SO2 measurements from the DEFRA AURN network, and also model forecasts of the same made using the EMEP model.</p> <p>The code used to make the estimations is available at <a href="https://zenodo.org/record/4518866">this Zenodo archive</a>.</p> <p>The postcode data in postcode_district_data.csv are collated from several sources: </p> <ul> <li><a href="https://www.doogal.co.uk/UKPostcodes.php">https://www.doogal.co.uk/UKPostcodes.php</a> (population figures for the UK (UK Census 2011))</li> <li><a href="https://www.freemaptools.com/download-uk-postcode-outcode-boundaries.htm">https://www.freemaptools.com/download-uk-postcode-outcode-boundaries.htm</a> (postcode boundary polygons for UK and crown dependancies)</li> <li><a href="https://www.gov.gg/population">https://www.gov.gg/population</a> (Guernsey (GY) population data for end June 2020) </li> <li><a href="https://www.gov.je/Government/JerseyInFigures/Population/Pages/Population.aspx">https://www.gov.je/Government/JerseyInFigures/Population/Pages/Population.aspx</a> (Jersey (JE) population data for end 2019) </li> <li><a href="https://www.gov.im/media/1369690/isle-of-man-in-numbers-july-2020.pdf">https://www.gov.im/media/1369690/isle-of-man-in-numbers-july-2020.pdf</a> (Isle of Man (IM) population data for April 2016)</li> </ul> <p>The data-set is presented in CSV format, as six files:</p> <ol> <li>postcode_district_data.csv: location metadata (region_id, geometry, description, population, country)</li> <li>regional_site_counts.csv: a table showing the number of sites for each measurement (columns), for each region_id (rows). region_id's match those in the postcode_district_data.csv file.</li> <li>turing_regional_estimates_aq_daily_met_pollen_pollution_imputed_data.csv: uses imputed site data (timestamp, region_id, ...[measurement name, rings]) ('rings' is the number of rings required to make the estimation)</li> <li>turing_regional_estimates_aq_daily_met_pollen_pollution_original_data.csv: uses original site data (timestamp, region_id, ...[measurement name, rings]) ('rings' is the number of rings required to make the estimation)</li> <li>turing_regional_estimates_aq_loc_type_daily_imputed_data.csv: uses imputed site data. Air quality regional estimates are calculated using specific AQ site location types* separately. (To prevent, for example, 'Traffic Urban' type sites being used to estimate 'non-traffic' or rural regions.)</li> <li>turing_regional_estimates_aq_loc_type_daily_original_data.csv: uses original data. Air quality regional estimates are calculated using specific AQ site location types* separately. (To prevent, for example, 'Traffic Urban' type sites being used to estimate 'non-traffic' or rural regions.)</li> </ol> <p>* Air quality site types: </p> <ul> <li>Industrial: comprises 'urban industrial' (9 sites) and suburban industrial (2 sites)</li> <li>'Rural background' (14 sites)</li> <li>'Urban background' (48 sites)</li> <li>'Urban traffic' (47 sites)</li> </ul>
1117 Russian cities with city name, region, geographic coordinates and 2020 population estimate
<p>1117 Russian cities with city name, region, geographic coordinates and 2020 population estimate.</p> <p> </p> <p>How to use</p> <pre>from pathlib import Path import requests import pandas as pd url = ("https://raw.githubusercontent.com/" "epogrebnyak/ru-cities/main/assets/towns.csv") # save file locally p = Path("towns.csv") if not p.exists(): content = requests.get(url).text p.write_text(content, encoding="utf-8") # read as dataframe df = pd.read_csv("towns.csv") print(df.sample(5))</pre> <p> </p> <p>Files:</p> <ul> <li><a href="https://github.com/epogrebnyak/ru-cities/blob/main/assets/towns.csv">towns.csv</a> - city information</li> <li><a href="https://github.com/epogrebnyak/ru-cities/blob/main/assets/regions.csv">regions.csv</a> - list of Russian Federation regions</li> <li><a href="https://github.com/epogrebnyak/ru-cities/blob/main/assets/alt_city_names.json">alt_city_names.json</a> - alternative city names</li> </ul> <p> </p> <p>Сolumns (towns.csv):</p> <p>Basic info:</p> <ul> <li><code>city</code> - city name (several cities have alternative names marked in <code>alt_city_names.json</code>)</li> <li><code>population</code> - city population, thousand people, Rosstat estimate as of 1.1.2020</li> <li><code>lat,lon</code> - city geographic coordinates</li> </ul> <p>Region:</p> <ul> <li><code>region_name</code> - subnational region (oblast, republic, krai or AO)</li> <li><code>region_iso_code</code> - <a href="https://en.wikipedia.org/wiki/ISO_3166-2:RU">ISO 3166 code</a>, eg <code>RU-VLD</code></li> <li><code>federal_district</code>, eg <code>Центральный</code></li> </ul> <p>City codes:</p> <ul> <li><code>okato</code></li> <li><code>oktmo</code></li> <li><code>fias_id</code></li> <li><code>kladr_id</code></li> </ul> <p> </p> <p>Data sources</p> <ul> <li>City list and city population collected from Rosstat publication <a href="https://rosstat.gov.ru/folder/210/document/13206">Регионы России. Основные социально-экономические показатели городов</a> and parsed from publication Microsoft Word files.</li> <li>City list corresponds to <a href="https://ru.wikipedia.org/wiki/%D0%A1%D0%BF%D0%B8%D1%81%D0%BE%D0%BA_%D0%B3%D0%BE%D1%80%D0%BE%D0%B4%D0%BE%D0%B2_%D0%A0%D0%BE%D1%81%D1%81%D0%B8%D0%B8">this Wikipedia article</a>.</li> <li>Alternative dataset is <a href="https://github.com/hflabs/city">wiki-based Dadata city dataset</a> (no population data).</li> </ul> <p> </p> <p>Comments</p> <p> </p> <p>City groups</p> <ul> <li> <p><code>Ханты-Мансийский</code> and <code>Ямало-Ненецкий</code> autonomous regions excluded to avoid duplication as parts of <code>Тюменская область</code>.</p> </li> <li> <p>Several notable towns are classified as administrative part of larger cities (<code>Сестрорецк</code> is a municpality at Saint-Petersburg, <code>Щербинка</code> part of Moscow). They are not and not reported in this dataset.</p> </li> </ul> <p> </p> <p>By individual city</p> <ul> <li><code>Белоозерский</code> not found in Rosstat publication, but <a href="https://github.com/epogrebnyak/ru-cities/issues/5#issuecomment-886179980">should be considered a city as of 1.1.2020</a></li> </ul> <p> </p> <p>Alternative city names</p> <ul> <li> <p>We suppressed letter "ё" <code>city</code> columns in towns.csv - we have <code>Орел</code>, but not <code>Орёл</code>. This affected:</p> <ul> <li><code>Белоозёрский</code></li> <li><code>Королёв</code></li> <li><code>Ликино-Дулёво</code></li> <li><code>Озёры</code></li> <li><code>Щёлково</code></li> <li><code>Орёл</code></li> </ul> </li> <li> <p><code>Дмитриев</code> and <code>Дмитриев-Льговский</code> are the same city.</p> </li> </ul> <p><code>assets/alt_city_names.json</code> contains these names.</p> <p> </p> <p>Tests</p> <pre><code>poetry install poetry run python -m pytest </code></pre> <p> </p> <p>How to replicate dataset</p> <p> </p> <p>1. Base dataset</p> <p>Run:</p> <ul> <li>download data stro rar/get.sh</li> <li>convert <code>Саратовская область.doc</code> to docx</li> <li>run make.py</li> </ul> <p>Creates:</p> <ul> <li><code>_towns.csv</code></li> <li><code>assets/regions.csv</code></li> </ul> <p> </p> <p>2. API calls</p> <p>Note: do not attempt if you do not have to - this runs a while and loads third-party API access.</p> <p>You have the resulting files in repo, so probably does not need to these scripts.</p> <p>Run:</p> <ul> <li><code>cd geocoding</code></li> <li>run coord_dadata.py (needs token)</li> <li>run coord_osm.py</li> </ul> <p>Creates:</p> <ul> <li>coord_dadata.csv</li> <li>coord_osm.csv</li> </ul> <p> </p> <p>3. Merge data</p> <p>Run:</p> <ul> <li>run merge.py</li> </ul> <p>Creates:</p> <ul> <li>assets/towns.csv</li> </ul> <p> </p>
MARv3.10 outputs: What is the Surface Mass Balance of Antarctica? An Intercomparison of Regional Climate Model Estimates
<p>MARv3.10 outputs used in:</p> <p><em>Mottram, R., Hansen, N., Kittel, C., van Wessem, M., Agosta, C., Amory, C., Boberg, F., van de Berg, W. J., Fettweis, X., Gossart, A., van Lipzig, N. P. M., van Meijgaard, E., Orr, A., Phillips, T., Webster, S., Simonsen, S. B., and Souverijns, N.: What is the Surface Mass Balance of Antarctica? An Intercomparison of Regional Climate Model Estimates, The Cryosphere Discuss. [preprint], https://doi.org/10.5194/tc-2019-333, accepted, 2020.</em></p> <ul> <li>MARv3.10 forced by ERA-Interim outputs with monthly values of SMB and components (kg m<sup>-2</sup> month<sup>-1</sup>), and (near-) surface temperature (°C) over the Antarctic ice sheet (1981--2018)</li> <li>Grid file used in MAR simulation</li> </ul> <p>Be carreful that the unit metadata in the netcdf files from SMB and its components are uncorrect. <strong>Values are in kg m<sup>-2</sup> month<sup>-1</sup></strong> instead of kg m<sup>-2</sup> day<sup>-1</sup>.<br> <br> If you need other variables or output frequencies from MAR, write me (c2kittel@gmail.com) and I will be glad to help you. I will also be happy to share the scripts I have developed to analyse the outputs and make the figures in this paper if needed. Please cite the paper if you use these MAR outputs. However, note that these outputs are now considered as deprecated since new outputs using a more recent model version (MARv3.11) and forcing (ERA5) have been published (see Kittel et al., 2021: https://tc.copernicus.org/articles/15/1215/2021/).<br> <br> Data usage notice:</p> <p>If you use any of these results, please acknowledge the work of the people involved in producing them. Acknowledgements should have language similar to the below that contained informations related to MAR. In order to document MAR scientific impact and enable ongoing support of the model, users are likely encouraged to contact C. Kittel and C. Agosta to add their works in the list of MAR-related publications. </p> <p>"We thank the MAR team which make available the model outputs, as well agencies (F.R.S - FNRS, CÉCI, and the Walloon Region) that provided computational resources for MAR simulations."</p> <p>You should also refer to and cite the following paper:</p> <p><em>Mottram, R., Hansen, N., Kittel, C., van Wessem, M., Agosta, C., Amory, C., Boberg, F., van de Berg, W. J., Fettweis, X., Gossart, A., van Lipzig, N. P. M., van Meijgaard, E., Orr, A., Phillips, T., Webster, S., Simonsen, S. B., and Souverijns, N.: What is the Surface Mass Balance of Antarctica? An Intercomparison of Regional Climate Model Estimates, The Cryosphere Discuss. [preprint], https://doi.org/10.5194/tc-2019-333, accepted, 2020.</em></p>
First estimation of global trends in nocturnal power emissions reveals acceleration of light pollution
<p>The power emitted by different countries at night is based on DMSP and VIIRS data. Inclued also, some extra data from Spain, Portugal, Italy, UK and Greece.</p>
Data for "Mapping the ghost: Estimating probabilistic snow leopard distribution across Mongolia"
<p>Data and code used for a country-wide occupancy survey of snow leopards in Mongolia, accompanying the paper "Mapping the ghost: Estimating probabilistic snow leopard distribution across Mongolia".</p> <p>This data contains the results of a survey of 1017 20x20km sampling units, out of a total of 1200 sampling units identified as potential snow leopard habitat (183 could not be sampled for various reasons), a near complete survey of potential snow leopard habitat in Mongolia, nearly 500,000 square kilometers, and an enormous effort by many researchers. If you make use of the data, please cite the following sources:</p> <ul> <li><em>Data for "Mapping the ghost: Estimating probabilistic snow leopard distribution across Mongolia".</em> (2021). Gantulga Bayandonoi, Koustubh Sharma, Justine Shanti Alexander, Purevjav Lkhagvajav, Ian Durbach, Darryl MacKenzie, Chimeddorj Buyanaa, Bariushaa Munkhtsog, Munkhtogtokh Ochirjav, Sergelen Erdenebaatar, Bilguun Batkhuyag, Nyamzav Battulga, Choidogjamts Byambasuren, Bayartsaikhan Uudus, Shar Setev, Lkhagvasuren Davaa, Khurel-Erdene Agchbayar, Naranbaatar Galsandorj, David Borchers. doi: https://doi.org/10.5281/zenodo.5257572</li> <li><em>Mapping the ghost: Estimating probabilistic snow leopard distribution across Mongolia. </em>(2021). Gantulga Bayandonoi, Koustubh Sharma, Justine Shanti Alexander, Purevjav Lkhagvajav, Ian Durbach, Darryl MacKenzie, Chimeddorj Buyanaa, Bariushaa Munkhtsog, Munkhtogtokh Ochirjav, Sergelen Erdenebaatar, Bilguun Batkhuyag, Nyamzav Battulga, Choidogjamts Byambasuren, Bayartsaikhan Uudus, Shar Setev, Lkhagvasuren Davaa, Khurel-Erdene Agchbayar, Naranbaatar Galsandorj, David Borchers. To appear in <em>Diversity and Distributions</em></li> </ul> <p><strong>Contents of zip file</strong></p> <p><em>Data</em></p> <p>The main dataset is contained in `data\Mongolia_occupancy_inputs.Rdata` . Please see the paper for more detail on data collection. The following objects are contained in the file:</p> <p>- Pres: presence/absence occupancy survey results, used for model fitting<br> - Site_Cov: unit-specific covariates, used for model fitting<br> - SurvCov: survey-specific covariates, used for model fitting<br> - Mongolia_studyarea: covariates for whole survey area, used for prediction<br> - Mongolia_fullrange: covariates across whole expected snow leopard range, used for prediction</p> <p><em>Code</em></p> <p>Code is cloned from the GitHub repository <a href="https://github.com/iandurbach/mongolia-occupancy">https://github.com/iandurbach/mongolia-occupancy</a>, which may contain updates. The version here reproduces the analyses in the paper above. The run these analyses:</p> <p>- run *occupancy-analysis.R* to fit the main occupancy models (these are also saved in the `\output` folder), do model selection, and plot covariate effects<br> - run *occupancy-goodness-of-fit.R* to calculate the c-hat statistic giving an indication of model fit for the best model<br> - run *comparing-maps.R* to compare the occupancy results with similar metrics generated using a presence-only analysis (using MaxEnt) or an expert map generated through qualitative discussion (reproduces Figure 3 in the paper).</p> <p>Code in *occupancy-data-preproc.R* is not needed but included for completeness. It converts the csv files in `data\csv`, which contain various input datasets used by the occupancy model, into a single .Rdata file (`data\Mongolia_occupancy_inputs.Rdata`), which is then used by the scripts above. Some minimal pre-processing (excluding ununsed variables, renaming for consistency, etc) is performed. </p>
Britain Breathing 2020 Air Quality and Meteorological Regional Estimates Dataset
<p>This data set is a collection of estimated daily mean and maximum values for a range of air quality and meterological measurements and model forecasts for UK postcode districts (e.g. 'AB') for the year 2020.</p> <p>The data uses a 'concentric regions' method to estimate the measurement for all regions, as follows. If measurements exist within the region, the mean of those measurements is used, if not, then a ring of neighbouring postcode regions are selected, and the mean of their measurement values used. If no measurement sites/data are found in the first ring, the process continues, taking the next ring of postcode district regions, working outwards until one or more sensors are found in a ring. As well as the measurement estimations, the number of rings required to find site data and make the estimations is also published. <strong>As a result, please note that estimations with higher ring counts ('rings') are likely to be calculated from more distant sensors. This distance depends upon the size of the postcode regions surrounding the location being estimated. Please use the ring count ('rings') to limit/filter estimations based on your required level of confidence.</strong></p> <p>The meteorological, pollen and air quality measurement data used to make the regional estimations can be found at <a href="https://zenodo.org/record/4740965#.YPWJf3VKhhF">this Zenodo archive</a>. The data there contains Temperature, Relative Humidity, and Pressure data, downloaded from the Met Office MIDAS archives via the MEDMI server (https://www.data-mashup.org.uk/). Also downloaded from the MEDMI server are daily pollen measurements for the UK. PM10, PM2.5, NO2, NOx (as NO2), O3, and SO2 measurements from the DEFRA AURN network, and also model forecasts of the same made using the EMEP model.</p> <p>The code used to make the estimations is available at <a href="https://zenodo.org/record/4518866">this Zenodo archive</a>.</p> <p>The data-set is presented in CSV format, as two files:</p> <ol> <li>turing_regional_estimates_aq_daily_met_pollen_pollution_original_data.csv: uses original site data (timestamp, region_id, ...[measurement name, rings]) ('rings' is the number of rings required to make the estimation)</li> <li>turing_regional_estimates_aq_loc_type_daily_original_data.csv: uses original data. Air quality regional estimates are calculated using specific AQ site location types* separately. (To prevent, for example, 'Traffic Urban' type sites being used to estimate 'non-traffic' or rural regions.)</li> </ol> <p>* Air quality site types: </p> <ul> <li>Industrial: comprises 'urban industrial' (9 sites) and suburban industrial (2 sites)</li> <li>'Rural background' (14 sites)</li> <li>'Urban background' (48 sites)</li> <li>'Urban traffic' (47 sites)</li> </ul>
Code and data for "KGML-ag: A Modeling Framework of Knowledge-Guided Machine Learning to Simulate Agroecosystems: A Case Study of Estimating N2O Emission using Data from Mesocosm Experiments "
<p>This is code and data for manuscript: <br> "KGML-ag: A Modeling Framework of Knowledge-Guided Machine Learning to Simulate Agroecosystems: <br> A Case Study of Estimating N<sub>2</sub>O Emission using Data from Mesocosm Experiments"<br> Licheng Liu, Shaoming Xu, Zhenong Jin*, Jinyun Tang, Kaiyu Guan, Timothy J. Griffis, <br> Matt D. Erickson, Alexander L. Frie, Xiaowei Jia, Taegon Kim, Lee T. Miller, Bin Peng, Shaowei Wu, Yufeng Yang, Wang Zhou, Vipin Kumar</p> <p>All the files belong to Prof. Zhenong Jin, University of Minnesota, UA. jinzn@umn.edu<br> "code" foler includes code for data processing, model training, and results plotting.<br> "trained_model_saved" includes all trained model so you can use to reproduce the results showed in the study;<br> "data" includes all data presented in the study. Finetuning data is refering to Miller, L.T. , Griffis, T. J., Erickson, M. D., Turner, P. A., Deventer, M. J., Chen, Z., Yu, Z., Venterea, R.T., Baker, J. M., and Frie, A. L. (2021). Response of nitrous oxide emissions to future changes in precipitation and individual rain events. Journal of Environmental Quality, In review</p>
Photometric Redshifts for Cosmology: Improving accuracy and uncertainty estimates using Bayesian Neural Networks
<p><strong>This data consists of 286,401 with broad-band g,r,i,z,y photometry from the HSC DR2 survey and spectroscopic redshifts. The majority of galaxies in our sample lies between redshift of 0.01 and 2.5</strong></p>
Environmental efficiency estimates for 127 Swiss acute care hospitals
<p>These are the estimates from our enviromental efficiency estimates using frontier analysis (Stochastic Frontier Analysis and Data Envelopment Analysis) for 127 Swiss acute care hospital in 2018.</p> <p>For further details please see our working paper: <a href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3939627">https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3939627</a></p>
Dry matter databases derived by crossing burned areas databases with above ground estimations from SMOS sensor
<p>Estimates of the the fuel consumed during a fire (dry-matter, DM) is derived by combining burned areas (from two different fire inventories) with above ground biomass (derived from SMOS L Band Vegetation Optical Depth). Six new datasets are provided on a 25 km grid for the years 2010-2017.</p> <p>The portion of vegetation that is consumed during biomass burning is expressed as:<br> <strong><span class="math-tex">\(DM= AGB * BA*\beta\)</span></strong></p> <p>where BA is the burned area; AGB is the fuel load, the amount of biomass or organic matter an ecosystem contains per unit area; <span class="math-tex">\(\beta\)</span> is the combustion completeness or burning efficiency, which is the fraction of fuel actually consumed during the fire.</p> <p>Monthly maps of AGB are converted from SMOS L-band vegetation optical depth (VOD) through an algorithm described in [1] and obtained looking at the relationship between three static AGB benchmark maps from the works of [2],[3] and [4]. Each static map provide three L-VOD to AGB conversion curves fitting the 5th, 50th and 95th percentiles of the data using a logistic regression([1]) In the following, the three different databases are named AGB-BA (Baccini), AGB-SA (Saatchi) and AGB-AV (Avitabile) </p> <p>Monthly total of burned areas are available from two sources. The first one, called hereinafter BA-GFED, is available though GEFD4.1s [5] and is based on MODIS MCD64A1 product. It has a 500m pixel resolution and is also available on a regular grid of 0.25 deg. The second BA product, named hereinafter BA-CCI, is a multi-sensors product provided by the European Space Agency Climate Change Initiative (ESA-CCI) [6] We use version FireCCI5.1 which is calculated using a two-phase algorithm, where MODIS active fire locations are used to identify seed pixels corresponding to high confidence burned areas. These areas are then grown using Medium Resolution Imaging Spectrometer (MERIS) vegetation input data.</p> <p>Combustion completeness, is a taken from table 4 of [7]. </p> <p>By selectively combining any AGB estimations with the two available BA datasets, a total of 6 products are generated.</p> <p> </p> <p><strong>References </strong></p> <p>[1] https://doi.org/10.5194/bg-15-4627-2018</p> <p>[2] <a href="https://doi.org/10.1126/science.aam5962">DOI: 10.1126/science.aam5962</a></p> <p>[3]<a href="https://cce.nasa.gov/veg3dbiomass/saatchi_tgrs07.pdf">https://cce.nasa.gov/veg3dbiomass/saatchi_tgrs07.pdf</a></p> <p>[4] <a href="https://onlinelibrary.wiley.com/doi/abs/10.1111/gcb.13139">https://onlinelibrary.wiley.com/doi/abs/10.1111/gcb.13139</a></p> <p>[5] <a href="https://daac.ornl.gov/VEGETATION/guides/fire_emissions_v4_R1.html">https://daac.ornl.gov/VEGETATION/guides/fire_emissions_v4_R1.html</a></p> <p>[6] <a href="https://geogra.uah.es/fire_cci/firecci51.php">https://geogra.uah.es/fire_cci/firecci51.php</a></p> <p>[7] <a href="https://acp.copernicus.org/articles/6/3423/2006/acp-6-3423-2006.pdf">https://acp.copernicus.org/articles/6/3423/2006/acp-6-3423-2006.pdf</a></p> <p> </p>
Truncated Marginal Neural Ratio Estimation - Data
<p>The dataset accompanying <em>Truncated Marginal Neural Ratio Estimation</em>. The software repository can be found <a href="https://github.com/bkmi/tmnre">here</a>. The arxiv article can be found <a href="https://arxiv.org/abs/2107.01214">here</a>.</p>
Contrastive Neural Ratio Estimation - Data
<p>The dataset generated by experimental results from <em><strong>Contrastive Neural Ratio Estimation</strong></em>. The code can be found <a href="https://github.com/bkmi/cnre">here</a>. The paper can be found <a href="https://arxiv.org/abs/2210.06170">here</a>.</p>
Antarctic Sea Ice Thickness Estimates from CryoSat-2: 2010-2021
<p><strong>*Preliminary data associated with manuscript submission to The Cryosphere*</strong></p> <p>Gridded estimates of Antarctic sea ice physical properties derived from CryoSat-2 Baseline-D SAR and SARIn data spanning July 2010 through August 2021. Data are generated using the CryoSat-2 Waveform-Fitting method for Antarctic sea ice (CS2WFA). Files include:</p> <ul> <li>CS2WFA_25km_YYYYMM.nc: Monthly mean values gridded on the NSIDC 25km polar stereographic grid. Each file represents 1 month of data (134 files total).</li> </ul> <p>Each monthly file contains:</p> <ul> <li>latitude, longitude, and time (in months since January 2000)</li> <li>Grids of retrieved snow depth, snow freeboard, ice freeboard, and sea ice concentration</li> <li>Grids of seasonal snow, sea ice, and seawater density</li> <li>Grids of sea ice thickness and estimated thickness uncertainty, as well as thickness estimated using a 70% threshold retracker and using a zero-ice-freeboard assumption.</li> </ul>
SEENIC: dataset for Spacecraft posE Estimation with NeuromorphIC vision
<p>Dataset used in the paper "Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing" (<a href="https://doi.org/10.48550/arXiv.2209.11945">arXiv</a>, <a href="https://ieeexplore.ieee.org/document/10160531">IEEE Xplore</a>), for the purpose of satellite pose estimation with an event camera.</p> <p>Both events and ground truth camera poses were captured across the 20 scenes in total. There are two trajectories, five lighting configurations and two camera speeds. All combinations of trajectory type, speed and lighting configuration were enumerated for capture. Sample event frames and dataset statistics are available in the paper linked above, along with our pose estimation method used on this dataset.</p> <p> </p> <p>Live-capture scene names use the following encoding: {satellite model}-{trajectory}-{speed}-{lighting configuration}</p> <p>The calibration scene (calibration.tar.gz) includes multiple views of a chessboard used to calibrate the camera intrinsics and extrinsics for the live-capture scenes. Camera parameters calibrated using this scene can be found in the <strong>calib.txt</strong> file, with the format: fx fy cx cy k1 k2 p1 p2 k3.</p> <p> </p> <p>All <strong>live-capture</strong> scenes have the same data format:</p> <p>scene/</p> <p> poses/ -- Raw timestamped robot gripper to base transforms</p> <p> cam-poses.csv -- Ground truth camera poses with the format {timestamp, Rx, Ry, Rz, x, y, z}</p> <p> events.csv -- Event stream with the format {timestamp, x, y, polarity (0=off, 1=on)}</p> <p> meta.json -- Metadata file with camera frame dimensions</p> <p>Note: all timestamps are in microseconds.</p> <p> </p> <p>The <strong>synthetic</strong> scene (synthetic.tar.gz) has the following data format:</p> <p>synthetic/</p> <p> poses/ -- Sequential poses captured at a constant time interval</p> <p> events.txt -- Event stream with the format: time (float s), x, y, polarity (0=off, 1=on) as specified at <a href="https://rpg.ifi.uzh.ch/davis_data.html">https://rpg.ifi.uzh.ch/davis_data.html</a></p> <p> camera_intrinsics.txt -- The camera intrinsic matrix (space separated)</p> <p>Note: please refer to the paper referenced below for further details on using this synthetic scene.</p> <p> </p> <p><strong>When using the data in an academic context, please cite the following paper.</strong></p> <pre>@INPROCEEDINGS{10160531, author={Jawaid, Mohsi and Elms, Ethan and Latif, Yasir and Chin, Tat-Jun}, booktitle={2023 IEEE International Conference on Robotics and Automation (ICRA)}, title={Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing}, year={2023}, volume={}, number={}, pages={11866-11873}, keywords={Adaptation models;Satellites;Pose estimation;Lighting;Robot sensing systems;Robustness;Data models}, doi={10.1109/ICRA48891.2023.10160531} }</pre>
Dataset supporting publication: "A novel ROM methodology to support the estimation of the energy savings under the Measurement and Verification protocol."
<p>DATASET suporting: "A novel ROM methodology to support the estimation of the energy savings under the Measurement and Verification protocol."</p> <p>Piccinini, Alessandro; Hajdukiewicz, Magdalena; D'Angelo, Letizia; Blanes, Luis Miguel; Keane, Marcus M.</p> <p>This paper presents a novel Reduced Order grey box Model (ROM) methodology, based on a ResistorCapacitor (RC) network, which supports the creation of the baseline energy consumption and the estimation of energy savings due to Energy Conservation Measures (ECMs) under the Measurement and Verification protocol. Within this scope, a description of the RC network, including a calculation of the parameters’ needed to execute the ROM, are presented. This ROM methodology is demonstrated on an educational building located in Sant Cugat, Spain as part of the H2020 GEOFIT project. The results presented in this paper demonstrate that the ROM is sufficiently accurate for the creation of the baseline energy consumption and for estimating the energy savings of different ECMs.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.