Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
8,828
datasets available to search
ShareScore release 0.9.0
Dataset results
8,828 results for “product”
SBC LTER: Reef: Community structure and productivity of subtidal turf and foliose algal assemblages at Naples Reef, 2006
This dataset contains abundance, primary production and respiration of macroalgal and turf assemblages at Naples Reef (Santa Barbara County, CA) during 2006. It includes abundance of macroalgae is in terms of biomass (dry weight), and abundance of animals is in numbers of individuals and biomass (ash-free dry weight). Primary production and respiration of the benthos were measured in situ as changes in oxygen in closed chambers that covered 0.1m2 of the bottom. Species richness data are for macroalgae only. Abundance and diversity were measured for the same plots where oxygen measurements were recorded. These data were presented in: <ulink url="http://dx.doi.org/10.3354/meps08131">Miller, R.J., D. Reed, and M. Brzezinski. 2009. Community structure and productivity of subtidal turf and foliose algal assemblages. Marine Ecology Progress Series 388:1-11 doi: 10.3354/meps08131</ulink>.
SBC LTER: Cross-shelf Study 2008-2009: Profiles of CTD, biogeochemistry, primary production, abundance of phytoplankton groups, and abundance and production of bacteria
These data were used by the following papers: Goodman, J., M. A. Brzezinski, E. R. Halewood and C. A. Carlson. 2012. Sources of phytoplankton to the inner continental shelf in the Santa Barbara Channel inferred from cross-shelf gradients in biological, physical and chemical parameters. Continental Shelf Research, 48: 27-39. (DOI: 10.1016/j.csr.2012.08.011) Halewood, E. R., C. A. Carlson, M. A. Brzezinski, D. C. Reed and J. Goodman. 2012. Annual cycle of organic matter partitioning and its availability to bacteria across the Santa Barbara Channel continental shelf. Aquatic Microbial Ecology, 67:189-209. (DOI:10.3354/ame01586) These data were collected on monthly day cruises from January 2008 to April 2009 on the RV Kelp Fish at five stations across the shelf starting at Mohawk Reef in the nearshore area of the Santa Barbara Channel, California, USA. Data were collected with a SBE19-Plus and rosette sampler. Measurements include standard CTD parameters in 1 m bins (e.g. salinity, temperature, density). At selected depths (1, 5, 10, 20 m), rosette bottle samples were collected for nutrients, pigments, particulate and dissolved organic carbon and nitrogen, and bacterial abundance, community structure and productivity. Phytoplankton abundances (to genus) were obtained from the 5 m sample only.
Net Primary Productivity (NPP) Weight Data at the Sevilleta National Wildlife Refuge, New Mexico
Several long-term studies at the Sevilleta LTER measure net primary production (NPP) across ecosystems and treatments. Net primary production is a fundamental ecological variable that quantifies rates of carbon consumption and fixation. Estimates of NPP are important in understanding energy flow at a community level as well as spatial and temporal responses to a range of ecological processes. Above-ground net primary production (ANPP) is the change in plant biomass, including loss to death and decomposition, over a given period of time. To measure this change, vegetation variables, including species composition and the cover and height of individuals, are sampled up to three times yearly (winter, spring, and fall) at permanent plots within a study site. The weight data presented here is obtained by harvesting a series of covers for species observed during plot sampling. These species are always harvested from habitat comparable to the plots in which they were recorded. This data is then used to make volumetric measurements of species and build regressions correlating biomass and volume. From these calculations, seasonal biomass and seasonal and annual NPP are determined.
Core Site Grid Quadrat Data for the Net Primary Production Study at the Sevilleta National Wildlife Refuge, New Mexico
Begun in spring 2013, this project is part of a long-term study at the Sevilleta LTER measuring net primary production (NPP) across three distinct ecosystems: creosote-dominant shrubland (Site C), black grama-dominant grassland (Site G), and blue grama-dominant grassland (Site B). Net primary production is a fundamental ecological variable that quantifies rates of carbon consumption and fixation. Estimates of NPP are important in understanding energy flow at a community level as well as spatial and temporal responses to a range of ecological processes. Above-ground net primary production is the change in plant biomass, represented by stems, flowers, fruit and foliage, over time and incorporates growth as well as loss to death and decomposition. To measure this change the vegetation variables in this dataset, including species composition and the cover and height of individuals, are sampled twice yearly (spring and fall) at permanent 1m x 1m plots within each site. A third sampling at Site C is performed in the winter. The data from these plots is used to build regressions correlating biomass and volume via weights of select harvested species obtained in SEV999, "Net Primary Productivity (NPP) Weight Data." This biomass data is included in SEV999, "Seasonal Biomass and Seasonal and Annual NPP for Core Grid Research Sites."
Long-term dynamics of soil organic matter and aboveground net primary production in a Chihuahuan Desert Grassland at the Sevilleta National Wildlife Refuge, New Mexico (1989-2014)
Drylands contain a third of the organic carbon stored in global soils; however, the long-term dynamics of soil organic carbon and soil organic matter (SOM) in drylands remain poorly understood relative to dynamics of the vegetation carbon pool. We examined long-term patterns in SOM against both climate and prescribed fire in a Chihuahuan Desert grassland in central New Mexico, USA. SOM was measured each spring and fall for 25 years (1989–2014) in unburned desert grassland and from 2003 to 2014 following a prescribed fire. SOM concentration from 0-20 cm depth did not show a clear long-term trend but fluctuated seasonally at both burned and unburned sites, ranging from a minimum of 0.9% to a maximum of 3.3%. SOM concentration declined nonlinearly in wet seasons and peaked in dry seasons. These results not only contrast with the positive relationships between aboveground net primary production and precipitation for this region, but also with previous reports of greater SOM in wetter sites across drylands globally, suggesting that space is not a good substitute for time in predicting the dynamics of dryland SOM. We suggest that declines in SOM in wet periods are caused by increased soil respiration, runoff, leaching, and soil erosion. In addition to tracking natural variability in climate, SOM concentration also decreased by 14% following prescribed fire, a response that magnified over time and has persisted for nearly a decade due to the slow recovery of primary production. Our results document the surprisingly dynamic nature of soil organic matter and its high sensitivity to climate and fire in this dryland ecosystem.
Language Production fMRI
Open the record for dataset details and reuse information.
Sediment Properties Drive Spatial Variability of Potential Methane Production and Oxidation in Small Streams
<ul> <li>This dataset contains 20 data tables (Fig.2.csv, Fig.3.csv, data_PLS_stream-main-stem.csv, Fig.4_a.csv, data_PLS_subcatch.-stream-sect.csv, Fig.4_b.csv, Fig.5.csv, Fig.S1.csv, Fig.S2.csv, Fig.S3.csv, Fig.S4.csv, Fig.S5_a.csv, Fig.S5_b.csv, Fig.S6_a.csv, Fig.S6_b.csv, Fig.S6_c.csv, Fig.S6_d.csv, TableS1_data-adjustment.csv, TableS1_lit-data.csv, PMO_surface-water.csv), we separated our data tables in the respective figures/analyses presented in our paper</li> <li>We added the units to each column title of each respective data table</li> <li>Please see "Metadata.pdf" and our paper (same title as the dataset) for more information</li> </ul> <p> </p>
Monthly Chlorophyll Concentration product of Mediterranean Sea at 1 km horizontal resolution 1998-2015
<p>Monthly Chlorophyll Concentration product of Mediterranean Sea at 1 km horizontal resolution, expressed as mg m^-3</p>
EXpLoRa - EXperimenting with LoRa products across realistic environments
<p>LoRa has gained significant momentum among industrial and research communities, with several device manufacturers adopting the LoRa technology in their IoT solutions. However, in spite of LoRa’s wide penetration, the resulting performance under realistic conditions and real-life scenarios has only recently been considered and mainly under line-of-sight environments. For instance, issues like communication across multiple floors and the performance degradation impact of interference have not been analyzed in detail. In the EXpLoRa proposal, we aim to answer the previously identified inquiries from the side of a technology adopter company, namely domX SME, which develops custom IoT monitoring solutions and considers the adoption of LoRa technology for covering the company’s needs.</p> <p>Through the EXpLoRa experiment, we managed to collect a first set of experimental data and familiarize with the LoRa technology and conduct an exhaustive set of experiments with LoRa-compatible devices, under realistic city-scale and varying channel conditions (range of ~35 dB, LOS/ NLOS). For the purposes of our experiment, NITOS testbed provided full access to 12 LoRa nodes and one LoRa Gateway with an additional Monitor interface to capture the prevailing channel occupancy. The set of conducted experiments employed all 12 LoRa end nodes, the 8 available channels, 3 different transmission power levels (0,7,14 dBm), 10 Transmission modes (modulation settings) and multiple payload sizes. In total, more than 100K LoRa packets were transmitted and analysed within the RSSI range of -102 and -137 dBm.</p>
Data for 'Local food crop production can fulfil demand for less than one-third of the population'
<p><strong>This dataset is supplement to the following publication (<em>please cite that when using the data</em>):</strong></p> <p>Kinnunen et al. 2020. Local food crop production can fulfil demand for less than one-third of the population. Nature Food 1: 229–237. http://doi.org/10.1038/s43016-020-0060-7</p> <p> </p> <p><strong>Data description</strong></p> <p><strong><em>Distance to food:</em></strong> Globally optimized distance between crop production and consumption. The optimization creates a theoretical food allocation set-up that minimizes travel time cost from crop production to consumption. Data is in two formats: NetCDF (dist_food_netcdf.zip) and multi-band geotiff (dist_food_tif.zip).</p> <p>The data includes:</p> <ul> <li>baseline scenario (dist_food_baseline.nc / .tif)</li> </ul> <p>and three other scenarios where food availability is changed by</p> <ul> <li>decreasing food waste by half (dist_food_halfLoss.nc / .tif)</li> <li>halving the yield gap (dist_food_halfYieldGap.nc / .tif)</li> <li>both of these measures together (dist_food_halfLoss_halfYielGap.nc / .tif)</li> </ul> <p><em>The data covers six crop functional types</em>: maize, pulses, rice, temperate cereals, tropical cereals and tropical roots </p> <p><em>Dataset specifications:</em></p> <p>spatial extent: -180, 180, -90, 90 (xmin, xmax, ymin, ymax)</p> <p>spatial resolution: 0.5 degrees</p> <p>projection: long/lat WGS84</p> <p>layers: 1: maize, 2: pulses, 3: rice, 4: temp_cereals, 5: trop_cereals, 6: trop_roots </p> <p>no data value: -999</p> <p>unit: km</p> <p> </p> <p><em><strong>Foodsheds:</strong></em> The data contains global foodsheds which are areas that are connected by food flows between raster cells. The food flows are from a theoretical food allocation set-up that minimizes travel time cost from crop production to consumption. In addition to normal foodsheds (values>0), there are two special cases: ridge-cells (value: -99) and unconnected single cells (value: -50). Ridge-cells are raster cells connected to multiple foodsheds, while being able to satisfy their own demand locally. Unconnected single cells are not connected to any other foodshed. Each positivie value is a crop specific id, signifying a connected foodshed area. </p> <p>Data is in two formats: NetCDF (foodsheds_netcdf.zip) and multi-band geotiff (foodsheds_tif.zip).</p> <p>The data includes:</p> <ul> <li>baseline scenario (foodsheds_baseline.nc / .tif)</li> </ul> <p>and three other scenarios where food availability is changed by</p> <ul> <li>decreasing food waste by half (foodsheds_halfLoss.nc / .tif)</li> <li>halving the yield gap (foodsheds_halfYieldGap.nc / .tif)</li> <li>both of these measures together (foodsheds_halfLoss_halfYielGap.nc / .tif)</li> </ul> <p><em>The data covers six crop functional types</em>: maize, pulses, rice, temperate cereals, tropical cereals and tropical roots </p> <p><em>Dataset specifications:</em></p> <p>spatial extent: -180, 180, -90, 90 (xmin, xmax, ymin, ymax)</p> <p>spatial resolution: 0.5 degrees</p> <p>projection: long/lat WGS84</p> <p>layers: 1: maize, 2: pulses, 3: rice, 4: temp_cereals, 5: trop_cereals, 6: trop_roots </p> <p>no data value: -999</p> <p>unit: -</p> <p> </p>
Techno-economic sustainability analysis methodology for conversion routes of renewable feedstock resources to bio-based products – case studies
<p>The dataset provides a set of sustainability principles, criteria and indicators for the evaluation of the conversion routes stage of a bio-based product. The selected case studies on the employment of alternative feedstocks and production of the bio-based products are implemented in order to evaluate the proposed methodology. Mass and energy balances for all case studies, estimated techno-economic metrics, cost of externalities and risk assessment results are provided</p>
Exploring Data Evaluation Strategies for Enhanced Identification of Host Cell Proteins in Drug Products of Therapeutic Antibodies and Fc-Fusion Proteins
<p>This data repository contains all previously unpublished raw data files for the manuscript “Exploring Data Evaluation Strategies for Enhanced Identification of Host Cell Proteins in Drug Products of Therapeutic Antibodies and Fc-Fusion Proteins” by Wolfgang Esser-Skala, Marius Segl, Therese Wohlschlager, Veronika Reisinger, Johann Holzmann, and Christian G. Huber. See <em>readme.md</em> for further information.</p>
Mapping the intertidal microphytobenthos Gross Primary Production
<p>Dataset used in the papers "Mapping the intertidal microphytobenthos Gross Primary Production. PartI & PartII" published in Frontiers Marine Science Research Topic "Advances and Challenges in Microphytobenthos Research: From Cell Biology to Coastal Ecosystem Function", and maps (geotiff) resulting of the use of the GPP-algorithm with Platt or Eilers and Peeters models.</p>
Data set: Can ocean community production and respiration be determined by measuring high-frequency oxygen profiles from autonomous floats?
<p>Relevant autonomous float data for <a href="https://doi.org/10.5194/bg-17-4119-2020">Gordon et al. (2020)</a>. Following a similar structure to the Argo network's "synthetic" profile files, one file per float is produced with all relevant variables (temperature, salinity, chlorophyll, backscatter, dissolved oxygen) on a common depth and time grid. The Electro-Magnetic Autonomous Profiling Explorer (EM-APEX) floats were deployed in the northern Gulf of Mexico in May 2017 - see <a href="https://doi.org/10.1109/CWTM43797.2019.8955168">Shay et al. (2019)</a> for more information. </p> <p>The data published here contains a timestamp for each data point. Another version of this data which contains some additional variables is hosted on <a href="https://data.gulfresearchinitiative.org/data/R5.x275.281:0001">GRIIDC</a>, but does not contain a timestamp for each data point, but rather for each profile. </p>
Block-wise sparse matrix-vector product dataset and convolutional neural nets for estimating the run time and energy consumption of the sparse matrix-vector product
<p><strong>Introduction</strong></p> <p><strong>SpMV-CNN</strong> is a set of Convolutional Neural Networks (CNNs) that provide accurate estimations of the performance and energy consumption of the SpMV kernel. The proposed CNN-based models use a block-wise approach to make the CNN architecture independent of the matrix size. These models cat be trained to estimate run time as well as total, package and DRAM energy consumption at different processor frequencies.</p> <p><strong>Prerequisites</strong></p> <p><strong>SpMV-CNN</strong> requires Python3 with the following packages:</p> <pre><code>keras==2.1.6 tensorflow==1.8.0 h5py==2.7.1 matplotlib==2.1.1 scikit-learn==0.19.1 </code></pre> <p><strong>Obtaining the dataset</strong></p> <p>The execution time and energy consumption data corresponding to the SpMV operation on a set of sparse matrices from the SuiteSparse Matrix Collection have been obtained on an Intel Xeon E5-2630 core running at frequencies 1.2, 1.6, 2.0, 2.4 GHz. The energy consumption measurements are obtained via the Intel RAPL interface and gathered at three different levels (total, package and DRAM, where total = package + DRAM) for this specific processor.</p> <p>The <code>spmv-cnn-dataset.tgz</code> archive contains the whole dataset, including the following HDF5 files:</p> <pre><code>$ tree . |-- test | |-- f_1200000_b250 | | |-- output_2cubes_sphere_1200000.h5 | | |-- output_apache2_1200000.h5 | | |-- output_bcsstk36_1200000.h5 | | |-- output_cfd1_1200000.h5 | | |-- output_cfd2_1200000.h5 | | |-- output_ct20stif_1200000.h5 | | |-- output_denormal_1200000.h5 | | |-- output_Dubcova2_1200000.h5 | | |-- output_Dubcova3_1200000.h5 | | |-- output_ecology2_1200000.h5 | | |-- output_gyro_1200000.h5 | | |-- output_gyro_k_1200000.h5 | | |-- output_msc10848_1200000.h5 | | |-- output_msc23052_1200000.h5 | | |-- output_nasasrb_1200000.h5 | | |-- output_nd3k_1200000.h5 | | |-- output_offshore_1200000.h5 | | |-- output_oilpan_1200000.h5 | | |-- output_olafu_1200000.h5 | | |-- output_parabolic_fem_1200000.h5 | | |-- output_qa8fm_1200000.h5 | | |-- output_raefsky4_1200000.h5 | | |-- output_s3dkq4m2_1200000.h5 | | |-- output_s3dkt3m2_1200000.h5 | | |-- output_ship_001_1200000.h5 | | |-- output_ship_003_1200000.h5 | | |-- output_shipsec1_1200000.h5 | | |-- output_shipsec5_1200000.h5 | | |-- output_shipsec8_1200000.h5 | | |-- output_smt_1200000.h5 | | |-- output_thermomech_dM_1200000.h5 | | |-- output_thread_1200000.h5 | | `-- output_vanbody_1200000.h5 | |-- f_1600000_b250 | | |-- output_2cubes_sphere_1600000.h5 | | |—- ... | | `-- output_vanbody_1600000.h5 | |-- f_2000000_b250 | | |-- output_2cubes_sphere_2000000.h5 | | |—- ... | | `-- output_vanbody_2000000.h5 | `-- f_2400000_b250 | |-- output_2cubes_sphere_2400000.h5 | |—- ... | `-- output_vanbody_2400000.h5 |-- test_pagerank | |-- f_1200000_b250 | | |-- output_adaptive_1200000.h5 | | |-- output_cit-HepPh_1200000.h5 | | |-- output_delaunay_n22_1200000.h5 | | |-- output_email-Enron_1200000.h5 | | |-- output_email-EuAll_1200000.h5 | | |-- output_europe_osm_1200000.h5 | | |-- output_hugebubbles-00020_1200000.h5 | | |-- output_rgg_n_2_24_s0_1200000.h5 | | |-- output_road_usa_1200000.h5 | | |-- output_Stanford_1200000.h5 | | |-- output_wb-edu_1200000.h5 | | |-- output_web-BerkStan_1200000.h5 | | |-- output_web-Google_1200000.h5 | | |-- output_web-NotreDame_1200000.h5 | | |-- output_wiki-Talk_1200000.h5 | | `-- output_wiki-Vote_1200000.h5 | |-- f_1600000_b250 | | |-- output_adaptive_1600000.h5 | | |—- ... | | `-- output_wiki-Vote_1600000.h5 | |-- f_2000000_b250 | | |-- output_adaptive_2000000.h5 | | |—- ... | | `-- output_wiki-Vote_2000000.h5 | `-- f_2400000_b250 | |-- output_adaptive_2400000.h5 | |—- ... | `-- output_wiki-Vote_2400000.h5 `-- train |-- merged_energy_train_shuffle_f1200000_250.h5 |-- merged_energy_train_shuffle_f1600000_250.h5 |-- merged_energy_train_shuffle_f2000000_250.h5 `-- merged_energy_train_shuffle_f2400000_250.h5 </code></pre> <p>The matrices contained in the merged training files (<code>merged_energy_train_shuffle_fXX00000_250.h5</code>) are the following:</p> <pre><code>$ tree . |-- output_af_0_k101_1200000.h5 |-- output_af_1_k101_1200000.h5 |-- output_af_2_k101_1200000.h5 |-- output_af_3_k101_1200000.h5 |-- output_af_4_k101_1200000.h5 |-- output_af_5_k101_1200000.h5 |-- output_af_shell10_1200000.h5 |-- output_af_shell1_1200000.h5 |-- output_af_shell2_1200000.h5 |-- output_af_shell3_1200000.h5 |-- output_af_shell4_1200000.h5 |-- output_af_shell5_1200000.h5 |-- output_af_shell6_1200000.h5 |-- output_af_shell7_1200000.h5 |-- output_af_shell8_1200000.h5 |-- output_af_shell9_1200000.h5 |-- output_atmosmodd_1200000.h5 |-- output_atmosmodj_1200000.h5 |-- output_atmosmodl_1200000.h5 |-- output_audikw_1_1200000.h5 |-- output_BenElechi1_1200000.h5 |-- output_bmw3_2_1200000.h5 |-- output_bmw7st_1_1200000.h5 |-- output_bmwcra_1_1200000.h5 |-- output_bone010_1200000.h5 |-- output_boneS01_1200000.h5 |-- output_boneS10_1200000.h5 |-- output_bundle_adj_1200000.h5 |-- output_cage14_1200000.h5 |-- output_cage15_1200000.h5 |-- output_circuit5M_1200000.h5 |-- output_circuit5M_dc_1200000.h5 |-- output_CO_1200000.h5 |-- output_consph_1200000.h5 |-- output_CoupCons3D_1200000.h5 |-- output_crankseg_1_1200000.h5 |-- output_crankseg_2_1200000.h5 |-- output_CurlCurl_2_1200000.h5 |-- output_CurlCurl_3_1200000.h5 |-- output_CurlCurl_4_1200000.h5 |-- output_dielFilterV2real_1200000.h5 |-- output_dielFilterV3real_1200000.h5 |-- output_Emilia_923_1200000.h5 |-- output_ESOC_1200000.h5 |-- output_F1_1200000.h5 |-- output_F2_1200000.h5 |-- output_Fault_639_1200000.h5 |-- output_Freescale1_1200000.h5 |-- output_Freescale2_1200000.h5 |-- output_FullChip_1200000.h5 |-- output_G3_circuit_1200000.h5 |-- output_Ga10As10H30_1200000.h5 |-- output_Ga19As19H42_1200000.h5 |-- output_Ga3As3H12_1200000.h5 |-- output_Ga41As41H72_1200000.h5 |-- output_Ge87H76_1200000.h5 |-- output_Ge99H100_1200000.h5 |-- output_Geo_1438_1200000.h5 |-- output_gsm_106857_1200000.h5 |-- output_Hardesty3_1200000.h5 |-- output_hood_1200000.h5 |-- output_Hook_1498_1200000.h5 |-- output_human_gene1_1200000.h5 |-- output_human_gene2_1200000.h5 |-- output_inline_1_1200000.h5 |-- output_JP_1200000.h5 |-- output_kkt_power_1200000.h5 |-- output_ldoor_1200000.h5 |-- output_Long_Coup_dt0_1200000.h5 |-- output_Long_Coup_dt6_1200000.h5 |-- output_mat_104_10000_1200000.h5 |-- output_mat_104_1000_1200000.h5 |-- output_mat_104_5000_1200000.h5 |-- output_mat_112_10000_1200000.h5 |-- output_mat_112_1000_1200000.h5 |-- output_mat_112_5000_1200000.h5 |-- output_mat_120_10000_1200000.h5 |-- output_mat_120_1000_1200000.h5 |-- output_mat_120_5000_1200000.h5 |-- output_mat_128_10000_1200000.h5 |-- output_mat_128_1000_1200000.h5 |-- output_mat_128_5000_1200000.h5 |-- output_mat_16_10000_1200000.h5 |-- output_mat_16_1000_1200000.h5 |-- output_mat_16_5000_1200000.h5 |-- output_mat_24_10000_1200000.h5 |-- output_mat_24_1000_1200000.h5 |-- output_mat_24_5000_1200000.h5 |-- output_mat_32_10000_1200000.h5 |-- output_mat_32_1000_1200000.h5 |-- output_mat_32_5000_1200000.h5 |-- output_mat_40_10000_1200000.h5 |-- output_mat_40_1000_1200000.h5 |-- output_mat_40_5000_1200000.h5 |-- output_mat_48_10000_1200000.h5 |-- output_mat_48_1000_1200000.h5 |-- output_mat_48_5000_1200000.h5 |-- output_mat_56_10000_1200000.h5 |-- output_mat_56_1000_1200000.h5 |-- output_mat_56_5000_1200000.h5 |-- output_mat_64_10000_1200000.h5 |-- output_mat_64_1000_1200000.h5 |-- output_mat_64_5000_1200000.h5 |-- output_mat_72_10000_1200000.h5 |-- output_mat_72_1000_1200000.h5 |-- output_mat_72_5000_1200000.h5 |-- output_mat_80_10000_1200000.h5 |-- output_mat_80_1000_1200000.h5 |-- output_mat_80_5000_1200000.h5 |-- output_mat_8_10000_1200000.h5 |-- output_mat_8_1000_1200000.h5 |-- output_mat_8_5000_1200000.h5 |-- output_mat_88_10000_1200000.h5 |-- output_mat_88_1000_1200000.h5 |-- output_mat_88_5000_1200000.h5 |-- output_mat_96_10000_1200000.h5 |-- output_mat_96_1000_1200000.h5 |-- output_mat_96_5000_1200000.h5 |-- output_memchip_1200000.h5 |-- output_ML_Laplace_1200000.h5 |-- output_mouse_gene_1200000.h5 |-- output_msdoor_1200000.h5 |-- output_m_t1_1200000.h5 |-- output_nd12k_1200000.h5 |-- output_nd24k_1200000.h5 |-- output_nd6k_1200000.h5 |-- output_nlpkkt120_1200000.h5 |-- output_nlpkkt80_1200000.h5 |-- output_PFlow_742_1200000.h5 |-- output_pwtk_1200000.h5 |-- output_rajat31_1200000.h5 |-- output_RM07R_1200000.h5 |-- output_Rucci1_1200000.h5 |-- output_Serena_1200000.h5 |-- output_Si34H36_1200000.h5 |-- output_Si41Ge41H72_1200000.h5 |-- output_Si87H76_1200000.h5 |-- output_SiO2_1200000.h5 |-- output_sls_1200000.h5 |-- output_StocF-1465_1200000.h5 |-- output_TEM152078_1200000.h5 |-- output_TEM181302_1200000.h5 |-- output_thermal2_1200000.h5 |-- output_tmt_sym_1200000.h5 |-- output_torso1_1200000.h5 |-- output_Transport_1200000.h5 |-- output_TSOPF_FS_b300_c2_1200000.h5 |-- output_TSOPF_FS_b300_c3_1200000.h5 |-- output_TSOPF_RS_b2383_1200000.h5 |-- output_TSOPF_RS_b2383_c1_1200000.h5 |-- output_TSOPF_RS_b678_c2_1200000.h5 `-- output_x104_1200000.h5 f_1600000_b250 |-- output_af_0_k101_1600000.h5 |—- ... `-- output_x104_1600000.h5 f_2000000_b250 |-- output_af_0_k101_2000000.h5 |—- ... `-- output_x104_2000000.h5 f_2400000_b250 |-- output_af_0_k101_2400000.h5 |—- ... `-- output_x104_2400000.h5 </code></pre> <p><strong>Creating your own dataset</strong></p> <p>If you wish to create your own training/testing dataset on a different target architecture you need to take the following steps:</p> <ol> <li> <p>Build the SpMV driver:</p> <ol> <li> <p>Go to <code>cd SpMV-driver/src</code></p> </li> <li> <p>Edit makefile and set the PAPI and HDF5 install prefixes.</p> </li> <li> <p>Build the driver via <code>make.</code></p> </li> </ol> </li> <li> <p>Run the SpMV driver: </p> <p><code>./driver <arg0> <arg1> ...</code></p> <p>List of driver arguments:</p> <pre><code>matrix = audikw_1.rb # Input matrix in rb format reps = 10000 # Number of repetitions of the operation to avoid overhead block_size_ini = 250 # Minimum block size block_size_end = 1000 # Maximum block size increment = 250 # Increment between block sizes base = 0 # Starting nnz of the matrix freq = [2400000, 2000000, 1600000, 1200000] # Operating frequency sym = 1 # If 1 the matrix is symmetric. If 0 the matrix is no-symmetric.</code></pre> <p>Example:</p> <p><code>numactl --membind 0 taskset -c 0 ./src/driver audikw_1.rb 10000 250 1000 250 0 2400000</code></p> <p>Note that <code>numactl</code> and <code>taskset</code> utilities are used to guarantee both NUMA and process-to-core affinity.</p> </li> <li> <p>Generating the dataset:</p> <ol> <li> <p>Edit the <code>SpMV-driver/run_all.sh</code> and uncomment the line <code>matrices =</code> in order to launch the driver for Train_symmetric / Train_noSymmetric / Test_symmetric / Test_noSymmetric matrices.</p> </li> <li> <p>Edit the 3rd parameter in the command SpMV-driver/run_driver.sh: 1 for symmetric matrices, 2 for unsymmetric matrices.</p> </li> <li> <p>Edit the command in SpMV-driver/run_driver.sh to select the input parameters of the driver as explained before.</p> </li> <li> <p>Run <code>SpMV-driver/run_all.sh</code> to obtain <code>hdf5</code> files that will create the dataset.</p> </li> </ol> </li> <li> <p>Merging the dataset:</p> <p>Run the script</p> <p><code>python3 SpMV-driver/merge_train_matrices.py /path/to/hdf5/matrix/files /output/path</code></p> <p>to obtain a single <code>hdf5</code> file containing all data from individual <code>hdf5</code> files obtained in the previous step. This merged file is the training dataset.</p> </li> </ol> <p><strong>Hyperparameter search</strong></p> <p>The script <code>spmv_cnn_hyperas.py</code> performs the hyperparameter search via the Hyperas tool. This script requires the hdf5 file dataset in the directory <code>dataset/train/</code> and produces both a <code>best_model_*.json</code> and <code>best_run_*.json </code>files in the <code>results/models/</code> directory containing the model structure and hyperparameters of the best performing configuration.</p> <p>This script can be invoked in the following way:</p> <p><code>python3 spmv_cnn_hyper.py 2400000 Time</code></p> <p>where <code>2400000</code> is the operating processor frequency (2.4 GHz) at which the dataset was generated and <code>Time</code> the modeled metric. According to the labels in the dataset, the hyperparameter search can also be performed with the <code>Energy</code>, <code>EPKG</code> and <code>EDRAM</code> metrics, corresponding to the energy measured by the Intel RAPL counters from our Intel Xeon Haswell core. In our case, however, we only search hyperparameters for the <code>Time</code> and <code>Energy</code> metrics at 2.4 GHz. Other metrics and frequencies inherit the best performing model and settings from the previous configuration.</p> <p><strong>Training</strong></p> <p>The script <code>spmv_cnn_train.py</code> performs the training on the best performing models obtained on the previous step. For that, it uses both the <code>best_model_*.json</code> and <code>best_run_*.json</code> files obtained in the hyperparameter search.</p> <p>This script can be invoked in the following way:</p> <p><code>python3 spmv_cnn_train.py 2400000 Time</code></p> <p>where <code>2400000</code> is the operating processor frequency (2.4 GHz) and <code>Time</code> the modeled metric. The training should be performed per metric and frequency. The training produces a file that contains the trained weights, so the model is ready for performing inference (testing).</p> <p><strong>Testing</strong></p> <p>The script <code>spmv_cnn_test.py</code> performs the test on the set of testing matrices involved in the SpMV operation.</p> <p>This script can be invoked in the following way:</p> <p><code>python3 spmv_cnn_test.py 2400000 Time</code></p> <p>where <code>2400000</code> is the operating processor frequency (2.4 GHz) and <code>Time</code> the modeled metric. The test should be performed per metric and frequency. The training produces two files in the <code>results/tests/</code> directory:</p> <ul> <li><code>Pred_*.txt</code>: This file contains the real measurements and the predictions obtained by the CNN for the individual vpos blocks of the testing matrices.</li> <li><code>Test_*.txt</code>: This file summarizes the information of <code>Pred_*.txt</code> file, showing the average relative error among the blocks of each test matrix and the total relative error, which is computed by summing up the real measurements and the predictions for all the blocks of a same matrix and computing the relative error upon those values.</li> </ul> <p><em>Note that this testing step and the two previous steps (hyperparameter search and training) can be performed at once using the <code>run.sh</code> script.</em></p> <p><strong>References</strong></p> <p>Publications describing <strong>SpMV-CNN-Model</strong>:</p> <ul> <li>Barreda, M., Dolz, M.F., Castaño, M.A. et al. Performance modeling of the sparse matrix–vector product via convolutional neural networks. J Supercomputing (2020). <a href="https://doi.org/10.1007/s11227-020-03186-1">https://doi.org/10.1007/s11227-020-03186-1</a></li> </ul> <p><strong>Acknowledgments</strong></p> <p>The <strong>SpMV-CNN-Model</strong> research has been partially supported by:</p> <ul> <li> <p>Project TIN2017-82972-R <strong>“Agorithmic Techniques for Energy-Aware and Error-Resilient High Performance Computing”</strong> funded by the Spanish Ministry of Economy and Competitiveness (2018-2020).</p> </li> <li> <p>Project CDEIGENT/2017/04 <strong>“High Performance Computing for Neural Networks” </strong>funded by the Valencian Government.</p> </li> <li> <p>Project UJI-A2019-11 <strong>“Energy-Aware High Performance Computing for Deep Neural Networks”</strong> funded by the Universitat Jaume I.</p> </li> </ul>
S13 | EUCOSMETICS | Combined Inventory of Ingredients Employed in Cosmetic Products (2000) and Revised Inventory (2006)
<p>This is the collection associated with list S13 EUCOSMETICS on the NORMAN Suspect List Exchange.</p> <p><a href="https://www.norman-network.com/nds/SLE/">https://www.norman-network.com/nds/SLE/</a></p> <p><strong>Combined Inventory of Ingredients Employed in Cosmetic Products (2000) and Revised Inventory (2006)</strong></p> <p>Merged Cosmetics <a href="https://www.norman-network.com/sites/default/files/files/suspectListExchange/Merged_CosmeticProducts_04052017.csv">CSV</a> (4/05/2017)</p> <p>CompTox <a href="https://comptox.epa.gov/dashboard/chemical_lists/eucosmetics">EU Cosmetics List</a></p> <p><a href="https://www.norman-network.com/sites/default/files/files/suspectListExchange/Merged_CosmeticProducts_04052017_InChIKeys.txt">Merged Cosmetics InChIKeys</a> (4/05/2017)</p> <p>The scientific committee on cosmetic products and non-food products Intended for consumers - <a href="https://www.norman-network.com/sites/default/files/files/suspectListExchange/SCCNFP038900_INCI-2000.pdf">SCCNFP/0389/00 Final</a> and Commission <a href="https://www.norman-network.com/sites/default/files/files/suspectListExchange/Decision_2006_257_EC.pdf">Decision 2006/257/EC</a> amending the Decision 96/335/EC. Provided by Peter von der Ohe, UBA, curated by Reza Aalizadeh, University of Athens.</p> <p>Update 12 May 2020: Added the source data from both reports (INCI-2000 and Decision 96/335/EC), including the function information and undefined structures. Update 28 May 2020: removed incomplete structural information from Decision 96/335/EC files. Update 24/7/2020: corrected one synonym reported by PubChem (GFMHHNOUDDHEOO-UHFFFAOYSA-N).</p>
Data from: Trade-off between standing biomass and productivity in species-rich tropical forest: evidence, explanations and implications
<p>These files are the R code and plot data files used for calculating species population turnover of biomass and abundance in a tropical forest plot.</p> <p>This dataset is a processed subset of the original dataset used in our analysis of biomass turnover across tree populations as demonstrated in <a href="https://doi.org/10.1111/1365-2745.13485">the main paper</a>. Readers interested in using the Pasoh 50-ha plot data for purposes other than reviewing our analysis are advised to contact the <a href="https://www.frim.gov.my/">Forest Research Institute Malaysia (FRIM)</a> and the <a href="https://forestgeo.si.edu/">Center for Tropical Forest Science-Forest Global Earth Observatory (CTFS-Forest GEO)</a>, Smithsonian Tropical Research Institute.</p>
GLC_FCS30: Global land-cover product with fine classification system at 30 m using time-series Landsat imagery
<p>A novel global 30-m land-cover product with a fine classification system for the year 2015 (GLC_FCS30-2015). The product was produced by combining time-series of Landsat imagery and high-quality training data from the GSPECLib (Global Spatial Temporal Spectra Library) on the Google Earth Engine computing platform. First, the global training data from the GSPECLib were developed by applying a series of rigorous filters to the MCD43A4 NBAR and CCI_LC land-cover products. Secondly, a local adaptive random forest model was built for each 5°×5° geographical tile by using the multi-temporal Landsat spectral and textures features of the corresponding training data, and the GLC_FCS30-2015 land-cover product containing 30 land-cover types was generated for each tile.</p>
Global vegetation productivity from 1981 to 2018 estimated from remote sensing data
<p>The MUltiscale Satellite remotE Sensing (MUSES) global vegetation productivity dataset includes gross primary productivity (GPP) and net primary productivity (NPP) data from 1981 to 2018. GPP and NPP were estimated with a light use efficiency (LUE) model and MUSES leaf area index (LAI) and fraction of absorbed photosynthetically active radiation (FAPAR) products.</p> <p>The MUSES product suite includes products with different spatial and temporal resolutions for parameters such as Normalized Difference Vegetation Index (NDVI), Near-Infrared Reflectance of Vegetation (NIRv), Leaf Area Index (LAI), Fraction of Absorbed Photosynthetically Active Radiation (FAPAR), Fractional Vegetation Coverage (FVC), Gross Primary Production (GPP), Net Primary Production (NPP). For more information about the MUSES products, please refer to this website (<a href="https://muses.bnu.edu.cn/">https://muses.bnu.edu.cn/</a>).</p> <p>The detail information of the MUSES 5-km global GPP and NPP products are as below:</p> <p>Name: MUSES 5-km global GPP and NPP products</p> <p>Period: 1981-2018</p> <p>Spatial resolution: 0.05°</p> <p>Temporal resolution: 8 days</p> <p>Projection: geographic latitude/longitude</p> <p>Data format: Tiff</p> <p>Data type: integer (16bit)</p> <p>Upper left coordinates: -180°E, 90°N</p> <p>Scale factor: 100</p> <p>Unit: gCm<sup>-2</sup>d<sup>-1</sup></p> <p> </p> <p><span>Citation (Please cite these papers when these data are used)</span></p> <p><span>1. Wang, J.M., Sun, R., Zhang, H.L., Xiao, Z.Q., Zhu A.R., Wang, M.J., Yu, T., Xiang, K.L.,</span><span> </span><span>New global MuSyQ GPP/NPP remote sensing products from 1981 to 2018. </span><span>IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14, 5596-5612.</span></p> <p><span>2. Wang, M.J.; Sun, R.; </span><span>Zhu, A.R.;</span><span> Xiao, Z. Q. Evaluation and Comparison of Light Use Efficiency</span><span> </span><span>and Gross Primary Productivity Using Three</span><span> </span><span>Different Approaches. <span>Remote Sensing</span>. <span>2020</span>, 12, 1003.</span></p> <p><span>3. Yu, T.; Sun, R.; Xiao, Z.Q. ;Zhang , Q.; Liu, G.; Cui, T.X.; Wang, J.M. Estimation of Global Vegetation Productivity from Global LAnd Surface Satellite Data. <span>Remote sensing. </span><span>2018, </span>10, 327.</span></p>
A global dataset of SST anomaly evolving processes retrieved from remote sensing products (GDSSTAEP V1.0)
<p> The GDSSTAEP includes three datasets and two relationship files with a time range from January 1982 to December 2009. Three datasets formatted in SHP are a dataset of process object-oriented SSTA, named DSPOSSTA, storing SSTA process objects, a dataset of sequence object-oriented SSTA, named DSSOSSTA, storing SSTA sequence objects, and a dataset of variation object-oriented SSTA, named DSVOSSTA, storing SSTA variation objects, respectively. And two relationship files formatted in CSV store the evolving behaviors among sequence objects of SSTA and variation objects of SSTA, respectively. </p> <p> </p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.