Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
15,702
datasets available to search
ShareScore release 0.7.1
Dataset results
15,702 results for “history”
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Maria Koepcke, <a href="http://www.wikidata.org/entity/Q85746">http://www.wikidata.org/entity/Q85746</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Leonard Cockayne, <a href="http://www.wikidata.org/entity/Q2268390">http://www.wikidata.org/entity/Q2268390</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Maurice Cossmann, <a href="http://www.wikidata.org/entity/Q639189">http://www.wikidata.org/entity/Q639189</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Pierre Marie Auguste Broussonet, <a href="http://www.wikidata.org/entity/Q1354117">http://www.wikidata.org/entity/Q1354117</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Ramón de la Sagra, <a href="http://www.wikidata.org/entity/Q973094">http://www.wikidata.org/entity/Q973094</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Data and code for: "Global Sampling Decline Erodes Science Potential of Natural History Collections"
<p># GBIF Specimen Data Analysis and Forecasting<br><br>## Version 2 - modified date ranges for figures 1 and 2 in response to reviewer comments</p> <p>This repository contains the code and data for analysing and forecasting trends in Global Biodiversity Information Facility (GBIF) specimen records across three major taxonomic groups: Chordata, Arthropoda, and Plantae. <br>The analysis pipeline includes data cleaning, anomaly detection, primary analyses, and forecasting based on historical database snapshots.</p> <p>These scripts and data correspond to analyses in the following manuscript:</p> <p>Global Sampling Decline Erodes Science Potential of Natural History Collections</p> <p>Authors:<br>Owen Forbes<br>Andrew G. Young<br>Peter H. Thrall</p> <p><br>## Repository Structure</p> <p>The repository consists of three main Quarto (.qmd) scripts and associated data files:</p> <p>1. `1_DataCleaning_Forbes-et-al_2025.qmd`: Data cleaning and anomaly detection<br>2. `2_PrimaryAnalyses_Forbes-et-al_2025.qmd`: Primary analyses and visualisation<br>3. `3_SnapshotsForecasting_Forbes-et-al_2025.qmd`: Historical snapshot analysis and forecasting</p> <p>## Requirements</p> <p>- R (version 4.3.2 or later)<br>- Required R packages:<br> - tidyverse (v2.0.0) - for data manipulation and visualization<br> - readr (v2.1.5) - for reading CSV/TSV files<br> - ggplot2 (v3.4.0 or v3.5.0) - for creating visualizations<br> - rnaturalearth (v1.0.1) - for accessing natural earth map data<br> - dplyr (v1.1.0 or v1.1.4) - for data manipulation<br> - countrycode (v1.6.0) - for converting country names and codes<br> - spdep (v1.3-3) - for spatial dependence modeling<br> - sp (v1.6-0 or v2.1-3) - for spatial data manipulation<br> - sf (v1.0-15 or v1.0-16) - for simple features access<br> - data.table (v1.14.8) - for fast aggregation of large data<br> - lubridate (v1.9.2) - for date-time manipulation<br> - viridis (v0.6.3) - for color palettes<br> - gridExtra (v2.3) - for arranging multiple plots<br> - ggpubr (v0.6.0) - for creating publication-ready plots<br> - zoo (v1.8-12) - for time series, including moving averages<br> - scales (v1.3.0) - for graphical scales<br> - forecast (v8.22.0) - for ARIMA forecast models<br> - purrr (v1.0.2) - for mapping custom forecast function onto each dataset<br> - arrow - for working with parquet files</p> <p>Install these packages before running the scripts.</p> <p>## How to Use</p> <p>1. Download this repository to your local machine.<br>2. Set your working directory to the location of the scripts.<br>3. Download raw datasets from GBIF (as required)<br>4. Ensure all required R packages are installed.<br>5. Run the scripts in RStudio or your preferred R environment.</p> <p>### Data Cleaning (`1_DataCleaning_Forbes-et-al_2025.qmd`)</p> <p>This script cleans the raw GBIF data and identifies anomalies. It produces files containing indexes of dataset records to be removed, which are used in subsequent analyses.</p> <p>**Note**: The raw GBIF exported datasets for contemporary records are not included in this repository due to file size constraints. Download them from the GBIF links provided in the script and place them in the `data/` directory.</p> <p>### Primary Analyses (`2_PrimaryAnalyses_Forbes-et-al_2025.qmd`)</p> <p>This script performs the main analyses and generates visualisations. It uses the outputs from the data cleaning script to filter anomalous records.</p> <p>To reproduce all analysis stages from the original raw .csv files:<br>- Start at the chunks labelled "DATA LOAD AND FILTERING".<br>- Run the pipeline for non-spatial analyses before spatial analyses.<br>- Due to memory constraints, it's recommended to run analyses for one taxonomic group and one analysis stream at a time.</p> <p>To skip to plot generation:<br>- Navigate to sections tagged as "@! SKIP TO PLOTTING !@".<br>- Ensure all required analysis output files are in the `data/` directory.</p> <p>### Forecasting (`3_SnapshotsForecasting_Forbes-et-al_2025.qmd`)</p> <p>This script analyses historical GBIF database snapshots and forecasts future growth. It uses the cleaned snapshot data produced by the data cleaning script.</p> <p>## Data Files</p> <p>### GBIF Exports - Raw Data (not included on Zenodo due to file size, please download directly from GBIF)<br>- `0016915-240425142415019.csv` for Chordata - https://www.gbif.org/occurrence/download/0016915-240425142415019</p> <p>- `0016914-240425142415019.csv` for Plantae - https://www.gbif.org/occurrence/download/0016914-240425142415019 </p> <p>- `0016913-240425142415019.csv` for Arthropoda - https://www.gbif.org/occurrence/download/0016913-240425142415019</p> <p>### Included Data Files</p> <p>#### Raw Data<br>- `GBIF_snapshots.parquet` # Historical snapshots RAW dataset (arrow/parquet format)<br>- `GBIF_integer_to_datasetKey.tsv` # Mapping old dataset IDs onto new datasetKey field</p> <p>#### Contemporary Datasets - data cleaning outputs<br>- `chordata_counts_to_highlight_030724` # List of anomalous Chordata dataset + year indexes to filter<br>- `arthropoda_counts_to_highlight_OG_030724` # List of anomalous Arthropoda dataset + year indexes to filter<br>- `plantae_counts_to_highlight_030724` # List of anomalous Plantae dataset + year indexes to filter</p> <p>#### Cleaned Snapshots<br>- `plantae_snapshots_filter_threshold_IN_040924` # Cleaned Plantae snapshots<br>- `arthropoda_snapshots_filter_threshold_IN_040924` # Cleaned Arthropoda snapshots<br>- `chordata_snapshots_filter_threshold_IN_040924` # Cleaned Chordata snapshots<br>- `gbif_dates_df_anomaly_filtered_090724` # Anomaly-filtered snapshots (combined dataset)<br>- `gbif_dates_df_anomalies_highlighted_090724` # Anomalies highlighted snapshots (combined dataset)</p> <p>#### Analysis Outputs - for skipping straight to plot/figure generation<br>- `arthropoda_specimens_per_year_080724` # Arthropoda specimen counts per year<br>- `arthropoda_unique_species_per_year_080724` # Arthropoda unique species counts per year<br>- `arthropoda_grid_counts_080724` # Arthropoda grid counts<br>- `chordata_specimens_per_year_080724` # Chordata specimen counts per year<br>- `chordata_unique_species_per_year_080724` # Chordata unique species counts per year<br>- `chordata_grid_counts_080724` # Chordata grid counts<br>- `plantae_specimens_per_year_080724` # Plantae specimen counts per year<br>- `plantae_unique_species_per_year_080724` # Plantae unique species counts per year<br>- `plantae_grid_counts_080724` # Plantae grid counts<br>- `chordata_continent_count_080724` # Chordata continent-specific counts<br>- `arthropoda_continent_count_080724` # Arthropoda continent-specific counts<br>- `plantae_continent_count_080724` # Plantae continent-specific counts</p> <p> </p>
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Sheila Williams, <a href="http://www.wikidata.org/entity/Q106850992">http://www.wikidata.org/entity/Q106850992</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Willy Kükenthal, <a href="http://www.wikidata.org/entity/Q86827">http://www.wikidata.org/entity/Q86827</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Oswaldo Handro, <a href="http://www.wikidata.org/entity/Q7108194">http://www.wikidata.org/entity/Q7108194</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Georg Kükenthal, <a href="http://www.wikidata.org/entity/Q75987">http://www.wikidata.org/entity/Q75987</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Walter Litten, <a href="http://www.wikidata.org/entity/Q21519279">http://www.wikidata.org/entity/Q21519279</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Sidney Miles Toppin, <a href="http://www.wikidata.org/entity/Q19002697">http://www.wikidata.org/entity/Q19002697</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Willis Stanley Blatchley, <a href="http://www.wikidata.org/entity/Q8022027">http://www.wikidata.org/entity/Q8022027</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Aaron Ludwig Kumlien, <a href="http://www.wikidata.org/entity/Q3266240">http://www.wikidata.org/entity/Q3266240</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Rudolf Marloth, <a href="http://www.wikidata.org/entity/Q7377264">http://www.wikidata.org/entity/Q7377264</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Leslie John Mehrhoff, <a href="http://www.wikidata.org/entity/Q111535888">http://www.wikidata.org/entity/Q111535888</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Thakur Rup Chand, <a href="http://www.wikidata.org/entity/Q108911267">http://www.wikidata.org/entity/Q108911267</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Richard L. Homola, <a href="http://www.wikidata.org/entity/Q21516006">http://www.wikidata.org/entity/Q21516006</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by José Camillo Lisboa, <a href="http://www.wikidata.org/entity/Q21519259">http://www.wikidata.org/entity/Q21519259</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
Natural history specimens collected and/or identified and deposited.
Natural history specimen data collected and/or identified by Eduardo José Santos Moreira Mendes, <a href="http://www.wikidata.org/entity/Q21520358">http://www.wikidata.org/entity/Q21520358</a>. Claims or attributions were made on Bionomia, <a href="https://bionomia.net">https://bionomia.net</a> using specimen data from the Global Biodiversity Information Facility, <a href="https://gbif.org">https://gbif.org</a>.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.