Skip to main content
Powered by ShareScore

Find research datasets worth reusing

Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.

625

datasets available to search

ShareScore release 0.9.0

Reset

Dataset results

625 results for “Anomaly”

Learn how ShareScore rates datasets ↗
zenodo32/100

Pn velocity anomalies and anisotropy

Open the record for dataset details and reuse information.

opencc-by-4.0Dec 2024View details →
zenodo32/100

SST Anomalies

<p>SST anomalies for GEV testing</p>

opencc-by-4.0Dec 2021View details →
zenodo32/100

Mooring observed zonal velocity anomaly at 142E/0 averaged over the depths of 400-1000 m

<p>This dataset contains zonal velocity anomaly observed by the mooring at 142E/0. It is supplementary of the paper &quot;<strong>Interdecadal modulation of ENSO-related anomalous Equatorial Intermediate Currents in the western Pacific by the PDO</strong>&quot; published by&nbsp;the Geophysical Research Letters.&nbsp;Please let me know if you need any more information.</p>

opencc-by-4.0Feb 2022View details →
zenodo32/100

Research Artifacts - An Anomaly-based Approach for Detecting Modularity Violations on Method Placement

<p>This record&nbsp;contains research artifacts of our paper.</p> <p>The description of each file is as follows.</p> <ul> <li>case_study.xlsx: a spreadsheet that contains a list of our detected cases and results of our manual inspection</li> <li>java-large+.tar.gz: a preprocessed dataset used for training our detection model</li> <li>model_parameters.ckpt.gz: trained parameters and a word dictionary of our neural network model</li> <li>src.tar.gz: source code of our neural network model written in Python and a dataset preprocessor written in Java</li> </ul>

opencc-by-4.0Mar 2022View details →
zenodo32/100

syslrn: Learning What to Monitor for Efficient Anomaly Detection [Dataset]

<p>This repository includes the dataset for the paper:</p> <p><em><a href="http://doi.org/10.1145/3517207.3526979">D. Sanvito, G. Siracusano, S. Santhanam, R. Gonzalez, R. Bifulco</a></em><br> <strong><em><a href="http://doi.org/10.1145/3517207.3526979">syslrn: Learning What to Monitor for Efficient Anomaly Detection </a></em></strong><br> <em><a href="http://doi.org/10.1145/3517207.3526979">ACM EuroMLSys 2022</a></em></p> <p>The dataset contains two directories at the root level:</p> <ul> <li><em><strong>raw_dataset</strong></em></li> <li><strong><em>processed_dataset</em></strong></li> </ul> <p>Each folder in the <strong><em>raw_dataset</em> </strong>directory contains the raw monitoring data used to generate the graph associated to a single experiment together with additional metadata files.<br> Each folder in the <strong><em>processed_dataset</em> </strong>directory contains the graph associated to a single experiment as a set of three CSV files: two for the graph edges (<em>pid_childof_pid_df.csv</em> and <em>pid_speakswith_pid_df.csv</em>) and one for the graph nodes (<em>proc_df.csv</em>).<br> We provide below a code snippet to parse a graph from <strong><em>processed_dataset</em> </strong>directory.</p> <p>In both folders the name of each sub-folder is based on the following schema: <strong><em>[SCENARIO]_[W]wl/test_[TEST_ID]</em></strong> where:</p> <ul> <li><em>[SCENARIO]</em> reports the target component for the failure injection (<em>cinder_failure</em>, <em>neutron_failure</em>, <em>nova_failure</em>). <em>ff</em>&nbsp; indicates instead a failure-free execution</li> <li><em>[W]</em> reports the number of concurrent workloads</li> <li><em>[TEST_ID] </em>reports the ID of the specific failure scenario injected (same ID selected by the OpenStack failure injection framework [1] )</li> </ul> <p>Each experiment includes the following data in the <strong><em>raw_dataset</em></strong> sub-folders:</p> <ul> <li><em>audit_raw_logs_[TEST_ID]/</em>: raw audit monitoring data</li> <li><em>bpf_tools_[TEST_ID]/</em>: raw ebpf tools monitoring data</li> <li><em>instance-[INSTANCE_ID]/</em>: workload-specific metadata files, e.g. stdout/stderr (generated by the OpenStack failure injection framework [1] )</li> <li><em>logs_workload_[TEST_ID]/:</em> OpenStack application logs</li> <li><em>perf_tools_[TEST_ID]/</em>: raw perf tools monitoring data</li> <li><em>audit_filtered_[TEST_ID].log:</em> audit data pre-processed by <em>ausearch</em> (e.g. numerical entities are resolved to symbols)</li> <li><em>failure_[TEST_ID].info</em>: metadata information about the specific failure scenario (generated by the OpenStack failure injection framework [1] )</li> <li><em>timestamps_[TEST_ID]:</em> timing information</li> </ul> <p><em>[1] D. Cotroneo, L. De Simone, P. Liguori, R. Natella, N. Bidokhti - How Bad Can a Bug Get? An Empirical Analysis of Software Failures in the OpenStack Cloud Computing Platform [ACM ESEC/FSE 2019]</em></p> <p>&nbsp;</p> <p>Example: parsing a graph from <strong><em>processed_dataset</em> </strong>directory</p> <pre><code class="language-python">import pandas as pd import networkx as nx def parse_csv(path): processes_df = pd.read_csv('%sproc_df.csv' % path, index_col=0).reset_index(drop=True) speakswith_edges_df = pd.read_csv('%spid_speakswith_pid_df.csv' % path, index_col=0) speakswith_edges_df['type'] = 'speaksWith' childof_edges_df = pd.read_csv('%spid_childof_pid_df.csv' % path, index_col=0) childof_edges_df['type'] = 'childOf' return processes_df, pd.concat([speakswith_edges_df, childof_edges_df], ignore_index=True) def make_graph(nodes_df, edges_df): G = nx.MultiGraph() for _, node in nodes_df.iterrows(): G.add_node(node.pid, **node) for _, edge in edges_df.iterrows(): G.add_edge(edge.pid1, edge.pid2, type=edge.type) return G PATH = 'processed_dataset/ff_1wl/test_1/' nodes_df, edges_df = parse_csv(PATH) G = make_graph(nodes_df, edges_df) nx.draw_networkx(G, node_size=10, with_labels=False)</code></pre> <p>&nbsp;</p> <p>If you use this dataset for your research, please cite the following paper:</p> <pre><code>@inproceedings{sanvito2022syslrn, title={syslrn: Learning What to Monitor for Efficient Anomaly Detection}, author={Sanvito, Davide and Siracusano, Giuseppe and Santhanam, Sharan and Gonzalez, Roberto and Bifulco, Roberto}, booktitle={2nd European Workshop on Machine Learning and Systems (EuroMLSys '22)}, year={2022}, address = {Rennes, France}, publisher = {ACM}, month = apr, } </code></pre>

openother-ncMar 2022View details →
zenodo32/100

Processed data: flood generation processes and flood anomalies

<p>This dataset inludes processed data required to reproduce main results presented in the manuscript by Tarasova et al. &quot;Shifts in flood generation processes exacerbate regional flood anomalies in Europe&quot;.</p>

opencc-by-4.0Mar 2022View details →
zenodo32/100

Elastic Anomalies across the α-β Phase Transition in Orthopyroxene: Implication for the Metastable Wedge in the Cold Subduction Slab

<p>Here are the expeirmental data</p>

opencc-by-4.0Apr 2022View details →
dryad32/100

Behavioral analysis for market anomalies with heterogeneous agent model

<p>This paper investigates the effect of heterogeneity and bounded rationality on market anomalies in price formation. We establish a heterogeneous agent model under prospect theory, where asset price fluctuation is determined by evolutionary dynamics system embedded in the model. Specifically, our model includes three types of expectation schemes related to different decision-making progresses: the rational scheme, the emotional scheme and the noise scheme. Agents under emotional scheme make decisions based on the cumulative prospect theory framework, which makes psychological factor tractable. By analyzing the distribution of return rate under selected parameters, we show that the model return shares the same pattern as those of SSE 50 Index. Furthermore, we investigate the factors of option implied volatility smile based on dynamic system, and the results suggest that the smile anomaly may be associated with the tail risk of the underlying asset's return distribution, which is effected by market stability and psychological factors.</p>

opencc-zeroDec 2021View details →
dryad32/100

Sea-surface temperature anomalies mediate changes in fish richness and abundance in Western North Atlantic and Gulf of Mexico estuaries

<p class="MsoNormal"><strong><span>Aim: </span></strong><span>Anthropogenic-driven warming of marine systems has resulted in a series of biological and physiological responses that are fundamentally altering ecosystem structure. Because estuaries exist at the land-ocean interface, they are particularly vulnerable to the effects of ocean warming as they can undergo rapid biogeochemical and hydrological shifts due to climate and land-use change. We explored how fish diversity structures—turnover, richness and abundance—have changed in the western North Atlantic and Gulf of Mexico estuaries through space and time and the drivers of change. </span></p> <p class="MsoNormal"><span><strong>Location:</strong> North Atlantic and Northern Gulf of Mexico</span></p> <p class="MsoNormal"><strong><span>Taxa</span></strong><span>: Fish</span></p> <p class="MsoNormal"><strong><span>Results:</span></strong><span> We found that species richness and abundance, turnover have increased in North Atlantic and northern Gulf of Mexico estuaries in the last 3 decades. These changes were mediated largely by sea-surface temperature anomalies, especially in more northern estuaries where warming has been relatively pronounced. </span><span>There is also an indication that urbanization, perhaps through habitat fragmentation and/or fisheries activities may be contributing to the increase in fish richness in many of these estuaries. </span></p> <p class="MsoNormal"><strong><span>Main Conclusion: </span></strong><span>The increasing trajectory of turnover in many of the estuaries suggests that the fish communities have changed fundamentally from the baselines. A fundamental change in community composition can lead to an irreversible trophic imbalance or alternative stable states among other outcomes. Thus, predicting how shifting community structures might influence food webs, ecosystem stability and human resource use remains a pertinent task.</span></p>

opencc-zeroMay 2022View details →
zenodo32/100

Dataset used in Can process mining help in anomaly-based intrusion detection?

<p>This is the dataset used in the paper&nbsp;Can process mining help in anomaly-based intrusion detection?</p>

opencc-by-4.0Jun 2022View details →
zenodo32/100

Cell Anomaly Localisation using Structured Uncertainty Prediction Networks

<p>Fluorescent and brightfield datasets for &quot;Cell Anomaly Localisation using Structured Uncertainty Prediction Networks&quot;, part of MIDL 2022.</p>

opencc-by-4.0Dec 2021View details →
dryad32/100

Data from: Effects of climate and topography on the diversity anomaly of plants disjunctly distributed in eastern Asia and eastern North America

<p><b>Aim: </b>Differences in physiography have been proposed to explain the diversity anomaly for vascular plants between environmentally similar regions of eastern Asia (EAS) and eastern North America (ENA). Here, we use plant species within disjunct genera to examine whether differences in topography contribute to the diversity anomaly and whether the richness–environment relationships differ between regions. Disjuncts are used to ensure that the diversity anomaly relates to post-disjunction evolution and diversification rather than regional differences in clade ages or immigration.</p> <p><b>Location: </b>EAS and ENA.</p> <p><b>Time period:</b> Current.</p> <p><b>Major taxa studied:</b> Plant taxa disjunctly distributed in EAS and ENA.</p> <p><b>Method:</b> We compiled county-level plant distribution data, and calculated species richness and variables of topography and climate within unit grid cells. We compared estimated coefficients of region effects among models, where richness was fitted with or without topography and climate. Topography and climate were also used to separately model within-region spatial diversity patterns using spatial simultaneous autoregressive error models.</p> <p><b>Results: </b>The coefficients of region effects varied from -0.776 for the model only including region to -0.309 when topography was controlled for, but remained significant. Climate dominated the spatial diversity patterns in ENA. In contrast, the influence of climate (14.2%) on species richness was weaker than that of topography (18.3%) in warm EAS. Relations to elevation and temperature varied between regions, shifting between positive and negative relationships in several cases.</p> <p><b>Main conclusion:</b> Our results demonstrate that variability in local topography contributes to the strong regional anomaly in plant species richness between EAS and ENA. Nevertheless, the diversity anomaly persists after controlling for local topography and climate. EAS and ENA also exhibit contrasting richness–environment relationships, providing another divergent aspect between the EAS-ENA disjunct floras. Our findings highlight that regional differences in topography or other environmental factors may underlie the diversity anomaly.</p>

opencc-zeroAug 2022View details →
zenodo32/100

Anomalies in Microservice Architecture (train-ticket) based on version configurations

<p>The work contains ten datasets containing monitoring data (logs, Jaeger Traces and Prometheus KPI data). The datasets contain monitoring data from train-ticket, a benchmark system for microservices. The dataset includes a short description with explanations of identified anomalies.</p> <p>The structure of the folder is as follows:</p> <p><strong>&lt;changed-microservice&gt;_&lt;third-party-library&gt;_&lt;version&gt;_&lt;date-when-data-was-collected&gt;</strong></p> <p>Each folder stores the respective data:</p> <ol> <li>Logs: <ul> <li>original log file: LOGS_&lt;change-microservice&gt;_&lt;third-party-library&gt;_&lt;Version&gt;.txt</li> <li>parsed log files required for Loglizer (anomaly detection technique): <ul> <li>LOGS_&lt;change-microservice&gt;_&lt;third-party-library&gt;_&lt;Version&gt;.txt_structured.csv</li> <li>LOGS_&lt;change-microservice&gt;_&lt;third-party-library&gt;_&lt;Version&gt;.txt_templates.csv</li> </ul> </li> </ul> </li> <li>KPI Data: Monitoring_&lt;change-microservice&gt;_&lt;third-party-library&gt;_&lt;Version&gt;</li> <li>Traces: Traces_&lt;change-microservice&gt;_&lt;third-party-library&gt;_&lt;Version&gt;</li> </ol> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p>

opencc-by-4.0Aug 2022View details →
dryad32/100

The relative influence of sea surface temperature anomalies on the benthic composition of an Indo-Pacific and Caribbean coral reef over the last decade

<p>Rising ocean temperatures are the primary driver of coral reef declines throughout the tropics. Such declines include reductions in coral cover that facilitate the monopolisation of the benthos by other taxa such as macroalgae, resulting in reduced habitat complexity and biodiversity. Long term monitoring projects present rare opportunities to assess how sea surface temperature anomalies (SSTAs) influence changes in the benthic composition of coral reefs across distinct locations. Here, using extensively monitored coral reef sites from Honduras (in the Caribbean Sea), and from the Wakatobi National Park located in the centre of the coral triangle of Indonesia, we assess the impact of global warming on coral reef benthic compositions over the period 2012-2019. Bayesian Generalised Linear Mixed effect Models revealed increases in sponge, and hard coral coverage through time, while rubble coverage decreased at the Indonesia location. Conversely, the effect of sea surface temperature anomalies (SSTA) did not predict any changes in benthic coverage. At the Honduras location, algae and soft coral coverage increased through time, while hard coral and rock coverage were decreasing. The effects of SSTA at the Honduras location included increased rock coverage, but reduced sponge coverage, indicating disparate responses between both systems under SSTAs. However, redundancy analyses showed intra-location site variability explained the majority of variance in benthic composition over the course of the study period. Our findings show that SSTAs have differentially influenced the benthic composition between the Honduras and the Indonesia coral reefs surveyed in this study. However, large intra-location variance which explains the benthic composition at both locations indicates that localised processes have a predominant role for explaining benthic composition over the last decade. The sustained monitoring effort is critical for understanding how these reefs will change in their composition as global temperatures continue to rise through the Anthropocene.</p>

opencc-zeroAug 2022View details →
zenodo32/100

Detecting anomalies in system logs with a compact convolutional transformer - Data

<p><strong>Detecting anomalies in system logs with a compact convolutional transformer - Data</strong></p> <p>Preprocessed data and a pre-trained model for the Larisch, Vitay, Hamker (2022) publication.</p> <p>The <em>data</em> directory contains the Blue Gene/L data set, after tokenization, shuffling, and splitting in a training and test set (BGL_masked_Xtrain.npy and BGL_masked_Xtest.npy, respectively) and the corresponding labels.<br> Additionally, the BGL_masked_Xtest_uniq.npy and BGL_masked_Ytest_uniq.npy contains the test data, where samples from the training set are removed.</p> <p>The <em>model</em> directory contains a pre-trained compact convolutional transformer (CCT) model. The CCT is trained on the proposed BGL training data and uses a 4x4 convolutional kernel.</p>

opencc-by-4.0Oct 2022View details →
zenodo32/100

Dataset related to publication: Landcover-categorized fires respond distinctly to precipitation anomalies in the South-Central United States

<p>Landcover-categorized fires respond distinctly to precipitation anomalies in the South-Central United States</p> <p>K&aacute;tia Fernandes and Sen g. Young</p> <p>doi: 10.3389/fenvs.2024.1433920</p> <p>Abstract</p> <p>Satellite detection of active fires have contributed to advance our understanding of fire ecology, fire and climate dynamics, fire emissions and how to better manage the use of fires as a tool. In this study we use 12 years (2012-2023) of active fire data combined with landcover information in the South-Central United States to derive a monthly, <strong>open access dataset of categorized fires.</strong> This is done by calculating a fire predominance index used to rank fire prone land covers, which are then grouped into four main landscapes: grassland, forest, wildland and crop fires. County level aggregated analyses reveal spatial distributions, climatologies, and peak fire months that are particular to each fire type. Using the Standardized Precipitation Index (SPI), it is found that during climatological fire peak-month, SPI and fires exhibit an inverse relationship in forests and crops, whereas grassland and wildland fires show less consistent inverse or even direct relationship with SPI. This varied behavior is discussed in the context of landscapes&rsquo; responses to anomalies in precipitation, and fire management practices, such as prescribed fires and crop residue burning. In a case study of Osage County (OK) we find that large wildfires, known to be closely related to climate anomalies, occur where forest fires are located in the county and absent in areas of grassland fires. Weaker grassland fires response to precipitation anomalies can be attributed to the use of prescribed burning, which are normally planned under environmental conditions that facilitate control and thus avoided during droughts. Crop fires on the other hand, are set to efficiently burn residue and practiced more intensely in drier years than in wetter, explaining the consistently strong inverse correlation between fires and precipitation anomalies. In our increasingly volatile climate, understanding how fires, vegetation, and precipitation interact has become imperative to prevent hazardous fire conflagrations and to better manage ecosystems.</p>

opencc-by-4.0May 2024View details →
zenodo32/100

Dataset: 2023 GPS Anomalies, NOTAMs, and Aircraft Traffic

<h1><strong>Dataset: 2023 GPS Anomalies, NOTAMs, and Aircraft Traffic</strong></h1> <p>The dataset "2023 GPS Anomalies, NOTAMs, and Aircraft Traffic" was collected and generated for the paper "Detecting GPS Anomalies in Aviation Using ADS-B: Correlating Coordinate Gaps and GPS Deviations with NOTAM Warnings."</p> <p>This dataset provides a collection of geospatial and temporal data necessary for analyzing potential GPS anomalies in aviation. The data sources include NOTAMs received from the FAA, and the aircraft traffic and GPS information calculated and extracted from the OpenSky Trino ADS-B database.</p> <p>The FAA_and_ICAO_locations file includes 21,382 records with identifiers, coordinates, and detailed facility information. This dataset serves as a reference for analyzing the geographical distribution of aviation facilities. The Flights_per_Hour_per_Grid file, with 74,219,036 records, provides hourly flight movement counts within specified grids, offering insights into air traffic patterns and potential disruptions. The GPS_Jumps_from_Routes file, comprising 5,878,275 records, documents deviations in flight paths, capturing metrics such as distances, speeds, and timestamps. This data is crucial for identifying potential GPS spoofing incidents by analyzing unusual jumps between consecutive data points.</p> <p>The GPS_Missing_Coordinates file, with 53,232 records, highlights periods of missing GPS signals, indicating possible GPS jamming events. This file includes start and end times, distances between known coordinates, and Navigation Integrity Category (NIC) values to assess data quality during null periods. The NOTAM_ICAO_GPS and NOTAM_USA files, with 30,160 and 234,205 records respectively, provide detailed information on NOTAM areas, including geographic areas, active periods, and categories. This allows for an analysis of the spatial and temporal correlation between NOTAM warnings and GPS anomalies, facilitating a better understanding of the impact of GPS disruptions on aviation safety and operations.</p> <h1><strong>Summary Table</strong></h1> <table> <tbody> <tr> <td> <p><strong>Category</strong></p> </td> <td> <p><strong>File Names</strong></p> </td> <td> <p><strong>Total Records</strong></p> </td> <td> <p><strong>Columns</strong></p> </td> </tr> <tr> <td> <p><strong>FAA and ICAO Locations</strong></p> </td> <td> <p>FAA_and_ICAO_locations.csv</p> <p>FAA_and_ICAO_locations.dpkg</p> </td> <td> <p>21,382</p> </td> <td> <p>WKT, id, fid, Location_ID, ICAO_ID, IATA_ID, FAA_Location_Code, Facility_Type, Facility_Name, FAA_New_Location_Code, Coordinates, lat, lon, Region, Country_Code, Country, State_Id, State_Name, City, Location, Effective_Date, Site_Id, ADO, ARTCC_Id, ARTCC_Computer_ID, ARTCC_Name, Tie_In_FSS_Id, Tie_In_FSS_Name, NOTAM_Facility_Id, NOTAM_Service</p> </td> </tr> <tr> <td> <p><strong>Flights per Hour per Grid</strong></p> </td> <td> <p>Flights_per_Hour_per_Grid-2023.csv</p> <p>Flights_per_Hour_per_Grid-2023.dpkg</p> </td> <td> <p>74,219,036</p> </td> <td> <p>grid_id, hour, movement_count, geometry</p> </td> </tr> <tr> <td> <p><strong>GPS Jumps from Routes</strong></p> <p><strong>(possible spoofing)</strong></p> </td> <td> <p>GPS_Jumps_from_Routes-2023.csv</p> <p>GPS_Jumps_from_Routes-2023.dpkg</p> </td> <td> <p>5,878,275</p> </td> <td> <p>WKT, id, fid, icao24, callsign, time_before_spoofing, time_of_spoofing, distance, time_difference, speed_m_s, time_start, time_end</p> </td> </tr> <tr> <td> <p><strong>GPS Missing Coordinates</strong></p> <p><strong>(possible jamming)</strong></p> </td> <td> <p>GPS_Missing_Coordinates-2023.csv</p> <p>GPS_Missing_Coordinates-2023.dpkg</p> </td> <td> <p>53,232</p> </td> <td> <p>WKT, id, icao24, callsign, null_start_time, null_end_time, time_of_previous_not_null_coords, time_of_next_not_null_coords, between_coords_distance_m, null_duration_seconds, between_coords_duration_seconds, avg_nic, min_nic, max_nic, start_time, end_time, start_y, end_x, end_y, start_x</p> </td> </tr> <tr> <td> <p><strong>NOTAM ICAO GPS</strong></p> </td> <td> <p>NOTAM_ICAO_GPS-2023.csv</p> <p>NOTAM_ICAO_GPS-2023.dpkg</p> </td> <td> <p>30,160</p> </td> <td> <p>WKT, id, fid, notam_id, category_name, coordinates_center, radius_nm, radius_mod_nm, notam_number, accountability, location_id, icao_id, domestic_text, icao_text, type, category_id, time_start, time_end</p> </td> </tr> <tr> <td> <p><strong>NOTAM USA</strong></p> </td> <td> <p>NOTAM_USA-2023.csv</p> <p>NOTAM_USA-2023.dpkg</p> </td> <td> <p>234,205</p> </td> <td> <p>WKT, id, fid, notam_id, category_name, is_circle, coordinates_polygon, coordinates_center, radius_nm, faa_location_code, is_faa_location, location_id, is_restricted_area, restricted_area_id, restricted_area_code, category_id, message, notam_number, notam_accountability, moa, type, time_start, time_end</p> </td> </tr> <tr> <td> <p>&nbsp;</p> </td> <td> <p>&nbsp;</p> </td> <td> <p>&nbsp;</p> </td> <td> <p>&nbsp;</p> </td> </tr> </tbody> </table> <h1><strong>Details</strong></h1> <h2><strong>1. FAA_and_ICAO_locations.csv </strong>and <strong>FAA_and_ICAO_locations.dpkg</strong></h2> <ul> <li><strong>Total Records</strong>: 21,382</li> <li><strong>Columns</strong>:</li> <ul> <li><strong>WKT</strong>: Well-Known Text representation of a point in the CSV file, or a geometry field in the DPKG file.</li> <li><strong>id</strong>: Unique identifier for each record.</li> <li><strong>fid</strong>: Feature identifier.</li> <li><strong>Location_ID</strong>: Identifier for the location.</li> <li><strong>ICAO_ID</strong>: ICAO (International Civil Aviation Organization) identifier.</li> <li><strong>IATA_ID</strong>: IATA (International Air Transport Association) identifier.</li> <li><strong>FAA_Location_Code</strong>: FAA location code.</li> <li><strong>Facility_Type</strong>: Type of facility (e.g., airport, heliport).</li> <li><strong>Facility_Name</strong>: Name of the facility.</li> <li><strong>FAA_New_Location_Code</strong>: New location code by FAA.</li> <li><strong>Coordinates</strong>: Coordinates of the location.</li> <li><strong>lat</strong>: Latitude of the location.</li> <li><strong>lon</strong>: Longitude of the location.</li> <li><strong>Region</strong>: Geographical region of the location.</li> <li><strong>Country_Code</strong>: Country code of the location.</li> <li><strong>Country</strong>: Country name of the location.</li> <li><strong>State_Id</strong>: State identifier.</li> <li><strong>State_Name</strong>: Name of the state.</li> <li><strong>City</strong>: City name.</li> <li><strong>Location</strong>: General location information.</li> <li><strong>Effective_Date</strong>: Effective date of the record.</li> <li><strong>Site_Id</strong>: Site identifier.</li> <li><strong>ADO</strong>: Airport District Office.</li> <li><strong>ARTCC_Id</strong>: ARTCC (Air Route Traffic Control Center) identifier.</li> <li><strong>ARTCC_Computer_ID</strong>: ARTCC computer identifier.</li> <li><strong>ARTCC_Name</strong>: Name of the ARTCC.</li> <li><strong>Tie_In_FSS_Id</strong>: Tie-in Flight Service Station identifier.</li> <li><strong>Tie_In_FSS_Name</strong>: Name of the Tie-in Flight Service Station.</li> <li><strong>NOTAM_Facility_Id</strong>: NOTAM (Notice to Airmen) facility identifier.</li> <li><strong>NOTAM_Service</strong>: Indicates if NOTAM service is available (Y/N).</li> </ul> </ul> <h2><strong>2. Flights_per_Hour_per_Grid-2023.csv </strong>and <strong>Flights_per_Hour_per_Grid-2023.dpkg</strong></h2> <ul> <li><strong>Total Records</strong>: 74,219,036</li> <li><strong>Columns</strong>:</li> <ul> <li><strong>grid_id</strong>: Identifier for the grid.</li> <li><strong>hour</strong>: Timestamp for the hour.</li> <li><strong>movement_count</strong>: Number of flights in each 0.5x0.5 degree grid during each hour of year 2023.</li> <li><strong>geometry</strong>: Well-Known Text representation of a polygon in the CSV file, or a geometry field in the DPKG file.</li> </ul> </ul> <h2><strong>3. GPS_Jumps_from_Routes-2023.csv </strong>and <strong>GPS_Jumps_from_Routes-2023.dpkg</strong></h2> <ul> <li><strong>Total Records</strong>: 5,878,275</li> <li><strong>Columns</strong>:</li> <ul> <li><strong>WKT</strong>: Well-Known Text representation of a linestring in the CSV file, or a geometry field in the DPKG file.</li> <li><strong>id</strong>: Unique identifier for each record.</li> <li><strong>fid</strong>: Feature identifier.</li> <li><strong>icao24</strong>: ICAO 24-bit aircraft address.</li> <li><strong>callsign</strong>: Callsign of the aircraft.</li> <li><strong>time_before_spoofing</strong>: Timestamp before the spoofing event.</li> <li><strong>time_of_spoofing</strong>: Timestamp of the spoofing event.</li> <li><strong>distance</strong>: Distance of the jump in meters.</li> <li><strong>time_difference</strong>: Time difference between two coordinates in seconds.</li> <li><strong>speed_m_s</strong>: Speed in meters per second.</li> <li><strong>time_start</strong>: Start time of the record.</li> <li><strong>time_end</strong>: End time of the record.</li> </ul> </ul> <h2><strong>4. GPS_Missing_Coordinates-2023.csv </strong>and <strong>GPS_Missing_Coordinates-2023.dpkg</strong></h2> <ul> <li><strong>Total Records</strong>: 53,232</li> <li><strong>Columns</strong>:</li> <ul> <li><strong>WKT</strong>: Well-Known Text representation of a linestring in the CSV file, or a geometry field in the DPKG file.</li> <li><strong>id</strong>: Unique identifier for each record.</li> <li><strong>icao24</strong>: ICAO 24-bit aircraft address.</li> <li><strong>callsign</strong>: Callsign of the aircraft.</li> <li><strong>null_start_time</strong>: Start time of missing GPS coordinates.</li> <li><strong>null_end_time</strong>: End time of missing GPS coordinates.</li> <li><strong>time_of_previous_not_null_coords</strong>: Time of the last known good GPS coordinates before the null period.</li> <li><strong>time_of_next_not_null_coords</strong>: Time of the first known good GPS coordinates after the null period.</li> <li><strong>between_coords_distance_m</strong>: Distance between the previous and next known good coordinates in meters.</li> <li><strong>null_duration_seconds</strong>: Duration of the null period in seconds.</li> <li><strong>between_coords_duration_seconds</strong>: Duration between the previous and next known good coordinates in seconds.</li> <li><strong>avg_nic</strong>: Average Navigation Integrity Category (NIC) during the period.</li> <li><strong>min_nic</strong>: Minimum NIC during the period.</li> <li><strong>max_nic</strong>: Maximum NIC during the period.</li> <li><strong>start_time</strong>: Human-readable start time of the null period.</li> <li><strong>end_time</strong>: Human-readable end time of the null period.</li> <li><strong>start_y</strong>: Latitude of the start point.</li> <li><strong>end_x</strong>: Longitude of the end point.</li> <li><strong>end_y</strong>: Latitude of the end point.</li> <li><strong>start_x</strong>: Longitude of the start point.</li> </ul> </ul> <h2><strong>5. NOTAM_ICAO_GPS-2023.csv </strong>and <strong>NOTAM_ICAO_GPS-2023.dpkg</strong></h2> <ul> <li><strong>Total Records</strong>: 30,160</li> <li><strong>Columns</strong>:</li> <ul> <li><strong>WKT</strong>: Well-Known Text representation of a polygon in the CSV file, or a geometry field in the DPKG file.</li> <li><strong>id</strong>: Unique identifier for each record.</li> <li><strong>fid</strong>: Feature identifier.</li> <li><strong>notam_id</strong>: NOTAM identifier.</li> <li><strong>category_name</strong>: Name of the NOTAM category.</li> <li><strong>coordinates_center</strong>: Center coordinates of the NOTAM area.</li> <li><strong>radius_nm</strong>: Radius in nautical miles.</li> <li><strong>radius_mod_nm</strong>: Modified radius in nautical miles.</li> <li><strong>notam_number</strong>: NOTAM number.</li> <li><strong>accountability</strong>: Accountability of the NOTAM.</li> <li><strong>location_id</strong>: Location identifier.</li> <li><strong>icao_id</strong>: ICAO identifier.</li> <li><strong>domestic_text</strong>: Text of the NOTAM for domestic purposes.</li> <li><strong>icao_text</strong>: Text of the NOTAM for ICAO purposes.</li> <li><strong>type</strong>: Type of NOTAM.</li> <li><strong>category_id</strong>: Identifier for the NOTAM category.</li> <li><strong>time_start</strong>: Start time of the NOTAM.</li> <li><strong>time_end</strong>: End time of the NOTAM.</li> </ul> </ul> <h2><strong>6. NOTAM_USA-2023.csv </strong>and <strong>NOTAM_USA-2023.dpkg</strong></h2> <ul> <li><strong>Total Records</strong>: 234,205</li> <li><strong>Columns</strong>:</li> <ul> <li><strong>WKT</strong>: Well-Known Text representation of a polygon in the CSV file, or a geometry field in the DPKG file.</li> <li><strong>id</strong>: Unique identifier for each record.</li> <li><strong>fid</strong>: Feature identifier.</li> <li><strong>notam_id</strong>: NOTAM identifier.</li> <li><strong>category_name</strong>: Name of the NOTAM category.</li> <li><strong>is_circle</strong>: Indicates if the NOTAM area is a circle (1) or not (0).</li> <li><strong>coordinates_polygon</strong>: Coordinates of the polygon vertices.</li> <li><strong>coordinates_center</strong>: Center coordinates of the NOTAM area.</li> <li><strong>radius_nm</strong>: Radius in nautical miles.</li> <li><strong>faa_location_code</strong>: FAA location code.</li> <li><strong>is_faa_location</strong>: Indicates if it is an FAA location (1) or not (0).</li> <li><strong>location_id</strong>: Location identifier.</li> <li><strong>is_restricted_area</strong>: Indicates if it is a restricted area (1) or not (0).</li> <li><strong>restricted_area_id</strong>: Restricted area identifier.</li> <li><strong>restricted_area_code</strong>: Code for the restricted area.</li> <li><strong>category_id</strong>: Identifier for the NOTAM category.</li> <li><strong>message</strong>: NOTAM message.</li> <li><strong>notam_number</strong>: NOTAM number.</li> <li><strong>notam_accountability</strong>: NOTAM accountability.</li> <li><strong>moa</strong>: Military Operations Area (MOA) identifier.</li> <li><strong>type</strong>: Type of NOTAM.</li> <li><strong>time_start</strong>: Start time of the NOTAM.</li> <li><strong>time_end</strong>: End time of the NOTAM.</li> </ul> </ul> <p>&nbsp;</p> <p>Note that all the files are zipped as CSV. The GPKG version is also available where geographical information is present.</p> <p>Due to the size of the file <strong>Flights_per_Hour_per_Grid-2023</strong>, the command line program ogr2ogr may be the best choice to upload the data into a database. Below is an example of a SQL script and a command to upload this file into a PostgreSQL table. Update the placeholders your_DB_table, your_DB_name, your_DB_user, your_DB_password, your_DB_hostname with the actual information.</p> <p>CREATE TABLE your_DB_table (grid_id TEXT, date TIMESTAMP, movement_count INTEGER, geometry GEOMETRY(POLYGON, 4326));</p> <p>"C:\Program Files\QGIS 3.36.2\bin\ogr2ogr" -f "PostgreSQL" PG:"dbname=your_DB_name user=your_DB_user password=your_DB_password host=your_DB_hostname port=5432" C:\Flights_per_Hour_per_Grid.gpkg -nln your_DB_table -a_srs EPSG:4326 -dim 2 -progress -append</p> <h1><strong>Author</strong></h1> <p>Eugene Pik</p> <p><a href="https://orcid.org/0000-0001-6296-919X">https://orcid.org/0000-0001-6296-919X</a></p> <p><a href="https://www.linkedin.com/in/eugene/">https://www.linkedin.com/in/eugene/</a></p> <p>eugene.pik@mevocopter.com</p> <h1><strong>DOI</strong></h1> <p><a href="https://doi.org/10.5281/zenodo.11411991">https://doi.org/10.5281/zenodo.11411991</a></p> <h1><strong>References</strong></h1> <p><strong>Following references were used to update NOTAMs with WKT polygons:</strong></p> <p>airport-data.com. (n.d.). <em>USA airports by FAA code</em>. https://www.airport-data.com/usa-airports/faa-code/A.html</p> <p>DoD. (2019). <em>Flight information publication area planning special use airspace</em>. NATIONAL GEOSPATIAL-INTELLIGENCE AGENCY. https://www.cnatra.navy.mil/assets-global/docs/area-planning-1A-20190815.pdf</p> <p>FAA. (n.d.-a). <em>Airport Data and Information Portal</em>. https://adip.faa.gov/agis/public/#/airportSearch/advanced</p> <p>FAA. (n.d.-b). <em>US ICAO location finder</em>. https://www.notams.faa.gov/common/icao/USA.html</p> <p>FAA. (2017a, September 30). <em>Encodes/decodes&mdash;Aeronautical data</em> [Template]. https://www.faa.gov/air_traffic/flight_info/aeronav/aero_data/loc_id_search/Encodes_Decodes/</p> <p>FAA. (2017b, October 12). <em>Aeronautical information manual&mdash;Official guide to&nbsp; basic flight Information and ATC procedures</em>. https://www.faa.gov/air_traffic/publications/media/AIM_Basic_dtd_10-12-17.pdf#page=142</p> <p>FAA. (2021, July 26). <em>Order JO 7350.9Z - Location identifiers</em> [Template]. https://www.faa.gov/regulations_policies/orders_notices/index.cfm/go/document.information/documentID/1040529</p> <p>FAA. (2023a). <em>Pilot&rsquo;s handbook of aeronautical knowledge</em>. https://www.faa.gov/regulations_policies/handbooks_manuals/aviation/phak</p> <p>FAA. (2023b, June 1). <em>Airport Data</em> [Template]. https://www.faa.gov/air_traffic/flight_info/aeronav/aero_data/Airport_Data/</p> <p>FAA. (2024, February 16). <em>Order JO 7400.10F - Special Use Airspace</em> [Template]. https://www.faa.gov/documentLibrary/media/Order/Order_7400.10F_2024_-_final_-signed.pdf</p> <p>ICAO. (2022). <em>North Atlantic (NAT) air navigation plan Volume I (Doc 9634)</em>. https://www.icao.int/EURNAT/EUR%20and%20NAT%20Documents/NAT%20Documents/_eANP%20NAT%20Doc9634/Doc9634%20NAT%20eANP%20Vol%20I.pdf</p> <p>ProAirPilot.com. (2024). <em>Complete list of NOTAM abbreviations</em>. https://proairpilot.com/notam-abbreviations.html</p> <p>SkyVector. (n.d.). <em>Search for Airports by ICAO ID or name</em>. https://skyvector.com/airports</p> <p>&nbsp;</p> <p><strong>Below is the reference to our source of the aircraft traffic and GPS anomalies data, the OpenSky ADS-B database.</strong></p> <p>Sch&auml;fer, M., Strohmeier, M., Lenders, V., Martinovic, I., &amp; Wilhelm, M. (2014). Bringing up OpenSky: A large-scale ADS-B sensor network for research. <em>IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks</em>, 83&ndash;94. https://doi.org/10.1109/IPSN.2014.6846743</p> <p>&nbsp;</p>

opencc-by-4.0Jun 2024View details →
zenodo32/100

Preliminary Results of Marine Gravity Anomaly and Bathymetry from SWOT Wide-Swath altimeter data

<p><span>We explore the potential of Ka-band radar interferometry (KaRIn) data from the SWOT mission for marine gravity and bathymetry applications. Our evaluation includes determining the deflection of vertical (DOV) using the least squares collocation (LSC) method, recovering gravity anomalies with the inverse Vening-Meinesz (IVM) approach, and predicting bathymetry through the gravity-geological method (GGM). SWOT-derived gravity anomalies in the study area, located between 20&ordm;N - 30&ordm;N and 135&ordm;E - 145&ordm;E, lies at the convergence of the Pacific and Eurasian tectonic plates. &nbsp;KaRIn data (only seven months) recovered gravity anomalies with an accuracy of 2.37 mGal, which is better than current models.</span></p> <p><span>The details of the method are discussed in a manuscript submitted to GRL.</span></p> <p>&nbsp;</p>

opencc-by-4.0Jun 2024View details →
zenodo32/100

IMAD-DS: A Dataset for Industrial Multi-Sensor Anomaly Detection Under Domain Shift Conditions

<p>IMAD-DS is a dataset developed for multi-rate multi-sensor anomaly detection (AD) in industrial environments, that considers varying operational and environmental conditions known as domain shifts.</p> <p><strong>Dataset Overview:</strong></p> <p>This dataset includes data from two scaled industrial machines: a robotic arm and a brushless motor.</p> <p>It includes both normal and abnormal data recorded under various operating conditions to account for domain shifts. These shifts are categorized into:</p> <p>Robotic Arm: The robotic arm is a scaled version of a robotic&nbsp;arm used to move silicon wafers in a factory. Anomalies are created by removing bolts at the nodes of&nbsp;the arm, resulting in an imbalance in the machine.<br>Brushless Motor: The brushless motor is a scaled representation&nbsp;of an industrial brushless motor. Two anomalies&nbsp;are introduced: first, a magnet is moved closer to the motor load,&nbsp;causing oscillations by interacting with two symmetrical magnets&nbsp;on the load; second, a belt that rotates in unison with the motor&nbsp;shaft is tightened, creating mechanical stress.</p> <p>The following domain shifts are included in the dataset:</p> <p>Operational Domain Shifts: Variations caused by changes in machine conditions (e.g., load changes for the robotic arm and speed changes for the brushless motor).</p> <p>Environmental Domain Shifts: Variations due to changes in background noise levels.</p> <p>Combinations of operating and environmental conditions divide each machine's dataset into two subsets: the <em>source domain</em> and the <em>target domain</em>. The source domain has a large number of training examples. The target domain, instead, has limited training data. This discrepancy highlights a common issue in the industry where sufficient training data is often unavailable for the target domain, as machine data is collected under controlled environments that do not fully represent the deployment environments.</p> <p>&nbsp;</p> <p><strong>Data Collection and Processing:</strong></p> <p>Data is collected using the STEVAL-STWINBX1 IoT Sensor Industrial Node. The sensor used to record the dataset are the following.</p> <p>&middot;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Analog Microphone (16 kHz)</p> <p>&middot;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3-axis Accelerometer (6.7 kHz)</p> <p>&middot;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3-axis Gyroscope (6.7 kHz)</p> <p>Recordings are conducted in an anechoic chamber to control acoustic conditions precisely</p> <p><strong>Data Format:</strong><strong><br></strong>Files are already divided into train and test sets. Inside each folder, each sensor's data is stored in a separate '.parquet' file.</p> <p>Sensor files related to the <em>same</em> segment of machine data share a unique ID. The mapping of each machine data segment to the sensor files is given in .csv files inside the train and test folders. Those .csv files also contain metadata denoting the operational and environmental conditions of a specific segment.</p> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p>

opencc-by-sa-4.0Jul 2024View details →
zenodo32/100

Climatological radiation covariance between temperature and radiative heating anomaly composites

Open the record for dataset details and reuse information.

opencc-by-4.0Jul 2024View details →

ScienceDex guides

Understand access before you commit

These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.

Compare curated datasets

Allen Brain Atlas

Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.

allen-brain-atlas
neuroscienceopenDocumentation, web resources, and API references are available online.
Last verified 2026-04-30Open record

Annotated Behaviour and Observability Dataset (ABODe)

ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.

abode-home-cage
behavioral-neuroscienceopenThe DataShare record exposes download links for annotations, documentation, license text, and the zipped per-snippet data directory.
Last verified 2026-04-30Open record

DANDI Archive for NWB datasets

DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.

dandi-nwb
electrophysiologyopenPublished Dandiset metadata and archive endpoints are available through the production DANDI API.
Last verified 2026-04-30Open record

International Brain Laboratory public data

The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.

ibl
behavioral-neuroscienceopenPublic sessions can be searched and loaded from the IBL public data server through ONE.
Last verified 2026-04-29Open record

OpenNeuro

OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.

openneuro
neuroscienceopenPublished datasets are available on demand over the internet.
Last verified 2026-04-29Open record