Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
3
datasets available to search
ShareScore release 0.9.0
Dataset results
3 results for “Power grid frequency”
Pre-Processed Power Grid Frequency Time Series
<p><strong>Overview</strong><br> This repository contains ready-to-use frequency time series as well as the corresponding pre-processing scripts in python. The data covers three synchronous areas of the European power grid:</p> <ul> <li>Continental Europe</li> <li>Great Britain</li> <li>Nordic</li> </ul> <p>This work is part of the paper "Predictability of Power Grid Frequency"[1]. Please cite this paper, when using the data and the code. For a detailed documentation of the pre-processing procedure we refer to the supplementary material of the paper.</p> <p><strong>Data sources</strong><br> We downloaded the frequency recordings from publically available repositories of three different Transmission System Operators (TSOs).</p> <ul> <li><strong>Continental Europe </strong>[2]: We downloaded the data from the German TSO <em>TransnetBW GmbH,</em> which retains the Copyright on the data, but allows to re-publish it upon request [3].</li> <li><strong>Great Britain </strong>[4]: The download was supported by National Grid ESO Open Data, which belongs to the British TSO <em>National Grid</em>. They publish the frequency recordings under the NGESO Open License [5].</li> <li><strong>Nordic</strong> [6]: We obtained the data from the Finish TSO <em>Fingrid</em>, which provides the data under the open license CC-BY 4.0 [7].</li> </ul> <p><strong>Content of the repository</strong></p> <p><strong>A) Scripts</strong></p> <ol> <li>In the "Download_scripts" folder you will find three scripts to automatically download frequency data from the TSO's websites.</li> <li>In "convert_data_format.py" we save the data with corrected timestamp formats. Missing data is marked as NaN (processing step (1) in the supplementary material of [1]).</li> <li>In "clean_corrupted_data.py" we load the converted data and identify corrupted recordings. We mark them as NaN and clean some of the resulting data holes (processing step (2) in the supplementary material of [1]).</li> </ol> <p>The python scripts run with Python 3.7 and with the packages found in "requirements.txt".</p> <p><strong>B) Yearly converted and cleansed data</strong><br> The folders "<year>_converted" contain the output of "convert_data_format.py" and "<year>_cleansed" contain the output of "clean_corrupted_data.py".</p> <ul> <li><strong>File type</strong>: The files are zipped csv-files, where each file comprises one year.</li> <li><strong>Data format</strong>: The files contain two columns. The second column contains the frequency values in Hz. The first one represents the time stamps in the format <em>Year-Month-Day Hour-Minute-Second</em>, which is given as naive local time. The local time refers to the following time zones and includes Daylight Saving Times (python time zone in brackets): <ul> <li>TransnetBW: Continental European Time (<em>CE)</em></li> <li>Nationalgrid: Great Britain (<em>GB</em>)</li> <li>Fingrid: Finland (<em>Europe/Helsinki</em>)</li> </ul> </li> <li><strong>NaN representation</strong>: We mark corrupted and missing data as "NaN" in the csv-files.</li> </ul> <p><strong>Use cases</strong><br> We point out that this repository can be used in two different was:</p> <ul> <li><strong>Use pre-processed data</strong>: You can directly use the converted or the cleansed data. Note however, that both data sets include segments of NaN-values due to missing and corrupted recordings. Only a very small part of the NaN-values were eliminated in the cleansed data to not manipulate the data too much.</li> </ul> <ul> <li><strong>Produce your own cleansed data</strong>: Depending on your application, you might want to cleanse the data in a custom way. You can easily add your custom cleansing procedure in "clean_corrupted_data.py" and then produce cleansed data from the raw data in "<year>_converted".</li> </ul> <p><strong>License</strong></p> <p>This work is licensed under multiple licenses, which are located in the "LICENSES" folder.</p> <ul> <li>We release the code in the folder "Scripts" under the MIT license .</li> <li>The pre-processed data in the subfolders "**/Fingrid" and "**/Nationalgrid" are licensed under CC-BY 4.0.</li> <li>TransnetBW originally did not publish their data under an open license. We have explicitly received the permission to publish the pre-processed version from TransnetBW. However, we cannot publish our pre-processed version under an open license due to the missing license of the original TransnetBW data.</li> </ul> <p><strong>Changelog</strong><br> Version 2:</p> <ul> <li>Add time zone information to description</li> <li>Include new frequency data</li> <li>Update references</li> <li>Change folder structure to yearly folders</li> </ul> <p>Version 3:</p> <ul> <li> <p>Correct TransnetBW files for missing data in May 2016</p> </li> </ul>
Supplementary data: "Revealing drivers and risks for power grid frequency stability with explainable AI"
<p>This repository contains processed data and result files for the paper <a href="https://arxiv.org/abs/2106.04341">Revealing drivers and risks for power grid frequency stability with explainable AI</a>. The code for producing the processed data and the results is <a href="https://github.com/johkruse/XAI-for-grid-frequency-stability">available at github</a>.</p> <p><strong>Data</strong></p> <p>For each area, the data folder contains the feature and target data used to train the ML model.</p> <ul> <li><em>raw_input_data.h5</em><strong> </strong>:<strong> </strong>The aggregated external features without additional engineered features.</li> <li><em>input_forecast.h5 </em>and<em> input_actual.h5: </em>The day-ahead available (forecast) and ex-post available (actual) data of external features including the engineered features.</li> <li><em>outputs.h5 </em>: The grid frequency stability indicators.</li> <li><em>version_2021-07-01</em>: Folder containing the training and test sets used for the results.</li> <li><em>documentation_of_data_download</em><strong>: </strong>Plots and information files concerning the ENTSO-E raw data and its aggregation.</li> </ul> <p><strong>Data sources</strong></p> <p>The data for input features (<em>raw_input_data.h5, input_forecast.h5 </em>and<em> input_actual.h5</em>) is derived from ENTSO-E Transparency Platform data [1]. The target data (<em>outputs.h5</em>) is based on power grid frequency recordings from the German Transmission System Operator TransnetBW [2].</p> <p><strong>Results</strong></p> <p>For each area and each target, the result folder comprises the results of hyper-parameter optimization, model prediction and interpretation via SHAP. The results refer to the full model and the restricted model (containing only day-ahead features).</p> <ul> <li><em>cv_results_gtb_full.csv</em> and <em>cv_results_gtb_day_ahead.csv</em> : Performance results for each combination in the hyper-parameter grid search.</li> <li><em>cv_best_params_gtb_full.csv</em> and <em>cv_best_params_gtb_day_ahead.csv</em> : Hyper-parameters used in the final (optimized) model.</li> <li><em>shap_values_gtb_full.npy</em> and <em>shap_interaction_values_gtb_full.npy </em>: First-order SHAP values and second-order SHAP interaction values for the full model.</li> <li><em>y_pred.h5</em> : Predictions of daily profile predictor, full model and day-ahead model.</li> </ul> <p><strong>Disclaimer</strong></p> <p>The data might be subject to copyright or related rights. Please consult the primary data owner.</p>
Supplementary data: "Physics-informed machine learning for power grid frequency modelling"
<p>This repository contains result files for the paper "Physics-informed machine learning for power grid frequency modelling" <a href="https://doi.org/10.48550/arXiv.2211.01481">(Preprint)</a>. The code for producing the processed data and the results is <a href="https://github.com/johkruse/PIML-for-grid-frequency-modelling">available at github</a>.</p> <p><strong>Results</strong></p> <p>The result folder comprises the results of hyper-parameter optimisation, scaling variation and interpretation via SHAP. In particular, it contains these sub-folders and files:</p> <ul> <li><em>tuning </em>: Results of hyper-parameter tuning.</li> <li><em>best_model </em>: Weights of the trained model with best hyper-parameters.</li> <li><em>best_model_<scaling-variation> </em>: Weights of the trained models with best hyper-parameters but with a variation of the parameter scaling.</li> <li><em>fixed_model_hps.pkl </em>: Hyper-parameters that are not optimised.</li> <li><em>shap_values_<parameter>_long.h5</em> : SHAP values for the prediction of the system parameters.</li> </ul>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.