Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
161
datasets available to search
ShareScore release 0.9.0
Dataset results
161 results for “unsupervised”
Detecting repeating earthquakes on the San Andreas Fault with unsupervised machine-learning of spectrograms (supplementary material)
<p>Supplementary material for Sawi et al., 2023, <i>Detecting repeating earthquakes on the San Andreas Fault with unsupervised machine-learning of spectrograms </i>(The Seismic Record). Catalog of repeating earthquakes in sequences on a 10-km long segment of the San Andreas Fault in California from 1984-2019. </p><p> </p><p><strong>Catalog Header</strong></p><p>YR/MO/DY...........Date of event</p><p>HR/MN/SC...........Time of event</p><p>LAT/LON/DEP........Location of event</p><p>EX/EY/EZ...........Relative location uncertainty (in m)</p><p>MAG................NCSN magnitude</p><p>evID.................NCSN event ID</p><p>seqID................Repeating earthquake sequence ID</p><p>isRESp............Is quasi-periodic RES (bool)</p><p> </p><p><strong>References: </strong></p><p>Sawi T., Waldhauser F., Holtzman B. K., Groebner, N. (2023) Detecting repeating earthquakes on the San Andreas Fault with unsupervised machine-learning of spectrograms. The Seismic Record. </p><p>Waldhauser, F., and Schaff, D. P. (2021). A Comprehensive Search for Repeating Earthquakes in Northern California: Implications for Fault Creep, Slip Rates, Slip Partitioning, and Transient Stress. J Geophys Res B Solid Earth, 126(11), 1–22. <a href="https://doi.org/10.1029/2021JB022495">https://doi.org/10.1029/2021JB022495</a></p>
8 years of dayside Magnetospheric Multiscale (MMS) unsupervised clustering plasma regions classifications
<p>These files contain the 1-minute resolution dataset (“labeled_sunside_data.csv”) and 15 minute or longer region list (“<region_name>_region_list.csv”) for Toy-Edens et al.'s Classifying 8 years of MMS Dayside Plasma Regions via Unsupervised Machine Learning. The 1-minute resolution file contains the rolled up 1-minute epoch, probe name (mms1, mms2, mms3, mms4), features that go into clustering and post-cleansing methods, spacecraft positions (in GSE, GSM, and magnetic latitude/local time), raw and cleansed clustering labels, and transition name. The 15+ minute region lists contain the name of the plasma region type, the probe name (mms1, mms2, mms3, mms4), and the start and stop epoch of >= 15 minute epoch where the probe is solidly within that region. NOTE: for the 15+ minute region lists we are only looking for changes in plasma regions, this means that missing data may artificially inflate the duration of the epoch, we suggest looking at the full 1-minute resolution dataset to confirm the region timing.</p> <p>We ask that if you use any parts of the dataset that you cite Toy-Edens et al.'s Classifying 8 years of MMS Dayside Plasma Regions via Unsupervised Machine Learning (DOI:10.1029/2024JA032431).</p> <p>This work was funded by grant 2225463 from the NSF GEM program.</p> <p> </p> <p>The following tables detail the contents of the described files:</p> <p><strong>labeled_sunside_data.csv description</strong></p> <table> <tbody> <tr> <td> <p><strong>Column Name</strong></p> </td> <td> <p><strong>Description</strong></p> </td> </tr> <tr> <td> <p>Epoch</p> </td> <td> <p>Epoch in datetime</p> </td> </tr> <tr> <td> <p> probe</p> </td> <td> <p>MMS probe name</p> </td> </tr> <tr> <td> <p> ratio_max_width</p> </td> <td> <p>Ratio of the width of the most prominent ion spectra peak (in number of energy channels) to max number of energy channels. See paper for more information</p> </td> </tr> <tr> <td> <p> ratio_high_low</p> </td> <td> <p>Ratio of the mean of the log intensity of high energies in the ion spectra to the mean of the log intensity of low energies in the ion spectra. See paper for more information</p> </td> </tr> <tr> <td> <p> norm_Btot</p> </td> <td> <p>Magnitude of the total magnetic field normalized to 50nT. See paper for more information</p> </td> </tr> <tr> <td> <p> small_energy_mean</p> </td> <td> <p>The denominator in ratio_high_low</p> </td> </tr> <tr> <td> <p> large_energy_mean</p> </td> <td> <p>The numerator in ratio_high_low</p> </td> </tr> <tr> <td> <p> temp_total</p> </td> <td> <p>Total temperature from the DIS moments. See paper for more information</p> </td> </tr> <tr> <td> <p> r_gse_x</p> </td> <td> <p>x position of the spacecraft in GSE</p> </td> </tr> <tr> <td> <p> r_gse_y</p> </td> <td> <p>y position of the spacecraft in GSE</p> </td> </tr> <tr> <td> <p> r_gse_z</p> </td> <td> <p>z position of the spacecraft in GSE</p> </td> </tr> <tr> <td> <p> r_gsm_x</p> </td> <td> <p>x position of the spacecraft in GSM</p> </td> </tr> <tr> <td> <p> r_gsm_y</p> </td> <td> <p>y position of the spacecraft in GSM</p> </td> </tr> <tr> <td> <p> r_gsm_z</p> </td> <td> <p>z position of the spacecraft in GSM</p> </td> </tr> <tr> <td> <p> mlat</p> </td> <td> <p>magnetic latitude of spacecraft</p> </td> </tr> <tr> <td> <p> mlt</p> </td> <td> <p>magnetic local time of spacecraft</p> </td> </tr> <tr> <td> <p> raw_named_label</p> </td> <td> <p>Raw cluster assigned plasma region label (allowed values: magnetosheath, magnetosphere, solar wind, ion foreshock)</p> </td> </tr> <tr> <td> <p> modified_named_label</p> </td> <td> <p>Cleansed cluster assigned plasma region label (use these unless have a specific reason to use raw labels). See paper for more information</p> </td> </tr> <tr> <td> <p> transition_name</p> </td> <td> <p>Transition names (e.g. quasi-perpendicular bow shock, magnetopause). See paper for more information</p> </td> </tr> </tbody> </table> <p> </p> <p><strong><region_name>_region_list.csv description</strong></p> <table> <tbody> <tr> <td> <p><strong>Column Name</strong></p> </td> <td> <p><strong>Description</strong></p> </td> </tr> <tr> <td> <p>start</p> </td> <td> <p>Starting Epoch in datetime</p> </td> </tr> <tr> <td> <p>stop</p> </td> <td> <p>Stopping Epoch in datetime</p> </td> </tr> <tr> <td> <p>probe</p> </td> <td> <p>MMS probe name</p> </td> </tr> <tr> <td> <p>region</p> </td> <td> <p>Cleansed cluster name associated with 1-minute resolution “modified_named_label”</p> </td> </tr> </tbody> </table> <p> </p> <p> </p> <p> </p>
Topic Labels of "Dynamic Topic Modelling for Exploring the Scientific Literature on Coronavirus: An Unsupervised Labelling Technique"
<p>These are the labels generated with the method proposed in the article <em>"Dynamic Topic Modelling for Exploring the Scientific Literature on Coronavirus: An Unsupervised Labelling Technique".</em> These labels are for the 100 and 200 DTM topic models, trained both with the whole corpus and with only the COVID-19 period data </p> <p> </p> <p>For the generation of these labels you can go to the original published work or to the linked Zenodo resource.</p>
Datasets for "Mapping Lunar Swirls with Machine Learning: The Application of Unsupervised and Supervised Classification Algorithms in Reiner Gamma and Mare Ingenii"
<p>Final surface reflectance data at 2.6 m/pixel resolution with floating point values are available as GeoTiff and ASCII text files. Definition files for the K-Means and MLC algorithms in classifying swirl units are also available as ASCII text files. See README file for further details.</p> <p>Data used in the research article:</p> <p>Chuang, F.C., M.D. Richardson, J.R. Weirich, A.A. Sickafoose, and D.L. Domingue, 2022. Mapping Lunar Swirls with Machine Learning: The Application of Unsupervised and Supervised Image Classification Algorithms in Reiner Gamma and Mare Ingenii. The Planetary Science Journal, 3:231. doi://10.3847/PSJ/ac8f43</p> <p> </p>
Swedish Test Data for SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection
<p>This data collection contains the Swedish test data for <a href="https://competitions.codalab.org/competitions/20948">SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection:</a></p> <p>- a Swedish text corpus pair (`corpus1/`, `corpus2/`)<br> - 31 lemmas which have been annotated for their lexical semantic change between the two corpora (`targets.txt`)<br> - the annotated binary change scores of the targets for subtask 1, and their annotated graded change scores for subtask 2 (`truth/`)</p> <p>We sample from the KubHist2 corpus, digitized by the National Library of Sweden, and available through the Språkbanken corpus infrastructure Korp (<a href="https://www.researchgate.net/profile/Markus_Forsberg/publication/266352576_Korp_-_the_corpus_infrastructure_of_Sprakbanken/links/55bf1ee008aed621de121ba3/Korp-the-corpus-infrastructure-of-Sprakbanken.pdf">Borin et al., 2012</a>). The full corpus is available through a CC BY (attribution) license. Each word for which the lemmatizer in the Korp pipelien has found a lemma is replaced with the lemma. In cases where the lemmatizer cannot find a lemma, we leave the word as is (i.e., unlemmatized, no lower-casing). KubHist contains very frequent OCR errors, especially for the older data.More detail about the properties and quality of the Kubhist corpus can be found in (<a href="https://www.diva-portal.org/smash/get/diva2:1358014/FULLTEXT01.pdf#page=28">Adesam et al., 2019</a>).</p> <p>Lars Borin, Markus Forsberg, and Johan Roxendal. "Korp-the corpus infrastructure of Språkbanken." <em>LREC</em>. 2012.</p> <p>Adesam, Yvonne, Dana Dannélls, and Nina Tahmasebi. "Exploring the Quality of the Digital Historical Newspaper Archive KubHist." <em>DHN</em>. 2019.</p> <p>__Corpus 1__</p> <p>- based on: <a href="https://spraakbanken.gu.se/korp/?mode=kubhist">Kubhist2</a><br> - language: Swedish<br> - time covered: 1790-1830<br> - size: ~71 million tokens<br> - format: lemmatized, sentence length > 9 (before removal of punctuation), no punctuation, sentences randomly shuffled<br> - encoding: UTF-8<br> - note: contains frequent OCR errors</p> <p>__Corpus 2__</p> <p>- based on: <a href="https://spraakbanken.gu.se/korp/?mode=kubhist">Kubhist2</a><br> - language: Swedish<br> - time covered: 1895-1903<br> - size: ~111 million tokens<br> - format: lemmatized, sentence length > 9 (before removal of punctuation), no punctuation, sentences randomly shuffled<br> - encoding: UTF-8<br> - note: contains OCR errors</p> <p>Besides the official lemma version of the corpora for SemEval-2020 Task 1 we also provide the raw token version (`corpus1/token/`, `corpus2/token/`). It contains the raw sentences in the same order as in the lemma version. Find more information on the data and SemEval-2020 Task 1 in the paper referenced below.</p> <p> </p> <p>Reference:</p> <p>Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky and Nina Tahmasebi.<a href="https://competitions.codalab.org/competitions/20948">SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection</a>. To appear in SemEval@COLING2020.</p>
Data bundle for "Spherical-angular dark field imaging and sensitive microstructural phase clustering with unsupervised machine learning"
<p>Prepared by Tom McAuliffe (t.mcauliffe17@imperial.ac.uk)</p> <p>This repository is a release of the raw data and analysis results for: 'Spherical-angular dark field imaging and sensitive microstructural phase clustering with unsupervised machine learning' </p> <p>The raw data is given as 'yprime.h5' - this contains patterns and metadata in the Bruker-exported format.</p> <p>Scripts for dataset decomposition into latent factors are given in 'Scripts'.</p> <p>Our spherical analysis code is included in 'SphericalAngleDF'.</p> <p>Outputs of our analysis code are contained in 'Analysis'.</p> <p>Figures for the paper are included in 'Figures'.</p> <p> </p>
Automated MESSENGER Plasma Region Classifications via Unsupervised Transfer Learning
<p>This file contains the 1-minute resolution dataset (“labeled_sunside_data_3labels.csv”) for Toy-Edens et al.’s Automated Classification of MESSENGER Plasma Observations via Unsupervised Transfer Learning. The 1-minute resolution file contains the rolled up 1-minute epoch, features that go into clustering and post-cleaning methods, spacecraft positions (in MSO), total magnetic field, raw and cleaned clustering labels, and raw and cleaned transition name.</p> <p>We ask that if you use any parts of the dataset that you cite Toy-Edens et al.’s Automated Classification of MESSENGER Plasma Observations via Unsupervised Transfer Learning (DOI: 10.3389/fspas.2025.1608091).</p> <p>This work was supported by NASA grants 80NSSC19K0789 and 80NSSC22K0993.</p> <p> </p> <p>The following tables detail the contents of the described files:</p> <p><strong>labeled_sunside_data_3labels.csv description</strong></p> <table style="width: 100.063%; height: 851.2px;"> <tbody> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p><strong>Column Name</strong></p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p><strong>Description</strong></p> </td> </tr> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p> Epoch</p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p>Epoch in datetime (YYYY-MM-DD HH:MM:SS)</p> </td> </tr> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p> x_mso</p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p>x position of the spacecraft in MSO [km]</p> </td> </tr> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p> y_mso</p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p>y position of the spacecraft in MSO [km]</p> </td> </tr> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p> z_mso</p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p>z position of the spacecraft in MSO [km]</p> </td> </tr> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p> btot_mso</p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p>Total magnetic field [nT]</p> </td> </tr> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p> norm_Btot</p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p>Magnitude of the total magnetic field normalized to 150nT. See paper for more information</p> </td> </tr> <tr style="height: 67.2px;"> <td style="width: 17.3792%; height: 67.2px;"> <p> ratio_max_width</p> </td> <td style="width: 78.9512%; height: 67.2px;"> <p>Ratio of the width of the most prominent ion spectra peak (in number of energy channels) to max number of energy channels. See paper for more information</p> </td> </tr> <tr style="height: 67.2px;"> <td style="width: 17.3792%; height: 67.2px;"> <p> ratio_high_low</p> </td> <td style="width: 78.9512%; height: 67.2px;"> <p>Ratio of the mean of the log intensity of high energies in the ion spectra to the mean of the log intensity of low energies in the ion spectra. See paper for more information</p> </td> </tr> <tr style="height: 67.2px;"> <td style="width: 17.3792%; height: 67.2px;"> <p> high_intensity</p> </td> <td style="width: 78.9512%; height: 67.2px;"> <p>Boolean if there is a peak with a higher minimum intensity threshold. See paper for more information</p> </td> </tr> <tr style="height: 67.2px;"> <td style="width: 17.3792%; height: 67.2px;"> <p> spectra_counts</p> </td> <td style="width: 78.9512%; height: 67.2px;"> <p>A ratio of spectra bins with non-zero counts to all possible spectra bins (i.e. way to determine if too much missing spectra data). See paper for more information</p> </td> </tr> <tr style="height: 67.2px;"> <td style="width: 17.3792%; height: 67.2px;"> <p> raw_named_label</p> </td> <td style="width: 78.9512%; height: 67.2px;"> <p>Raw cluster assigned plasma region label (allowed values: magnetosheath, magnetosphere, solar wind)</p> </td> </tr> <tr> <td style="width: 17.3792%;"> <p>intermediate_named_label</p> </td> <td style="width: 78.9512%;"> <p>Cleaned cluster assigned plasma region label with only relabeling rules applied. See paper for more information</p> </td> </tr> <tr style="height: 67.2px;"> <td style="width: 17.3792%; height: 67.2px;"> <p> named_label</p> </td> <td style="width: 78.9512%; height: 67.2px;"> <p>Cleaned cluster assigned plasma region label with relabeling rules and post-processing applied (use these unless have a specific reason to use raw labels). See paper for more information</p> </td> </tr> <tr style="height: 47.6px;"> <td style="width: 17.3792%; height: 47.6px;"> <p> raw_transition_name</p> </td> <td style="width: 78.9512%; height: 47.6px;"> <p>Raw transition names (e.g. bow shock, magnetopause) based on "raw_named_label" cluster labels. See paper for more information</p> </td> </tr> <tr style="height: 67.2px;"> <td style="width: 17.3792%; height: 67.2px;"> <p> transition_name</p> </td> <td style="width: 78.9512%; height: 67.2px;"> <p>Cleaned transition names (e.g. bow shock, magnetopause) after removing likely transient transitions based on "named_label" cluster labels. See paper for more information</p> </td> </tr> </tbody> </table> <p> </p>
The Automotive Visual Inspection Dataset (AutoVI): A Genuine Industrial Production Dataset for Unsupervised Anomaly Detection
<p><strong>See the official website: <a href="https://autovi.utc.fr">https://autovi.utc.fr</a></strong></p> <p>Modern industrial production lines must be set up with robust defect inspection modules that are able to withstand high product variability. This means that in a context of industrial production, new defects that are not yet known may appear, and must therefore be identified.</p> <p>On industrial production lines, the typology of potential defects is vast (texture, part failure, logical defects, etc.). Inspection systems must therefore be able to detect non-listed defects, i.e. not-yet-observed defects upon the development of the inspection system. To solve this problem, research and development of unsupervised AI algorithms on real-world data is required.</p> <p>Renault Group and the Université de technologie de Compiègne (Roberval and Heudiasyc Laboratories) have jointly developed the <em>Automotive Visual Inspection Dataset (AutoVI)</em>, the purpose of which is to be used as a scientific benchmark to compare and develop advanced unsupervised anomaly detection algorithms under real production conditions. The images were acquired on Renault Group's automotive production lines, in a genuine industrial production line environment, with variations in brightness and lighting on constantly moving components. This dataset is representative of actual data acquisition conditions on automotive production lines.</p> <p>The dataset contains 3950 images, split into 1530 training images and 2420 testing images.</p> <p>The evaluation code can be found at <a href="https://github.com/phcarval/autovi_evaluation_code">https://github.com/phcarval/autovi_evaluation_code</a>.</p> <p><strong>Disclaimer</strong><br>All defects shown were intentionally created on Renault Group's production lines for the purpose of producing this dataset. The images were examined and labeled by Renault Group experts, and all defects were corrected after shooting.</p> <p><strong>License</strong><br>Copyright © 2023-2024 Renault Group</p> <p>This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. To view a copy of the license, visit <a href="https://creativecommons.org/licenses/by-nc-sa/4.0/">https://creativecommons.org/licenses/by-nc-sa/4.0/</a>.</p> <p>For using the data in a way that falls under the commercial use clause of the license, please contact us.</p> <p><strong>Attribution</strong><br>Please use the following for citing the dataset in scientific work:</p> <p>Carvalho, P., Lafou, M., Durupt, A., Leblanc, A., & Grandvalet, Y. (2024). The Automotive Visual Inspection Dataset (AutoVI): A Genuine Industrial Production Dataset for Unsupervised Anomaly Detection [Dataset]. <a href="https://doi.org/10.5281/zenodo.10459003">https://doi.org/10.5281/zenodo.10459003</a></p> <p><strong>Contact</strong><br>If you have any questions or remarks about this dataset, please contact us at philippe.carvalho@utc.fr, meriem.lafou@renault.com, alexandre.durupt@utc.fr, antoine.leblanc@renault.com, yves.grandvalet@utc.fr.</p> <p><strong>Changelog</strong></p> <ul> <li><em>v1.0.0</em> <ul> <li>Cropped engine_wiring, pipe_clip and pipe_staple images</li> <li>Reduced tank_screw, underbody_pipes and underbody_screw image sizes</li> </ul> </li> <li><em>v0.1.1</em> <ul> <li>Added ground truth segmentation maps</li> <li>Fixed categorization of some images</li> <li>Added new defect categories</li> <li>Removed tube_fastening and kitting_cart</li> <li>Removed duplicates in pipe_clip</li> </ul> </li> </ul>
Supporting DNN Safety Analysis and Retraining through Heatmap-based Unsupervised Learning
<p>This repository provides the data used for the experiments of the paper "Supporting DNN Safety Analysis and Retraining through Heatmap-based Unsupervised Learning" by Hazem Fahmy, Fabrizio Pastore, Mojtaba Bagherzadeh, and Lionel Briand appearing in IEEE Transactions on Reliability (doi: 10.1109/TR.2021.3074750)</p> <p>Deep neural networks (DNNs) are increasingly important in safety-critical systems, for example in their perception layer to analyze images. Unfortunately, there is a lack of methods to ensure the functional safety of DNN-based components.</p> <p>We observe three major challenges with existing practices regarding DNNs in safety-critical systems: (1) scenarios that are underrepresented in the test set may lead to serious safety violation risks, but may, however, remain unnoticed; (2) char- acterizing such high-risk scenarios is critical for safety analysis; (3) retraining DNNs to address these risks is poorly supported when causes of violations are difficult to determine.</p> <p>To address these problems in the context of DNNs analyzing images, we propose HUDD, an approach that automatically supports the identification of root causes for DNN errors. HUDD identifies root causes by applying a clustering algorithm to heatmaps capturing the relevance of every DNN neuron on the DNN outcome. Also, HUDD retrains DNNs with images that are automatically selected based on their relatedness to the identified image clusters.</p> <p>We evaluated HUDD with DNNs from the automotive domain. HUDD was able to identify all the distinct root causes of DNN errors, thus supporting safety analysis. Also, our retraining approach has shown to be more effective at improving DNN accuracy than existing approaches.</p> <p> </p>
Combined unsupervised and semi-automated supervised analysis of flow cytometry data reveals cellular fingerprint associated with newly diagnosed pediatric type 1 diabetes
<p>Type 1 diabetes is a chronic autoimmune disease resulting in an immune-mediated loss of pancreatic β-cells; however, an unbiased and reproducible profiling of type 1 diabetes-specific circulating immunome at disease onset has yet to be explored. In this study, fresh whole blood was collected from a pediatric cohort of 107 patients with new-onset type 1 diabetes, 85 relatives of patients with type 1 diabetes with 0-1 islet autoantibodies, 58 patients with celiac disease or autoimmune thyroiditis and 76 healthy controls. Up to 6 mL of blood was collected from each subject into a VACUETTE® TUBE 6 ml ACD-B (Greiner). Fresh whole blood underwent red blood cell lysis, was washed and stained with specific monoclonal antibodies. Fresh whole blood samples were stained with five panels of antibodies labelled as T cells, T&NK cells, B cells, Tregs and DCs/monos encompassing main subsets of T cells, NK cells, B cells, Tregs, DCs and monocytes detected using 26 surface markers and the intracellular marker forkhead box P3 (FoxP3); for the Treg panel, intracellular staining was performed after fixation and permeabilization. Cells were acquired on a BD FACSCanto-II flow cytometer equipped with FACSDiva software (Becton Dickinson, Franklin Lakes, NJ). </p>
Unsupervised New Physics detection at 40 MHz: h+ -> tau nu Signal Benchmark Dataset
<p>Unsupervised New Physics detection at 40 MHz data challenge</p> <p>Signal Benchmark Dataset consisting of h+ -> tau nu decays produced in collision events (simulation of LHC 13 TeV proton-proton collisions) pre-filtered by a requirement of a muon or electron with 23 GeV transverse momentum. Data format description available on the data challenge web page: https://mpp-hep.github.io/ADC2021/</p>
Unsupervised New Physics detection at 40 MHz: h^0 -> tau tau Signal Benchmark Dataset
<p>Unsupervised New Physics detection at 40 MHz data challenge</p> <p>Signal Benchmark Dataset consisting of h^0 -> tau tau decays produced in collision events (simulation of LHC 13 TeV proton-proton collisions) pre-filtered by a requirement of a muon or electron with 23 GeV transverse momentum. Data format description available on the data challenge web page: https://mpp-hep.github.io/ADC2021/</p>
Unsupervised New Physics detection at 40 MHz: LQ -> b tau Signal Benchmark Dataset
<p>Unsupervised New Physics detection at 40 MHz data challenge</p> <p>Signal Benchmark Dataset consisting of Leptoquarks -> b tau decays produced in collision events (simulation of LHC 13 TeV proton-proton collisions) pre-filtered by a requirement of a muon or electron with 23 GeV transverse momentum. Data format description available on the data challenge web page: https://mpp-hep.github.io/ADC2021/</p>
Unsupervised New Physics detection at 40 MHz: Black Box Dataset
<p>Unsupervised New Physics detection at 40 MHz data challenge</p> <p>Signal Benchmark Dataset consisting of the signal+background Black Box datasets, containing collision events (simulation of LHC 13 TeV proton-proton collisions) pre-filtered by a requirement of a muon or electron with 23 GeV transverse momentum. Data format description available on the data challenge web page: https://mpp-hep.github.io/ADC2021/</p>
Unsupervised New Physics detection at 40 MHz: Training Dataset
<p>Unsupervised New Physics detection at 40 MHz data challenge</p> <p>Training dataset, consisting of a cocktail of Standard Model collision events (simulation of LHC 13 TeV proton-proton collisions) pre-filtered by a requirement of a muon or electron with 23 GeV transverse momentum. Data format description available on the data challenge web page: https://mpp-hep.github.io/ADC2021/</p>
Unsupervised New Physics detection at 40 MHz: A -> 4 leptons Signal Benchmark Dataset
<p>Unsupervised New Physics detection at 40 MHz data challenge</p> <p>Signal Benchmark Dataset consisting of A -> 4 leptons decays produced in collision events (simulation of LHC 13 TeV proton-proton collisions) pre-filtered by a requirement of a muon or electron with 23 GeV transverse momentum. Data format description available on the data challenge web page: https://mpp-hep.github.io/ADC2021/</p>
Research data supporting: "Unsupervised Data-Driven Reconstruction of Molecular Motifs in Simple to Complex Dynamic Micelles"
<p>This repository contains the set of data shown in the paper <strong>"Unsupervised Data-Driven Reconstruction of Molecular Motifs in Simple to Complex Dynamic Micelles"</strong>, published on The Journal of Physical Chemistry B (DOI:10.1021/acs.jpcb.2c08726).</p>
Original data for article "Is Unsupervised Dimensionality Reduction Sufficient to Decode the Complexities of Electrochemical Impedance Spectra?"
<p>The uploaded Jupyter notebooks contain original data generation and processing methods used in the article "Is Unsupervised Dimensionality Reduction Sufficient to Decode the Complexities of Electrochemical Impedance Spectra?" by A. Makogon, F. Kanoufi, and V. Shkirskiy</p>
Dragon_Pi: IoT Side-Channel Power Data Intrusion Detection Dataset and Unsupervised Convolutional Autoencoder for Intrusion Detection
<h2><strong>Dragon_Pi</strong></h2> <div> <div>For a more in depth description of the Dragon_Pi dataset, please consult the journal article of the same name:</div> <div>Lightbody <em>et al.</em>, Future Internet, 2024, <a href="https://doi.org/10.3390/fi16030088">https://doi.org/10.3390/fi16030088</a> - specifically Section 3.2: Dataset Overview.</div> <div> </div> </div> <p>Dragon_Pi is an intrusion detection dataset for IoT devices. In the field of IoT security there are few datasets, and those which do exist tend to focus solely on network traffic. The Dragon_Pi dataset seeks to provide not only more data for the field of IoT security, but also, data of a somewhat under-published type: linear time series power consumption data.</p> <p>Dragon_Pi is a fully labelled Intrusion Detection dataset for IoT devices. It is composed of both normal and under-attack power consumption data obtained from two separate testbeds - one using a DragonBoard 410c and the other a Raspberry Pi Model 3 - Hence the moniker <em>Dragon_Pi</em>. </p> <p>These testbeds were set up with predefined normal behavour as described in the attached publications. The normal linear time series power consumption was sampled from the testbed under these normal conditions. Both testbeds were then attacked using some common attacks on IoT - the linear time series power consumption captured under these condtions as well. </p> <p>Specifically, the testbeds were subjected to the Port Scan (using Nmap), SSH Brute Force (using Hydra) and SYNFlood Denial of Service (using Hping3) attacks. These attacks were repeated to gain insight to what their signatures looked like and also how varying the tool settings effected the resultant signature. A fourth type of scenario was also conducted on the testbeds - the "Capture the Flag" scenarios. In these files multiple attack types were used with a more specific target - to exfiltrate a hidden file from the testbeds.</p> <p>Each file has three hierarchical levels of annotation for <strong>each sample</strong> within:</p> <ol> <li>A simple "Normal or Anomaly" label for the specific sample</li> <li>A specifc attack type label e.g. "SSH Bruteforce", for the specific sample</li> <li>A specific tool setting for that attack e.g. "Hydra_T16", for the specific sample</li> </ol> <p>Users can decide for themselves what level of annotation they require for their specific task. </p> <p>Each file in the Dragon_Pi dataset is accompanied by its own legend file. This file explains the contents of the specific .csv file and the specific indexes of the events within.</p> <p>The Dragon_Pi dataset consists of approximately 67 files, as shown in Table 1. Compressed, the datset totals approximately 13GB. Completely decompressed the dataset is approximately 80GB ( 30GB Pi data, 50 GB Dragon data). </p> <div> </div> <div> <table> <tbody> <tr> <td>Label Type</td> <td>Specific Label </td> <td>Number of Files DragonBoard 410c</td> <td>Number of Files Raspberry Pi</td> </tr> <tr> <td>Normal </td> <td>Normal </td> <td>3 </td> <td>2</td> </tr> <tr> <td>Port Scan Attack </td> <td>Nmap_T5</td> <td>2</td> <td>1</td> </tr> <tr> <td> </td> <td>Nmap_T4</td> <td>1</td> <td>1</td> </tr> <tr> <td> </td> <td>Nmap_T3</td> <td>1</td> <td>1</td> </tr> <tr> <td> </td> <td>Nmap_T2</td> <td>1</td> <td>1</td> </tr> <tr> <td>SSH Brute Force</td> <td>Hydra_T32</td> <td>4</td> <td>2</td> </tr> <tr> <td> </td> <td>Hydra_T16</td> <td>16</td> <td>2</td> </tr> <tr> <td> </td> <td>Hydra_T3</td> <td>8</td> <td>2</td> </tr> <tr> <td> </td> <td>Hydra_T1</td> <td>5</td> <td>2</td> </tr> <tr> <td>SYNFlood DOS</td> <td>SYNFlood DOS</td> <td>1</td> <td>1</td> </tr> <tr> <td>Capture the Flag</td> <td>Misc Attacks</td> <td>3</td> <td>5</td> </tr> </tbody> </table> </div> <div>Table 1. Enumeration of the in the Dragon_Pi dataset.</div> <div> </div> <div> </div> <div>For a more in depth description of the Dragon_Pi dataset, please consult the journal article of the same name:</div> <div>Lightbody <em>et al.</em>, Future Internet, 2024, <a href="https://doi.org/10.3390/fi16030088">https://doi.org/10.3390/fi16030088</a> - specifically Section 3.2: Dataset Overview.</div> <div> </div> <div> </div> <div><strong>Publication of this dataset:</strong></div> <div> </div> <div>This dataset was published in Lightbody <em>et al.</em>, Future Internet, 2024, <a href="https://doi.org/10.3390/fi16030088">https://doi.org/10.3390/fi16030088</a>. Consult and cite this article for a more in depth dataset description, as well as an in depth review of first AI Intrusion Detection model trained on this dataset. </div> <div> </div> <div>See article Lightbody <em>et al.</em>, Future Internet, 2023, <a href="https://doi.org/10.3390/fi15050187">https://doi.org/10.3390/fi15050187</a> for a detailed investigation on the attack signatures discovered while creating this dataset. This work was an inital investigation of the dataset and can serve as a part 1 to the Dragon_Pi paper.</div> <div> </div> <div> </div> <div><strong>How to cite this dataset in your work: </strong></div> <div> </div> <div>Please cite these two DOIs when publishing using this dataset:</div> <div> <ol> <li>Dragon_Pi release publication: <a href="https://doi.org/10.3390/fi16030088">https://doi.org/10.3390/fi16030088</a> (most important)</li> <li>Zenodo Dataset DOI: https://doi.org/10.5281/zenodo.10784947</li> </ol> </div> <div> <div> </div> </div> <p> </p>
Dataset of structural and energetic descriptors for optimized geometries of the pyrene dimer in the S1 state and Jupyter Notebbok used for the unsupervised clustering, analysis and visualization
<p>Geometrical and energy data extracted from a set of 188 optimized geometries for the pyrene dimer in the first excited singlet state at the TD-CAMB3LYP + D3BJ / 6-31G* / C-CPCM(Cyclohexane) level. </p> <p>Coordinates (in xyz format) of the 188 optimized geometries considered.</p> <p>Jupyter notebook used to perform unsupervised clustering and analysis of the available structures.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.