Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
1,782
datasets available to search
ShareScore release 0.7.1
Dataset results
1,782 results for “algorithms”
Dataset for algorithmic thinking skills assessment: Results from the virtual CAT large-scale study in Swiss compulsory education
<p><strong>Overview</strong><br>This dataset was collected during a main study that evaluated the virtual Cross Array Task (CAT) platform as an assessment tool for algorithmic thinking (AT) skills among K-12 students in Swiss compulsory education.<br>As algorithmic thinking becomes increasingly vital in our digital age, this study bridges the gap between traditional assessments and the needs of today's learners by introducing a digital platform. The virtual CAT, a digital adaptation of an unplugged assessment activity, offers scalable, automated assessments with reduced human intervention.</p> <p><strong>Study Context, Location and Participants</strong><br>To comprehensively investigate algorithmic competencies within compulsory education, exploring their variations and determining the factors influencing them, in Spring 2023 we conducted an experimental study with the virtual CAT's.<br>The sample comprises 129 students (65 girls and 64 boys), selected from nine classes across five public schools in Ticino and Solothurn cantons.</p> <p><strong>Data Collection</strong><br>During the data collection process, session and participant details were manually recorded by the administrator. <br>Each session has been assigned a unique identifier, and specific details, such as the date, canton, school name and type, and the students’ HarmoS grade (HG) level, have been recorded. <br>Student information are limited to sex and date of birth, with birth dates used to calculate ages, a significant factor in our demographic analysis. <br>To protect student privacy, unique identifiers have been assigned to each participant, keeping the data anonymous and secure. <br>The assessment tool automatically tracked all user interaction within the platform.<br>All data collected have been pseudonymised, aligning with prevailing open science practices in Switzerland (SNSF, 2021). <br>Data collection was integrated into a validation module of the app. </p> <p><strong>Data Features</strong><br>The dataset comprises the following files:</p> <ul> <li>STUDENTS_SESSIONS.csv</li> <li>RESULTS.csv</li> <li>LOGS.csv</li> <li>CANTONS.csv</li> <li>ALGORITHMS.csv</li> </ul> <p>These files collectively provide insights into the algorithmic actions of the students, demographic details, session logs, results, and more.</p> <p><strong>Usage & Ethics</strong><br>In the spirit of open science, this dataset is made available to the public after meticulous anonymisation to ensure all participants' privacy and ethical treatment. <br>Initial authorisations were secured from school administrators, teachers, and parents. <br>Detailed communication regarding the study's nature, data handling, and objectives was transparently shared with all stakeholders.</p> <p><strong>REFERENCES</strong></p> <p><strong>[1]</strong> A. Piatti, G. Adorni, L. El-Hamamsy, L. Negrini, D. Assaf, L. Gambardella & F. Mondada. (2022). The CT-cube: A framework for the design and the assessment of computational thinking activities. Computers in Human Behavior Reports, 5, 100166. <a href="https://doi.org/10.1016/j.chbr.2021.100166">https://doi.org/10.1016/j.chbr.2021.100166</a></p> <p><strong>[2]</strong> Adorni, G., & Piatti, S., & Karpenko, V. (2023). virtual CAT: An app for algorithmic thinking assessment within Swiss compulsory education. Zenodo Software. <a href="https://doi.org/10.5281/zenodo.10027851">https://doi.org/10.5281/zenodo.10027851</a> On GitHub: <a href="https://github.com/GiorgiaAuroraAdorni/virtual-CAT-app/">https://github.com/GiorgiaAuroraAdorni/virtual-CAT-app/</a></p> <p><strong>[3]</strong> Adorni, G., & Karpenko, V. (2023). virtual CAT programming language interpreter. Zenodo Software. <a href="https://doi.org/10.5281/zenodo.10016535">https://doi.org/10.5281/zenodo.10016535</a> On GitHub: <a href="https://github.com/GiorgiaAuroraAdorni/virtual-CAT-programming-language-interpreter/">https://github.com/GiorgiaAuroraAdorni/virtual-CAT-programming-language-interpreter/</a></p> <p><strong>[4]</strong> Adorni, G., & Karpenko, V. (2023). virtual CAT data infrastructure. Zenodo Software. <a href="https://doi.org/10.5281/zenodo.10015011">https://doi.org/10.5281/zenodo.10015011</a> On GitHub: <a href="https://github.com/GiorgiaAuroraAdorni/virtual-CAT-data-infrastructure">https://github.com/GiorgiaAuroraAdorni/virtual-CAT-data-infrastructure</a></p> <p> </p>
Dataset for algorithmic thinking skills assessment: Results from the virtual CAT pilot study in Swiss compulsory education
<p><strong>Overview</strong><br>This dataset was collected during a pilot study that evaluated the virtual Cross Array Task (CAT) platform as an assessment tool for algorithmic thinking (AT) skills among K-12 students in Swiss compulsory education.<br>As algorithmic thinking becomes increasingly vital in our digital age, this study bridges the gap between traditional assessments and the needs of today's learners by introducing a digital platform. The virtual CAT, a digital adaptation of an unplugged assessment activity, offers scalable, automated assessments with reduced human intervention.</p><p><strong>Study Context, Location and Participants</strong><br>To demonstrate the virtual CAT's effectiveness, we conducted a pilot study in March 2023.<br>The study was conducted in Switzerland, specifically within the Ticino canton.<br>The sample consisted of 31 students (21 girls and 10 boys) from a preschool class (ages 4-6) and two low secondary classes (1st grade, ages 11-12). </p><p><strong>Data Collection</strong><br>Data collection was integrated into a validation module of the app. <br>Sessions required manual input for details like date, canton, and school information. <br>Students' details, anonymised for privacy, encompassed their gender and date of birth. <br>Each interaction within the platform was meticulously logged, capturing operations like task confirmations, command updates, mode changes, and more.</p><p><strong>Data Features</strong><br>The dataset comprises the following files:</p><ul><li>ALGORITHMS.csv</li><li>CANTONS.csv</li><li>DF.csv</li><li>LOGS.csv</li><li>RESULTS.csv</li><li>SCHOOLS.csv</li><li>SESSIONS.csv</li><li>STUDENTS_SESSIONS.csv</li></ul><p>These files collectively provide insights into the algorithmic actions of the students, demographic details, session logs, results, and more.</p><p><strong>Usage & Ethics</strong><br>In the spirit of open science, this dataset is made available to the public after meticulous anonymisation to ensure all participants' privacy and ethical treatment. <br>Initial authorisations were secured from school administrators, teachers, and parents. <br>Detailed communication regarding the study's nature, data handling, and objectives was transparently shared with all stakeholders.</p><p> </p><p><strong>REFERENCES</strong></p><p><strong>[1]</strong> A. Piatti, G. Adorni, L. El-Hamamsy, L. Negrini, D. Assaf, L. Gambardella & F. Mondada. (2022). The CT-cube: A framework for the design and the assessment of computational thinking activities. Computers in Human Behavior Reports, 5, 100166. <a href="https://doi.org/10.1016/j.chbr.2021.100166">https://doi.org/10.1016/j.chbr.2021.100166</a></p><p><strong>[2]</strong> Adorni, G., & Piatti, S., & Karpenko, V. (2023). virtual CAT: An app for algorithmic thinking assessment within Swiss compulsory education. Zenodo Software. <a href="https://doi.org/10.5281/zenodo.10027851">https://doi.org/10.5281/zenodo.10027851</a> On GitHub: <a href="https://github.com/GiorgiaAuroraAdorni/virtual-CAT-app/">https://github.com/GiorgiaAuroraAdorni/virtual-CAT-app/</a></p><p><strong>[3]</strong> Adorni, G., & Karpenko, V. (2023). virtual CAT programming language interpreter. Zenodo Software. <a href="https://doi.org/10.5281/zenodo.10016535">https://doi.org/10.5281/zenodo.10016535</a> On GitHub: <a href="https://github.com/GiorgiaAuroraAdorni/virtual-CAT-programming-language-interpreter/">https://github.com/GiorgiaAuroraAdorni/virtual-CAT-programming-language-interpreter/</a></p><p><strong>[4]</strong> Adorni, G., & Karpenko, V. (2023). virtual CAT data infrastructure. Zenodo Software. <a href="https://doi.org/10.5281/zenodo.10015011">https://doi.org/10.5281/zenodo.10015011</a> On GitHub: <a href="https://github.com/GiorgiaAuroraAdorni/virtual-CAT-data-infrastructure">https://github.com/GiorgiaAuroraAdorni/virtual-CAT-data-infrastructure</a></p>
Dataset used for evaluation of GRASP-AOD algorithm
<p><strong>Dataset used for evaluation of GRASP-AOD algorithm</strong></p> <p>30 AERONET sites where processed using GRASP v1.0.0 and following the methodology described in Torres et. al 2017 and Torres et Fuertes 2020. More sites and data can be found at <a href="http://www.grasp-open.com">www.grasp-open.com</a> .</p> <p>31 files can be found. 30 Files described the 30 AERONET sites used for GRASP-AOD validation while the file aureole_Granada.csv is used in the section 4.2 for GRASP-AUR test.</p> <p>Description of the columns that can be found in the datafiles:</p> <ul> <li>date</li> <li>FineModeMedianRadius</li> <li>FineModeGeometricStandardDeviation</li> <li>FineModeVolumeConcentration</li> <li>CoarseModeMedianRadius</li> <li>CoarseModeGeometricStandardDeviation</li> <li>CoarseModeVolumeConcentration</li> <li>VolumeConcentration</li> <li>Effective radius</li> <li>abs_error</li> <li>rel_error</li> <li>aod500_fine</li> <li>aod500_coarse</li> <li>aod380_retrieved</li> <li>aod440_retrieved</li> <li>aod500_retrieved</li> <li>aod870_retrieved</li> <li>aod1020_retrieved</li> <li>input380nm</li> <li>input440nm</li> <li>input500nm</li> <li>input870nm</li> <li>input1020nm</li> <li>exist_380nm</li> <li>exist_440nm</li> <li>exist_500nm</li> <li>exist_870nm</li> <li>exist_1020nm</li> <li>number_of_wavelengths</li> <li>min_wavelength</li> <li>max_wavelength</li> <li>climatology_method</li> <li>wavelengths_used</li> </ul> <p><strong><em>Please follow the data policy of each data source:</em></strong></p> <p>GRASP-AOD: GRASP-OPEN (<a href="https://www.grasp-open.com/products/">https://www.grasp-open.com/products/</a>)</p> <p>AERONET: <a href="http://www.aeronet.gsfc.nasa.gov/">http://www.aeronet.gsfc.nasa.gov</a></p> <p>Details can be found in manuscript:</p> <p>Torres B. et Fuertes D., Characterisation of aerosol size properties from measurements of spectral optical depth: a global validation of the GRASP-AOD code using long-term AERONET data, sent to review on 2020</p>
Evaluation Framework for Multiband Image Enhancement and Blending Algorithms in Enhanced Flight Vision Systems - Image Dataset
<p>This dataset contains data used in the research published by MLabs Optronics in the paper:</p> <p>Medina Heierle, Victor, María Tejada Casado, Alberto Briasco González, Hugo Jestes Zoilo, Jesús Martín Tapia, Adeodato Altamirano Aguilar, and Javier Muñoz De Luna Clemente. Evaluation Framework for Multiband Image Enhancement and Blending Algorithms in Enhanced Flight Vision Systems. Proceedings of the 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), pp. 274-280. IEEE, 2018.</p> <p><br> The dataset is classified into 3 folders:</p> <p>- IR_VIS: Contains 28 pairs of images in the IR (some images may be in the NIR spectrum instead) and Visual spectrum, taken from different public repositories off the internet, which are typically used in multispectral fusion research.<br> <br> - Fusion: Contains 8 sets with the results of applying each of the 4 fusion algorithms described in the paper on some of the images in folder "IR_VIS".</p> <p>- VIS haze filtering: Contains 24 images taken with a CCD camera of a contrast target inside a fog simulation cabin in a laboratory. For comparison purposes, all images have been taken with a similar amount of fog, which is as much as was possible while still being able to see the target with the camera through the fog. Each image has been taken with a different type of filter (filter information is provided in another image inside the folder).</p> <p> </p> <p>Mlabs Optronics<br> PTA<br> Calle Pierre Laffitte, 8<br> 29590 Málaga (Spain)</p> <p>www.mlabsoptronics.com<br> info@mlabsoptronics.com</p>
Webis-WebSeg-20-Algorithm-Segmentations
<p>This dataset contains the segmentations of five segmentation algorithms, one ensemble, and one baseline algorithm for the pages of the <a href="https://doi.org/10.5281/zenodo.3354902">Webis-WebSeg-20</a> dataset. If you use this dataset in your research, please cite it using <a href="https://webis.de/publications.html?q=An+Empirical+Comparison+of+Web+Page+Segmentation+Algorithms">this paper</a>.</p>
Data from: An implicit, conservative electrostatic particle-in-cell algorithm for paraxial magnetic nozzles
<p><strong> Data from: An implicit, conservative electrostatic particle-in-cell algorithm for paraxial magnetic nozzles</strong></p> <p>- Authors: Pedro Jimenez, Luis Chacon, Mario Merino</p> <p>- Contact email: pejimene@ing.uc3m.es</p> <p>- Date: 2024-02-09</p> <p>- Keywords: electric propulsion, plasma simulation, magnetic nozzles, implicit particle-in-cell (PIC)</p> <p>- Version: 1.2</p> <p>- Digital Object Identifier (DOI): 10.5281/zenodo.8081962</p> <p>- License: This dataset is made available under the <a href="http://opendatacommons.org/licenses/by/1.0">Open Data Commons Attribution License</a></p> <p><strong>Abstract</strong></p> <p>This dataset contains the data found in the plots of the journal article:</p> <p><a href="https://www.sciencedirect.com/science/article/pii/S0021999124000755?via%3Dihub">Pedro Jimenez, Luis Chacon, Mario Merino, "An implicit, conservative electrostatic particle-in-cell algorithm for paraxial magnetic nozzles"</a></p> <p>The data in this repository are the results of kinetic plasma simulations as described in the reference. For further information on the setup for the simulation please refer to the article.</p> <p><strong>Data Files</strong></p> <p>The data files are in .csv format. They were produced in Julia using <a href="http://csv.juliadata.org/stable/)">CSV.jl</a> and <a href="https://dataframes.juliadata.org/stable/">DataFrames.jl</a> libraries.</p> <p>The files are organised following the order of the figures in the article. All the plots are 1D series, the first column corresponding to the x-axis data. Y-axis data is presented in the following columns, the total number of additional columns is equal to the number of line series. The title of each series is found in the first row of the .csv files. Please find below some specificalities in certain figures:</p> <p>- The columns for the time evolution in <strong>fig6_left.csv</strong> and<strong> fig6_right.csv </strong>(corresponding to the actual left and right columns in the figure i.e. cases A and B) contain a field tag followed by the corresponding time step (e.g. phi_500).</p> <p>- Due to the different number of nodes, steady state fields for cases A and B are saved in <strong>fig8_a-f.csv</strong> while cases AF and BF are saved in <strong>fig8_a-f_fine.csv</strong>.</p> <p>The rest of the data files should be self descripting</p> <p><strong>Citation</strong></p> <p>Any works using this dataset or any part of it in any form shall cite it as follows:</p> <p>The prefered means of citation is to reference the publication asociated to the jounal article with DOI: <a href="https://doi.org/10.1016/j.jcp.2024.112826">10.1016/j.jcp.2024.112826</a></p> <p>The BibTex is also provided for the sake of convinience:</p> <pre>@article{jimenez2024implicit, title={An implicit, conservative electrostatic particle-in-cell algorithm for paraxial magnetic nozzles}, author={Jim{\'e}nez, Pedro and Chac{\'o}n, Luis and Merino, Mario}, journal={Journal of Computational Physics}, pages={112826}, year={2024}, publisher={Elsevier} }</pre> <p>Optionally the dataset can be cited by referencing the corresponding DOI:</p> <p><a href="https://doi.org/10.5281/zenodo.8081962">https://doi.org/10.5281/zenodo.8081962</a></p> <p><strong>Acknowledgments</strong></p> <p>This dataset was created by the [ERC-ZARATHUSTRA project](https://erc-zarathustra.uc3m.es/).</p> <p>The ERC-ZARATHUSTRA project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 950466).</p>
Labeled Images at OBSEA for Object Detection Algorithms
<p>Images from OBSEA underwater cameras labeled with marine species to train AI-based Object Detection algorithms.</p>
Coefficients for the SMACPy atmospheric correction algorithm
<p>This dataset stores coefficients used by the updated Simplified Method for Atmospheric Correction - Python (SMACPy). The coefficients are used, together with meteorological data, to remove the effects of atmospheric gases and aerosols from a satellite image.</p> <p>Currently, this is a beta version and more updates to these coefficients may be expected in the future.</p> <p> </p> <p>Coefficients exist for various aerosol types, all defined from the equivalent 6S (<a href="https://doi.org/10.1109/36.581987">10.1109/36.581987</a>) aerosol types:</p> <p>BIOMA: Biomass burning plumes.</p> <p>CONTI: Continental aerosol.</p> <p>DESER: Desert dust aerosol.</p> <p>MARIT: Maritime aerosol, primarily sea salt.</p> <p>STRATO: Stratospheric aerosol.</p> <p>URBAN: Urban pollution aerosol.</p> <p>NOAER: A profile with no aerosol effects, just atmospheric gases and Rayleigh scattering.</p> <p> </p> <p> </p> <p>In this version the following satellites / sensors are supported:</p> <p>NASA Aqua / MODIS</p> <p>NASA Terra / MODIS</p> <p>Fengyun-4A / AGRI</p> <p>GEO-KOMPSAT-2A / AMI</p> <p>GOES-16 / ABI</p> <p>GOES-17 / ABI</p> <p>Himawari-8 / AHI</p> <p>Landsat-8 / OLI</p> <p>Meteosat-8 / SEVIRI (no HRV channel)</p> <p>Meteosat-9 / SEVIRI (no HRV channel)</p> <p>Meteosat-10 / SEVIRI (no HRV channel)</p> <p>Meteosat-11 / SEVIRI (no HRV channel)</p> <p>NOAA-20 / VIIRS (M and I bands)</p> <p>Suomi-NPP / VIIRS (M and I bands)</p> <p>Sentinel-2A / MSI</p> <p>Sentinel-2B / MSI</p> <p>Sentinel-3A / OLCI</p> <p>Sentinel-3B / OLCI</p> <p>Sentinel-3A / SLSTR</p> <p>Sentinel-3B / SLSTR</p> <p> </p>
Super-resolving ocean dynamics from space with computer vision algorithms: training datasets
<p>We provide here the datasets used for the development of the dilated Adaptive Residual Network for the super-resolution of ocean Absolute Dynamic Topography described in <em>Buongiorno Nardelli et al.</em> (2022). The model is designed to combine satellite altimetry and thermal observations and provides super-resolved dynamic topography. The training/test datasets have been built starting from the data originally prepared for an Observing System Simulation Experiment carried out in the framework of the European Space Agency CIRCOL project [<em>Ciani et al.</em>, 2021]. They consist of one year of synthetic daily Absolute Dynamic Topography (ADT), surface geostrophic currents and sea surface temperature data obtained from Copernicus Marine Service Mediterranean Forecasting System (MFS) (Product ID: MEDSEA-ANALYSIS- FORECAST-PHY-006-013) [<em>Clementi et al. 2021</em>]. Synthetic Altimeter-derived ADT maps were obtained by first sampling the model output along the actual tracks of a synthetic constellation composed of 4 Radar Altimeters: Jason-3, Sentinel-3A, SARAL/Altika, and Cryosat-2 missions (this step is achieved by running the SWOT simulator software [<em>Gaultier et al.</em>, 2016]) and successively applying the DUACS (<em>Data Unification and Altimeter Combination System)</em> mapping method. The original input images cover the entire Mediterranean domain at 1/24° spatial resolution, leading to an individual image size of 380x1000 pixels. Here, we have randomly chosen 40 dates (~11% of the total) to be kept aside as fully independent test data, and successively re-sampled the original images extracting much smaller tiles (76x100), which are used as input to the network training. The tiles are extracted by going through a double loop on latitude and longitude, imposing a spatial overlap of 50%. Full details on data pre-processing (e.g.normalization strategies) are given in the paper:</p> <ul> <li>Buongiorno Nardelli, B.; Cavaliere, D.; Charles, E.; Ciani, D. Super-Resolving Ocean Dynamics from Space with Computer Vision Algorithms. <em>Remote Sens.</em>, <strong>2022</strong>, 14, 1159. https://doi.org/10.3390/rs14051159</li> </ul>
Supplementary materials to the paper: Automatic Parameters Tuning of Late Reverberation Algorithms for Audio Augmented Reality
<p>Supplementary materials to the paper:</p> <blockquote> <p>Riccardo Bona, Davide Fantini, Giorgio Presti, Marco Tiraboschi, Isaac Engel and Federico Avanzini. 2022. Automatic Parameters Tuning of Late Reverberation Algorithms for Audio Augmented Reality. In <em>Proceedings of International Conference on Audio Mostly</em>.</p> </blockquote> <p>The supplementary materials include the reverberated audio stimuli employed in the MUSHRA listening test reported in the paper. For each type of audio stimuli (Drums, Sax and Speech) the version reverberated with each of the six target Room Impulse Responses (RIRs) is provided along with the versions reverberated using the reverb matching method proposed in the paper (two different artificial reverberators have been considered: FDN and Freeverb).</p> <p>Further, the reverberation times (<span class="math-tex">\(T_{20}\)</span>) per octave band for each considered RIR are provided.</p>
ICESat-2 Arctic Sea Ice Surface Topography from the University of Maryland-Ridge Detection Algorithm: April 2019, 2020, and 2021
<p>This dataset is derived from the ICESat-2 (IS-2) Global Geolocated Photon Height Product (ATL03) using the University of Maryland-Ridge Detection Algorithm (UMD-RDA). The UMD-RDA is applied to ATL03 on a per-shot basis, nominally resulting in elevation measurements at IS-2's maximum along-track resolution of ~0.7 m. From these elevation measurements, the UMD-RDA can measure various sea ice parameters including, but not limited to, individual ridge crests and their respective sail heights, the distance between ridges, and sea ice surface roughness.</p> <p><strong>********Changes in Version 2********</strong></p> <p><em>Version 2 includes a column for time (seconds since 2018-01-01) in all parameter files in addition to longitude, latitude, and parameter value.</em></p> <p><em>The full resolution UMD-RDA derived elevation data was too large to host here, but is available upon request. If you need a particular track or segment for your research please contact me with your request by email: kd</em><em>uncan at umd dot edu</em></p>
An automatic fascicle tracking algorithm quantifying gastrocnemius architecture during maximal effort contractions
<p>This repository includes all the experimental data, tracking code, and tracked trials reported in Drazan JF, Hullfish TJ, Baxter JR. 2019. An automatic fascicle tracking algorithm quantifying gastrocnemius architecture during maximal effort contractions. <em>PeerJ</em> 7:e7120. DOI: <a href="https://doi.org/10.7717/peerj.7120">10.7717/peerj.7120</a>.</p> <p>Updated tracking code will be maintained on github https://github.com/joshrbaxter/ultrasound_tracking</p> <p>To get started - download the 'matlab' and 'Sample Videos' folders and unzip them into a common directory. If you are having path issues (will first appear when trying to pull the Data structure), then these folders are either in the wrong path or the path separators are incorrect (this was developed on Windows and linux/OSX use a different path format). </p>
Three Annotated Anomaly Detection Datasets for Line-Scan Algorithms
<h1>Summary</h1> <p>This dataset contains two hyperspectral and one multispectral anomaly detection images, and their corresponding binary pixel masks. They were initially used for real-time anomaly detection in line-scanning, but they can be used for any anomaly detection task.</p> <p>They are in .npy file format (will add tiff or geotiff variants in the future), with the image datasets being in the order of (height, width, channels). The SNP dataset was collected using sentinelhub, and the Synthetic dataset was collected from AVIRIS. The Python code used to analyse these datasets can be found at: https://github.com/WiseGamgee/HyperAD</p> <h1>How to Get Started</h1> <p>All that is needed to load these datasets is Python (preferably 3.8+) and the NumPy package. Example code for loading the Beach Dataset if you put it in a folder called "data" with the python script is:</p> <pre><code>import numpy as np # Load image file hsi_array = np.load("data/beach_hsi.npy") n_pixels, n_lines, n_bands = hsi_array.shape print(f"This dataset has {n_pixels} pixels, {n_lines} lines, and {n_bands}.") # Load image mask mask_array = np.load("data/beach_mask.npy") m_pixels, m_lines = mask_array.shape print(f"The corresponding anomaly mask is {m_pixels} pixels by {m_lines} lines.")</code></pre> <h1>Citing the Datasets</h1> <p>If you use any of these datasets, please cite the following paper:</p> <pre><code>@article{garske2024erx,</code><br><code> title={ERX - a Fast Real-Time Anomaly Detection Algorithm for Hyperspectral Line-Scanning},</code><br><code> author={Garske, Samuel and Evans, Bradley and Artlett, Christopher and Wong, KC},</code><br><code> journal={arXiv preprint arXiv:2408.14947},</code><br><code> year={2024},</code><br><code>}</code></pre> <div> <pre>If you use the beach dataset please cite the following paper as well (original source):</pre> </div> <pre><code>@article{mao2022openhsi, title={OpenHSI: A complete open-source hyperspectral imaging solution for everyone}, author={Mao, Yiwei and Betters, Christopher H and Evans, Bradley and Artlett, Christopher P and Leon-Saval, Sergio G and Garske, Samuel and Cairns, Iver H and Cocks, Terry and Winter, Robert and Dell, Timothy}, journal={Remote Sensing}, volume={14}, number={9}, pages={2244}, year={2022}, publisher={MDPI} }</code></pre>
Solutions and Genetic algorithm dataset of the Scenarios used for the Validation of the Conflict Detection and Resolution Use Case (ARTIMATION )
<p>This dataset contains the <strong>solution </strong>of the scenarios used for one of the validation of the ARTIMATION project: Conflict Detection and Resolution (CD&R) use case (link).</p> <p>The solution are computed by a Genetic Algorithm developped by Nicolas Durand.<br> <br> Inside, one can find:</p> <p>-One archive, "GA_Scenario_Solution_Dataset.zip", containing 10 couple of files (so 20 files). Each couple of file "sol_X_1.csv" and "sols_X_1.csv" are reciprocally the solutino given by the Genetic Algorithm to scenario X, and all the candidate solution explroed by the GA while solving scenario X. This archive also contain other versions of the solutions made by the GA with other parameters.<br> <br> -One archive, "GA_Toy_Dataset.zip" , containing solution to random scenarios, used to develop the first interfaces.</p> <p>Those solutions are used to developp the heatmatrix and heatmaps of the project (link), and visualisations for the validation (link).</p>
Predicted times of bow Shock crossings at Venus from the ESA/Venus Express mission, using spacecraft ephemerides and magnetic field data, with a predictor-corrector algorithm
<p><strong>CHARACTERISTICS</strong><br> Planet: <strong>Venus</strong><br> Radius: <strong>R<sub>V</sub> = 6051.8 km</strong> (volumetric mean planetary radius)<br> Spacecraft: <strong>ESA/Venus Express</strong><br> Spacecraft coordinates system: <strong>Venus Solar Orbital (VSO)</strong> equivalent to <em>Sun-State </em>coordinate system:</p> <ul> <li>+<em>X<sub>VSO</sub></em> points towards the Sun from the planet’s centre,</li> <li>+<em>Z<sub>VSO</sub></em> towards Venus’ North pole and perpendicular to the orbital plane defined as the <em>X<sub>VSO</sub></em>–<em>Y<sub>VSO</sub></em> plane passing through the centre of Venus,</li> <li><em>Y<sub>VSO</sub></em> completes the orthogonal system.</li> </ul> <p>Time span: <strong>01/04/2006 to 25/11/2014</strong><br> Total number N of candidate bow shock crossings in the database: <strong>N = 4950</strong><br> Number of quasi-parallel bow shock crossings: <strong>N<sub>||</sub> = 844</strong><br> Number of quasi-perpendicular bow shock crossings: <strong>N<sub><span class="math-tex">\(\perp\)</span></sub> = 4106</strong></p> <p><strong>ORIGINAL DATASETS USED</strong><br> The original Venus Express/MAG data repository on which these algorithms were applied is available on ESA's Planetary Science Archive system (PSA) at: https://archives.esac.esa.int/psa/ftp/VENUS-EXPRESS/MAG/. For this study, 1-Hz magnetic field data was used.</p> <p><strong>METHOD</strong><br> To construct this database from the original datasets above, the predictor and predictor-corrector algorithms used are described for the Mars case in:<br> Simon Wedlund, C., Volwerk, M., Beth, A., Mazelle, C., Möstl, C., Halekas, J., Gruesbeck, J. and Rojas-Castillo, D., (2021), A Fast Bow Shock Location Predictor-Estimator From 2D and 3D Analytical Models: Application to Mars and the MAVEN mission, <em>Journal of Geophysical Research</em>, <strong>127</strong>, e2021JA029942. <a href="https://doi.org/10.1029/2021JA029942">https://doi.org/10.1029/2021JA029942</a></p> <p>They consist of two consecutive steps: </p> <ol> <li>Predictor geometric algorithm based on 2D or 3D existing fits for prediction of the Venus bow shock position. The original fits were taken from 2D conic fits in the plane <span class="math-tex">\(\left(X_\text{VSO}, \sqrt{Y_\text{VSO}^2+Z_\text{VSO}^2}\right)\)</span>performed on the datasets of <strong>Persson et al. (2023)</strong>, Venusian bow shock crossings manually identified from measurements by the ASPERA-4 and MAG instruments onboard Venus Express, <em>Zenodo</em> (<a href="http://doi.org/10.5281/zenodo.7679677">https://doi.org/10.5281/zenodo.7679677</a>).</li> <li>Corrector algorithm based on magnetic field measurements.</li> </ol> <p>We also provide the angle between the average Interplanetary Magnetic Field (IMF) vector upstream of the shock and the shock normal, noted <span class="math-tex"><em>θ</em><sub><em>B</em><em>n</em></sub></span> (ThetaBn). Assuming a locally smooth shock surface, this gives a first indication of the geometry of the shock, so that:</p> <ul> <li><span class="math-tex">45<sup>∘</sup><<em>θ</em><sub><em>B</em><em>n</em></sub><135<sup>∘</sup></span>: quasi-perpendicular shock condition</li> <li><span class="math-tex"><em>θ</em><sub><em>B</em><em>n</em></sub>≤45<sup>∘</sup> and <em>θ</em><sub><em>B</em><em>n</em></sub><span class="math-tex">\(\geq\)</span>135<sup>∘</sup></span>: quasi-parallel shock condition</li> </ul> <p>Uncertainty on these angles is estimated to be ± 5º. </p> <p>For details, see <strong>Simon Wedlund et al. (2022)</strong> above, §2.3 pp. 10-12.</p> <p><strong>VARIABLES DESCRIPTION</strong></p> <p>This database contains the following ASCII variables:</p> <ul> <li>Bow shock times in Venus Express' database (1-s resolution): <em>T</em><sub>bs</sub></li> <li>Venus Solar Orbital coordinates of the shock, in units of Venus radius <em>R</em><sub>V </sub>(<em>R</em><sub>V</sub> = 6051.8 km):<br> <em>X<sub>VSO</sub></em>,<sub> </sub><em>Y<sub>VSO</sub></em>, <em>Z<sub>VSO</sub></em> and Euclidean distance <span class="math-tex">\(R_{VSO} = \sqrt{X_{VSO}^2 + Y_{VSO}^2 + Z_{VSO}^2}\)</span> (in <em>R<sub>V</sub></em>)</li> <li>Solar Zenith angle in degrees: <em>SZA</em> = <span class="math-tex">\(\tan^{-1}{Y_{VSO}^2+Z_{VSO}^2 \over X_{VSO}^2}\)</span> (in º) </li> <li>Angle between average B-field direction and shock normal assuming a smooth shock surface <span class="math-tex">\(\theta_{Bn}\)</span> (ThetaBn, in º, calculated with atan2(norm(cross(<strong>B</strong>,<strong>ñ</strong>),dot(<strong>B</strong>,<strong>ñ</strong>)), with <strong>B</strong> the magnetic field vector and <strong>ñ</strong> the vector normal to the shock surface): <ul> <li>45 < ThetaBn < 135 deg: quasi-<span class="math-tex">\(\perp\)</span> shock</li> <li>ThetaBn <span class="math-tex">\(\leq\)</span> 45 deg & ThetaBn <span class="math-tex">\(\geq\)</span> 135 deg: quasi-|| shock</li> </ul> </li> <li>Interplanetary Magnetic Field (IMF) upstream average vector in VSO coordinates, <em>B<sub>x</sub></em>, <em>B<sub>y</sub></em>, <em>B<sub>z</sub></em> (in nT).</li> <li>Flag for direction of crossing: <ul> <li>flag = 0: magnetosheath <span class="math-tex">\(\longrightarrow\)</span> solar wind (2447 events)</li> <li>flag = 1: solar wind <span class="math-tex">\(\longrightarrow\)</span> magnetosheath (2503 events)</li> </ul> </li> </ul> <p><strong>WARNING</strong></p> <ol> <li>This version of the database is currently in a preliminary stage of application and, as such, is not fully tested. Solar wind upstream magnetic field values (IMF) are given only as a first approximation for each orbit segment. See point 2 for caveats. For carefully manually picked shock crossings, the user is referred to the database of:<br> <strong>Persson et al. (2023)</strong>, Venusian bow shock crossings manually identified from measurements by the ASPERA-4 and MAG instruments onboard Venus Express, <em>Zenodo</em> (<a href="http://doi.org/10.5281/zenodo.7679677">https://doi.org/10.5281/zenodo.7679677</a>)</li> <li>This database is based on an automatic statistical geometrical estimate, further refined by constraints on magnetic fields. This is aimed at giving a first approximation of the shock area times in the Venus Express data. It is particularly suited to statistical studies and region identification in the Venus Express datasets. As such, this database should be used as a <em>first indicator</em> of the shock location, and <em>with</em> <em>caution</em>: it <strong>CANNOT</strong>, and <strong>WILL NOT </strong>substitute, especially in case studies, for a careful analysis of the full magnetometer and plasma bow shock signatures. Moreover, the algorithm is optimised for detecting the first disturbance observed in the magnetic field immediately ahead of the shock's foot (in the foreshock area), and not for the detection of other structures in the shock, such as the shock ramp. The "shock" location is therefore given here with typical uncertainties of about 0.040 R<sub>V</sub> (with R<sub>V</sub> = 6051.8 km, i.e., about 250 km in the radial direction). Finally, for multiple shock crossings, the algorithm chooses the first occurrence of the shock starting from the undisturbed solar wind.</li> </ol> <p>Current formatting optimised for MATLAB.</p> <p><strong>ACKNOWLEDGEMENTS</strong><br> C. Simon Wedlund and M. Volwerk thank the Austrian Science Fund (FWF) project P32035-N36. </p> <p><strong>LICENSE AND RIGHTS</strong><br> This database is shared under a Creative Commons CC-BY-4.0 license.</p> <p>Version 1 (c) Cyril Simon Wedlund @ Space Research Institute of Graz (IWF), <br> Austrian Academy of Sciences, 2022-10-05<br> Contact email: cyril.simon.wedlund@gmail.com</p>
Application of two-step clustering algorithm to QuaLiKiz-v2.6.2 turbulent transport simulation data
<p>QuaLiKiz simulation data in support of the two-step clustering algorithm, developed by Bart J. J. Kremers.</p> <p>The NETCDF file, generated via NETCDF4, contains the raw QuaLiKiz output for the 3-dimensional (2-input, 1-output) toy case used to develop the algorithm. Within the NETCDF file, the coordinates represent the code inputs and various vector indices and the data variables represent the code outputs.</p> <p>There are also 4 HDF5 files, containing the results from the two-step clustering reduction algorithm, where the data is saved under 2 keys: "/input" and "/flattened". The file names indicate the reduction algorithm settings used to produce the results within.</p> <p>The algorithm is available open-source at <a href="https://gitlab.com/BartKremers/two-step-clustering">https://gitlab.com/BartKremers/two-step-clustering</a>.</p>
Datasets for "Mapping Lunar Swirls with Machine Learning: The Application of Unsupervised and Supervised Classification Algorithms in Reiner Gamma and Mare Ingenii"
<p>Final surface reflectance data at 2.6 m/pixel resolution with floating point values are available as GeoTiff and ASCII text files. Definition files for the K-Means and MLC algorithms in classifying swirl units are also available as ASCII text files. See README file for further details.</p> <p>Data used in the research article:</p> <p>Chuang, F.C., M.D. Richardson, J.R. Weirich, A.A. Sickafoose, and D.L. Domingue, 2022. Mapping Lunar Swirls with Machine Learning: The Application of Unsupervised and Supervised Image Classification Algorithms in Reiner Gamma and Mare Ingenii. The Planetary Science Journal, 3:231. doi://10.3847/PSJ/ac8f43</p> <p> </p>
Data: Algorithms for new types of fair stable matchings
<p>This data corresponds to the data and experiments described in Section 5 of<br> the following paper:</p> <p>Algorithms for new types of fair stable matchings<br> Authors: Frances Cooper and David Manlove</p> <ul> <li>The paper is located at: <a href="https://arxiv.org/abs/2001.10875">https://arxiv.org/abs/2001.10875</a></li> <li>The software is located at: <a href="https://zenodo.org/record/3630383">https://zenodo.org/record/3630383</a></li> <li>The data is located at: <a href="https://zenodo.org/record/3630349">https://zenodo.org/record/3630349</a></li> </ul> <p>See the README for more information.</p>
Wind turbine blade simulations under changing environment for benchmarking SHM algorithms
<p>This data set contains the flapwise vibration response simulation of a wind turbine blade under <em>Environmental and Operational Variability</em> (EOV) as well as increasing damage. The blade’s dynamics are represented by means of a 4 element FEM of a cantilever beam, while dynamic loading corresponds to a discretized turbulent wind field calculated with the help of the software <em>TurbSim</em> for prescribed 10-minute average wind speed and turbulence. Rotation effects are ignored. The wind loading is coupled with the structural dynamics considering aeroelastic interactions, based on lift and drag forces calculated from a NACA 64-618 airfoil. Ambient temperature (10-minute average) is used to set the elasticity (Young’s) modulus of the blade material.</p> <p>While on the healthy state, the vibration response of the blade is simulated over a year of temperature and wind speed variations according to the average values measured in an area of north-central Switzerland. In addition, a week of extreme weather (abnormally high temperature in summer) and a month where the blade is subject to increasing damage are also simulated. Damage is represented as a decrement of the stiffness on a single FEM element located on the blade’s root. Damage increments linearly from 0 to 25% decrease of the total stiffness during a period of two weeks, while on the remaining two weeks a 25% stiffness decrement is sustained.</p> <p>The main aim of this data set is to be used as a benchmark of vibration based SHM methods, particularly on damage detection and localization under EOV. To this end, both the blade’s vibration response and the environmental and operational parameters (temperature and wind) used to simulate each response are provided. Further details can be found in the publication attached.</p>
Exploiting Statistical and Structural Features for the Detection of Domain Generation Algorithms
<p>This repository contains a dataset for the research of domain generation algorithms (DGAs) and machine learning. More precisely, it targets dictionary-based DGAs.</p> <p><em>Constantinos Patsakis, Fran Casino: "Exploiting Statistical and Structural Features for the Detection of Domain Generation Algorithms", Journal of Information Security and Applications, 2021.</em></p> <p>Features ordered as in the shared dataset:</p> <ul> <li>Family: DGA that the domain belongs to</li> <li>SLD: SLD of the Domain</li> <li>L-LEN: The length of Domain</li> <li>L-DIG: The number of digits in Domain</li> <li>L-CON-MAX: The maximum number of consecutive consonants Domain</li> <li>R-CON-VOW: Number of consonants divided by L-LEN </li> <li>L-SYM: The number of special characters</li> <li>R-SYM-LEN: L-SYM divided by L-LEN</li> <li>R-Dom-3G: Ratio of benign grams in Dom-3G</li> <li>R-Dom-4G: Ratio of benign grams in Dom-4G</li> <li>R-Dom-5G: Ratio of benign grams in Dom-5G</li> <li>L-W2: Number of words with more than 2 characters in Domain</li> <li>L-W3: Number of words with more than 3 characters in Domain</li> <li>R-WS-LEN: Dom-WS divided by L-LEN</li> <li>R-WDS-LEN: Dom-WDS divided by L-LEN</li> <li>R-W2-LEN: Dom-W2 divided by L-LEN</li> <li>R-W3-LEN: Dom-W3 divided by L-LEN</li> <li>M2-Dom-Ws: 2-Chain Markov English grams applied to Dom-WS</li> <li>M2-Dom-WDS: 2-Chain Markov English grams applied Dom-WDS</li> <li>E-Dom-WS: Entropy of Dom-WS </li> <li>E-Dom-WDS: Entropy of Dom-WDS</li> <li>E-Dom-W2: Entropy of Dom-W2</li> <li>E-Dom-W3: Entropy of Dom-W3</li> </ul>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.