Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
52
datasets available to search
ShareScore release 0.9.0
Dataset results
52 results for “Data Training Sets”
PANDEM-2 European COVID-19 training data set
<p>The PANDEM-2 COVID-19 European training dataset is a large collection of time series either of real or realistic synthetic (generated) data and indicators associated with the European pandemic response to the COVID-19 pandemic. It is intended to be used for training in pandemic management.</p> <p> </p> <p>This dataset is the result of a data gathering requirement process for pandemic management involving feedback and inputs from several public health and first responder professionals as well as researchers and military personnel directly involved in the European COVID-19 pandemic response. This work is part of the PANDEM-2 project funded by the <em>Horizon 2020 Secure Societies</em> program. To collect this data, an open source software was developed named PANDEM-Source allowing reproducibility and customisation of this dataset. </p> <p> </p> <p>The dataset includes indicators for cases, deaths, hospitalisation, testing and laboratory data including pathogen genomic information, vaccination, non-pharmaceutical interventions, participatory surveillance, social media, flights resources (human and material such as beds or vaccines), and contact tracing activities. When no open available data was found, realistic synthetic data and indicators were generated with the goal of producing a data set to be used for pandemic management training. </p> <p>The project received funding from the European Union’s Horizon 2020 Research and Innovation programme under the Grant Agreement No. 883285. The material presented and views expressed here are the responsibility of the author(s) only. The EU Commission takes no responsibility for any use made of the information set out.<br> References</p> <p> </p> <p> </p>
ShiftCrypt training data set for training ConforMine
<p>Data set containing the ShiftCrypt values of the proteins used for training ConforMine. This set is not to be confused the the Molecular Dynamics (MD) data set, also used for training of this model. </p> <p>The data set also contains a python script which recreates the filtering of sequences performed in the training steps of ConforMine, which discards all proteins for which no valid ShiftCrypt predictions were obtained. </p>
Data set - Practical teacher-training program on STEAM activity planning
<p>Data set of answers of 14 Brazilian teachers who took part in a practical teacher-training program on STEAM activity planning. </p>
In silico data-set used to train the PGNNIV
<p>The folder contains the data used to train PGNNIVs to unravel the go or grow behaviour of glioblastoma under 4 different parametric models. These data consist on the solutions (in time and space) of eleven simulations with different oxygen boundary conditions.</p> <p>Each folder is named as DATA_"ModelName", where "ModelName" can be: "Sigmoid", "ReLU", "MichaelisMenten" or "Heaviside". Inside each folder, the multidimensional arrays for input and output data for the network training can be found. These arrays have dimension [nExp,TimeStep,x,field], where:</p> <ul> <li>nExp = 11 and corresponds to the number of different configurations or experiments simulated.</li> <li>TimeStep = 1000 and correspond to the different temporal frames where the solution is given.</li> <li>x = 51 and corresponds to the different spatial points where the solution is given.</li> <li>field = 2 and correspond to the different solution fields (1: cells, 2: oxygen).</li> </ul>
MItosis DOmain Generalization Challenge 2022 (MICCAI MIDOG 2022), Training data set (PNG version)
<p>This is the training dataset of the MItosis DOmain Generalization (MIDOG) challenge 2022, held in conjunction with MICCAI 2022. Please find the structured challenge description at 10.5281/zenodo.6362337.</p> <p>The training set consists of 405 tumor cases in total across six tumor types:</p> <ul> <li>Canine Lung Cancer (44 cases, scanned with 3DHistech Pannoramic Scan II)</li> <li>Human Breast Cancer (150 cases, scanned using three scanners, part of MIDOG2021 dataset)</li> <li>Canine Lymphoma (55 cases, scanned with 3DHistech Pannoramic Scan II)</li> <li>Human neuroendocrine tumor (55 cases, scanned with Hamamatsu NanoZoomer XR)</li> <li>Canine Cutaneous Mast Cell Tumor (50 cases, scanned with Aperio ScanScope CS2)</li> <li>Human melanoma (51 cases, scanned with Hamamatsu NanoZoomer XR) (no labels provided)</li> </ul> <p>From each WSI, a trained pathologist selected an area of 2mm² corresponding to approximately 10 high power fields, according to the grading scheme of Elston and Ellis. We cropped this area and provide it as PNG files in this data set due to restrictions in data set size on zenodo. Each file includes the resolution (in dots per inch, DPI) of the original scanned images.</p> <p>The training set contains 9501 mitotic figures (MF) and 11051 hard examples (non-mitotic figures). All annotations are provided in MS COCO JSON format and as SQLITE database (SlideRunner format).</p>
Galaxy Training Data for "Evaluating and ranking a set of pathways based on multiple metrics"
<pre>This dataset provides the inputs needed for the Galaxy Pathway Analysis workflow training tutorial (<a href="https://galaxy-synbiocad.org">https://galaxy-synbiocad.org</a>). This workflow asseses the performance of predicted pathways by computing 4 criteria (target product flux, thermodynamic feasibility, pathway length, and enzyme availability). A score inform the user about the best candidate pathways to produce a compound of interest. The generated output is a collection of scored and ranked heterologous pathways. The content of the dataset is as follows: - A set of pathways provided in the SBML format (Systems Biology Markup Language) to be ranked, modeling heterologous pathways such as those outputted by the RetroSynthesis workflow (<a href="https://galaxy-synbiocad.org">https://galaxy-synbiocad.org</a>). - The GEM (Genome-scale metabolic models) which is a formalized representation of the metabolism of the host organism (the model is E. coli iML1515), provided in the SBML format.</pre>
Data from: How many specimens make a sufficient training set for automated three dimensional feature extraction?
<p>Deep learning has emerged as a robust tool for automating feature extraction from 3D images, offering an efficient alternative to labour-intensive and potentially biased manual image segmentation methods. However, there has been limited exploration into the optimal training set sizes, including assessing whether artificial expansion by data augmentation can achieve consistent results in less time and how consistent these benefits are across different types of traits. In this study, we manually segmented 50 planktonic foraminifera specimens from the genus Menardella to determine the minimum number of training images required to produce accurate volumetric and shape data from internal and external structures. The results reveal unsurprisingly that deep learning models improve with a larger number of training images with eight specimens being required to achieve 95% accuracy. Furthermore, data augmentation can enhance network accuracy by up to 8.0%. Notably, predicting both volumetric and shape measurements for the internal structure poses a greater challenge compared to the external structure, due to low contrast differences between different materials and increased geometric complexity. These results provide novel insight into optimal training set sizes for precise image segmentation of diverse traits and highlight the potential of data augmentation for enhancing multivariate feature extraction from 3D images. </p>
Data sets of multi-body models for conventional, articulated, and equidistant-axles trains and single span bridges
<p>Information about characteristics of multi-body models of conventional, articulated, and equidistant-axles trains.</p> <p>Information about bridge data set, used for vehicle-bridge interaction investigations.</p>
Unipen data set of on-line (vectorial) handwriting - train_r01_v07
<p>/*****************************************************************************\<br> * *<br> * *<br> * This is the first UNIPEN distribution of the iUF *<br> * *<br> * This distribution comprises NIST train_r01_v07 *<br> * *<br> * http://www.unipen.org/ *<br> * *<br> * Source code: C/Linux at *<br> * http://www.sourcefiles.org/Scientific/Other_Sciences/uptools3.tar.gz *<br> * *<br> * *<br> * The International Unipen Foundation, December 1999 *<br> * *<br> * *<br> *******************************************************************************<br> * *<br> * *<br> * DISCLAIMER AND COPYRIGHT NOTICE FOR ALL DATA CONTAINED ON THIS CDROM: *<br> * *<br> * *<br> * 1) PERMISSION IS HEREBY GRANTED TO USE THE DATA FOR RESEARCH *<br> * PURPOSES. IT IS NOT ALLOWED TO DISTRIBUTE THIS DATA FOR COMMERCIAL *<br> * PURPOSES. *<br> * *<br> * Copyright 1999, International Unipen Foundation - All rights reserved *<br> * *<br> * 2) PROVIDER GIVES NO EXPRESS OR IMPLIED WARRANTY OF ANY KIND AND ANY *<br> * IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR PURPOSE ARE *<br> * DISCLAIMED. *<br> * *<br> * 3) PROVIDER SHALL NOT BE LIABLE FOR ANY DIRECT, INDIRECT, SPECIAL, *<br> * INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF ANY USE OF THIS *<br> * DATA. *<br> * *<br> * 4) THE CONDITIONS OF USE REQUIRE PROPER REFERENCE TO THIS DATABASE *<br> * AS DESCRIBED IN ACCOMPANYING DOCUMENT 'unipen-conditions-of-use.html' *<br> * *<br> \*****************************************************************************/</p> <p>Contents of the CDROM:<br> ----------------------</p> <p>1) This file, called CDROM-README<br> 2) The nist distribution, of which part of the directory tree is listed here.</p> <p>train_r01_v07<br> include<br> abm apb app atu bbd ced gmd ibm kai lou pap pri sta uqb<br> aga apc art bba cea cee hpb imp kar mot par rim syn val<br> anj apd ata bbb ceb cef hpp imt lav nic pcl scr tos<br> apa ape att bbc cec dar huj int lex not phi sie ugi</p> <p> data<br> 1a<br> aga apb art ceb gmd imp pri tos val<br> apa app cea ced ibm lou syn uqb<br> 1b 1c 1d 2 3 4 5 6 7 8</p> <p>All files on the the CDROM were tested on UNIPEN integrity using uplib.<br> The description of the contents is given below:</p> <p><br> Description of the contents:<br> ----------------------------</p> <p>For a description and examples of the UNIPEN format, see http://www.unipen.org/</p> <p>The UNIPEN files contained in this release are organized in 10 categories, listed<br> below. The number of .SEGMENTS and number of files for each category are given:</p> <p> cat nsegm nfiles<br> 1a 15953 634 isolated digits<br> 1b 28069 1423 isolated upper case<br> 1c 61351 2145 isolated lower case<br> 1d 17286 1222 isolated symbols (punctuations etc.)<br> 2 122628 2735 isolated characters, mixed case<br> 3 67352 1949 isolated characters in the context of words or texts<br> 4 0 0 isolated printed words, not mixed with digits and symbols<br> 5 0 0 isolated printed words, full character set<br> 6 75529 3298 isolated cursive or mixed-style words (without digits and symbols)<br> 7 85213 3393 isolated words, any style, full character set<br> 8 14544 4563 text: (minimally two words of) free text, full character set</p> <p>In each directory representing a category, e.g., data/1a, a number of<br> sub-directories are contained. The name of a subdirectory is a<br> three-letter word identifying the contributor of the data.</p> <p>Consider for example the UNIPEN files contributed by 'aga' of category<br> 1a (isolated digits). The files containing .SEGMENT entries are contained<br> in the 'data' directory:<br> data/1a/aga</p> <p>Most files in this distribution contain one or more .INCLUDE statements.<br> The corresponding files are found in the 'include' directory, in this case:<br> include/aga<br> Some files (such as the 'imp' contributions) use nested .INCLUDE statements.<br> The software contained in the uptools3 distribution contains code to find<br> files to be included based on an environment variable.</p> <p><br> Distribution of categories per contributor:<br> -------------------------------------------</p> <p> 1a | 1b | 1c | 1d | 2 | 3 | 6 | 7 | 8<br> --------------------------------------------------------------------------------------------------------------<br> abm | | | | | | | 628 4 | 646 4 | 7 3 |<br> aga | 405 14 | 1115 14 | 1063 14 | 221 14 | 2804 14 | | | | 605 14 |<br> anj | | | | | | | 1435 6 | 1435 6 | |<br> apa | 692 74 | 2236 247 | 7414 391 | 1953 268 | 12295 527 | 12295 527 | | | 527 527 |<br> apb | 2033 138 | 3450 466 | 8869 434 | 946 233 | 15298 590 | 15298 590 | | | 590 590 |<br> apc | | | | | | | 1724 441 | 1798 444 | 444 444 |<br> apd | | | | | | | 1958 453 | 2448 507 | 507 507 |<br> ape | | | | | | | 1384 286 | 1848 322 | 322 322 |<br> app | 1046 115 | 3010 353 |10370 556 | 2886 400 | 17312 745 | 17312 745 | | | 745 745 |<br> art | 170 6 | 1042 6 | 2301 6 | 202 6 | 3715 6 | 3715 6 | 687 6 | 933 6 | 186 6 |<br> att | | | | | | | 932 29 | 2253 29 | 819 30 |<br> atu | | | | | | | | | 92 92 |<br> bba | | | | | | | | | 63 63 |<br> bbb | | | | | | | | | 51 51 |<br> bbc | | | | | | | | | 61 61 |<br> bbd | | | | | | | | | 858 858 |<br> cea | 7 3 | 57 6 | 1402 6 | 35 6 | 1501 6 | 1501 6 | 311 6 | 345 6 | 38 6 |<br> ceb | 16 2 | 30 4 | 488 4 | 8 3 | 542 4 | 542 4 | 116 4 | 129 4 | 22 4 |<br> cec | | | | | | | 4880 35 | 5625 35 | 604 35 |<br> ced | 1369 42 | 2691 42 | 2619 43 | 1077 43 | 7756 43 | 7756 43 | | | 1100 43 |<br> cee | | | | | | | 3977 29 | 3978 29 | |<br> dar | | | | | | | 277 2 | 316 2 | 36 2 |<br> gmd | 1145 3 | | 2921 3 | 832 3 | 4898 3 | | | | |<br> hpb | | | | | | | 1524 7 | 2292 7 | 1832 23 |<br> hpp | | | | | | | 8323 32 | 10820 32 | 2591 29 |<br> huj | | | | | | | 104 1 | 104 1 | |<br> ibm | 1571 22 | 4264 22 | 4354 22 | 1994 22 | 12183 22 | | 1196 9 | 1196 9 | |<br> imp | 257 50 | 645 50 | 656 50 | 851 50 | 2409 50 | | 1119 22 | 1119 22 | |<br> imt | | | | | | | 242 1 | 242 1 | |<br> int | | | | | | | 2012 4 | 2012 4 | |<br> kai | | 1961 28 | 8663 46 | 1585 22 | 12209 57 | 8933 28 | 1013 28 | 1663 28 | |<br> kar | | | | | | | 1809 33 | 1860 33 | |<br> lav | | | 1324 9 | | 1324 9 | | 213 5 | 213 5 | |<br> lex | | | | | | | 5660 13 | 7235 13 | 1937 13 |<br> lou | 7 1 | 11 1 | 15 1 | 2 1 | 35 1 | | 1538 7 | 1599 7 | |<br> mot | | | 2701 8 | | 2701 8 | | | | |<br> nic | | | | | | | 6813 66 | 6813 66 | |<br> not | | | | | | | 1452 8 | 1452 8 | |<br> pap | | | | | | | 2203 39 | 2213 41 | |<br> par | | | | | | | 496 8 | 512 8 | |<br> pcl | | | | | | | 616 21 | 616 21 | |<br> phi | | | | | | | 2506 12 | 2506 12 | 91 4 |<br> pri | 78 15 | 212 15 | 191 15 | 230 15 | 711 15 | | 106 3 | 110 3 | 49 18 |<br> rim | | | | | | | 277 21 | 277 21 | |<br> scr | | | | | | | | | 211 44 |<br> sie | | | 377 377 | | 377 377 | | 1593 1593 | 1593 1593 | |<br> sta | | | | | | | 15808 61 | 16415 61 | 156 29 |<br> syn | 4554 17 | 637 8 | 589 8 | 415 8 | 6195 17 | | | | |<br> tos | 543 108 | 1432 108 | 1381 108 | 1660 108 | 4985 108 | | | | |<br> ugi | | | | | | | 597 3 | 597 3 | |<br> uqb | 598 4 | 1514 4 | | 1327 4 | 3439 4 | | | | |<br> val | 1462 20 | 3762 49 | 3653 44 | 1062 16 | 9939 129 | | | | |<br> --------------------------------------------------------------------------------------------------------------<br> | | | | | | | | | |<br> tot |15953 634 |28069 1423|61351 2145|17286 1222|122628 2735|67352 1949 | 75529 3298 | 85213 3393 |14544 4563|<br> --------------------------------------------------------------------------------------------------------------<br> 1a | 1b | 1c | 1d | 2 | 3 | 6 | 7 | 8</p>
Training data set for: Graph Neural Network based elastic deformation emulators for magmatic reservoirs of complex geometries
<h2>Overview</h2> <p>This is a synthetic volcano deformation dataset accompanying the publication of <em><strong>Graph Neural Network based elastic deformation emulators for magmatic reservoirs of complex geometries</strong></em>,<em><strong> </strong></em>on the journal <em>Volcanica</em>. Synthetic, quasi-static deformation is computed for magma chambers of various geometries, parameterized as spheroids or superpositions of spherical harmonics. Surface deformation is computed using the boundary element method (BEM) of Nikkhoo & Walter (2015). Please reference our paper for details of computational methods.</p> <p>The dataset contains 50,000 realizations of magma chamber geometries/orientations/centroid depths and associated deformation fields. Surface deformation fields are sampled at discrete locations, with a uniform random distribution within [Lh x Lh], and a distribution that concentrates near the chamber (at radial distances, r = 10^(-3 <em> random number) * </em>Lh/2). Note this dataset contains only a small fraction of the total dataset. In total, 824,393 realizations of magma chambers were used to train our emulators. For accessing the complete training data set, please contact the authors. </p> <p>Each .mat file contains the deformation field associated with a single chamber geometry. Use visData.m to visualize chamber geometry and associated surface displacement. Each file contains two MATLAB structures, "input" and "output". </p> <h2>Naming of each zip file</h2> <p>The numbers after the underscore, N:M, indicate that this file contains N of the M total chamber realizations for this particular setup. </p> <p><a href="../api/records/13800065/draft/files/sph_20AspRatios_1e4:151211.zip.zip/content" target="_blank" rel="noopener noreferrer">sph_20AspRatios_1e4:151211.zip</a>: deformation corresponding to spheroidal magma chambers parameterized by aspect ratios. </p> <p><a href="../api/records/13800065/draft/files/sh_complex_1e4:152283.zip/content" target="_blank" rel="noopener noreferrer">sh_complex_1e4:152283.zip</a>: deformation corresponding to chamber geometry produced by superposition of spherical harmonic modes. </p> <p><a href="../api/records/13800065/draft/files/sh_mode_approx_1e4:138380.zip/content" target="_blank" rel="noopener noreferrer">sh_mode_approx_1e4:138380.zip</a>: deformation corresponding to chamber geometries corresponding to individual spherical harmonic modes, combined with a spherical mode (the spherical mode prevents chamber surfaces from having zero radii locally)</p> <p><a href="../api/records/13800065/draft/files/sh_spheroid_approx1e4:202272.zip/content" target="_blank" rel="noopener noreferrer">sh_spheroid_approx1e4:202272.zip</a>: deformation corresponding to chambers approximating spheroids, but parameterized by spherical harmonics.</p> <p><a href="../api/records/13800065/draft/files/sh_spheroid_perturb_1e4:180247.zip/content" target="_blank" rel="noopener noreferrer">sh_spheroid_perturb_1e4:180247.zip</a>: same as above, but with additional random perturbations parameterized in spherical harmonics.</p> <h2>Variables in each file</h2> <p><strong>Input</strong> contains the following fields:</p> <p><strong>dp2mu</strong>: pressure change to shear modulus ratio.</p> <p><strong>dx</strong>, <strong>dy</strong>, <strong>dz</strong>: the coordinates of chamber centroid [meters]</p> <p><strong>mu: </strong>dimensionless crustal shear modulus (always set to 1)</p> <p><strong>nu</strong>: crustal Poisson's ratio (always set to 0.25)</p> <p><strong>Ns</strong>: number of points on the surface where displacements are computed</p> <p><strong>Lh</strong>, <strong>Lv</strong>: horizontal and vertical dimensions of the model domain [meters]. Lh is determined such that at the edge of the model domain, the displacement magnitude is below 10 percent of the maximum. Lv = Lh/2 + abs(dz)</p> <p>for the spheroids -----------------------------------------------------------------------------------------------------------</p> <p>the input files contain</p> <p><strong>asp</strong>: aspect ratio of chamber (length of the semi-major axis divided by that of the semi-minor axis)</p> <p><strong>ra</strong>, <strong>rb</strong>: semi-major, -minor, axis length [meters]</p> <p><strong>thetax</strong>, <strong>thetay</strong>, <strong>thetaz</strong>: counterclockwise rotation angles with regard to x, y, z axis [degrees]. thetax = [0, 90] degrees, thetay = 0 degrees, thetaz = 360 degrees.</p> <p>for the general geometries--------------------------------------------------------------------------------------------------</p> <p>the input files contain</p> <p><strong>ls</strong>, <strong>ms</strong>, <strong>fs</strong>: degree, order, coefficients of spherical harmonic modes. Spherical harmonics are sampled up to degree 5. fs is a complex vector of coefficients such that the resulting shape is real. </p> <p><strong>normF</strong>: normalization factor applied to the shape parameterized by ls, ms, fs, such that the shape as a maximum radius of unity.</p> <p><strong>rmax</strong>: scale factor to scale the spherical harmonics parameterized shape to real dimensions [meters].</p> <p>=============================================================================================</p> <p>Output contains the following fields,</p> <p><strong>X</strong>, <strong>Y</strong>, <strong>Z</strong>: coordinates of points where displacement vectors are computed [meters]</p> <p><strong>Ux</strong>, <strong>Uy</strong>, <strong>Uz</strong>: displacements in x, y, z directions [meters]</p> <p><strong>P</strong>, <strong>T</strong>: coordinates [meters] of vertices for the triangular mesh used in BEM calculation, and the connectivity matrix </p> <p><strong>C</strong>: coordinates [meters] of the center of each triangular element</p> <p><strong>that</strong>, <strong>dhat</strong>, <strong>nhat</strong>: unit vectors for orthogonal coordinate systems local to each triangular element. that ("t-hat") extends from vertex one to vertex two, nhat is outward normal, and dhat = cross (nhat, that).</p> <p>Reference:</p> <p>1. Nikkhoo, M., & Walter, T. R. (2015). Triangular dislocation: an analytical, artefact-free solution. <em>Geophysical Journal International</em>, <em>201</em>(2), 1119-1141.</p>
Training and test data set of thickness distribution of turbidites
<p>This is a data set of thickness distribution used for training and test of the inverse model of turbidites. Details were described in https://esurf.copernicus.org/preprints/esurf-2020-93/esurf-2020-93.pdf</p>
Data Set on Content Excerpts from Relevant Literature for a Scoping Review of Evacuation Training Methods in Buildings
<p>This Excel-file contains a set of data from a scoping review on methods for fire evacuation training in buildings. The review follows the PRISMA approach (Transparent Reporting of Systematic Reviews and Meta-Analyses) and systematically identifies 73 sources among scientific literature published between 1997 and 2022. The dataset contains information excerpted through a custom template on the employed training methods and technology, study information, participants, and contents of the discussion of the 73 sources of evidence that were identified in the systematic review process.</p>
Data Set on the Literature Screening for a Scoping Review of Evacuation Training Methods in Buildings
<p>This data set contains all retrieved literature records of a scoping review on fire evacuation training methods in buildings together with the reasoning for their in- or exclusion in the review.</p>
Neural net training and test data set
<p>In this zip file you will find several folders as well as a readme file explaining the dataset. The neural net file can be directly used in cellpose to segment <strong>widefield</strong> <strong>20x objective</strong> imaging data of neutrophils. The neural net could be used for other types of data, but might perform below expectations.</p>
Data from: How many specimens make a sufficient training set for automated three dimensional feature extraction?
Open the record for dataset details and reuse information.
Automated bio-AFM generation of large mechanome data set and their analysis by machine learning to classify prostatic cell lines_Training base 100 PC3-GFP
Open the record for dataset details and reuse information.
Data set of axle loads and distances for operating passenger and freight trains for development of load models
<p>Train data for moving load models of operating trains (5,007 passenger trains and 139,182 freight trains).</p> <ul> <li>axle distances [m] and axle loads [kN] for all trains included in zip-files as txt-files</li> <li>information on line categories (DIN EN 15528), loadcases and maximum speeds for passenger trains (and assignment to passenger train numbers in previous version of publication (used for development of load model)) in xlsx-file</li> </ul>
rime fraction training data set extracted from BAECC
<p>training data set used in Vogl et al. (https://amt.copernicus.org/preprints/amt-2021-137/) to derive rime mass fraction from Doppler cloud radar observations. Extracted from the BAECC data set.</p> <p>rime mass fraction retrieved from PIP data</p> <p>cloud radar observations at Ka- and W-band (ARM KAZR and MWACR)</p> <p>attenuation estimated using the Passive and Active Microwave Remote Sensing Tool (PAMTRA)</p>
Weekly supervised Multilingual Data Set to train Named Entity Recognition for Symptom Extraction
<p>Data Sets were generated using the Weakly Supervised NER pipeline (https://github.com/HUMADEX/Weekly-Supervised-NER-pipline) to train the symptom extraction NER models. </p> <p><strong>Supported Languages and dataset locations for the specific language:</strong></p> <p> English (base language): https://huggingface.co/HUMADEX/english_medical_ner<br> German: https://huggingface.co/HUMADEX/german_medical_ner<br> Italian: https://huggingface.co/HUMADEX/italian_medical_ner<br> Spanish: https://huggingface.co/HUMADEX/spanish_medical_ner<br> Greek: https://huggingface.co/HUMADEX/german_medical_ner<br> Slovenian: https://huggingface.co/HUMADEX/slovenian_medical_ner<br> Polish: https://huggingface.co/HUMADEX/polish_medical_ner<br> Portuguese: https://huggingface.co/HUMADEX/portugese_medical_ner</p> <p> </p> <p><strong>Dataset Building </strong></p> <ul> <li>Data Integration and Preprocessing</li> <li>Data Cleaning</li> <li>Annotation with Stanza's i2b2 Clinical Model </li> <li>Translation into the targeted language</li> <li>Word Alignment </li> <li>Data Augmentation </li> </ul> <p><strong>Acknowledgement</strong><br>This dataset had been created as part of joint research of HUMADEX research group (https://www.linkedin.com/company/101563689/) and has received funding by the European Union Horizon Europe Research and Innovation Program project SMILE (grant number 101080923) and Marie Skłodowska-Curie Actions (MSCA) Doctoral Networks, project BosomShield ((rant number 101073222). Responsibility for the information and views expressed herein lies entirely with the authors.</p> <p><strong>Authors:</strong><br>dr. Izidor Mlakar, Rigona Sallauka, dr. Umut Arioz, dr. Matej Rojc</p> <p><strong>Please cite as:</strong></p> <p><span>Article title: Weakly-Supervised Multilingual Medical NER For Symptom Extraction For Low-Resource Languages</span><br><span>Doi: 10.20944/preprints202504.1356.v1</span><br><span>Website: </span><a title="https://www.preprints.org/manuscript/202504.1356/v1" href="https://www.preprints.org/manuscript/202504.1356/v1">https://www.preprints.org/manuscript/202504.1356/v1</a></p>
Training, Validation and Test Sets for paper 'A Little Data goes a Long Way: Automating Seismic Phase Arrival Picking at Nabro Volcano with Transfer Learning'
<p>Training, Validation and Test Data for model presented in paper 'A Little Data Goes A Long Way: Automating Seismic Phase Arrival Picking at Nabro Volcano with Transfer Learning', submitted to Journal of Geophysical Research: Solid Earth.</p> <p>Files:</p> <p>- train_events_2498.h5 = training set of seismic waveforms (events with P-/S-wave labelled arrivals only, i.e., no noise waveforms)</p> <p>- train_events_2498.pkl = event training set metadata (UTC P-/S-wave phase arrival times)</p> <p>- train_noise_2498.h5 = training set of seismic waveforms (noise sections only, i.e., no event waveforms)</p> <p>- train_noise_2498.pkl = noise training set metadata (UTC time for training noise waveforms)</p> <p>- val_events.h5 = validation set of seismic waveforms (events with P-/S-wave labelled arrivals only, i.e., no noise waveforms)</p> <p>- val_events.pkl = event validation set metadata (UTC P-/S-wave phase arrival times)</p> <p>- val_noise.h5 = validation set of seismic waveforms (noise sections only, i.e., no event waveforms)</p> <p>- val_noise.pkl = noise validation set metadata (UTC time for validation noise waveforms)</p> <p>- test.h5 = test set of seismic waveforms (events and noise)</p> <p>- test_events.pkl = event test set metadata (UTC P-/S-wave phase arrival times for test event waveforms)</p> <p>- test_noise.pkl = noise test set metadata (UTC time for test noise waveforms)</p> <p>- nabro_2011-247.mseed = 24 hours seismic data from Nabro Urgency Array (2011-09-04), saved in mseed format (e.g., can be read with obspy)</p> <p>- nabro_2011-269.mseed = 24 hours seismic data from Nabro Urgency Array (2011-09-26), saved in mseed format (e.g., can be read with obspy)</p> <p> </p> <p>Further details and code for reading and using these files can be found at the GitHub repo for this paper: <a href="https://github.com/sachalapins/U-GPD">https://github.com/sachalapins/U-GPD</a></p> <p> </p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.