Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
1,037
datasets available to search
ShareScore release 0.9.0
Dataset results
1,037 results for “large-scale”
Large-scale attributed graph & hypergraph datasets: TWeibo, Amazon2M, Amazon, MAG-PM
<p>Here we provide additional large-scale datasets used in our work "A Versatile Framework for Attributed Network Clustering via K-Nearest Neighbor Augmentation", along with the index files for constructing KNN graphs using ScaNN and Faiss.</p> <p>Usage:</p> <p>cd ANCKA/</p> <p>unzip ~/Download_path/ANCKA_data.zip -d data/</p>
The Femern-project: a large-scale excavation of a Stone Age landscape - supplementary data
<p>This dataset contains all radiocarbon dates from the Femern project.</p> <p>Please cite the dataset as: </p> <p>Måge, B.T., Groß, D., Kanstrup, M. 2023. The Femern-project: a large-scale excavation of a Stone Age landscape. In: Groß, D. and Rothstein, M.: Changing Identity in a Changing World. Archaeological Studies on Human Interaction in Northern Europe around 4000 cal BC. Leiden: Sidestone, supplementary material.</p> <p>19.02.2024: Dataset updated: Wrong species ID in original dataset for AAR-27426</p>
Efficient and accurate framework for genome-wide gene-environment interaction analysis in large-scale biobanks
<p>Gene-environment interaction (GxE) analysis elucidates the interplay between genetic predispositions and environmental influences, offering significant potential for precision medicine. With the increasing use of electronic health records (EHR) linked to genetic data in large-scale biobanks, genome-wide association studies (GWAS) have expanded to encompass complex traits with intricate structures, such as time-to-event and ordinal categorical traits. Although these complex traits convey more phenotypic information, most existing scalable genome-wide GxE analysis approaches only focus on quantitative or binary traits. In this work, we propose a scalable and accurate analysis framework, SPAGxE<sub>CCT</sub>, that is applicable to a wide variety of trait types. We extend SPAGxE to SPAGxE+, which can account for sample relatedness. In addition, we extend SPAGxE<sub>CCT</sub> to SPAGxEmix<sub>CCT</sub>, which accounts for population stratification and is applicable to include individuals from multiple ancestries or admixed populations. We applied SPAGxE<sub>CCT</sub>, SPAGxE+, and SPAGxEmix<sub>CCT</sub> to analyze time-to-event traits in UK Biobank. For the SPAGxE<sub>CCT</sub> analyses, 281,149 White British individuals were included. For the SPAGxE+ analyses, 337,367 WB individuals with sample relatedness were included. For the SPAGxEmix<sub>CCT</sub> analyses, 338,044 individuals from all ancestries were included. SPAGxE<sub>CCT</sub>, SPAGxE+, and SPAGxEmix<sub>CCT</sub> are computationally efficient to analyze large datasets with hundreds of thousands of individuals, can accurately control type I error rates while remaining powerful to identify novel GxE findings.</p>
Large-scale 3D building and tree datasets constructed from airborne LiDAR point clouds in Glasgow, UK
<p>This is the updated version of building 3D model data. The revision includes appending attributes to the lod1 and lod2 shapefile and creating cityjson file for each 3D building model. All 3D building models are available in mesh (.obj), multipath shapefile, and cityjson (.json) now.</p> <p><strong>IMPORTANT NOTE: We suggest using the building footprint, lod1, and lod2 data of this version (Version v4).</strong></p> <p>Urban Big Data Centre of the University of Glasgow generates 3D city models via the airborne LiDAR point clouds acquired between 2020-2021 on behalf of Glasgow City Council. It is a large-scale 3D city model containing 3D information on terrain, trees, and buildings in Glasgow City. This dataset comprises terrain, tree canopy, and building products derived from high-density airborne LiDAR point clouds. </p> <p>The terrain products include Digital Terrain Model (DTM), Digital Surface Model (DSM), and normalized Digital Surface Model (nDSM) in 0.5 m spatial resolution. The DTM and DSM rasters were provided by the vendor and nDSM rasters were obtained by subtracting DTM from DSM. Terrain products are provided in 5 km by 5 km GeoTIF format raster.</p> <p>The tree canopy products are composed of canopy height models (CHM) and tree top locations. Classified tree point clouds were applied with pit-free algorithm to generate CHM in 0.5 m grid raster in GeoTIF format [1]-[2]. Treetop locations were identified by using Local Maximum Filter based on CHM and are recorded as points in Shapefile format. The tree canopy products are provided in 5 km by 5 km tiles.</p> <p>Building 3D model products include footprint polygons with building height attributes and 3D mesh of building models in LoD1 and LoD2 levels. A series of processes such as converting building point clouds to building height models (BHM), converting BHM to polygons, and polygon regularization were conducted to obtain the building footprint polygons. Building height attributes were calculated from BHM for each footprint. The building footprint data are provided in Shapefile format. LoD1 models were generated based on the footprint and average height of the building. LoD2 models were constructed based on footprint and building point cloud with City3D tool[3]. LoD1 and LoD2 models are provided in OBJ and shapefile format. Building 3D model products are provided in 5 km by 5 km tiles. The RMSE of Euclidean distances between each point in the point cloud to the reconstructed model was calculated to evaluate the LoD2 model construction. A table of RMSE and a note for a few problematic models are provided.</p>
WikiMed and PubMedDS: Two large-scale datasets for medical concept extraction and normalization research
<p>Two large-scale, automatically-created datasets of medical concept mentions, linked to the <a href="https://uts.nlm.nih.gov/uts/umls/home">Unified Medical Language System (UMLS)</a>.</p> <p><strong>WikiMed</strong></p> <p>Derived from Wikipedia data. Mappings of Wikipedia page identifiers to UMLS Concept Unique Identifiers (CUIs) was extracted by crosswalking Wikipedia, Wikidata, Freebase, and the NCBI Taxonomy to reach existing mappings to UMLS CUIs. This created a 1:1 mapping of approximately 60,500 Wikipedia pages to UMLS CUIs. Links to these pages were then extracted as mentions of the corresponding UMLS CUIs.</p> <p>WikiMed contains:</p> <ul> <li>393,618 Wikipedia page texts</li> <li>1,067,083 mentions of medical concepts</li> <li>57,739 unique UMLS CUIs</li> </ul> <p>Manual evaluation of 100 random samples of WikiMed found 91% accuracy in the automatic annotations at the level of UMLS CUIs, and 95% accuracy in terms of semantic type.</p> <p><strong>PubMedDS</strong></p> <p>Derived from biomedical literature abstracts from <a href="https://pubmed.ncbi.nlm.nih.gov/">PubMed</a>. Mentions were automatically identified using distant supervision based on Medical Subject Heading (MeSH) headers assigned to the papers in PubMed, and recognition of medical concept mentions using the high-performance <a href="https://allenai.github.io/scispacy/">scispaCy</a> model. MeSH header codes are included as well as their mappings to UMLS CUIs.</p> <p>PubMedDS contains:</p> <ul> <li>13,197,430 abstract texts</li> <li>57,943,354 medical concept mentions</li> <li>44,881 unique UMLS CUIs</li> </ul> <p>Comparison with existing manually-annotated datasets (NCBI Disease Corpus, BioCDR, and MedMentions) found 75-90% precision in automatic annotations. Please note this dataset is <em>not </em>a comprehensive annotation of medical concept mentions in these abstracts (only mentions located through distant supervision from MeSH headers were included), but is intended as data for <em>concept n</em><em>ormalization</em> research.</p> <p>Due to its size, PubMedDS is distributed as 30 individual files of approximately 1.5 million mentions each.</p> <p><strong>Data format</strong></p> <p>Both datasets use JSON format with one document per line. Each document has the following structure:</p> <pre><code class="language-json">{ "_id": "A unique identifier of each document", "text": "Contains text over which mentions are ", "title": "Title of Wikipedia/PubMed Article", "split": "[Not in PubMedDS] Dataset split: <train/test/valid>", "mentions": [ { "mention": "Surface form of the mention", "start_offset": "Character offset indicating start of the mention", "end_offset": "Character offset indicating end of the mention", "link_id": "UMLS CUI. In case of multiple CUIs, they are concatenated using '|', i.e., CUI1|CUI2|..." }, {} ] }</code></pre> <p><strong>Version history</strong></p> <table align="left"> <thead> <tr> <th scope="col">Version</th> <th scope="col">Notes</th> </tr> </thead> <tbody> <tr> <td>1.0.0</td> <td>Initial release</td> </tr> <tr> <td>1.0.1</td> <td>Corrected duplication error in WikiMed.zip file</td> </tr> </tbody> </table> <p> </p> <p> </p> <p> </p> <p> </p>
BirdVox-296h: a large-scale dataset for detection and classification of flight calls
<p>BirdVox 296 hours dataset (BirdVox-296h)<br> ====================================</p> <p>Version 2.1, May 2022.</p> <p><br> Created By<br> ----------</p> <p>Andrew Farnsworth (1), Benjamin Mark Van Doren (1), Steve Kelling (1), Vincent Lostanlen (2), Justin Salamon (3), Aurora Cramer (4), Juan Pablo Bello (4)</p> <p>(1): Cornell Lab of Ornithology (CLO)<br> (2): Laboratoire des Sciences du Numérique de Nantes (LS2N), CNRS<br> (3): Adobe Research<br> (4): New York University</p> <p>https://wp.nyu.edu/birdvox<br> <br> </p> <p>Description<br> ---------------</p> <p>The BirdVox-296h dataset contains 148 audio recordings, each two hours in duration. These recordings come from ROBIN autonomous recording units, placed near Ithaca, NY, USA during the fall 2015. They were captured by nine different sensors, originally numbered 1, 2, 3, 4, 5, 6, 7, 8, and 10.<br> <br> Ornithologist Andrew Farnsworth used the Raven software to pinpoint and label every avian flight call in time and frequency. He found 26138 sound events, of which 21546 are flight calls from Passeriformes. Of those, 13385 are identifiable in terms of family, and 8669 are identifiable in terms of both family and species. The annotation process took over 600 hours.</p> <p>The dataset can be used, among other things, for the research, development and testing of machine listening models for bird migration monitoring.</p> <p> </p> <p>Data Files<br> ------------</p> <p>The BirdVox-296h_wav folder contains 148 recordings as WAV files, sampled at 24 kHz, with a single channel (mono). Each recording lasts exactly two hours and is named according to the following format:</p> <p>YYYY-MM-DD_hh-mm-ss_unitUU.wav</p> <p>Where Y means Year, M means Month, D means Day, h means hour, m means minute, and s means second. This date format corresponds to the start time of the recording file, expressed in Coordinated Universal Time (UTC).</p> <p>The field UU contains two digits corresponding to the identifier of the autonomous recording unit (i.e., bioacoustic sensor). UU is either equal to 01, 02, 03, 04, 05, 06, 07, 08, or 10. Note that 09 is absent from the list because sensor 09 failed during the acquisition campaign.</p> <p> </p> <p>Metadata Files<br> -------------------</p> <p>The BirdVox-296h_csv-annotations folder contains CSV files, one for each audio file. The columns of each CSV file are:</p> <p>ID,Time (s),Frequency (Hz),Taxonomy Code,Fine Label,Medium Label,Coarse Label</p> <p><br> "Taxonomy Code" is compliant with the BirdVoxClassify software: github.com/BirdVox/BirdVoxClassify</p> <p>"Fine Label", "Medium Label", and "Coarse Label" most often correspond to species, family and order respectively.</p> <p> </p> <p>The BirdVox-296h_gps-coordinates.csv file contains the approximate GPS coordinates of the sensors (latitudes and longitudes rounded to 2 decimal points) of all nine sensors.</p> <p> </p> <p> </p> <p>Conditions of Use<br> -----------------</p> <p>Dataset created by Andrew Farnsworth, Steve Kelling, Vincent Lostanlen, Justin Salamon, Aurora Cramer, and Juan Pablo Bello.</p> <p>The BirdVox-full-night dataset is offered free of charge under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) license:<br> https://creativecommons.org/licenses/by/4.0/</p> <p>The dataset and its contents are made available on an "as is" basis and without warranties of any kind, including without limitation satisfactory quality and conformity, merchantability, fitness for a particular purpose, accuracy or completeness, or absence of errors. Subject to any liability that may not be excluded or limited by law, Cornell Lab of Ornithology is not liable for, and expressly excludes all liability for, loss or damage however and whenever caused to anyone by any use of the BirdVox-full-night dataset or any part of it.</p> <p> </p> <p>Feedback<br> -------------</p> <p>Please help us improve BirdVox-296h by sending your feedback to:<br> vincent.lostanlen@ls2n.fr and af27@cornell.edu</p> <p>In case of a problem, please include as many details as possible.</p> <p> </p> <p>Acknowledgements<br> --------------------------</p> <p>Jessie Barry, Ian Davies, Tom Fredericks, Jeff Gerbracht, Sara Keen, Holger Klinck, Anne Klingensmith, Ray Mack, Peter Marchetto, Ed Moore, Matt Robbins, Ken Rosenberg, and Chris Tessaglia-Hymes.</p> <p>We acknowledge that the land on which the data was collected is the unceded territory of the Cayuga nation, which is part of the Haudenosaunee (Iroquois) confederacy.</p>
TBGA: A Large-Scale Gene-Disease Association Dataset for Biomedical Relation Extraction
<p>This repository contains the TBGA dataset. TBGA is a large-scale, semi-automatically annotated dataset for Gene-Disease Association (GDA) extraction. The dataset consists of three text files, corresponding to train, validation, and test sets, plus an additional JSON file containing the mapping between relation names and IDs. Each record in train, validation, or test files corresponds to a single GDA extracted from a sentence. Records are represented as JSON objects with the following structure:</p> <ul> <li><strong>text:</strong> sentence from which the GDA was extracted.</li> <li><strong>relation:</strong> relation name associated with the given GDA.</li> <li><strong>h: </strong>JSON object representing the gene entity, composed of: <ul> <li><strong>id: </strong>NCBI Entrez ID associated with the gene entity.</li> <li><strong>name:</strong> NCBI official gene symbol associated with the gene entity.</li> <li><strong>pos: </strong>list consisting of starting position and length of the gene mention within text.</li> </ul> </li> <li><strong>t:</strong> JSON object representing the disease entity, composed of: <ul> <li><strong>id: </strong>UMLS CUI associated with the disease entity.</li> <li><strong>name:</strong> UMLS preferred term associated with the disease entity.</li> <li><strong>pos:</strong> list consisting of starting position and length of the disease mention within text.</li> </ul> </li> </ul> <p>TBGA contains over 200,000 instances and 100,000 bags.<br> The zip file consists of one folder, named TBGA, containing the files corresponding to the dataset.</p> <p>If you use or extend our work, please cite the following: https://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-022-04646-6#citeas<br> TBGA paper can be found at: <a href="https://rdcu.be/cKkY2">https://rdcu.be/cKkY2</a><br> TBGA code is available at: https://github.com/GDAMining/gda-extraction</p>
MOBDrone: a large-scale drone-view dataset for man overboard detection
<p><strong>Dataset</strong></p> <p>The <em>Man OverBoard Drone (MOBDrone)</em> dataset is a large-scale collection of aerial footage images. It contains 126,170 frames extracted from 66 video clips gathered from one UAV flying at an altitude of 10 to 60 meters above the mean sea level. Images are manually annotated with more than 180K bounding boxes localizing objects belonging to 5 categories --- <em>person, boat, lifebuoy, surfboard, wood</em>. More than 113K of these bounding boxes belong to the person category and localize people in the water simulating the need to be rescued.</p> <p>In this repository, we provide:</p> <ul> <li> <p>66 Full HD video clips (total size: 5.5 GB) </p> </li> <li> <p>126,170 images extracted from the videos at a rate of 30 FPS (total size: 243 GB)</p> </li> <li> <p>3 annotation files for the extracted images that follow the MS COCO data format (for more info see <a href="https://cocodataset.org/#format-data">https://cocodataset.org/#format-data</a>):</p> <ul> <li> <p><em>annotations_5_custom_classes.json</em>: this file contains annotations concerning all five categories; please note that class ids do not correspond with the ones provided by the MS COCO standard since we account for two new classes not previously considered in the MS COCO dataset --- <em>lifebuoy </em>and <em>wood</em></p> </li> <li> <p><em>annotations_3_coco_classes.json:</em> this file contains annotations concerning the three classes also accounted by the MS COCO dataset --- <em>person, boat, surfboard</em>. Class ids correspond with the ones provided by the MS COCO standard.</p> </li> <li> <p><em>annotations_person_coco_classes.json</em>: this file contains annotations concerning only the '<em>person</em>' class. Class id corresponds to the one provided by the MS COCO standard.</p> </li> </ul> </li> </ul> <p>The MOBDrone dataset is intended as a test data benchmark. However, for researchers interested in using our data also for training purposes, we provide training and test splits:</p> <ul> <li><em>Test set: </em>All the images whose filename starts with "DJI_0804" (total: 37,604 images)</li> <li><em>Training set:</em> All the images whose filename starts with "DJI_0915" (total: 88,568 images)</li> </ul> <p>More details about data generation and the evaluation protocol can be found at our MOBDrone paper: <a href="https://arxiv.org/abs/2203.07973">https://arxiv.org/abs/2203.07973</a><br> The code to reproduce our results is available at this GitHub Repository: <a href="https://github.com/ciampluca/MOBDrone_eval">https://github.com/ciampluca/MOBDrone_eval</a><br> See also <strong> </strong><a href="http://aimh.isti.cnr.it/dataset/MOBDrone">http://aimh.isti.cnr.it/dataset/MOBDrone</a></p> <p><strong>Citing the MOBDrone</strong></p> <p>The MOBDrone is released under a Creative Commons Attribution license, so please cite the MOBDrone if it is used in your work in any form.<br> Published academic papers should use the academic paper citation for our MOBDrone paper, where we evaluated several pre-trained state-of-the-art object detectors focusing on the detection of the overboard people</p> <blockquote> <pre>@inproceedings{MOBDrone2021, title={MOBDrone: a Drone Video Dataset for Man OverBoard Rescue}, author={Donato Cafarelli and Luca Ciampi and Lucia Vadicamo and Claudio Gennaro and Andrea Berton and Marco Paterni and Chiara Benvenuti and Mirko Passera and Fabrizio Falchi}, booktitle={ICIAP2021: 21th International Conference on Image Analysis and Processing}, year={2021} } </pre> </blockquote> <p>and this Zenodo Dataset</p> <blockquote> <pre>@dataset{donato_cafarelli_2022_5996890, author={Donato Cafarelli and Luca Ciampi and Lucia Vadicamo and Claudio Gennaro and Andrea Berton and Marco Paterni and Chiara Benvenuti and Mirko Passera and Fabrizio Falchi}, title = {{MOBDrone: a large-scale drone-view dataset for man overboard detection}}, month = feb, year = 2022, publisher = {Zenodo}, version = {1.0.0}, doi = {10.5281/zenodo.5996890}, url = {https://doi.org/10.5281/zenodo.5996890} }</pre> </blockquote> <p>Personal works, such as machine learning projects/blog posts, should provide a URL to the MOBDrone Zenodo page (<a href="https://doi.org/10.5281/zenodo.5996890">https://doi.org/10.5281/zenodo.5996890</a>), though a reference to our MOBDrone paper would also be appreciated.</p> <p> </p> <p><strong>Contact Information</strong></p> <p>If you would like further information about the MOBDrone or if you experience any issues downloading files, please contact us at <a href="mailto:mobdrone@isti.cnr.it">mobdrone[at]isti.cnr.it</a></p> <p> </p> <p><strong>Acknowledgements</strong></p> <p>This work was partially supported by NAUSICAA - "NAUtical Safety by means of Integrated Computer-Assistance Appliances 4.0" project funded by the Tuscany region (CUP D44E20003410009). The data collection was carried out with the collaboration of the Fly&Sense Service of the CNR of Pisa - for the flight operations of remotely piloted aerial systems - and of the Institute of Clinical Physiology (IFC) of the CNR - for the water immersion operations. </p>
A Large-scale Dataset of (Open Source) License Text Variants
<p>We introduce a large-scale dataset of the complete texts of free/open source software (FOSS) license variants. To assemble it we have collected from the Software Heritage archive—the largest publicly available archive of FOSS source code with accompanying development history—all versions of files whose names are commonly used to convey licensing terms to software users and developers.<br> The dataset consists of 6.5 million unique license files that can be used to conduct empirical studies on open source licensing, training of automated license classifiers, natural language processing (NLP) analyses of legal texts, as well as historical and phylogenetic studies on FOSS licensing.<br> Additional metadata about shipped license files are also provided, making the dataset ready to use in various contexts; they include: file length measures, detected MIME type, detected SPDX license (using ScanCode), example origin (e.g., GitHub repository), oldest public commit in which the license appeared.<br> The dataset is released as open data as an archive file containing all deduplicated license blobs, plus several portable CSV files for metadata, referencing blobs via cryptographic checksums.</p> <p>For more details see the included README file and companion paper:</p> <ul> <li>Stefano Zacchiroli. <a href="https://doi.org/10.1145/3524842.3528491"><em>A Large-scale Dataset of (Open Source) License Text Variants</em></a>. In proceedings of the <a href="https://conf.researchr.org/home/msr-2022">2022 Mining Software Repositories Conference (MSR 2022)</a>. 23-24 May 2022 Pittsburgh, Pennsylvania, United States. ACM 2022.</li> </ul> <p>If you use this dataset for research purposes, please acknowledge its use by citing the above paper.</p> <ul> </ul>
LARD: Large-scale Artificial Disfluency Generation
<p>This dataset contains 95,992 examples of utterances with 71,994 artificial inserted disfluencies using the LARD method. We use the <a href="https://arxiv.org/pdf/1801.04871.pdf">Schema-Guided Dialogue (SGD) </a>dataset as a base to construct the synthetic disfluencies. The LARD dataset contains three different types of disfluencies: repetitions, replacements, and restarts. </p>
HISTORIAN: a large-scale HISTORIcal film dataset with cinematographic ANnotation
<p>Developing automated tools for sustainable film preservation of extensive historical film collections assumes an understanding of fundamental cinematographic settings. In order to be able to investigate new approaches to detect and classify cinematographic settings, this paper proposes a novel large-scale historical film dataset with cinematographic annotations (HISTORIAN), i.e., shot boundaries, shot types, camera movements. The dataset consists of 98 digitized original analog film reels related to the Second World War and 10593 film shots manually annotated by human film experts. Moreover, annotations for overscan areas such as sprocket holes are included. A baseline film analysis pipeline is introduced and evaluated. To the best of our knowledge, HISTORIAN is the first dataset that covers the challenges and characteristics of historical film documentaries and provides novel possibilities for exploring automatic film analysis tools.</p> <p>This repository presents a tiny set including a few examples for demonstration.</p> <p>A link to the Github repository (including helper scripts and readme) can be found <a href="https://github.com/dahe-cvl/historian_dataset">here</a></p> <p> </p> <p> </p> <p> </p> <p> </p>
Influence of Large-scale Land-sea Atmosphere Interaction on Ozone Pollution in Coastal Cities in the Northern Bohai Sea
<p><strong>O3_obs </strong>includes ozone observations for Qinhuangdao (QHD), Jinzhou (JZ), Yingkou (YK), Dalian (DL) from 29 August to 5 September 2017, and the information of four sites including station code, longitude and latitude. <strong>O3_sim</strong> includes ozone simulation in the four sites extracted according to location of them. <strong>Met_obs</strong> and <strong>Met_sim</strong> include the observations of 2 m temperature (℃), 2 m relative humidity (RH2) and 10 m wind speed for the 4 stations from 29 August to 5 September 2017, and the information of four stations including station code and their location. <strong>Slp_wind_9km.nc</strong> is mean sea-level pressure and wind in Phase Ⅰ and Phase Ⅱ. <strong>O3_wind_9km.nc</strong> is mean simulated surface ozone mixing ratios and wind at 10 m in 19:00-09:00 LT and 10:00-18:00 LT during Phase Ⅰ and Phase Ⅱ. <strong>Process_contribution </strong>includes mean surface O<sub>3</sub> mixing ratios and O<sub>3</sub> contribution at the bottom level in Phase Ⅰ, Phase Ⅱ, and at different heights (AGL) in Phase Ⅱ in four sites, respectively. <strong>O3_source_site</strong> includes time series of O<sub>3 </sub>source in QHD, JZ, YK, and DL. <strong>Mean_source_base_27km.nc </strong>is the mean O­<sub>3</sub> contribution in Phase Ⅰ and Phase Ⅱ from five primary exogenous source regions. <strong>Mean_source_control_27km.nc</strong> is the O<sub>3</sub> contribution in Phase Ⅱ from the BTH and NEC emissions in Phase I, in which BTH and NEC’s emissions in Phase Ⅱ are set zero. <strong>Trjectory_conc_pa</strong> includes three trajectories analyzed in this work and vertical O<sub>3</sub> and NO<sub>X</sub> mixing ratios, and the chemical generations and consumptions of O<sub>3</sub> within the air masses along the trajectories.</p>
The COUGHVID crowdsourcing dataset: A corpus for the study of large-scale cough analysis algorithms
<p><strong>Overview</strong></p> <p>Cough audio signal classification has been successfully used to diagnose a variety of respiratory conditions, and there has been significant interest in leveraging Machine Learning (ML) to provide widespread COVID-19 screening. The COUGHVID dataset provides over 30,000 crowdsourced cough recordings representing a wide range of subject ages, genders, geographic locations, and COVID-19 statuses. Furthermore, experienced pulmonologists labeled more than 2,000 recordings to diagnose medical abnormalities present in the coughs, thereby contributing one of the largest expert-labeled cough datasets in existence that can be used for a plethora of cough audio classification tasks. As a result, the COUGHVID dataset contributes a wealth of cough recordings for training ML models to address the world’s most urgent health crises.</p> <p><strong>Private Set and Testing Protocol</strong></p> <p>Researchers interested in testing their models on the private test dataset should contact us at coughvid@epfl.ch, briefly explaining the type of validation they wish to make, and their obtained results obtained through cross-validation with the public data. Then, access to the unlabeled recordings will be provided, and the researchers should send the predictions of their models on these recordings. Finally, the performance metrics of the predictions will be sent to the researchers. The private testing data is not included in any file within our Zenodo record, and it can only be accessed by contacting the COUGHVID team at the aforementioned e-mail address.</p> <p><strong>New Semi-Supervised Labeling</strong></p> <p>The third version of the COUGHVID dataset contains thousands of additional recordings obtained through October 2021. Additionally, the recordings containing coughs were re-labeled according to a semi-supervised learning algorithm that combined the user labels with those of the expert physicians, which were modeled using ML and expanded on the previously unlabeled data. These labels can be found in the "status_SSL" column of the "metadata_compiled.csv" file.</p>
Bus Violence: a large-scale benchmark for video violence detection in public transport
<p><strong>Dataset</strong></p> <p>The <em>Bus Violence </em>dataset<em> </em>is a large-scale collection of videos depicting violent and non-violent situations in public transport environments. This benchmark was gathered from multiple cameras located inside a moving bus where several people simulated violent actions, such as stealing an object from another person, fighting between passengers, etc. It contains 1,400 video clips manually annotated as having or not violent scenes, making it one of the biggest benchmarks for video violence detection in the literature.</p> <p>Specifically, videos are recorded from three cameras at 25 Frames Per Second (FPS) --- two cameras located in the corners of the bus (with resolution 960x540 px) and one fisheye in the middle (1280x960 px). The clips have a minimum length of 16 frames and a maximum of 48 frames, capturing a very precise action (either violence or non-violence). The dataset is perfectly balanced, containing 700 videos of violence and 700 videos of non-violence.</p> <p>The <em>Bus Violence</em> dataset is intended as a test data benchmark. However, for researchers interested in using our data also for training purposes, we provide training and test splits.</p> <p>In this repository, we provide</p> <ul> <li> <p>the 1,400 video clips divided into two folders named Violence /NoViolence, containing clips of violent situations and non-violent situations, respectively;</p> </li> <li> <p>two txt files containing the names of the videos belonging to the training and test splits, respectively.</p> </li> </ul> <p> </p> <p><strong>Citing our work</strong></p> <p>If you found this dataset useful, please cite the following paper</p> <blockquote> <pre>@inproceedings{bus_violence_dataset_2022, title = {Bus Violence: An Open Benchmark for Video Violence Detection on Public Transport}, doi = {10.3390/s22218345}, url = {https://doi.org/10.3390%2Fs22218345}, year = 2022, month = {oct}, publisher = {{MDPI} {AG}}, volume = {22}, number = {21}, pages = {8345}, author = {Luca Ciampi and Pawe{\l} Foszner and Nicola Messina and Micha{\l} Staniszewski and Claudio Gennaro and Fabrizio Falchi and Gianluca Serao and Micha{\l} Cogiel and Dominik Golba and Agnieszka Szcz{\k{e}}sna and Giuseppe Amato}, journal = {Sensors} } </pre> </blockquote> <p>and this Zenodo Dataset</p> <blockquote> <pre>@dataset{pawel_bus_violence_zenodo, author = {Paweł Foszner, Michał Staniszewski, Agnieszka Szczęsna, Michał Cogiel, Dominik Golba, Luca Ciampi, Nicola Messina, Claudio Gennaro, Fabrizio Falchi, Giuseppe Amato, Gianluca Serao}, title = {{Bus Violence: a large-scale benchmark for video violence detection in public transport}}, month = sep, year = 2022, publisher = {Zenodo}, version = {1.0.0}, doi = {10.5281/zenodo.7044203}, url = {https://doi.org/10.5281/zenodo.7044203} } </pre> </blockquote> <p> </p> <p><strong>Contact Information</strong></p> <p>Blees Sp. z o.o., Gliwice, Poland<br> mstaniszewski@blees.co</p> <p> </p> <p><strong>Acknowledgments</strong></p> <p>The presented dataset was supported by: European Union funds awarded to Blees Sp. z o.o. under grant POIR.01.01.01-00-0952/20-00 “Development of a system for analysing vision data captured by public transport vehicles interior monitoring, aimed at detecting undesirable situations/behaviours and passenger counting (including their classification by age group) and the objects they carry”); EC H2020 project "AI4media: a Centre of Excellence delivering next generation AI Research and Training at the service of Media, Society and Democracy" under GA 951911; research project INAROS (INtelligenza ARtificiale per il mOnitoraggio e Supporto agli anziani), Tuscany POR FSE CUP B53D21008060008.</p> <p> </p> <p><strong>License</strong></p> <p>The <em>Bus Violence </em>dataset was acquired by Blees Sp. z o.o. and is released under a Creative Commons Attribution license for non-commercial use.</p>
LSPO: A Large-Scale Physics ORCiD-Linked Dataset for Author Name Disambiguation
<p>The LSPO dataset, a Large-Scale Physics ORCiD-Linked Dataset for Author Name Disambiguation is comprised of 554,962 NASA/ADS publications linked to 125,486 unique researchers through ORCiD identifiers. The available meta-data fields are: ORCiD identifier, author name, affiliation, title, asbtract, and name block. The dataset can be utilized to make pairs or triplets for training a author name disambiguation model. </p>
Datasets for "Advancing Drug-Target Interactions Prediction: Leveraging a Large-Scale Dataset with a Rapid and Robust Chemogenomic Algorithm"
<p>All datasets required to reproduce the results of publication "Drug-Target Interactions Prediction at Scale: the Komet Algorithm with the LCIdb Dataset"</p>
Archetypes of climate change adaptation among large-scale arable farmers in southern Romania
<p>Supplementary material belonging to the publication.</p> <p>Two files:</p> <p>1. Excel file with database containing raw data and information resulted from surveying a sample of 30 farmers/farm managers in southern lowlands of Romania between April and June 2020.</p> <p>2. PDF with interview guideline</p>
Final model for "Automated Large-Scale Full Seismic Waveform Inversion for North America and the North Atlantic" by Krischer et al. (2018)
<p>The HDF5 file contains the final model of the paper "Automated Large-Scale Full Seismic Waveform Inversion for North America and the North Atlantic" by Krischer et al. (2018), soon to be published in the Journal of Geophysical Research - Solid Earth.</p> <p>The "coordinates_0", "coordinates_1", and "coordinates_2" data sets are the coordinates along each dimension, here colatitude in degree, longitude in degree, and radius in meter, respectively. The regularly sampled data is available in five 3D-arrays in the "data" group: "vp", "vsv", "vsh", "rho", and "Q". Velocities are defined at 1 Hertz and are given in km/s, the density in kg/m^3. Q is Q_mu.</p> <p>The coordinates have to be rotated to yield true spherical Earth coordinates. They have to be rotated around on axis vector of 0.766044443118978/0.6427876096865393/0.0 in cartesian x/y/z coordinates by -30.0 degrees. Conversion of spherical to cartesian coordinates happens with the standard convention:</p> <p>x = r sin(theta) cos(phi)<br> y = r sin(theta) sin(phi)<br> z = r cos(theta)</p>
WALOWA (WAve LOads on WAlls) - Large-scale Experiments in the Delta Flume on Overtopping Wave Loads on Vertical Walls
<p>Coasts of low lying countries are often comprised of a gentle foreshore and shallow waters, followed by a dike and a promenade. At the end of the promenade buildings or storm walls are constructed. This setting makes it possible for waves to overtop the dike and impact on the storm wall or building. Especially during storm season the overtopping waves induce large loads on these structures. New scenarios for climate change and sea level rise make it worthwhile to invest in research regarding overtopping wave loads.</p> <p>Within the European project 'Wave Loads on Walls' (WaLoWa) model tests in the Delta flume (The Netherlands) were conducted. It is the aim to study overtopping wave loads on storm walls and buildings. The project is coordinated by Ghent University (Belgium), in cooperation with TU Delft (The Netherlands), RWTH Aachen (Germany), University of Bari, University of L'Aquila, University of Calabria and University of Florence (Italy) and Flanders Hydraulics Research (Belgium). The project is financed by a grant by Hydralab+ in the framework of the EC Horizon 2020 program.</p> <p>A model geometry comprised of a sandy beach, a sloping dike, promenade and wall structure was built into the Delta flume. The beach alone consists of 1000m³ sand material and was an essential part of the structure, to obtain the broken wave conditions similar to reality. Waves representing a storm with a 1000 year return period and an additional water level to account for sea level rise result in the tested superstorm conditions.</p> <p>Measurements of the water surface elevation were taken close to the paddle, along the mildly sloping foreshore and at the dike toe location by resistance type wave gauges mounted to the flume side wall. The bathymetry of the sandy foreshore was measured by a mechanical profiler before and after the test. The overtopping flow properties thickness and velocity were measured by resistance type wave gauges, ultra-sonic distance sensors, paddle wheels and an electro-magnetic current meter installed along the promenade. Finally, the impact forces and pressures on the wall were measured by compression load cells and pressure sensors respectively. The data-set was complemented by a number of synoptic measurements, such as laser scan profiles, GoPro images, High-speed camera images, Digital camera images. Due to its large storage size, these data are provided on request.</p>
UnientrezDB: Large-scale Gene Ontology Annotation Dataset and Evaluation Benchmarks with Unified Entrez Gene Identifiers
<p>Our work focuses on providing a comprehensive dataset and benchmarks for evaluating gene ontology annotations using a unified system of Entrez Gene Identifiers.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.