Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
5
datasets available to search
ShareScore release 0.9.0
Dataset results
5 results for “sound separation”
Free Universal Sound Separation Dataset
<p>The Free Universal Sound Separation (FUSS) Dataset is a database of arbitrary sound mixtures and source-level references, for use in experiments on arbitrary sound separation. </p> <p>This is the official sound separation data for the DCASE2020 Challenge Task 4: Sound Event Detection and Separation in Domestic Environments.</p> <p><strong>Citation: </strong>If you use the FUSS dataset or part of it, please cite our paper describing the dataset and baseline [1]. FUSS is based on <a href="https://annotator.freesound.org/fsd/">FSD data</a> so please also cite [2]:</p> <p><strong>Overview: </strong>FUSS audio data is sourced from a pre-release of <a href="https://annotator.freesound.org/fsd/">Freesound dataset</a> known as (FSD50k), a sound event dataset composed of Freesound content annotated with labels from the AudioSet Ontology. Using the FSD50K labels, these source files have been screened such that they likely only contain a single type of sound. Labels are not provided for these source files, and are not considered part of the challenge. For the purpose of the DCASE Task4 Sound Separation and Event Detection challenge, systems should not use FSD50K labels, even though they may become available upon FSD50K release.</p> <p>To create mixtures, 10 second clips of sources are convolved with simulated room impulse responses and added together. Each 10 second mixture contains between 1 and 4 sources. Source files longer than 10 seconds are considered "background" sources. Every mixture contains one background source, which is active for the entire duration. We provide: a software recipe to create the dataset, the room impulse responses, and the original source audio.</p> <p><strong>Motivation for use in DCASE2020 Challenge Task 4: </strong> This dataset provides a platform to investigate how source separation may help with event detection and vice versa. Previous work has shown that universal sound separation (separation of arbitrary sounds) is possible [3], and that event detection can help with universal sound separation [4]. It remains to be seen whether sound separation can help with event detection. Event detection is more difficult in noisy environments, and so separation could be a useful pre-processing step. Data with strong labels for event detection are relatively scarce, especially when restricted to specific classes within a domain. In contrast, source separation data needs no event labels for training, and may be more plentiful. In this setting, the idea is to utilize larger unlabeled separation data to train separation systems, which can serve as a front-end to event-detection systems trained on more limited data.</p> <p><strong>Room simulation: </strong>Room impulse responses are simulated using the image method with frequency-dependent walls. Each impulse corresponds to a rectangular room of random size with random wall materials, where a single microphone and up to 4 sources are placed at random spatial locations.</p> <p><strong>Recipe for data creation: </strong>The data creation recipe starts with scripts, based on<a href="https://github.com/justinsalamon/scaper"> scaper</a> [5], to generate mixtures of events with random timing of source events, along with a background source that spans the duration of the mixture clip. The scipts for this are at<a href="https://github.com/google-research/sound-separation/tree/master/datasets/fuss"> this GitHub repo</a>.</p> <p>The data are reverberated using a different room simulation for each mixture. In this simulation each source has its own reverberation corresponding to a different spatial location. The reverberated mixtures are created by summing over the reverberated sources. The dataset recipe scripts support modification, so that participants may remix and augment the training data as desired.</p> <p>The constituent source files for each mixture are also generated for use as references for training and evaluation. The dataset recipe scripts support modification, so that participants may remix and augment the training data as desired.</p> <p>Note: no attempt was made to remove digital silence from the freesound source data, so some reference sources may include digital silence, and there are a few mixtures where the background reference is all digital silence. Digital silence can also be observed in the event recognition public evaluation data, so it is important to be able to handle this in practice. Our evaluation scripts handle it by ignoring any reference sources that are silent. </p> <p><strong>Format: </strong>All audio clips are provided as uncompressed PCM 16 bit, 16 kHz, mono audio files.</p> <p><strong>Data split: </strong> The FUSS dataset is partitioned into "train", "validation", and "eval" sets, following the same splits used in FSD data. Specifically, the train and validation sets are sourced from the FSD50K dev set, and we have ensured that clips in train come from different uploaders than the clips in validation. The eval set is sourced from the FSD50K eval split.</p> <p><strong>Baseline System: </strong>A baseline system for the FUSS dataset is available at <a href="https://github.com/google-research/sound-separation/tree/master/datasets/fuss">dcase2020_fuss_baseline</a>.</p> <p><strong>License: </strong>All audio clips (i.e., in FUSS_fsd_data.tar.gz) used in the preparation of Free Universal Source Separation (FUSS) dataset are designated Creative Commons (CC0) and were obtained from<a href="http://freesound.org"> freesound.org</a>. The source data in FUSS_fsd_data.tar.gz were selected using labels from the<a href="https://annotator.freesound.org/fsd/"> FSD50K corpus</a>, which is licensed as Creative Commons Attribution 4.0 International (CC BY 4.0) License.</p> <p>The FUSS dataset as a whole, is a curated, reverberated, mixed, and partitioned preparation, and is released under the Creative Commons Attribution 4.0 International (CC BY 4.0) License. This license is specified in the `LICENSE-DATASET` file downloaded with the `FUSS_license_doc.tar.gz` file.</p> <p><strong>Notes:</strong></p> <p>Added in v1.2: </p> <ul> <li>FUSS_baseline_dry_model.tar.gz: baseline separation model trained on non-reverberated (dry) data. </li> <li>FUSS_DESED_baseline_dry_2_model.tar.gz:: baseline separation model for the DESED task, trained on a mixture of DESED in-domain data and FUSS data</li> </ul> <p>Added in v1.3:</p> <ul> <li>FUSS_DESED_baseline_dry_1_model.tar.gz: baseline separation model for the DESED task, trained to separate DESED mixtures from dry FUSS mixtures (DmFm)</li> <li>FUSS_DESED_baseline_dry_4_model.tar.gz: baseline separation model for the DESED task, trained to separate DESED background, dry FUSS mixture, and 5 DESED foreground sources with PIT (PIT)</li> <li>FUSS_DESED_baseline_dry_4np_model.tar.gz: baseline separation model for the DESED task, trained to separate DESED background, 10 DESED classes, and dry FUSS mixture without PIT (Classwise)</li> <li>FUSS_DESED_baseline_dry_6_model.tar.gz: baseline separation model for the DESED task, trained to separate DESED background, 5 DESED foreground sources, 4 dry FUSS sources, with groupwise PIT (GroupPIT)</li> </ul> <p>The names in parentheses are the task names from Table 3 of the following paper: <a href="https://arxiv.org/pdf/2007.03932.pdf">Nicolas Turpault, Scott Wisdom, Hakan Erdogan, John R. Hershey, Romain Serizel, Eduardo Fonseca, Prem Seetharaman, and Justin Salamon, "Improving Sound Event Detection in Domestic Environments using Sound Separation", DCASE 2020.</a></p>
Auditory Scene Analysis dataset (Multichannel universal sound separation & polyphonic audio classification)
<p>We constructed a new dataset for <strong>multichannel universal sound separation</strong> and <strong>polyphonic audio classification</strong> tasks.</p> <p>We constructed a new dataset for multichannel USS and polyphonic audio classification tasks. The proposed dataset is designed to reflect various conditions, including moving sources with temporal onsets and offsets. For foreground sound sources, signals from 13 audio classes were selected from open-source databases (Pixabay and FSD50K, Librispeech, MUSDB18, Vocalsound). These signals were resampled to 16 kHz and pre-processed by either padding zeros or cropping to 4 seconds. Each sound source has a 75% probability of being a moving source, with speeds ranging from 0 to 3 m/s. The dataset features between 2 to 4 foreground sound sources, along with one background noise from the diffused TAU-SNoise dataset with a signal-to-noise ratio (SNR) ranging from 6 to 30 dB. The simulations were conducted using gpuRIR. Room dimensions were set to a width and length between 5 and 8 meters, and a height between 3 and 4 meters, with reverberation times ranging from 0.2 to 0.6 seconds. These parameters were sampled from uniform distributions. We simulated spatialized sound sources using a 4-channel tetrahedral microphone array with a radius of 4.2 cm. The procedure for dataset generation and details about class configuration and durations of audio clips are provided in the paper. This dataset poses a significant challenge for separation tasks due to the inclusion of moving sources, onset and offset conditions, overlapped in-class sources, and noisy reverberant environments.</p> <p>The procedure for dataset generation and details about class configuration and durations of audio clips are provided in the paper. This dataset poses a significant challenge for separation tasks due to the inclusion of moving sources, onset and offset conditions, overlapped in-class sources, and noisy reverberant environments.</p>
Test dataset for separation of speech, traffic sounds, wind noise, and general sounds
<p>The dataset was generated as part of the paper:<br> Deep Complex U-Net Ensemble for Outdoor Urban Sound Source Separation,<br> K. Arendt, A. Szumaczuk, B. Jasik, P. Masztalski, K. Piaskowski, M. Matuszewski, K. Nowicki, P. Zborowski.</p> <p>It contains various sounds from the Audio Set [1] and spoken utterances from VCTK [2] and DNS [3] datasets.</p> <p>Contents:<br> sr_8k/<br> mix_clean/<br> s1/<br> s2/<br> s3/<br> s4/<br> sr_16k/<br> mix_clean/<br> s1/<br> s2/<br> s3/<br> s4/<br> sr_48k/<br> mix_clean/<br> s1/<br> s2/<br> s3/<br> s4/</p> <p>Each directory contains 512 audio samples in different sampling rate (sr_8k - 8 kHz, sr_16k - 16 kHz, sr_48k - 48 kHz).<br> The audio samples for each sampling rate are different as they were generated randomly and separately.<br> Each directory contains 5 subdirectories:<br> - mix_clean - mixed sources,<br> - s1 - source #1 (general sounds),<br> - s2 - source #2 (speech),<br> - s3 - source #3 (traffic sounds),<br> - s4 - source #4 (wind noise).</p> <p>The sound mixtures were generated by adding s2, s3, s4 to s1 with SNR ranging from -10 to 10 dB w.r.t. s1.</p> <p><br> REFERENCES:</p> <p>[1] Jort F. Gemmeke, Daniel P. W. Ellis, Dylan Freedman,<br> Aren Jansen, Wade Lawrence, R. Channing Moore,<br> Manoj Plakal, and Marvin Ritter, “Audio set: An ontology<br> and human-labeled dataset for audio events,” in<br> Proc. IEEE ICASSP 2017, New Orleans, LA, 2017.</p> <p>[2] Christophe Veaux, Junichi Yamagishi, and Kirsten Mac-<br> Donald, “CSTR VCTK corpus: English multi-speaker<br> corpus for CSTR voice cloning toolkit, [sound],”<br> https://doi.org/10.7488/ds/1994, University of Edinburgh.<br> The Centre for Speech Technology Research<br> (CSTR). 2017.</p> <p>[3] Chandan K. A. Reddy, Ebrahim Beyrami, Harishchandra<br> Dubey, Vishak Gopal, Roger Cheng, Ross Cutler,<br> Sergiy Matusevych, Robert Aichner, Ashkan Aazami,<br> Sebastian Braun, Puneet Rana, Sriram Srinivasan, and<br> Johannes Gehrke, “The interspeech 2020 deep noise<br> suppression challenge: Datasets, subjective speech<br> quality and testing framework,” 2020.</p>
A large joint sound scene and sound event dataset for source separation of foreground sound events
<p>This large scale data set contains 10000 samples of sound scenes generated from real world recordings, and the original source recordings. It includes 10 different backgrounds with 6-9 appropriate foreground sound events. Strong labels (timed annotations) are provided in four formats for all samples. The original sourceids to identify the class type, a two source method to simply separate foreground and backgrounds, a 32 source annotation for all distinct foregrounds, and a by background (scene) type annotation where sources are according to the background. </p> <p>Baseline results will be presented later in 2020. Further evolutions of this dataset will also be produced with more complex, polyphonic foreground sound events. Please email h.bear@qmul.ac.uk with any questions.</p> <p>Data is free to use for Research purposes only. </p>
Audio-visual sound source localization and separation
<p>CVPR 2021 tutorial</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.