Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
693
datasets available to search
ShareScore release 0.7.1
Dataset results
693 results for “Vocalizations”
Bioacoustic Dataset of African and Florida Manatee Vocalizations for Machine Learning Applications, 2020-2022
This data package presents a comprehensive acoustic library of manatee vocalizations for machine learning (ML) and classifier development. It includes recordings from two species, African and Florida manatees, sampled across four locations. The species are combined due to the acoustic similarity of their vocalizations, providing a diverse and representative training set for ML algorithms. The dataset consists of 0.5-second WAV clips categorized as either containing manatee vocalizations (MV, n=18,129 clips) or not (Noise, n=23,444 clips). MV clips may include multiple vocalizations or truncated calls. All clips were manually verified by two researchers with expertise in manatee acoustics. Recordings were collected using stationary hydrophones deployed in natural habitats, with variable signal-to-noise ratios (SNR) resulting from changes in distance between the vocalizing manatees and the recorders. Background noise across sites is relatively low, with minimal anthropogenic noise; caution is advised when applying models to noisier environments. No dolphin species are believed to be present at the recording sites, and models trained on this dataset should be used cautiously in dolphin-inhabited regions to avoid false positives. If you use this dataset, please reach out to the listed contacts, we are interested in learning how it supports your work.
Underwater sounds, including killer whale and humpback whale vocalizations, recorded in northern Norway in January 2023
<p>Dataset of underwater acoustic recordings obtained during the expedition “Orcalize” that took place in Skjervøy in northern Norway from 29<sup>th</sup> December 2022 till 6<sup>th</sup> January 2023. The data contains vocalizations from killer whales and songs from humpback whales which gather in the local fjords during the winter months to feed on herring. We recorded in the band of 20 Hz – 60 kHz with calibrated hydrophones arranged in a compact tetrahedral array that we deployed over board of a motorboat. In total we provide 16 files of continuous recordings with duration from several minutes to over one hour. The total dataset is about 7 hours 37 minutes long and the memory size is 62.8 GB. See the file info.pdf for more information.</p>
Guinea baboon vocalizations dataset automatically extracted with a deep neural network from natural audio recordings
<p><strong>Abstract</strong></p> <p>The data collection process consisted of continuously recording during one month a group of Guinea baboons living in semi-liberty at the CNRS primatology center in Rousset-sur-Arc (France). Two microphones we placed nearby their enclosure to continuously record the sounds produced by the group. A convolutional neural network (CNN) was used on these large and noisy audio recordings to automatically extract segments of sound containing a baboon vocal production by following the method of <a href="https://arxiv.org/abs/2302.07640">Bonafos et al. (2023)</a>. The resulting dataset consists of one-second to several-minute wav files of automatically detected vocalizations segments. The dataset thus provides a wide range of baboon vocalizations produced at all times of the day. It can be used to study vocal productions of non-human primates, their repertoire, their distribution over the day, their frequency, and their heterogeneity. In addition to the analysis of animal communication, the dataset can also be used as a learning base for sound classification models.</p> <p> </p> <p><strong>Data acquisition</strong></p> <p>The data are audio recordings of baboons. The recordings were made with a H6 Zoom recorder, using the included XYH-6 stereo microphone. The sample size is 44100 Hertz, 16 bits. The microphones were placed in the vicinity of the enclosure for one month and recorded continuously on a PC computer. A CNN passed over the data with a sliding window of 1 second and an overlap of 80% to detect the vocal productions of the baboons. The dataset consists of the segments predicted by the CNN to contain a baboon vocalization. Windows containing signal less than one second apart were merged into a single vocalization.</p> <p> </p> <p><strong>Data source location</strong></p> <ul> <li>Institution: CNRS, Primate Facility</li> <li> <p>City/Town/Region: Rousset-sur-Arc</p> </li> <li> <p>Country: France</p> </li> <li> <p>Latitude and longitude for collected samples/data: 43.47033535251509, 5.6514732876668905</p> </li> </ul> <p> </p> <p><strong>Value of the data</strong></p> <ul> <li> <p>This dataset is relatively unique in terms of the quantity of vocalizations available.</p> </li> <li> <p>This massive dataset can be very useful to two types of scientific communities: experts in primatology who study the vocal productions of non-human primates, and experts in data science and audio signal processing.</p> </li> <li> <p>The machine learning research community has at its disposal a database of several dozen hours of animal vocalizations, which will make it possible to build up a large learning base, very useful for Environemental Sound Recognition tasks, for example.</p> </li> </ul> <p> </p> <p><strong>Objective</strong></p> <p>This dataset is a follow-up of two studies on the vocal productions of Guinea baboons (Papio papio) in which we carried out analyses of their vocal productions on the basis of a relatively large vocalization sample containing around 1300 vocalizations (<a href="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0169321">Boë, Berthommier, Legou, Captier, Kemp, Sawallis, Becker, Rey, & Fagot, 2017</a>; <a href="https://hal.science/hal-01649539">Kemp, Rey, Legou, Boë, Berthommier, Becker, & Fagot, 2017</a>). The aim was to collect a larger database using the technique of deep convolutional neural networks in order to 1) automatically detect vocal productions in a large continuous audio recording and 2) perform a categorization of these vocalizations on a more massive sample. A description of the pipeline that enabled these automatic detections and categorizations is given in <a href="https://arxiv.org/abs/2302.07640">Bonafos, Pudlo, Freyermuth, Legou, Fagot, Tronçon, & Rey (2023)</a>.</p> <p> </p> <p><strong>Data description</strong></p> <p>The data is a set of audio files in wav format. They are at least one second long (the size of the window), up to several minutes, if several windows are consecutively predicted as containing signal. Moreover, we add the labeled data we used to train the CNN which did the prediction. We also provide two hours of the continuous recordings to have an idea of the continuous recordings and test the code of the paper provided on <a href="https://gitlab.com/papers4375727/detection-and-classification-of-vocal-productions">gitlab</a>.</p> <p>In addition, there is a database in csv format listing all the vocalizations, the day and time of their production, and the prediction probabilities of the model.</p> <p> </p> <p><strong>Experimental design, materials and methods</strong></p> <p>The original recordings represent one month of continuous audio recording. Seven hours of this month were manually labelled. They were segmented and labelled according to whether or not there was a monkey vocalization (i.e., noise or vocalization) and, if there was a vocalization, according to the type of vocalization (6 possible classes: bark, copulation grunt, grunt, scream, yak, wahoo). These manually labelled data were used as a training set for a CNN, which was automatically trained following the pipeline of Bonafos et al. (2023). This model was then used to automatically detect and classify vocalization during the whole month of audio recording. It processes the data in the same way when predicting new data as it does when training. It uses a sliding window of one second with an overlap of 80%. It does not take into account information from previous predictions, but calculates the probability of a vocalization in each one-second window independently. It then iterates through the month. For each window, the model predicts two outputs: the probability that there is a vocalization and the probability of each class of vocalization.</p> <p>For the purpose of generating the wav files, if a window has a probability of a vocalization greater than 0.5, it is considered to contain a vocalization. If it is the first one, a vocalization is started at that moment. If the time windows that follow a vocalization also contain a vocalization, then the signal they contain is added to the first segment for which a vocalization has been detected. As soon as a one-second segment no longer contains a signal corresponding to a vocalization, the wav file is closed. If windows are predicted to contain no vocalizations, but are between two windows that contain vocalizations within 1 second of each other, then all windows are merged.</p>
CatMeows: A Publicly-Available Dataset of Cat Vocalizations
<p><strong>Abstract</strong></p> <p>This dataset, composed of 440 sounds, contains meows emitted by cats in different contexts. Specifically, 21 cats belonging to 2 breeds (Maine Coon and European Shorthair) have been repeatedly exposed to three different stimuli that were expected to induce the emission of meows:</p> <ol> <li><em>Brushing</em> - Cats were brushed by their owners in their home environment for a maximum of 5 minutes;</li> <li><em>Isolation in an unfamiliar environment</em> - Cats were transferred by their owners into an unfamiliar environment (e.g., a room in a different apartment or an office). Distance was minimized and the usual transportation routine was adopted so as to avoid discomfort to animals. The journey lasted less than 30 minutes and cats were allowed 30 minutes with their owners to recover from transportation, before being isolated in the unfamiliar environment, where they stayed alone for maximum 5 minutes;</li> <li><em>Waiting for food</em> - The owner started the routine operations that preceded food delivery in the usual environment the cat was familiar with. Food was given at most 5 minutes after the beginning of the experiment.</li> </ol> <p>The dataset has been produced and employed in the context of an interdepartmental project of the University of Milan (for further information, please refer to this <a href="https://doi.org/10.3390/ani9080543">doi</a>). The content of the dataset has been described in detail in a scientific work currently under review; the reference will be provided as soon as the paper is published.</p> <p><strong>File naming conventions </strong></p> <p>Files containing meows are in the <em>dataset.zip</em> archive. They are PCM streams (.wav).<br> Naming conventions follow the pattern C_NNNNN_BB_SS_OOOOO_RXX, which has to be exploded as follows:</p> <ul> <li>C = emission context (values: B = brushing; F = waiting for food; I: isolation in an unfamiliar environment);</li> <li>NNNNN = cat’s unique ID;</li> <li>BB = breed (values: MC = Maine Coon; EU: European Shorthair);</li> <li>SS = sex (values: FI = female, intact; FN: female, neutered; MI: male, intact; MN: male, neutered);</li> <li>OOOOO = cat owner’s unique ID;</li> <li>R = recording session (values: 1, 2 or 3)</li> <li>XX = vocalization counter (values: 01..99)</li> </ul> <p><strong>Extra content</strong></p> <p>The <em>extra.zip</em> archive contains excluded recordings (sounds other than meows emitted by cats) and uncut sequences of close vocalizations.</p> <p><strong>Terms of use</strong></p> <p>The dataset is open access for scientific research and non-commercial purposes.</p> <p>The authors require to acknowledge their work and, in case of scientific publication, to cite the most suitable reference among the following entries:</p> <p>Ntalampiras, S., Ludovico, L.A., Presti, G., Prato Previde, E., Battini, M., Cannas, S., Palestrini, C., Mattiello, S.: Automatic Classification of Cat Vocalizations Emitted in Different Contexts. Animals, vol. 9(8), pp. 543.1–543.14. MDPI (2019).<br> ISSN: 2076-2615</p> <p>Ludovico, L.A., Ntalampiras, S., Presti, G., Cannas, S., Battini, M., Mattiello, S.: CatMeows: A Publicly-Available Dataset of Cat Vocalizations. In: Li, X., Lokoč, J., Mezaris, V., Patras, I., Schoeffmann, K., Skopal, T., Vrochidis, S. (eds.) MultiMedia Modeling. 27th International Conference, MMM 2021, Prague, Czech Republic, June 22–24, 2021, Proceedings, Part II, LNCS, vol. 12573, pp. 230–243. Springer International Publishing, Cham (2021). <br> ISBN: 978-3-030-67834-0 (print), 978-3-030-67835-7 (online)<br> ISSN: 0302-9743 (print), 1611-3349 (online)</p>
Dataset: Features of animal babbling in the vocal ontogeny of the gray mouse lemur
<p>Dataset used in the unsupervised cluster analysis of the publication "Features of animal babbling in the vocal ontogeny of the gray mouse lemur (<em>Microcebus murinus</em>)"</p> <p><strong>Abstract</strong></p> <p>In human infants babbling is an important developmental stage of vocal plasticity to acquire maternal language. To investigate parallels in the vocal development of human infants and non-human mammals, seven key features of human babbling were defined, which are up to date only shown in bats and marmosets. This study will explore whether these features can also be found in gray mouse lemurs by investigating how infant vocal streams gradually resemble the structure of the adult trill call, which is not present at birth. Using unsupervised clustering, we distinguished six syllable types, whose sequential order gradually reflected the adult trill. A subset of adult syllable types was produced by several infants, with the syllable production being rhythmic, repetitive, and independent of the social context. The temporal structure of the calling bouts and the tempo-spectral features of syllable types became adult-like at the age of weaning. The age-dependent changes in the acoustic parameters differed between syllable types, suggesting that they cannot solely be explained by physical maturation of the vocal apparatus. Since gray mouse lemurs exhibit five features of animal babbling, they show parallels to the vocal development of human infants, bats, and marmosets.</p> <p> </p> <p>For details concerning the recording of the calling bouts confer to the publication at doi:10.1038/s41598-023-47919-7</p>
La Armonía Vocal (Xinka-Gua)
<p><strong>Cuadro recogido de la obra "Alyamalh Xinka-Wirimalh Xinka (Enseñemos Xinka-Hablemos Xinka). Gramática Xinka. Módulo II: Morfología. Consejo Coordinador del Pueblo Xinka de Guatemala-COPXIG.</strong></p>
La Armonía Vocal (Xinka-Gua)
<p><strong>Cuadro recogido de la obra "Alyamalh Xinka-Wirimalh Xinka (Enseñemos Xinka-Hablemos Xinka). Gramática Xinka. Módulo II: Morfología. Consejo Coordinador del Pueblo Xinka de Guatemala-COPXIG.</strong></p>
Dataset: Sex differences in the impact of social relationships on individual vocal signatures in grey mouse lemurs
<p>Dataset used in the statistical analysis of the publication "Sex differences in the impact of social relationships on individual vocal signatures in grey mouse lemurs (<em>Microcebus murinus</em>)"</p> <p><strong>Abstract</strong></p> <p>Vocali<span>z</span>ations coordinate social interactions between conspecifics by conveying information concerning the individual or group identity of the sender. Social accommodation is a form of vocal learning where social affinity is signalled by converging or diverging vocali<span>z</span>ations to those of conspecifics. To investigate whether social accommodation is linked to the social lifestyle of the sender, we investigated sex-specific differences in social accommodation in a dispersed living primate, the grey mouse lemur, where females form stable sleeping groups whereas males live solitarily. We used 482 trill calls of 36 individuals from our captive breeding colony to compare acoustic dissimilarity between individuals with genetic relatedness, social contact time and body weight. Our results showed that female trills become more similar the more time females spen<span>d</span> with each other independent of genetic relationship, suggesting vocal convergence. In contrast, male trills were affected more by genetic than social factors. However, focus<span>s</span>ing only on sociali<span>z</span>ed males, male trills diverged from each other the more time males were cage partners. Thus, grey mouse lemurs show the capacity for social accommodation, with females converging their trills to signal social closeness to sleeping group partners, whereas males do not adapt or diverge their trills to signal individual distinctiveness. </p> <p> </p> <p>For details concerning the recording of the trills confer to the publication at doi: 10.1098/rstb.2023.0193</p>
The UK COVID-19 Vocal Audio Dataset
<p>The UK COVID-19 Vocal Audio Dataset is designed for the training and evaluation of machine learning models that classify SARS-CoV-2 infection status or associated respiratory symptoms using vocal audio. The UK Health Security Agency recruited voluntary participants through the national Test and Trace programme and the REACT-1 survey in England from March 2021 to March 2022, during dominant transmission of the Alpha and Delta SARS-CoV-2 variants and some Omicron variant sublineages. Audio recordings of volitional coughs, exhalations, and speech (speech not available in open access version) were collected in the 'Speak up to help beat coronavirus' digital survey alongside demographic, self-reported symptom and respiratory condition data, and linked to SARS-CoV-2 test results. The UK COVID-19 Vocal Audio Dataset represents the largest collection of SARS-CoV-2 PCR-referenced audio recordings to date. PCR results were linked to 70,794 of 72,999 participants and 24,155 of 25,776 positive cases. Respiratory symptoms were reported by 45.62% of participants. This dataset has additional potential uses for bioacoustics research, with 11.30% participants reporting asthma, and 27.20% with linked influenza PCR test results.</p> <h3>Contents</h3> <ul> <li><strong>participant_metadata.csv</strong> row-wise, participant identifier indexed information on participant demographics and health status. Please see <a href="https://arxiv.org/pdf/2212.07738.pdf">A large-scale and PCR-referenced vocal audio dataset for COVID-19</a> for a full description of the dataset.</li> <li><strong>audio_metadata.csv</strong> row-wise, participant identifier indexed information on three recorded audio modalities, including audio filepaths. Please see <a href="https://arxiv.org/pdf/2212.07738.pdf">A large-scale and PCR-referenced vocal audio dataset for COVID-19</a> for a full description of the dataset.</li> <li><strong>train_test_splits.csv</strong> row-wise, participant identifier indexed information on train test splits for the following sets: 'Randomised' train and test set, Standard' train and test set, Matched' train and test sets, 'Longitudinal' test set and 'Matched Longitudinal' test set. Please see <a href="https://arxiv.org/abs/2212.08570">Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers</a> for a full description of the train test splits.</li> <li><strong>audio/ </strong>directory containing all the recordings in .wav format <ul> <li>Due to the large size of the dataset, to assist with ease of download, the audio files have been zipped into <strong>covid_data.z{ip, 01-24}.</strong> This enables the dataset to be downloaded in short periods, reducing the chances of a dropped internet connection scuppering progress. To unzip, first, ensure that all zip files are in the same directory. Then run the command 'unzip covid_data.zip' or right-click on 'covid_data.zip' and use a programme such as 'The Unarchiver' to open the file.</li> <li>Once extracted, to check the validity of the download, please run the 'python Turing-RSS-Health-Data-Lab-Biomedical-Acoustic-Markers/data-paper/unit-tests.py. All tests should pass with no exceptions. Please clone the GitHub repo detailed below.</li> </ul> </li> <li><strong>README.md</strong> full dataset descriptor.</li> <li><strong>DataDictionary_UKCOVID19VocalAudioDataset_OpenAccess.xlsx </strong>descriptor of each dataset attribute with the percentage coverage.</li> </ul> <h3>Code Base</h3> <p>The accompanying code can be found here: https://github.com/alan-turing-institute/Turing-RSS-Health-Data-Lab-Biomedical-Acoustic-Markers</p> <h3>Citations:</h3> <p>Please cite.</p> <p>@article{coppock2024audio,</p> <p> author = {Coppock, Harry and Nicholson, George and Kiskin, Ivan and Koutra, Vasiliki and Baker, Kieran and Budd, Jobie and Payne, Richard and Karoune, Emma and Hurley, David and Titcomb, Alexander and Egglestone, Sabrina and Cañadas, Ana Tendero and Butler, Lorraine and Jersakova, Radka and Mellor, Jonathon and Patel, Selina and Thornley, Tracey and Diggle, Peter and Richardson, Sylvia and Packham, Josef and Schuller, Björn W. and Pigoli, Davide and Gilmour, Steven and Roberts, Stephen and Holmes, Chris},</p> <p> title = {Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers},</p> <p> journal = {Nature Machine Intelligence},</p> <p> year = {2024},</p> <p> doi = {https://doi.org/10.1038/s42256-023-00773-8}</p> <p>}</p> <p>@article{budd2024,</p> <p> author={Jobie Budd and Kieran Baker and Emma Karoune and Harry Coppock and Selina Patel and Ana Tendero Cañadas and Alexander Titcomb and Richard Payne and David Hurley and Sabrina Egglestone and Lorraine Butler and George Nicholson and Ivan Kiskin and Vasiliki Koutra and Radka Jersakova and Peter Diggle and Sylvia Richardson and Bjoern Schuller and Steven Gilmour and Davide Pigoli and Stephen Roberts and Josef Packham Tracey Thornley Chris Holmes},</p> <p> title={A large-scale and PCR-referenced vocal audio dataset for COVID-19},</p> <p> journal={Scientific Data},</p> <p> year={2024},</p> <p> doi = {https://doi.org/10.1038/s41597-024-03492-w}</p> <p>}</p> <p>@article{Pigoli2022,</p> <p> author={Davide Pigoli and Kieran Baker and Jobie Budd and Lorraine Butler and Harry Coppock and Sabrina Egglestone and Steven G.\ Gilmour and Chris Holmes and David Hurley and Radka Jersakova and Ivan Kiskin and Vasiliki Koutra and George Nicholson and Joe Packham and Selina Patel and Richard Payne and Stephen J.\ Roberts and Bj\"{o}rn W.\ Schuller and Ana Tendero-Ca$\tilde{n}$adas and Tracey Thornley and Alexander Titcomb},</p> <p>title={Statistical Design and Analysis for Robust Machine Learning: A Case Study from Covid-19},</p> <p> year={2022},</p> <p> journal={arXiv},</p> <p> doi = {10.48550/ARXIV.2212.08571}</p> <p>}</p> <p> </p> <h3>The Dublin Core™ Metadata Initiative</h3> <p> </p> <p>- Title: The UK COVID-19 Vocal Audio Dataset, Open Access Edition.</p> <p>- Creator: The UK Health Security Agency (UKHSA) in collaboration with The Turing-RSS Health Data Lab.</p> <p>- Subject: COVID-19, Respiratory symptom, Other audio, Cough, Asthma, Influenza.</p> <p>- Description: The UK COVID-19 Vocal Audio Dataset Open Access Edition is designed for the training and evaluation of machine learning models that classify SARS-CoV-2 infection status or associated respiratory symptoms using vocal audio. The UK Health Security Agency recruited voluntary participants through the national Test and Trace programme and the REACT-1 survey in England from March 2021 to March 2022, during dominant transmission of the Alpha and Delta SARS-CoV-2 variants and some Omicron variant sublineages. Audio recordings of volitional coughs and exhalations were collected in the 'Speak up to help beat coronavirus' digital survey alongside demographic, self-reported symptom and respiratory condition data, and linked to SARS-CoV-2 test results. The UK COVID-19 Vocal Audio Dataset Open Access Edition represents the largest collection of SARS-CoV-2 PCR-referenced audio recordings to date. PCR results were linked to 70,794 of 72,999 participants and 24,155 of 25,776 positive cases. Respiratory symptoms were reported by 45.62% of participants. This dataset has additional potential uses for bioacoustics research, with 11.30% participants reporting asthma, and 27.20% with linked influenza PCR test results.</p> <p>- Publisher: The UK Health Security Agency (UKHSA).</p> <p>- Contributor: The UK Health Security Agency (UKHSA) and The Alan Turing Institute.</p> <p>- Date: 2021-03/2022-03</p> <p>- Type: Dataset</p> <p>- Format: Waveform Audio File Format audio/wave, Comma-separated values text/csv</p> <p>- Identifier: <strong>10.5281/zenodo.10043977</strong></p> <p>- Source: The UK COVID-19 Vocal Audio Dataset Protected Edition, accessed via application to <a href="https://www.gov.uk/government/publications/accessing-ukhsa-protected-data/accessing-ukhsa-protected-data">Accessing UKHSA protected data</a>.</p> <p>- Language: eng</p> <p>- Relation: The UK COVID-19 Vocal Audio Dataset Protected Edition, accessed via application to <a href="https://www.gov.uk/government/publications/accessing-ukhsa-protected-data/accessing-ukhsa-protected-data">Accessing UKHSA protected data</a>.</p> <p>- Coverage: United Kingdom, 2021-03/2022-03.</p> <p>- Rights: Open Government Licence version 3 (OGL v.3), © Crown Copyright UKHSA 2023.</p> <p>- accessRights: When you use this information under the Open Government Licence, you should include the following attribution: The UK COVID-19 Vocal Audio Dataset Open Access Edition, UK Health Security Agency, 2023, licensed under the <a href="https://www.nationalarchives.gov.uk/doc/open-government-licence/">Open Government Licence v3.0</a> and cite the papers detailed above.</p> <p> </p>
Amateur Vocal Percussion Dataset
<p>Dataset of vocal imitations of percussion sounds. It includes a total of 9780 utterances in 280 audio files recorded by 28 participants with little or no experience in beatboxing. Onsets and labels for kick drum, snare drum, closed hi-hat, and opened hi-hat are annotated in separate .csv files.</p> <p>All audio files were recorded with a MacBook Pro's built-in mic in an indoor environment and they are distributed into two modalities: personal imitations and fixed imitations. For each modality and participant, four files contain repetitions of utterances of the same class and one file corresponds to a rhythmic improvisation with these.</p> <p><strong>Update from V3</strong>:<em> Onset and coda phoneme labels added, sample noise audio file added.</em></p>
Audio files of synthetic sustained vowels for the study of vocal fry
<p>This is the dataset of stimuli used in the experiments reported in [1]. SinglePulsing.zip contains the stimuli of reported experiment 1, Transition.zip contains stimuli of experiment 2.</p> <p></p> <p>[1] V. Devaraj, F. Wendt, I. Roesner, J. Schoentgen, and P. Aichinger, “Auditory perception of impulsiveness and tonality in vocal fry,” <em>Appl. Sci. Basel</em>. (under review)</p>
The Effect of Soundscape Composition on Bird Vocalization Classification in a Citizen Science Biodiversity Monitoring Project
<p>This archive includes sound clips (.wav files) and associated mel-scale spectrograms of bird vocalizations for 54 species in Sonoma County, California, USA. These data were used for training and validating convolutional neural network (CNN) models for bird species detection. We also include xeno-canto training and validation mel spectrograms used to pretrain CNNs. Details on these data are explained in the paper by Clark et al. (2023) titled "The effect of soundscape composition on bird vocalization classification in a citizen science biodiversity monitoring project". These data are available for use without restrictions, with no warranty on data quality or utility for a given application. We request that any work that does use these data cite the Clark et al. (2023) paper.<br> <br> Clark, M.L., Salas, L., Baligar, S., Quinn, C., Snyder, R.L., Leland, D., Schackwitz, W., Goetz, S.J., Newsam, S. (2023). The effect of soundscape composition on bird vocalization classification in a citizen science biodiversity monitoring project. <em>Ecological Informatics</em>. <a href="https://doi.org/10.1016/j.ecoinf.2023.102065">https://doi.org/10.1016/j.ecoinf.2023.102065</a></p> <p>Associated code for training CNN models, performing inference, and applying post-classification corrections can be found in the GitHub archive <a href="https://github.com/pointblue/Soundscapes2Landscapes/tree/master/CNN_Bird_Species">https://github.com/pointblue/Soundscapes2Landscapes/tree/master/CNN_Bird_Species</a></p> <p>Raw sound data from the Soundscapes to Landscapes project are available upon request: Dr. Matthew Clark, matthew.clark@sonoma.edu</p> <p>These data were collected as part of the Soundscapes to Landscapes project (<a href="https://soundscapes2landscapes.org/">soundscapes2landscapes.org</a>), funded by NASA’s Citizen Science for Earth Systems Program (CSESP) 16-CSESP 2016-0009 under cooperative agreement 80NSSC18M0107.<br> <br> ----------------------------<br> This depository includes the following archives:</p> <ul> <li> <p>mel_specs.zip: contains 2-sec mel spectrograms split into training (“tr”), validation (“val”), testing (“test”) data for each target bird species (n = 54) used to fine-tune the CNNs. Select spectrogram files are appended with “aug” if they are augmented versions for the training data.</p> </li> <li> <p>wav.zip: contains the associated wav-format sound recordings used to generate the training, validation, testing mel spectrograms found in mel_specs.zip.</p> </li> <li> <p>Xeno-canto_pretrain.tar: contains 2-sec mel spectrograms split into training and validation data for 40 bird species used for CNN pre-training that were generated using a warbleR segmentation methodology described in the paper. The sound files used to generate these mel spectrograms came from the Kaggle competition, <a href="https://www.kaggle.com/datasets/imoore/xenocanto-bird-recordings-dataset">https://www.kaggle.com/datasets/imoore/xenocanto-bird-recordings-dataset</a><br> Mel spectrogram naming reflects the XC number used for cataloging on Xeno-canto in the format XC123456_2.png. The six numbers following the XC characters can be used to search for unique recordings on Xeno-canto (<a href="https://xeno-canto.org/">https://xeno-canto.org/</a>) using the search query “nr:123456” in the search tool or queried using the Xeno-canto API (<a href="https://xeno-canto.org/explore/api">https://xeno-canto.org/explore/api</a>). Unique recording names can be extracted from the mel spectrogram filenames.</p> </li> <li> <p>soundscape_test_wavs.zip: the wav-format sound recordings used to perform soundscape testing.</p> </li> </ul>
Extreme Metal Vocals Dataset (EMVD)
<p><strong>Extreme Metal Vocals Dataset (EMVD)</strong></p> <p>Version 1.0, October 2023</p> <p> </p> <p><strong>Created by</strong></p> <p>Modan Tailleur (1,3), Julien Pinquier (2), Laurent Millot (1), Corsin Vogel (1), Mathieu Lagrange (3)</p> <ol> <li> <p>ENS Louis-Lumière, Saint-Denis, France</p> </li> <li> <p>IRIT, Université de Toulouse, CNRS, UT3 Toulouse, France</p> </li> <li> <p>Nantes Université, Ecole Centrale Nantes, CNRS, LS2N, UMR 6004, Nantes, France</p> </li> </ol> <p> </p> <p><strong>Publication</strong></p> <p>If using this data in an academic work, please reference the DOI and version, as well as cite the following paper, which presented the data collection procedure and the first version of the dataset:</p> <p>@misc{tailleur2024emvddatasetdatasetextreme,<br> title={EMVD dataset: a dataset of extreme vocal distortion techniques used in heavy metal}, <br> author={Modan Tailleur and Julien Pinquier and Laurent Millot and Corsin Vogel and Mathieu Lagrange},<br> year={2024},<br> eprint={2406.17732},<br> archivePrefix={arXiv},<br> primaryClass={cs.SD},<br> url={https://arxiv.org/abs/2406.17732}, <br>}</p> <p> </p> <p><strong>Description</strong></p> <p>The Extreme Metal Vocals Dataset (EMVD) comprises a collection of recordings of extreme vocal techniques performed within the realm of heavy metal music. The dataset consists of 760 audio excerpts of 1 second to 30 seconds long, totaling about 100 min of audio material, roughly composed of 60 minutes of distorted voices and 40 minutes of clear voice recordings. These vocal recordings are from 27 different singers and are provided without accompanying musical instruments or post-processing effects. The distortion taxonomy within this dataset encompasses four distinct distortion techniques and three vocal effects, all performed in different pitch ranges.</p> <p> </p> <p><strong>How to use</strong></p> <p>To get an example on how to use this dataset for deep learning applications, please follow the link to the companion website: <a href="https://github.com/modantailleur/ExtremeMetalVocalsDataset">https://github.com/modantailleur/ExtremeMetalVocalsDataset</a></p> <p> </p> <p><strong>Label Taxonomy</strong></p> <p>The label taxonomy is as follows (see our paper for further details):</p> <p>Techniques:</p> <ul> <li>Clear Voice: high, mid, low</li> <li>Black Shriek: high, mid</li> <li>Death Growl: mid, low</li> <li>Hardcore Scream: high, mid, low</li> <li>Grind Inhale</li> </ul> <p>Effects:</p> <ul> <li>Pig Squeal</li> <li>Deep Gutturals</li> <li>Tunnel Throat</li> </ul> <p> </p> <p><strong>Recording procedure</strong></p> <p>For the recording sessions, a mobile setup was selected to accommodate as many singers as possible. An SM58 microphone was employed, chosen for its prevalence as a microphone commonly used by metal singers during live performances. A closed-back headphone served for music playback and provided the singers with a monitor of their own voice if they desired to hear it during recording. An audio interface <em>Scarlett 6i6</em> by <em>Focusrite</em> was responsible for connecting the laptop, microphone, and headset.</p> <p>In some cases, singers were recorded remotely using their own equipment (a stage microphone and an audio interface) which are documented in the database. These singers were provided with a video tutorial and explanatory documents to facilitate their participation in the project, with the main author remotely guiding them. Each singer was instructed to sustain three vowels—[a] as in "cat," [i] as in "ship," and [u] as in "book"—for a duration of five seconds each. They were required to maintain a consistent pitch not only within each vowel but also across all vowels produced. After this, they were asked to perform for approximately 15 seconds using the same vocal technique, but this time with lyrics of their choosing. The lyrics had to remain the same across all technique categories. Each vocal technique was recorded across several registers (high, mid, and low) depending on their relevance to the specific technique. It's worth noting that the Grind Inhale technique, although producible in multiple registers, was recorded in only one register, as many singers deemed it potentially harmful to their voice. A musical loop was provided in the singers' headphones during each recording.</p> <p> </p> <p><strong>Grading system</strong></p> <p>Each vocalist in this study underwent a comprehensive assessment of their comfort level with each vocal technique across the various vocal registers, employing a ranking system ranging from 0 to 5. A rank of 0 signifies that they never use this technique and are not sufficiently comfortable to produce it, which ultimately results in missing data in the dataset. A rank of 3 indicates occasional use, and a rank of 5 signifies that they use it in every live performance.This dataset provides supplementary insights into the singers' practices. These include the typical microphone-to-mouth distance employed by each vocalist during recording, as well as their professional status within the field of singing. The majority of the recordings were conducted onsite, within the familiar confines of the vocalist's chosen location, whether it be their home or a professional studio, utilizing equipment provided by the authors. However, some recordings were independently done by the vocalists themselves, leveraging their personal microphones and audio interfaces. In such instances, the authors remotely guided the recording process to ensure consistency and quality. Detailed equipment specifications have been documented.</p> <p>As authors noticed that the singers auto-evaluation ranking wasn’t very effective, the main author provided grades to individual audio files created by the singers, ranging from 0 to 2. A 2 grade suggests that the technique closely represents the intended vocal technique, 1 indicates that it moderately represents the vocal technique, and 0 signifies that the technique does not adequately represent the vocal technique. Audio files rated as 0 should not be employed for deep learning applications, but they are retained within the dataset in case future re-evaluation of the audio files is desired. Notably, approximately 70\% of the dataset's audio files received grades of 2 or 1 from the authors and are thus suitable for being used in diverse applications.</p> <p> </p> <p><strong>metadata_files.csv</strong></p> <p><em>file_name : </em>the name of the audio file</p> <p><em>singer_id : </em>the id of each singer (from 1 to 27)</p> <p><em>type : </em>whether the distortion employed is a technique, an effect, or a distortion that doesn’t fit any specific category</p> <p><em>name : </em>the name of the technique or of the effect employed by the singer (‘-’ if it doesn’t fit in any category)</p> <p><em>range</em> : the range employed by the singer (‘High’, ‘Mid’, or ‘Low’)</p> <p><em>vowel</em> : the vowel employed by the singer. ‘a’ if vowel [a] as in "cat", 'i' if vowel [i] as in "ship," and 'u' if vowel [u] as in "book"</p> <p><em>authors_rank</em> : the rank given by the authors (2, 1 or 0)</p> <p><em>duration(s) </em>: duration (in seconds) of the audio file</p> <p> </p> <p><strong>metadata_singers.csv</strong></p> <p><em>singer_id</em> : the id of each singer (from 1 to 27)</p> <p><em>gender : </em>the gender of the singer (« M » if male, « F » if female)</p> <p><em>status : </em>whether the singer is professional or non-professional (« Professional », or « Non-professional »)</p> <p><em>recording : </em>whether the recording was made onsite, with the authors equipment, or if it was guided remotely (« Onsite » or « Guided »)</p> <p><em>distance_to_microphone(cm) : </em>the distance chosen by the singer to the microphone (in centimeters)</p> <p><em>microphone : </em>model of microphone that was used for the recording</p> <p><em>audio_interface : </em>audio interface used for the recordings</p> <p><em>DAW : </em>Digital Audio Workstation (DAW) used for recording the singer (Ex: ProTools, Reaper etc...)</p> <p><em>ClearVoice_High, …, TunnelThroat : </em>singer’s rank (from 0 to 5) from his auto-evalution on each technique performed in each range.<br> </p> <p><strong>split_kfolds.csv</strong></p> <p>For deep learning applications, a k-fold cross-validation with 4 folds was performed and stored in the «split_kfolds.csv » file, reserving 20% of the training data for validation.</p> <p><em>file_name : </em><em>the name of the audio file</em></p> <p><em>split0, …, split3</em> : for each split, wether the file belongs to the train subset (‘train’), the evaluation subset (‘eval’), the validation subset (‘valid’) or if it isn’t used for training (‘-’)</p> <p> </p> <p><strong>Feedback</strong></p> <p>Please help us improve EMVD by sending your feedback to:</p> <ul> <li>Modan Tailleur: <a href="mailto:modan.tailleur@gmail.com">modan.tailleur@gmail.com</a></li> </ul> <p>In case of a problem, please include as many details as possible.</p> <p> </p> <p><strong>Acknowledgments</strong></p> <p>We want to thank Oriol Nieto, Geoffroy Peeters, Christophe d'Alessandro and Boris Doval for fruitful discussion. We particularly want to thank Joshua Smith for guidance for the design of the taxonomy. We also want to thank the 27 singers for bringing this dataset to life.</p>
Figure 7 in The vocal repertoire of Myrmeciza loricata (Lichtenstein, 1823) (Aves: Thamnophilidae)
Figure 7. Sonograms of other notes (call III) of Myrmeciza loricata. (A) Notes "D + E". (B) Note "F". (C) Note "I" emitted with call II. (D) Note "G". (E) Note "H". (F) Note "J" emitted with call II.
Figure 4 in The vocal repertoire of Myrmeciza loricata (Lichtenstein, 1823) (Aves: Thamnophilidae)
Figure 4. Sonograms of the call I (alarm) of Myrmeciza loricata. (A) Rattle phrases sequence. (B) Zoom showing the series of vertical tick notes.
Vocal drum sounds in Human Beatboxing: an acoustic and articulatory exploration using electromagnetic articulography
<p>This dataset constitutes the supplementary material of a paper in review in the Journal of the Acoustical Society of America (JASA)</p>
Vocal Fold Paralysis Dataset and Code
<p>Data and Code for Low et al. Uncovering the important acoustic features for detecting vocal fold paralysis with explainable machine learning.</p>
Fig. 3 in Proboscis Monkeys (Nasalis Larvatus (Wurmb, 1787)) Have Unusually High-Pitched Vocalizations
Fig. 3. Cumulative curve of mean frequencies of calls in the study. Graph omits the one call that has a frequency <2.7 kHz.
Fig. 2. A in Proboscis Monkeys (Nasalis Larvatus (Wurmb, 1787)) Have Unusually High-Pitched Vocalizations
Fig. 2. A sample spectrogram of a high frequency vocalization of the proboscis monkey, Nasalis larvatus, that shows the harmonic structure of these calls. The fundamental frequency of this call ranges from 3.4–5.4 kHz and the mean frequency is 4.9 kHz.
Supporting data for: Vocal fingerprinting reveals a substantially smaller global population of the Critically Endangered cao vit gibbon (Nomascus nasutus) than previously thought
<p>These data were used in the publication "Vocal fingerprinting reveals a substantially smaller global population of the Critically Endangered cao vit gibbon (Nomascus nasutus) than previously thought", currently in review. </p><p>The acoustic measurements provided in the file were input to the clustering analyses detailed in the paper. Each row corresponds to a single male song phrase. The columns include:</p><ul><li>GroupID - the name of the gibbon group, based on manual identification of the song phrase</li><li>MFCC[1-88] - Mel-frequency cepstral coefficients as detailed in the paper</li><li>Delta[89-176] - Delta-cepstral coefficients as detailed in the paper</li><li>Duration - the length of the song phrase (in seconds)</li><li>Freq 5% (Hz) and Freq 95% (Hz) - 5th and 95th percentile frequencies, respectively</li><li>Cao and Vit - the number of "cao" and "vit" components, respectively, present in the song phrase</li><li>CutFileName - the file name of the extracted song phrase (which also acts as a unique identifier)</li><li>Representative - whether the given song phrase was 'representative' ("Yes" or "No") of a typical phrase for that male (as defined by the modal number of 'cao' and 'vit' components for males)</li></ul><p>All columns (except GroupID, CutFileName and Representative) have been standardised (i.e. centred to the mean and scaled according to the standard deviation).</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.