Find research datasets worth reusing

CFAD: A Chinese Dataset for Fake Audio Detection

<p>Fake audio detection is a growing concern and some relevant datasets have been designed for research. However, there is no standard public Chinese dataset under complex conditions.</p> <p>In this paper, we aim to fill in the gap and design a Chinese fake audio detection dataset (CFAD) for studying more generalized detection methods. Twelve mainstream speech-generation techniques are used to generate fake audio. To simulate the real-life scenarios, three noise datasets are selected for noise adding at five different signal-to-noise ratios, and six codecs are considered for audio transcoding. CFAD dataset can be used not only for fake audio detection but also for detecting the algorithms of fake utterances for audio forensics. Baseline results are presented with analysis. The results that show fake audio detection methods with generalization remain challenging. The CFAD dataset is publicly available&nbsp;on GitHub&nbsp;https://github.com/ADDchallenge/CFAD</p> <p>&nbsp;</p> <p>CFAD dataset considers 12 types of fake audio, 11 of which are generated by different speech synthesis techniques and the remaining one is partially fake type. Partially fake audio is completely different from synthesis speech and thus can better evaluate the generalization of the detection model to unknown types. The real audio is collected from 6 different corpora to increase the diversity of real category distributions, which makes model less prone to artifact from a single database. For robustness evaluation, we additionally simulate background noise and media codecs that might occur in real life and provide detailed labels, including fake type, real source, noise type, signal noise ratio (SNR), and media codecs. Overall, CFAD dataset consists of three different versions, named clean, noisy, and codec versions.</p> <p>Each version of the dataset is divided into disjoint training, development, and test sets in the same way. There is no speaker overlap across these three subsets. Each test set is further divided into seen and unseen test sets. Unseen test sets can evaluate the generalization of the methods to unknown types. It is worth mentioning that both real audio and fake audio in the unseen test set are unknown to the model.</p> <p>For the noisy speech part, we select three noise databases for simulation. Additive noises are added to each audio in the clean dataset at 5 different SNRs. The additive noises of the unseen test set and the remaining subsets come from different noise databases.</p> <p>For the codec speech part, we select six different codecs. Two of them are applied for unseen test set.</p> <p>In each version (clean, noisy, and codec versions) of the CFAD dataset, there are 138400 utterances in training set, 14400 utterances in development set, 42000 utterances in seen test set, and 21000 utterances in unseen test set.</p> <p>&nbsp;</p> <p>Clean Real Audios Collection</p> <p>From the point of eliminating the interference of irrelevant factors, we collect clean real audios from&nbsp;two aspects: 5 open resources from OpenSLR platform (http://www.openslr.org/12/) and one self-recording dataset.&nbsp;</p> <p>&nbsp;</p> <p>Clean Fake Audios Generation</p> <p>We select 11 representative speech synthesis methods to generate the fake audios and one partially fake audios.</p> <p>&nbsp;</p> <p>Noisy Audios Simulation</p> <p>Noisy audios aim to quantify the robustness of the methods under noisy conditions. To simulate the real-life scenarios, we artificially sample the noise signals and add them to clean audios at 5 different&nbsp;SNRs, which are 0dB, 5dB, 10dB, 15dB and 20dB. Additive noises are selected from three noise databases: PNL 100 Nonspeech Sounds, NOISEX-92, and TAU Urban Acoustic Scenes.</p> <p>&nbsp;</p> <p>Audio Transcoding</p> <p>The Codec version aims to quantify the robustness of the methods under different format conversions. We select a total of six codecs. For the training, development, and seen test sets in codec version, mp3, flac, ogg, and m4a are used. For the unseen test set of the codec version, aac, and wma are used.</p> <p>Audio transcoding operation is operated on the audio in the clean version. Each clean audio will be randomly transformed with one of the candidate codecs and converted back to original WAV files using ffmpeg toolkits.</p> <p>&nbsp;</p> <p>&nbsp;</p> <p>This data set is licensed with a CC BY-NC-ND 4.0 license.</p> <p>You can cite the data using the following BibTeX entry.</p>