Skip to main content
zenodoopen

DCASE 2020 Challenge Task 2 Evaluation Dataset

<p><strong>Description</strong></p> <p>This dataset is the &quot;evaluation dataset&quot; for the&nbsp;<strong>DCASE 2020 Challenge Task 2 &quot;Unsupervised Detection of Anomalous Sounds for Machine Condition Monitoring&quot; </strong><a href="http://dcase.community/challenge2020/task-unsupervised-detection-of-anomalous-sounds">[task description]</a>.&nbsp;</p> <p>In the task, three datasets have been released:&nbsp;&quot;<a href="http://zenodo.org/record/3678171">development dataset</a>&quot;, &quot;<a href="https://zenodo.org/record/3727685">additional training&nbsp;dataset</a>&quot;,&nbsp;and &quot;evaluation dataset&quot;.&nbsp;This evaluation dataset was the last of the three released.&nbsp;This&nbsp;dataset&nbsp;includes around 400 samples for each Machine Type and Machine ID used in the evaluation dataset, none of which have a condition label (i.e., normal or anomaly).</p> <p>The recording procedure and data format are the same as&nbsp;the <a href="http://zenodo.org/record/3678171">development dataset</a>&nbsp;and <a href="https://zenodo.org/record/3727685">additional training&nbsp;dataset</a>.&nbsp;The Machine IDs in this dataset are the same as&nbsp;those in the <a href="https://zenodo.org/record/3727685">additional training&nbsp;dataset</a>.&nbsp;For more information, please see the pages of the&nbsp;<a href="http://zenodo.org/record/3678171">development dataset</a> and the <a href="http://dcase.community/challenge2020/task-unsupervised-detection-of-anomalous-sounds">task description</a>.&nbsp;</p> <p>After the DCASE 2020 Challenge, we released the <a href="https://zenodo.org/record/3951620">ground truth for this evaluation dataset</a>.</p> <p>&nbsp;</p> <p><strong>Directory structure</strong></p> <p>Once&nbsp;you unzip the downloaded files from&nbsp;Zenodo, you can see the following directory structure. Machine Type information is given by directory name, and Machine ID and condition information are given by file name, as:</p> <ul> </ul> <p>/eval_data</p> <ul> <li>/ToyCar <ul> <li>/test &nbsp;(Normal and anomaly data for all Machine IDs are included, but they do not have a condition label.) <ul> <li>/id_05_00000000.wav</li> <li>...</li> <li>/id_05_00000514.wav</li> <li>/id_06_00000000.wav</li> <li>...</li> <li>/id_07_00000514.wav</li> </ul> </li> </ul> </li> <li>/ToyConveyor (The other Machine Types have the same directory structure as ToyCar.)</li> <li>/fan</li> <li>/pump</li> <li>/slider</li> <li>/valve</li> </ul> <p>&nbsp;</p> <p>The paths of audio files are:</p> <ul> <li>&quot;/eval_data/&lt;Machine_Type&gt;/test/id_&lt;Machine_ID&gt;_[0-9]+.wav&quot;</li> </ul> <p>For example, the Machine Type and Machine ID of&nbsp;&quot;/ToyCar/test/id_05_00000000.wav&quot; are &quot;ToyCar&quot; and &quot;05&quot;, respectively. Unlike the <a href="http://zenodo.org/record/3678171">development dataset</a>&nbsp;and <a href="https://zenodo.org/record/3727685">additional training&nbsp;dataset</a>, its condition label is hidden.&nbsp;</p> <p>&nbsp;</p> <p><strong>Baseline system</strong></p> <p>A simple baseline system is available&nbsp;on the Github repository <a href="https://github.com/y-kawagu/dcase2020_task2_baseline">[URL]</a>. The baseline system provides a simple entry-level approach that gives a reasonable performance in the dataset of Task 2. It is a good starting point, especially for entry-level researchers who want to get familiar with the anomalous-sound-detection task.</p> <p>&nbsp;</p> <p><strong>Conditions of use</strong></p> <p>This dataset was created jointly by <strong>NTT Corporation</strong> and <strong>Hitachi, Ltd.</strong>&nbsp;and is available&nbsp;under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) license.</p> <p>&nbsp;</p> <p><strong>Publication</strong></p> <p>If you use this dataset, please cite <strong>all the following three&nbsp;papers</strong>:</p> <p>Yuma Koizumi, Shoichiro Saito, Noboru Harada, Hisashi Uematsu, and Keisuke Imoto, &quot;ToyADMOS: A Dataset of Miniature-Machine Operating Sounds for Anomalous Sound Detection,&quot; in Proc. of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), 2019.&nbsp;<a href="https://ieeexplore.ieee.org/document/8937164">[pdf]</a></p> <p>Harsh Purohit, Ryo Tanabe, Kenji Ichige, Takashi Endo, Yuki Nikaido, Kaori Suefusa, and Yohei Kawaguchi, &ldquo;MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection,&rdquo; in Proc. 4th Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE), 2019.&nbsp;<a href="http://dcase.community/documents/workshop2019/proceedings/DCASE2019Workshop_Purohit_21.pdf">[pdf]</a></p> <p>Yuma Koizumi, Yohei Kawaguchi, Keisuke Imoto, Toshiki Nakamura, Yuki Nikaido, Ryo Tanabe, Harsh Purohit, Kaori Suefusa, Takashi Endo, Masahiro Yasuda, and Noboru Harada,&nbsp;&quot;Description and Discussion on DCASE2020 Challenge Task2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring<em>,&quot;</em>&nbsp;in Proc. 5th Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE),&nbsp;2020. <a href="https://dcase.community/documents/workshop2020/proceedings/DCASE2020Workshop_Koizumi_3.pdf">[pdf]</a></p> <p><br> <strong>Feedback</strong></p> <p>If there is any problem, please contact us:</p> <ul> <li>Yuma Koizumi, <a href="mailto:koizumi.yuma@ieee.org">koizumi.yuma@ieee.org</a></li> <li>Yohei Kawaguchi, <a href="mailto:yohei.kawaguchi.xk@hitachi.com">yohei.kawaguchi.xk@hitachi.com</a></li> <li>Keisuke Imoto, <a href="mailto:keisuke.imoto@ieee.org">keisuke.imoto@ieee.org</a></li> </ul>

ShareScore

40/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
8
Harmonization
8
Access
12
Reuse readiness
8
Engagement
4

Topics