PAN Wikipedia Vandalism Corpus 2010 (PAN-WVC-10)

<p>The PAN Wikipedia Vvandalism Ccorpus 2010 (PAN-WVC-10) is a corpus for the evaluation of automatic vandalism detectors for Wikipedia. For research purposes the corpus can be used free of charge.</p> <p>This corpus is supplemented by the <a href="https://doi.org/10.5281/zenodo.3342157">PAN-WVC-11</a>, which features additional edits in English, Spanish and German. Both corpora should be used to get more representative results.</p> <p>As part of our research on automatic vandalism detection we have compiled a corpus of vandalism cases found in Wikipedia. The corpus compiles 32452 edits on 28468 Wikipedia articles, among which 2391 vandalism edits have been identified. To annotate the corpus we have used Amazon&#39;s Mechanical Turk; 753 workers have been recruited who cast more than 150000 votes on the edits, so that each edit was reviewed by at least 3 annotators. The achieved level of agreement was analyzed in order to label an edit as &quot;regular&quot; or &quot;vandalism.&quot;</p>