Detecting Cross-Language Plagiarism using Open Knowledge Graphs

<p>Corresponding authors: <a href="mailto:meuschke@uni-wuppertal.de?subject=Inquiry%20about%20CL-OSA%20dataset">Norman Meuschke</a>, <a href="mailto:ruas@uni-wuppertal.de?subject=Inquiry%20about%20CL-OSA%20dataset">Terry Ruas</a><br> Venue: 2nd Workshop on Extraction and Evaluation of Knowledge Entities from Scientific Documents (EEKE2021)<br> at the ACM/IEEE Joint Conference on Digital Libraries 2021 (JCDL2021)</p> <p>==========================================================================</p> <p><strong>Source code:&nbsp;<a href="https://github.com/ag-gipp/cl-osa">https://github.com/ag-gipp/cl-osa</a>&nbsp;</strong></p> <p>==========================================================================</p> <p><strong>Dataset Details</strong></p> <p><em><a href="https://jipsti.jst.go.jp/aspec/">ASPEC</a></em>. The Asian Scientific Paper Excerpt Corpus comprises&nbsp;excepts of scientific papers in Japanese that have been manually translated to English and Chinese. We use both subsets of&nbsp;the ASPEC corpus.&nbsp;</p> <ul> <li><em>ASPEC-JC</em><strong>&nbsp;</strong>contains abstracts and paragraphs from the main text of research papers that were translated manually from Japanese&nbsp;to Chinese.</li> <li><em>ASPEC-JE</em> contains abstracts of approx. two million research papers that were translated manually from Japanese to English. &nbsp;</li> </ul> <p><em><a href="https://ec.europa.eu/jrc/en/language-technologies/jrc-acquis">JRC-Acquis</a></em>. The corpus consists of legislative texts in 22 languages, which the European Union&#39;s Joint Research Centre (JRC) selected from the cumulative body of EU laws (the so called Acquis communautaire). We sampled our test cases from the 10,000 document pairs in the English-French&nbsp;subset of the corpus.</p> <p><em><a href="https://www.statmt.org/europarl/">Europarl</a></em>. The corpus contains transcripts of European Parliament proceedings in 21 European languages. We exclusively sampled test cases from the 9,443 document pairs in the English-French&nbsp;subset of the corpus.</p> <p><em><a href="https://zenodo.org/record/3250095#.YOr25jqxVH4">PAN-PC-11</a></em>.&nbsp;The corpus contains instances of simulated monolingual and cross-language plagiarism that were used for evaluating plagiarism detection methods as part of the workshop series <a href="https://pan.webis.de/">Plagiarism Analysis, Authorship Identification, and Near-Duplicate Detection (PAN)</a>. Most of the 26,939 documents in the corpus were created by extracting text from openly available books. The documents are partially interspersed with instances of simulated plagiarism that were created and obfuscated automatically or by crowdsourced workers. We exclusively sampled test cases from the 2,921 Spanish-English aligned document pairs in the corpus,&nbsp;for which simulated plagiarism instances were either machine-generated or created manually by crowdsourced workers.</p> <ul> </ul> <p>==========================================================================</p> <p><strong>File Structure</strong></p> <p><strong>[corpus_documents] folder</strong>: Corpora of translation-aligned documents used in our experiments composed of:&nbsp;</p> <ul> <li>aspec: Japanese and English</li> <li>aspecx: Japanese and Chinese&nbsp;</li> <li>jrc: English and French&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</li> <li>europarl: English and French</li> <li>pan: English and Spanish</li> </ul> <p>Each sub-corpus consists of&nbsp;4,000 translation-aligned files (2,000 per language); the entire corpus has thus 20,000 files.<br> Each set of translation-aligned documents was randomly selected from the original datasets (details in the paper).<br> The Japanese files in aspec and aspecx do not necessarily overlap even though they are from the same dataset.</p> <p><br> <strong>[vectors_documents] folder</strong>: Average vector representation of the documents in the datasets from two pre-trained models:</p> <ul> <li>Universal Sentence Encoder - Multilingual (USE-ML)</li> <li>ConceptNet Numberbatch</li> </ul> <p>&nbsp;</p> <p><strong>Naming convention</strong>: &lt;model&gt;_&lt;dataset&gt;_&lt;language&gt;;</p> <ul> <li>Example: cn_jrc_es: <ul> <li>model: ConceptNet Numberbatch</li> <li>corpus: JRC-Acquis</li> <li>language: Spanish</li> </ul> </li> </ul> <ul> <li>Labels: <ul> <li>&lt;model&gt;:<br> cn - ConceptNet Numberbatch<br> um - USE-ML<br> &nbsp;</li> <li>&lt;dataset&gt;<br> aspec - ASPEC (Asian Scientific Paper Excerpt Corpus) - English and Japanese<br> aspecx - ASPEC (Asian Scientific Paper Excerpt Corpus) - Japanese and Chinese<br> jrc - JRC-Acquis<br> europarl - Europarl<br> pan - PAN-PC-11<br> &nbsp;</li> <li>&lt;language&gt;<br> en - English<br> es - Spanish<br> fr - French<br> ja - Japanese<br> zh - Chinese</li> </ul> </li> </ul>