Dataset for Named Entity Recognition and Entity Linking from Greek Wikipedia Events

<p>An automated benchmark dataset for (Named Entity Recognition) NER and (Named Entity Linking) NEL tools, based on Greek Wikipedia events pages.</p> <p>Note: This data includes data from the following sources:<br> - Wikipedia el.wikipedia.org</p> <p><strong>Description</strong></p> <p>The dataset is provided in the form of&nbsp; three&nbsp; JSON-formatted subsets i.e.,&nbsp; train, validation and test in an analogy of 70-20-10. The current version of the dataset contains 18,617 events annotated with 40,798 entity mentions and 36,189 links to elWikipedia (and wikidata ids). The dataset contains annotations belonging to 8 entity types: person, organization, location, gpe, event, facility, product and work of art.</p> <table> <caption>Overall dataset statistics</caption> <thead> <tr> <th scope="col">&nbsp;</th> <th scope="col">Docs</th> <th scope="col">Tokens</th> <th scope="col">Sentences</th> <th scope="col">Surface Mentions</th> <th scope="col">Valid Links</th> <th scope="col">Red Links</th> </tr> </thead> <tbody> <tr> <td><strong>Train</strong></td> <td>13,031</td> <td>332,077</td> <td>16,927</td> <td>28,593</td> <td>25,365</td> <td>3,228</td> </tr> <tr> <td><strong>Validation</strong></td> <td>3,722</td> <td>94,746</td> <td>4,844</td> <td>8,168</td> <td>7,240</td> <td>928</td> </tr> <tr> <td><strong>Test</strong></td> <td>1,862</td> <td>47,450</td> <td>2,427</td> <td>4,037</td> <td>3,584</td> <td>453</td> </tr> <tr> <td><strong>Total</strong></td> <td>18,617</td> <td>474,361</td> <td>24,200</td> <td>40,798</td> <td>36,189</td> <td>4,609</td> </tr> </tbody> </table> <p><strong>Example</strong></p> <p>A record example is given below.</p> <p>{</p> <p>&quot;json_file&quot;: &quot;February 2012_39_0 events&quot;,<br> &quot;text&quot;: &quot;Sudan and South Sudan sign non-aggression pact.&quot;,<br> &quot;ground_truth_mentions&quot;: [<br> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {&quot;start&quot;: 0, &quot;end&quot;: 4, &quot;surface_mention&quot;: &quot;Sudan&quot;, &quot;mention_type&quot;: &quot;GPE&quot;},<br> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {&quot;start&quot;: 10, &quot;end&quot;: 20, &quot;surface_mention&quot;: &quot;South Sudan&quot;, &quot;mention_type&quot;: &quot;GPE&quot;}<br> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ],<br> &quot;ground_truth_links&quot;: [<br> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {&quot;enwiki&quot;: &quot;Sudan&quot;,&quot;wikidata&quot;: &quot;Q1049&quot;},<br> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {&quot;enwiki&quot;: &quot;South_Sudan&quot;, &quot;wikidata&quot;: &quot;Q958&quot;}<br> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ]<br> }</p> <p><strong>Code</strong></p> <p><a href="https://gitlab.isl.ics.forth.gr/debatelab/elwiki_events_benchmark">https://gitlab.isl.ics.forth.gr/debatelab/elwiki_events_benchmark</a></p> <p><strong>Acknowledgments</strong></p> <p>This work has received funding from the Hellenic Foundation for Research and Innovation (HFRI) and the General Secretariat for Research and Technology (GSRT), under grant agreement No 4195.</p>