Evaluation Data for "Semantic Modelling of Citation Contexts for Context-aware Citation Recommendation"

<p><strong>Contents</strong><br> <br> The four CSV files are the data used for the evaluation in:</p> <ul> <li>Saier T., F&auml;rber M. (2020) Semantic Modelling of Citation Contexts for Context-Aware Citation Recommendation. In: Advances in Information Retrieval. ECIR 2020. Lecture Notes in Computer Science, vol 12035.</li> <li>DOI: <a href="http://doi.org/10.1007/978-3-030-45439-5_15">10.1007/978-3-030-45439-5_15</a></li> <li>Code: <a href="https://github.com/IllDepence/ecir2020">github.com/IllDepence/ecir2020</a></li> </ul> <p>The evaluation was conducted in a citation re-prediction setting.</p> <p><strong>CSV Format</strong></p> <ul> <li>7 columns divided by \u241E <ol> <li>cited document ID <ul> <li>for *_nomarker.csv: citation marker position ambiguous</li> <li>&nbsp;for *_withmarker.csv: citation marker position at &#39;MAINCIT&#39; in citation context</li> </ul> </li> <li>adjacent cited document IDs <ul> <li>only given in citrec_unarxive_*.csv</li> <li>divided by \u241F</li> <li>order matches &#39;CIT&#39; markers in citation context</li> </ul> </li> <li>citing document ID</li> <li>citation context</li> <li>MAG field of study IDs <ul> <li>divided by \u241F</li> </ul> </li> <li>predicate:argument tuples generated based on PredPatt <ul> <li>JSON</li> </ul> </li> <li>noun phrases <ul> <li>for *_nomarker.csv: divided by \u241F</li> <li>for *_withmarker.csv: <ul> <li>divided by \u241D into</li> <li>noun phrases</li> <li>noun phrase directly preceding citation marker</li> </ul> </li> </ul> </li> </ol> </li> </ul> <p><strong>Data Sources</strong></p> <ol> <li>citrec_unarxive_cs_withmarker.csv <ul> <li>data set <ul> <li>unarXive</li> <li>Paper DOI: <a href="http://doi.org/10.1007/s11192-020-03382-z">10.1007/s11192-020-03382-z</a></li> <li>Data DOI: <a href="http://doi.org/10.5281/zenodo.2553522">10.5281/zenodo.2553522</a></li> </ul> </li> <li>filter <ul> <li>citing doc from computer science</li> <li>cited doc is cited at least 5 times</li> </ul> </li> </ul> </li> <li>citrec_mag_cs_en.csv <ul> <li>data set <ul> <li>Microsoft Academic Graph (MAG)</li> <li>Paper DOI: <a href="http://doi.org/10.1145/2740908.2742839">10.1145/2740908.2742839</a></li> </ul> </li> <li>filter <ul> <li>citing doc from computer science and in English</li> <li>citing doc abstract in MAG given</li> <li>cited doc is cited at least 50 times</li> </ul> </li> </ul> </li> <li>citrec_refseer.csv <ul> <li>data set <ul> <li>RefSeer</li> <li>Paper URL: <a href="http://ojs.aaai.org/index.php/AAAI/article/view/9528">ojs.aaai.org/index.php/AAAI/article/view/9528</a></li> <li>Data URL: <a href="http://ojs.aaai.org/index.php/AAAI/article/view/9528">psu.app.box.com/v/refseer</a></li> </ul> </li> <li>filter <ul> <li>for citing and cited docs title, venue, venuetype, abstract, and year not NULL</li> </ul> </li> </ul> </li> <li>citrec_acl-arc_withmarker.csv <ul> <li>data set <ul> <li>ACL ARC</li> <li>Paper URL: <a href="http://aclanthology.org/L08-1005">aclanthology.org/L08-1005</a></li> <li>Data URL: <a href="http://acl-arc.comp.nus.edu.sg/">acl-arc.comp.nus.edu.sg/</a></li> </ul> </li> <li>filter <ul> <li>cited doc has a DBLP ID</li> </ul> </li> </ul> </li> </ol> <p>&nbsp;</p> <p><strong>Paper Citation</strong></p> <pre>@inproceedings{Saier2020ECIR, author = {Tarek Saier and Michael F{\&quot;{a}}rber}, title = {{Semantic Modelling of Citation Contexts for Context-aware Citation Recommendation}}, booktitle = {Proceedings of the 42nd European Conference on Information Retrieval}, pages = {220--233}, year = {2020}, month = apr, doi = {10.1007/978-3-030-45439-5_15}, } </pre>