An Open Dataset of Scholarly Publications Referenced in Selected Policy Documents (POLIDOC_SCHOLAR)
<p>POLIDOC_SCHOLAR: An Open Dataset of Scholarly Publications Referenced in Selected Policy Documents</p>
<p>This repository contains an open dataset of scholarly publications cited by selected policy documents.</p>
<p><strong>1. Background:</strong></p>
<ul>
<li>We do not aim to create a dataset of references for all policy documents or millions of policy documents but rather from a carefully selected set of policy documents.</li>
<li>The long-term plan is to facilitate the inclusion of citations of scholarly publications in open bibliometric databases (or at least to create inter-operable datasets).</li>
<li>In the short-term, we plan to increase the number of policy documents included in the dataset and continue to monitor and increase the data quality (completeness of records, provided external identifiers).</li>
<li>We will also document - in the next release - the reference extraction process (including code used)</li>
</ul>
<p> </p>
<p><strong>2. Structure of the dataset:</strong></p>
<p>The dataset is structured into two primary categories: "<strong>Collections</strong>" and "<strong>Collection References</strong>."</p>
<p><strong>Collections:</strong></p>
<p>The metadata for selected policy documents is included the "<em>collections.jsonl</em>" file.</p>
<p>The <strong>collection</strong> is a central feature of the POLIDOC_SCHOLAR dataset. The selected policy documents are listed in the “<em>collections.jsonl</em>”.</p>
<p>For instance, a collection might include reports like the IPCC reports of the 6th Cycle (the "IPCC_AR_6 collection") or the reports from IPBES (the "IPBES collection").</p>
<p>Within each collection, there are "documents." These can be twofold:</p>
<ul>
<li>They represent individual reports within a collection (e.g., the IPCC_AR_6 collection contains 6 reports: 3 assessment reports and 3 special reports from the 6th Cycle of the IPCC assessment).</li>
<li>They also denote specific sections of these reports that contain bibliographic references. These sections can be chapters or other segments like supplementary materials or annexes (any section which has a reference list). Each document has a unique code, and the relationships between a main document and its subdivisions are indicated in the "is_part_of" field.</li>
</ul>
<p><strong>Collection References:</strong></p>
<p>To allow users to access only the collections they are interested in, we've separated references by collection in files named "<em>collection_reference_{…name of collection…}jsonl</em>."</p>
<ul>
<li>Each of these files includes bibliographic references for every document in a specific collection.</li>
<li>Besides presenting these as "reference strings" (in their original format within the document), we also offer unique identifiers like DOI and OpenAlex ID to facilitate linkage to external databases.</li>
</ul>
<p>The documentation of the dataset is provided in the file “<em>data_dictionary</em>”</p>
<p><strong>3, Content release v1:</strong></p>
<p>This release (POLIDOC_SCHOLAR version 1) includes 2 collections:</p>
<ol>
<li>IPCC Assessment Cycle 6 </li>
<li>IPBES Assessment reports</li>
</ol>
<p> </p>
<table>
<tbody>
<tr>
<td>
<p> </p>
</td>
<td>
<p>collection</p>
</td>
<td>
<p>Number of reports</p>
</td>
<td>
<p>Number of documents (“sections” with reference)</p>
</td>
<td>
<p>Number of references (strings, not unique)</p>
</td>
<td>
<p>Number of references with DOI (unique)</p>
</td>
<td>
<p>Number of references with DOI (unique)</p>
</td>
</tr>
<tr>
<td>
<p>1</p>
</td>
<td>
<p>IPCC Assessment Cycle 6</p>
</td>
<td>
<p>6</p>
</td>
<td>
<p>103</p>
</td>
<td>
<p>94,958 </p>
</td>
<td>
<p>51,713</p>
</td>
<td>
<p>48,695</p>
<p> </p>
</td>
</tr>
<tr>
<td>
<p>2</p>
</td>
<td>
<p>IPBES Assessment reports</p>
</td>
<td>
<p>3</p>
</td>
<td>
<p>27</p>
</td>
<td>
<p>21,750 </p>
</td>
<td>
<p>12,100 </p>
</td>
<td>
<p>11,896</p>
</td>
</tr>
</tbody>
</table>
opencc-by-4.0Jul 2023View details →
