Publication dates for ArXiv publication versions

<p>Lookup tables in plain JSON, mapping ArXiv publication version identifiers to their respective publications dates.</p> <p>The JSON files are archived in&nbsp;<em>arxiv-publication-dates-by-identifier-prefix.tar.gz</em>.<br>The archive contains files named after the date prefix of the ArXiv publication version identifiers they contain.<br>E.g., the file&nbsp;<em>1908.json</em> will contain the data for identifiers <em>1908.12345v1</em>, <em>1908.12345v2</em>, <em>1908.23456v1</em>, etc.<br>Publication dates are given in the format <em>YYYY-MM-DD</em>.</p> <h2>Reproducibility</h2> <p>The <a href="https://snakemake.readthedocs.io/">Snakemake</a> workflow that has produced this dataset has been archived&nbsp;and is available in <em>arxiv-publication-dates-workflow.tar.gz</em>.</p> <h3>Changes in version 1.2</h3> <p>Version 1.2 includes a JSON file that contains a JSON array with all file names included in the dataset: <em>file_names.json</em>.</p> <h3>Changes in version 1.1</h3> <p>For version 1.1, the dataset was extended manually to include a single missing date for <a href="https://arxiv.org/abs/0906.3421v3">arXiv:0906.3421v3</a>: <em>2010-02-02</em>.&nbsp;As of 2024-05-13, the date for the respective version had not been provided in the&nbsp;<em>arXivRaw</em> OAI-PMH data (<a href="http://export.arxiv.org/oai2?verb=GetRecord&amp;identifier=oai:arXiv.org:0906.3421&amp;metadataPrefix=arXivRaw">http://export.arxiv.org/oai2?verb=GetRecord&amp;identifier=oai:arXiv.org:0906.3421&amp;metadataPrefix=arXivRaw</a>).</p> <h3>Running the workflow</h3> <p>To reproduce the dataset on a Linux machine,&nbsp;you need a version of the <a href="https://conda-forge.org/"><em>conda</em></a> package manager installed on your system.</p> <p>Run the following:<br><br></p> <pre><code># Extract the archived workflow tar -xf my-workflow.tar.gz # Create conda environment from lock file conda env create -n arxiv-metadata --file conda-environment.lock.yaml # Activate the environment conda activate arxiv-metadata # Optionally, dry-run the workflow snakemake -n # Produce the output files snakemake --keep-storage-local-copies --software-deployment-method conda -c &lt;NUMBER OF CORES TO USE&gt;</code><br><br>Then, append the file <em>0906.json</em> (included in the <em>tar.gz</em> output) with value <em>2010-02-02</em> for a new key <em>0906.3421v3</em>.</pre> <h2>Workflow</h2> <p>To adapt/change the workflow, clone it from <a href="https://github.com/sdruskat/arxiv-publication-metadata">https://github.com/sdruskat/arxiv-publication-metadata</a>.<br>The workflow version used to produce this dataset is available at <a href="https://doi.org/10.5281/zenodo.11507183">https://doi.org/10.5281/zenodo.11507183</a>.&nbsp;</p>