Subject indexing data of K10plus library union catalog

<p>This dataset contains a an extract of <strong>K10plus library union catalog</strong> with its <strong>subject indexing data</strong>:</p> <ul> <li><code>kxp-subjects_2022-09-30_??of10.dat</code> : the full data (68.051.434&nbsp;records) split in files of up to 5.000.000 records each</li> </ul> <p><strong>K10plus</strong> is a union catalog of German libraries, run by library service centers BSZ and VZG since 2019. The catalog contains bibliographic data of the majority of academic libraries in Germany. The core data of K10plus is made available as OpenData via APIs and in form of database dumps. More information can be found here:</p> <ul> <li><a href="https://www.bszgbv.de/services/k10plus/">K10plus homepage</a> (in German)</li> <li><a href="https://wiki.k10plus.de/display/K10PLUS/Open+Data">K10plus Open Data page</a> (in German)</li> <li><a href="https://opac.k10plus.de/">Traditional search interface (OPAC)</a></li> </ul> <p><strong>Data format</strong></p> <p>The data is provided in its raw internal format called <strong>PICA+</strong> to not loose information during conversion. In particular the data is given in <strong>PICA Normalized Format</strong> with one record per line. Each record consists of a list of <strong>fields</strong> and each field consists of a list of <strong>subfields</strong>.</p> <p>The data can best be processed with command line tools <a href="https://github.com/deutsche-nationalbibliothek/pica-rs#pica-rs">pica-rs</a> or <a href="https://metacpan.org/dist/PICA-Data/view/script/picadata">picadata</a>.</p> <p>A detailled description of PICA format and its processing is given in the German textbook <a href="https://pro4bib.github.io/pica/">Einf&uuml;hrung in die Verarbeitung von PICA-Daten</a>.</p> <p>For visual inspection PICA Normalized Format is best converted into <strong>PICA Plain Format</strong> (pica-rs command <code>pica print</code>). The following example record contains seven fields:</p> <pre><code>003@ $0010003231 013D $9104450460$VTsvz$3209786884$7gnd/4151278-9$aEinführung 044K $9106080474$VTsv1$7gnd/4077343-7$3209204761$aSekte 044N $aReligionsgemeinschaft 045E $a12 045F $a291 045Q/01 $9181570408$VTkv$a11.97$jNeue religiöse Bewegungen$jSekten 045R $91270641751$VTkv$7rvk/11410:$3200641751$aBG 9600$jAllgemeines$NB$JTheologie und Religionswissenschaften$NBG$JFundamentaltheologie$NBG 9020-BG 9790$JKirche und Kirchen$NBG 9600-BG 9720$JFreikirchen und Sekten 045V $a1</code></pre> <p>Each K10plus record is uniquely identified by its record identifier PPN, given in field <code>003@</code> subfield <code>$0</code>. The PPN can be used:</p> <ul> <li>to link into K10plus catalog, e.g.&nbsp;<a href="https://opac.k10plus.de/DB=2.299/PPNSET?PPN=010003231">https://opac.k10plus.de/DB=2.299/PPNSET?PPN=010003231</a></li> <li>to retrieve the record in other formats via API, e.g.&nbsp;<a href="https://unapi.k10plus.de/?id=opac-de-627:ppn:010003231&amp;format=marcxml">https://unapi.k10plus.de/?id=opac-de-627:ppn:010003231&amp;format=marcxml</a> (MARC/XML format) and <a href="https://ws.gbv.de/suggest/csl/?query=pica.ppn=010003231&amp;citationstyle=ieee&amp;language=de">https://ws.gbv.de/suggest/csl/?query=pica.ppn=010003231&amp;citationstyle=ieee&amp;language=de</a> (Citation Format)</li> </ul> <p><strong>Scope of the data</strong></p> <p>The data is limited to records having a least one holding by a library participating in K10plus. Records are provided with &ldquo;offline expansion&rdquo; (some subfield have been added automatically to facilitate re-use of the data) and limited to the following fields:</p> <ul> <li><code>003@</code> with internal record identifier &ldquo;PPN&rdquo; in subfield <code>$0</code></li> <li><code>010@</code>&nbsp;language<code>&nbsp;</code></li> <li><code>013D</code> type of content</li> <li><code>013E</code>&nbsp;musical type of document</li> <li><code>013F</code> target audience</li> <li><code>013H</code>&nbsp;additional type of document</li> <li><code>041A</code> keywords</li> <li><code>044.</code> all subject indexing fields starting with <code>044</code></li> <li><code>045.</code> all subject indexing fields starting with <code>045</code></li> <li><code>144Z</code> local library keywords</li> <li><code>145S</code> local library classification</li> <li><code>145Z</code> local library classification</li> </ul> <p>The following fields may also be of interest but are not included:</p> <ul> <li><code>017G</code> and <code>017H</code>URL for catalog enrichment (e.g. table of contents)</li> <li><code>047I</code> abstract</li> </ul> <p>Documentation of the fields can be found at <a href="https://format.k10plus.de/k10plushelp.pl?cmd=pplist&amp;katalog=Standard#titel">https://format.k10plus.de/k10plushelp.pl?cmd=pplist&amp;katalog=Standard#titel</a></p> <p><strong>Processing examples</strong></p> <p>Extract CSV file of PPN and RVK-Notation:</p> <pre><code>pica filter '045R?' kxp-subjects_2022-06-30.dat | pica select '003@$0,045Ra'</code></pre> <p>Get a list of PPN of records having RVK but not BK:</p> <pre><code>pica filter '045R? &amp; !045Q/01' kxp-subjects_2022-06-30.dat | pica select '003@$0'</code></pre> <p>See <a href="https://github.com/gbv/k10plus-subjects#readme">https://github.com/gbv/k10plus-subjects#readme</a> for additional examples of data analysis.</p> <p><strong>Automatic download</strong></p> <p>Given the Zenodo Record ID (e.g.&nbsp;6810556), a list of all files can be generated with curl and jq:</p> <pre><code>curl -sL https://zenodo.org/api/records/$ID | jq -r '.files|map([.key,.links.self]|@tsv)[]'</code></pre> <p><strong>Changes</strong></p> <ul> <li>2022-09-30: update with additional fields 010@, 013E, 013H, 014A (68.051.434&nbsp;records)</li> <li>2022-06-30: update with additional fields 013D and 013F (47.686.064 records)</li> <li>2021-06-30: first published dump (41.786.820 records)</li> </ul> <p><strong>License</strong></p> <p><a href="https://creativecommons.org/publicdomain/zero/1.0/">https://creativecommons.org/publicdomain/zero/1.0/</a></p>