Towards a general open dataset and model for late medieval Castilian text recognition (HTR/OCR). Datasets and scripts
<p>This repository contains the dataset of the article "Towards a general open dataset and models for late medieval Castilian writing (HTR/OCR)" submitted to the Journal of Data Mining and Digital Humanities (JDMDH). I refer to the paper (<a href="https://doi.org/10.5281/zenodo.7387376">https://doi.org/10.5281/zenodo.7387376</a>) for the description of the corpus and the models.</p><p><strong>The dataset is in version V2: it contains the allographetic AND graphematic transcriptions (files `*.normalized.xml`) and models.</strong></p><p><i>Caveat</i>: the allographetic transcriptions and models only are described in the data paper mentionned above. The graphematic transcriptions are produced using a Chocomuffin conversion table (see `corpus/conversion_table.csv`) to reduce each allograph to its corresponding grapheme. The abbreviations are not expanded.</p><p>Please cite the following paper if you use this dataset or the models:</p><p>@article{gille_levenson_2023_towards,<br> author = {Gille Levenson, Matthias},<br> date = {2023},<br> journaltitle = {Journal of Data Mining and Digital Humanities},<br> doi = {<a href="https://doi.org/10.46298/jdmdh.10416">10.46298/jdmdh.10416</a>},<br> editor = {Pinche, Ariane and Stokes, Peter},<br> issuetitle = {Special Issue: Historical documents and automatic text recognition},<br> title = {Towards a general open dataset and models for late medieval Castilian text recognition<br>(HTR/OCR)},</p><p>GILLE LEVENSON , Matthias, « Towards a general open dataset and models for late medieval Castilian<br>text recognition (HTR/OCR) », <i>Journal of Data Mining and Digital Humanities</i> (2023) : Special<br>Issue : Historical documents and automatic text recognition, eds. Ariane PINCHE and Peter<br>STOKES, DOI : <a href="https://doi.org/10.46298/jdmdh.10416">10.46298/jdmdh.10416</a>.</p><p>The image of the manuscript M (Esc_M) has not yet been uploaded, pending permission from the library that keeps the manuscript.</p><p>All images are kept in a directory named after the place where the manuscript is kept, and the sigla of the witness for the in-domain dataset.</p><p> </p><p>The global licence for the dataset (except for images) is CC-BY-NC-SA.</p><p>All manuscripts reproductions are published with the authorization of the libraries.</p><p><strong>©Biblioteca General Histórica de Salamanca</strong></p><p>Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2709 (L)</p><p>Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2097 (J)</p><p>Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2673</p><p>Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2011</p><p>Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2654</p><p>Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2086</p><p><strong>©Museo Lázaro Galdiano. Madrid</strong></p><p>Inv. 15304, Fundación Lázaro Galdiano (A)</p><p><strong>©Universidad de Valladolid</strong></p><p>Ms. 251, Biblioteca Santa Cruz (S)</p><p><strong>©Real Biblioteca del Escorial</strong></p><p>Ms. K.I.5, Biblioteca del Real Monasterio del Escorial (Q)</p><p>Ms. h.I.8, Biblioteca del Real Monasterio del Escorial (M): to be published</p><p>Ms. Z-I-12</p><p>Ms.Z-III-9</p><p>Ms. X-III-4</p><p>Ms. h-III-9</p><p>Ms. b-IV-15</p><p>Ms. b-II-11</p><p>Ms. a-II-17</p><p>Ms. T-III-5</p><p><strong>©Rosenbach Foundation</strong></p><p>Ms. 482/2 (U)</p><p><strong>© Gallica.bnf.fr</strong></p><p>Espagnol 12</p><p>Espagnol 36</p><p>Espagnol 218</p><p><strong>© Bodleian Library</strong></p><p>Ms. Span. d. 1</p><p>Ms. Span. d. 2/1</p><p><strong>© Biblioteca Real, Madrid</strong></p><p>Ms. II/215 (G)</p><p><strong>© Biblioteca Nacional de España</strong></p><p>Mss/4183</p><p>Inc/901 (Z)</p><p><strong>© Biblioteca Universitaria, Sevilla</strong></p><p>Ms. 332/131 (R)</p><p> </p><p>Edit: add result files</p>
opencc-by-nc-sa-4.0Nov 2022View details →