Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
11
datasets available to search
ShareScore release 0.9.0
Dataset results
11 results for “Text correction”
Dataset of ICDAR 2019 Competition on Post-OCR Text Correction
<p><strong>Corpus for the ICDAR2019 Competition on Post-OCR Text Correction (October 2019)</strong><br> Christophe Rigaud, Antoine Doucet, Mickael Coustaty, Jean-Philippe Moreux<br> <a href="http://l3i.univ-larochelle.fr/ICDAR2019PostOCR">http://l3i.univ-larochelle.fr/ICDAR2019PostOCR</a><br> -------------------------------------------------------------------------------</p> <p>These are the supplementary materials for the ICDAR 2019 paper <em><a href="https://zenodo.org/record/3459116">ICDAR 2019 Competition on Post-OCR Text Correction</a></em></p> <p>Please use the following citation:</p> <pre><code>@inproceedings{rigaud2019pocr,</code> <code> </code><code>title="ICDAR 2019 Competition on Post-OCR Text Correction",</code> <code> </code><code>author={Rigaud, Christophe and Doucet, Antoine and Coustaty, Mickael and Moreux, Jean-Philippe},</code> <code> </code><code>year={2019},</code> <code> </code><code>booktitle={Proceedings of the 15th International Conference on Document Analysis and Recognition (2019)}</code> <code> </code><code>}</code></pre> <p> </p> <p><strong>Description</strong><br> The corpus accounts for 22M OCRed characters along with the corresponding Gold Standard (GS). The documents come from different digital collections available, among others, at the National Library of France (BnF) and the British Library (BL). The corresponding GS comes both from BnF's internal projects and external initiatives such as Europeana Newspapers, IMPACT, Project Gutenberg, Perseus and Wikisource.</p> <p><strong>Repartition of the dataset</strong><br> - <em>ICDAR2019_Post_OCR_correction_training_18M.zip</em>: 80% of the full dataset, provided to train participants' methods.<br> - <em>ICDAR2019_Post_OCR_correction_evaluation_4M</em>: 20% of the full dataset used for the evaluation (with Gold Standard made publicly after the competition).<br> - <em>ICDAR2019_Post_OCR_correction_full_22M</em>: full dataset made publicly available after the competition.</p> <p><strong>Special case for Finnish language</strong><br> Material from the National Library of Finland (<em>Finnish dataset FI > FI1</em>) are not allowed to be re-shared on other website. Please follow these guidelines to get and format the data from the original website.</p> <p>1. Go to <a href="https://digi.kansalliskirjasto.fi/opendata/submit?set_language=en">https://digi.kansalliskirjasto.fi/opendata/submit?set_language=en</a>;<br> 2. Download <em>OCR Ground Truth Pages (Finnish Fraktur) [v1](4.8GB)</em> from <em>Digitalia (2015-17)</em> package;<br> 3. Convert the Excel file "<em>~/metadata/nlf_ocr_gt_tescomb5_2017.xlsx</em>" as Comma Separated Format (.csv) by using <em>save as</em> function in a spreadsheet software (e.g. Excel, Calc) and copy it into "<em>FI/FI1/HOWTO_get_data/input/</em>";<br> 4. Go to "<em>FI/FI1/HOWTO_get_data/</em>" and run "<em>script_1.py</em>" to generate the <em>full</em> "<em>FI1</em>" dataset in "<em>output/full/</em>";<br> 4. Run "<em>script_2.py</em>" to split the "<em>output/full/</em>" dataset into "<em>output/training/</em>" and "<em>output/evaluation/</em>" sub sets.<br> At the end of the process, you should have a "<em>training</em>", "<em>evaluation</em>" and "<em>full</em>" folder with 1579528, 380817 and 1960345 characters respectively.</p> <p><br> <strong>Licenses: free to use for non-commercial uses, according to sources in details</strong><br> - BG1: IMPACT - National Library of Bulgaria: CC BY NC ND<br> - CZ1: IMPACT - National Library of the Czech Republic: CC BY NC SA<br> - DE1: Front pages of Swiss newspaper NZZ: Creative Commons Attribution 4.0 International (<a href="https://zenodo.org/record/3333627">https://zenodo.org/record/3333627</a>)<br> - DE2: IMPACT - German National Library: CC BY NC ND<br> - DE3: GT4Hist-dta19 dataset: CC-BY-SA 4.0 (<a href="https://zenodo.org/record/1344132">https://zenodo.org/record/1344132</a>)<br> - DE4: GT4Hist - EarlyModernLatin: CC-BY-SA 4.0 (<a href="https://zenodo.org/record/1344132">https://zenodo.org/record/1344132</a>)<br> - DE5: GT4Hist - Kallimachos: CC-BY-SA 4.0 (<a href="https://zenodo.org/record/1344132">https://zenodo.org/record/1344132</a>)<br> - DE6: GT4Hist - RefCorpus-ENHG-Incunabula: CC-BY-SA 4.0 (<a href="https://zenodo.org/record/1344132">https://zenodo.org/record/1344132</a>)<br> - DE7: GT4Hist - RIDGES-Fraktur: CC-BY-SA 4.0 (<a href="https://zenodo.org/record/1344132">https://zenodo.org/record/1344132</a>)<br> - EN1: IMPACT - British Library: CC BY NC SA 3.0<br> - ES1: IMPACT - National Library of Spain: CC BY NC SA<br> - FI1: National Library of Finland: no re-sharing allowed, follow the above section to get the data. (<a href="https://digi.kansalliskirjasto.fi/opendata">https://digi.kansalliskirjasto.fi/opendata</a>)<br> - FR1: HIMANIS Project: CC0 (<a href="https://www.himanis.org/">https://www.himanis.org</a>)<br> - FR2: IMPACT - National Library of France: CC BY NC SA 3.0<br> - FR3: RECEIPT dataset: CC0 (<a href="http://findit.univ-lr.fr/">http://findit.univ-lr.fr</a>)<br> - NL1: IMPACT - National library of the Netherlands: CC BY<br> - PL1: IMPACT - National Library of Poland: CC BY<br> - SL1: IMPACT - Slovak National Library: CC BY NC</p> <p>Text post-processing such as cleaning and alignment have been applied on the resources mentioned above, so that the Gold Standard and the OCRs provided are not necessarily identical to the originals.</p> <p><br> <strong>Structure</strong><br> - **Content** [<em>./lang_type/sub_folder/#.txt</em>]<br> - "<em>[OCR_toInput] </em>" => Raw OCRed text to be de-noised.<br> - "<em>[OCR_aligned] </em>" => Aligned OCRed text.<br> - "<em>[ GS_aligned] </em>" => Aligned Gold Standard text.</p> <p>The aligned OCRed/GS texts are provided for training and test purposes. The alignment was made at the character level using "<em>@</em>" symbols. "<em>#</em>" symbols correspond to the absence of GS either related to alignment uncertainties or related to unreadable characters in the source document. For a better view of the alignment, make sure to disable the "word wrap" option in your text editor.</p> <p>The Error Rate and the quality of the alignment vary according to the nature and the state of degradation of the source documents. Periodicals (mostly historical newspapers) for example, due to their complex layout and their original fonts have been reported to be especially challenging. In addition, it should be mentioned that the quality of Gold Standard also varies as the dataset aggregates resources from different projects that have their own annotation procedure, and obviously contains some errors.</p> <p><br> <strong>ICDAR2019 competition</strong><br> Information related to the tasks, formats and the evaluation metrics are details on :<br> <a href="https://sites.google.com/view/icdar2019-postcorrectionocr/evaluation">https://sites.google.com/view/icdar2019-postcorrectionocr/evaluation</a></p> <p><br> <strong>References</strong><br> - IMPACT, European Commission's 7th Framework Program, grant agreement 215064<br> - Uwe Springmann, Christian Reul, Stefanie Dipper, Johannes Baiter (2018). Ground Truth for training OCR engines on historical documents in German Fraktur and Early Modern Latin.<br> - <a href="https://digi.nationallibrary.fi/">https://digi.nationallibrary.fi</a> , Wiipuri, 31.12.1904, Digital Collections of National Library of Finland<br> - EU Horizon 2020 research and innovation programme grant agreement No 770299</p> <p><br> <strong>Contact</strong><br> - christophe.rigaud(at)univ-lr.fr<br> - antoine.doucet(at)univ-lr.fr<br> - mickael.coustaty(at)univ-lr.fr<br> - jean-philippe.moreux(at)bnf.fr</p> <p>L3i - University of la Rochelle, <a href="http://l3i.univ-larochelle.fr/">http://l3i.univ-larochelle.fr</a><br> BnF - French National Library, <a href="http://www.bnf.fr/">http://www.bnf.fr</a></p>
Text-fig. 10. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, NM S 4766, x 26. Lateral plates on undersurface of arm segment in Hunsrück Slate articulated specimen. Short thin groove spines on ventral edge of lateral arm plates protect undersurface of vertebra and partially cover ambulacral groove. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 10. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, NM S 4766, x 26. Lateral plates on undersurface of arm segment in Hunsrück Slate articulated specimen. Short thin groove spines on ventral edge of lateral arm plates protect undersurface of vertebra and partially cover ambulacral groove.
Text-fig. 11. Eospondylus cf. primigenius (STÜRTZ) "Prastav" quarry at Praha-Holyně, Třebotov Limestone, Lower Devonian, Dalejan, NM L 36905, x 65. Overlay of proximal and distal articulations. Upper photo is proximal surface with distal bird-like articulation knobs superposed in ink. Lower photo is distal surface with proximal articulation knobs superposed in ink. The architecture of articulation surfaces is both zygospondylous and auluroid. This architecture occurs also in vertebrae of Furcaster and indicates that families Eospondylidae and Furcasteridae are closely related. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 11. Eospondylus cf. primigenius (STÜRTZ) "Prastav" quarry at Praha-Holyně, Třebotov Limestone, Lower Devonian, Dalejan, NM L 36905, x 65. Overlay of proximal and distal articulations. Upper photo is proximal surface with distal bird-like articulation knobs superposed in ink. Lower photo is distal surface with proximal articulation knobs superposed in ink. The architecture of articulation surfaces is both zygospondylous and auluroid. This architecture occurs also in vertebrae of Furcaster and indicates that families Eospondylidae and Furcasteridae are closely related.
Text-fig. 7B. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, BMNH E3358, x 4. Hunsrück Slate articulated specimen. Underside of arm showing two contrasting appearances of lateral arm plates in a single arm. The arm is rolled slightly. Of the left lateral arm plates the lateral surface is extensively exposed. The spine ridge faces distally (posteriorly). Of the right lateral arm plates only the ventral edge that borders the ambulacral groove is exposed. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 7B. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, BMNH E3358, x 4. Hunsrück Slate articulated specimen. Underside of arm showing two contrasting appearances of lateral arm plates in a single arm. The arm is rolled slightly. Of the left lateral arm plates the lateral surface is extensively exposed. The spine ridge faces distally (posteriorly). Of the right lateral arm plates only the ventral edge that borders the ambulacral groove is exposed.
Text-fig. 8. Eospondylus cf. primigenius (STÜRTZ) "Červený lom" quarry near Praha-Klukovice, Loděnice Limestone, Lower Devonian, Pragian, NM L 36910, x 25. Left lateral plate, outer view. The surface leading to the vertical ridge flairs outward. The height profile leaves uncovered part of the side of the arm vertebra. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 8. Eospondylus cf. primigenius (STÜRTZ) "Červený lom" quarry near Praha-Klukovice, Loděnice Limestone, Lower Devonian, Pragian, NM L 36910, x 25. Left lateral plate, outer view. The surface leading to the vertical ridge flairs outward. The height profile leaves uncovered part of the side of the arm vertebra.
Text-fig. 6. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, NM S 4766, x 12.5. Undersurface of arm segments in Hunsrück Slate articulated specimen. A few lateral plates are displaced and expose details of vertebrae. The canal for radial water vessel is in center of zygosphene knob and zygotreme pit, like spout and funnel. At distal outer edges of vertebrae is cupola for tube feet. There are no under arm plates. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 6. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, NM S 4766, x 12.5. Undersurface of arm segments in Hunsrück Slate articulated specimen. A few lateral plates are displaced and expose details of vertebrae. The canal for radial water vessel is in center of zygosphene knob and zygotreme pit, like spout and funnel. At distal outer edges of vertebrae is cupola for tube feet. There are no under arm plates.
Text-fig. 2. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate,, NM S 4764, x 3. Specimen with ventral arm coiling. The specimen is on its dorsum in slate with all five rays curled ventrally inward toward mouth area on underside of disk. Barely visible are tips of two jaws; slightly exposed are proximal parts of rays in oral view extending outward from disk. The location of abrupt ventral bending of rays is indicated by emergence from slate of five rays in aboral view that point inward toward buried disk. Based on ventral bending of rays and intimate association with crinoids Eospondylus has been interpreted as stratigraphic first occurrence of Order Euryalida, which contains epizoic gorgonocephalid and euryalid basket-stars of modern oceans. This status is rejected using new evidence from isolated vertebrae. [Photo by Alexander Glass]. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 2. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate,, NM S 4764, x 3. Specimen with ventral arm coiling. The specimen is on its dorsum in slate with all five rays curled ventrally inward toward mouth area on underside of disk. Barely visible are tips of two jaws; slightly exposed are proximal parts of rays in oral view extending outward from disk. The location of abrupt ventral bending of rays is indicated by emergence from slate of five rays in aboral view that point inward toward buried disk. Based on ventral bending of rays and intimate association with crinoids Eospondylus has been interpreted as stratigraphic first occurrence of Order Euryalida, which contains epizoic gorgonocephalid and euryalid basket-stars of modern oceans. This status is rejected using new evidence from isolated vertebrae. [Photo by Alexander Glass].
IG. 6. Ordination diagram of PCA of the Patagonian bat assemblage for craniodental variables using A) data set not size-corrected; and B) data set size-corrected. Polygons include specimens from each species: H. macrotus (▲), H. magellanicus (), H. montanus (▲), L. varius (■), M. chiloensis (●), and T. brasiliensis (£). Vectors show the strengh of correlation of each variable with the plane of PC1 and PC2. See text for abbreviations in Ecomorphological diversity in the Patagonian assemblage of bats from Argentina
IG. 6. Ordination diagram of PCA of the Patagonian bat assemblage for craniodental variables using A) data set not size-corrected; and B) data set size-corrected. Polygons include specimens from each species: H. macrotus (▲), H. magellanicus (), H. montanus (▲), L. varius (■), M. chiloensis (●), and T. brasiliensis (£). Vectors show the strengh of correlation of each variable with the plane of PC1 and PC2. See text for abbreviations
Text-fig. 9A. Eospondylus cf. primigenius (STÜRTZ) "Červený lom" quarry near Praha-Klukovice, Loděnice Limestone, Lower Devonian, Pragian, NM L 36910, x 40. Left lateral plate. Inner surface view from below. The spine ridge faces distally (posteriorly) and has blunt pointed denticles. Anterior and parallel to denticled part of spine ridge is internal rounded ridge. Ventrolaterally ossicle has slit-like sockets for groove spines. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 9A. Eospondylus cf. primigenius (STÜRTZ) "Červený lom" quarry near Praha-Klukovice, Loděnice Limestone, Lower Devonian, Pragian, NM L 36910, x 40. Left lateral plate. Inner surface view from below. The spine ridge faces distally (posteriorly) and has blunt pointed denticles. Anterior and parallel to denticled part of spine ridge is internal rounded ridge. Ventrolaterally ossicle has slit-like sockets for groove spines.
Text-fig. 7A. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, BMNH E3353, x 3. Extreme horizontal arm bending: Arm loop with half-twist in Hunsrück Slate. In the proximal part of the arm the view is of the upper surface, but after the loop the view is of the lower surface. Seven arm segments (six articulations) bend 180 degrees, indicating 30 degrees of bend per articulation. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 7A. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, BMNH E3353, x 3. Extreme horizontal arm bending: Arm loop with half-twist in Hunsrück Slate. In the proximal part of the arm the view is of the upper surface, but after the loop the view is of the lower surface. Seven arm segments (six articulations) bend 180 degrees, indicating 30 degrees of bend per articulation.
Text-fig. 1. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, specimens PWL 1996 57LS (NMM) top image (A) x 1.5, and PWL 1996 66LS (NMM) bottom image (B) x 1.7. Specimen with rays bent into strong curves. Such flexibility and attitudes of rays differentiate the behavioral ecology of Eospondylus from all other Hunsrück Slate ophiuroids. Delicateness of the top specimen and robustness of the bottom specimen is perhaps the combined result of real phenotypic differences, differences of preserved detail, and differences of distortion of the rock. [courtesy of Herbert Lutz and Thomas Engel; photos by Alexander Glass]. in Isolated Ossicles Of The Family Eospondylidae Spencer Wright, 1966, In The Lower Devonian Of Bohemia (Czech Republic) And Correction Of The Systematic Position Of Eospondylid Brittlestars (Echinodermata: Ophiuroidea: Oegophiurida)
Text-fig. 1. Eospondylus primigenius (STÜRTZ) Bundenbach, Eschenbach-Bocksberg quarry, Lower Devonian, Lower Emsian (Zlichovian), Hunsrück Slate, specimens PWL 1996 57LS (NMM) top image (A) x 1.5, and PWL 1996 66LS (NMM) bottom image (B) x 1.7. Specimen with rays bent into strong curves. Such flexibility and attitudes of rays differentiate the behavioral ecology of Eospondylus from all other Hunsrück Slate ophiuroids. Delicateness of the top specimen and robustness of the bottom specimen is perhaps the combined result of real phenotypic differences, differences of preserved detail, and differences of distortion of the rock. [courtesy of Herbert Lutz and Thomas Engel; photos by Alexander Glass].
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.