Figures with raw prediction samples from submissions to ICDAR'24 MapText Competition

<h2>Raw predictions sample from MapText submissions</h2> <p><em>Generated on June 6th, 2024</em></p> <p>Files structure: <code>{TASK}/{SUBSET}/{SELECTION}/{IMAGEID}.pdf</code> where</p> <ul> <li><code>{TASK}</code> is "task1", "task2", "task3" or "task4"</li> <li><code>{SUBSET}</code> is "rumsey", or "ign" (for French land registers dataset)</li> <li><code>{SELECTION}</code> is "random", "easy" or "hard"</li> <li><code>{IMAGEID}</code> is the image id in the dataset</li> </ul> <p>Example:&nbsp;<code>20-raw-predictions/task2/ign/hard/000016.pdf</code></p> <p>For each image, the PDF contains a comparison of the raw predictions of each submission, with the ground truth.</p> <p>For each task, the random images are the same, but the easy and hard images are different: their selection is based on the mean performance of all submissions regarding the main evaluation metric of the task.</p> <p>Sorting strategies for each task:</p> <ul> <li>Task 1: by detection quality (Panoptic Quality) for isolated words</li> <li>Task 2: by detection quality (Panoptic Quality) for word groups</li> <li>Task 3: by detection quality (Panoptic Quality) for isolated words while constraining matches between the ground truth and predictions to have exactly the same transcription</li> <li>Task 4: by character quality (Panoptic Character Quality) for word groups</li> </ul> <p>Task details and legend for each task:</p> <ul> <li><code>task1/</code>: detections for isolated words. Red means cropped or ignored regions, blue means prediction, green is ground truth.</li> <li><code>task2/</code>: detections for word groups. Groups are colored with different colors, and a link is drawn between successive group members. Ground truth is displayed separately.</li> <li><code>task3/</code>: detections and transcriptions of isolated words. Groups are colored with different colors, and the transcription for each isolated work is overlaid as black text. Ground truth is displayed separately.</li> <li><code>task4/</code>: detection and transcription of word groups. Same visualization as task3, but different sorting for easy and hard images.</li> </ul> <p><br>An additional directory <code>extrafigs/</code> contains a couple of figures with a different layout for inclusion in the report.</p> <p><em>These figures were produced by MapText'24 organizers.</em></p>