Find research datasets worth reusing

iDPP@CLEF 2022 - Participants' repositories for the Intelligent Disease Prediction Progression Challenge

<p><a href="https://brainteaser.health/open-evaluation-challenges/idpp-2022/">iDPP@CLEF 2022</a> (Intelligent Disease Progression Prediction at CLEF) is a challenge organised by the&nbsp;<a href="https://brainteaser.health/">BRAINTEASER</a>&nbsp;Horizon 2020 project and co-located with&nbsp;<a href="https://clef2022.clef-initiative.eu/">CLEF 2022</a>&nbsp;(Conference and Labs of the Evaluation Forum).&nbsp;</p> <p>BRAINTEASER is a data science project that seeks to exploit the value of big data, including those related to health, lifestyle habits, and environment, to support patients with amyotrophic lateral sclerosis (ALS) and multiple sclerosis (MS) and their clinicians. Taking advantage of cost-efficient sensors and apps, BRAINTEASER will integrate large, clinical datasets that host both patient-generated and environmental data.</p> <p>The goal of iDPP@CLEF is to design and develop an evaluation infrastructure for AI algorithms able to:</p> <ul> <li> <p>Better describe<strong>&nbsp;disease mechanisms</strong>.</p> </li> <li> <p><strong>Stratify patients&nbsp;</strong>according to their phenotype assessed all over the disease evolution.</p> </li> <li> <p><strong>Predict disease progression</strong>&nbsp;in a probabilistic, time dependent fashion.</p> </li> </ul> <p>iDPP@CLEF 2022 offered the following tasks:</p> <ul> <li> <p><strong>Pilot Task 1 &ndash; Ranking Risk of Impairment</strong>: It focuses on ranking of patients based on the risk of impairment in specific domains. More in detail, we will use the ALSFRS-R scale to monitor speech, swallowing, handwriting, dressing/hygiene, walking and respiratory ability in time and will ask participants to rank patients based on time to event risk of experiencing impairment in each specific domain.</p> </li> <li> <p><strong>Pilot Task 2 &ndash; Predicting Time of Impairment</strong>: It refines Task 1 asking participants to predict when specific impairments will occur (i.e. in the correct time-window). In this regard, we assess model calibration in terms of the ability of the proposed algorithms to estimate a probability of an event close to the true probability within a specified time-window.</p> </li> <li> <p><strong>Position Papers Task 3 &ndash; Explainability of AI algorithms</strong>: We call for proposals of different visualization frameworks able to show the multivariate nature of the data and the model predictions in an explainable, possibly interactive, way.</p> </li> </ul> <p>&nbsp;</p> <p>This dataset contains the repositories of the participants to iDPP@CLEF 2022. These repositories contain the output, i.e. the predictions, produced by the participating systems as well as the performance scores for those systems.</p> <p>For additional information about iDPP@CLEF 2022, please see:</p> <ul> <li> <p>Guazzo, A., Trescato, I., Longato, E., Hazizaj, E., Dosso, D., Faggioli, G., Di Nunzio, G. M., Silvello, G., Vettoretti, M., Tavazzi, E., Roversi, C., Fariselli, P., Madeira, S. C., de Carvalho, M., Gromicho, M., Chi&ograve;, A., Manera, U., Dagliati, A., Birolo, G., Aidos, H., Di Camillo, B., and Ferro, N. (2022). Intelligent Disease Progression Prediction: Overview of iDPP@CLEF 2022. In Barr ́on-Cedeno, A., Da San Martino, G., Degli Es- posti, M., Sebastiani, F., Macdonald, C., Pasi, G., Hanbury, A., Potthast, M., Faggioli, G., and Ferro, N., editors, <em>Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Thirteenth International Conference of the CLEF Association (CLEF 2022)</em>, pages 395&ndash;422. Lecture Notes in Computer Science (LNCS) 13390, Springer, Heidelberg, Germany.</p> </li> <li> <p>Guazzo, A., Trescato, I., Longato, E., Hazizaj, E., Dosso, D., Faggioli, G., Di Nunzio, G. M., Silvello, G., Vettoretti, M., Tavazzi, E., Roversi, C., Fariselli, P., Madeira, S. C., de Carvalho, M., Gromicho, M., Chi&ograve;, A., Manera, U., Dagliati, A., Birolo, G., Aidos, H., Di Camillo, B., and Ferro, N. (2022). Overview of iDPP@CLEF 2022: The Intelligent Disease Progression Prediction Challenge. In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, <em>CLEF 2022 Working Notes</em>, pages 1130&ndash; 1210. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073. <a href="https://ceur-ws.org/Vol-3180/paper-88.pdf">http://ceur-ws.org/Vol-3180/</a>.</p> </li> </ul>