Skip to main content
zenodoopen

Best practices for evaluating IRFL approaches - Supplemental material

<p>Information retrieval fault localization (IRFL) is a popular research field and many IRFL approaches have been proposed recently.<br>Unfortunately, the evaluation of some of these IRFL approaches is often too simplistic, which can cause an overestimation of performance of these approaches.<br>For this reason, we discuss evaluation pitfalls and problems in our paper "<a href="https://doi.org/10.1016/j.jss.2025.112342"><em>Best practices for evaluating IRFL approaches</em></a>".<br>To support our claim of the poor status quo of current evaluation practices in some research papers, we have performed a literature survey on 135 papers.<br>This repository contains the data that we have extracted from these papers and our evaluation script.</p>

ShareScore

32/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
4
Harmonization
4
Access
16
Reuse readiness
8
Engagement
0

ScienceDex for faculty

Your academic CV and NIH biosketch

Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.