Best practices for evaluating IRFL approaches - Supplemental material
<p>Information retrieval fault localization (IRFL) is a popular research field and many IRFL approaches have been proposed recently.<br>Unfortunately, the evaluation of some of these IRFL approaches is often too simplistic, which can cause an overestimation of performance of these approaches.<br>For this reason, we discuss evaluation pitfalls and problems in our paper "<a href="https://doi.org/10.1016/j.jss.2025.112342"><em>Best practices for evaluating IRFL approaches</em></a>".<br>To support our claim of the poor status quo of current evaluation practices in some research papers, we have performed a literature survey on 135 papers.<br>This repository contains the data that we have extracted from these papers and our evaluation script.</p>
ShareScore
32/100
Overall dataset sharing score
Score breakdown
These five areas show where the dataset supports — or may limit — practical reuse.
- Stewardship
- 4
- Harmonization
- 4
- Access
- 16
- Reuse readiness
- 8
- Engagement
- 0
ScienceDex for faculty
Your academic CV and NIH biosketch
Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.