Approximation-guided Fairness Testing through Discriminatory Space Analysis

<h3>Description:</h3> <p>This dataset contains the experimental results from the paper titled "Approximation-guided Fairness Testing through Discriminatory Space Analysis".</p> <p>In this paper, we conducted 24 fairness testing tasks using 7 different fairness testing algorithms: AFT (our proposed algorithm), VBT-X, VBT, THEMIS, ExpGA, SG and LIMI. Each execution was repeated 30 times, with a runtime of 1 hour.</p> <h3>Files Included:</h3> <ol> <li><strong>log.txt</strong>: This file contains the logs of each execution. Each log is labeled with an identifier, such as "'aft-LogReg-Adult-sex-0", which represents the 1st execution of the fairness testing task on (LogReg, Adult, sex) using AFT.</li> <li><strong>discriminatory_instances.zip</strong>: This archive includes all the IDIs (individual discriminatory instances) identified during the experiments.</li> <li><strong>res.txt</strong>: This file contains the averaged results of the 30 repetitions. It includes four metrics: #IDIs/sec (the number of indentified IDIs per second), #Tests/sec (the number of generated test cases per second), SuccessRatio (the success ratio of test cases), Diversity (the diversity of IDIs) and Naturalness (the naturalness of IDIs).</li> </ol>