Root Cause Analysis Calibration Data

<p>This dataset contains three parts:</p> <ul> <li><strong>sizeEvolution.tar</strong>: Measurement data of relative standard deviations of generated call trees</li> <li>RCA strategy data: <strong>strategy-COMPLETE.tar</strong>, <strong>strategy-UNTIL_SOURCE_CHANGE.tar</strong>, <strong>strategy-LEVELWISE.tar</strong>: Measurement data of root cause analysis of example performance differences of 1.0%, 2.0%, 3.0% and 5.0% for three RCA strategies</li> <li><strong>extract.sh</strong>: Script for unpacking the RCA strategy data</li> <li><strong>RCA-strategy-results.tar.xz</strong>: The result data of the analysis</li> <li><strong>UNTIL_SOURCE_CHANGE_2_1.010.pdf </strong>and <strong>UNTIL_SOURCE_CHANGE_8_1.010.pdf</strong>: Two example files, showing how the F₁ score declines with increasing tree depth.</li> </ul> <p>Thereby, the measurability of root causes of performance changes based on the effect size and measurement strategy and configuration can be estimated.</p> <p>To execute the analysis of the data, execute the following steps:</p> <ul> <li>Download everything to the folder $DATA (eg. ~/Downloads/data/).</li> <li>Extract the data by running ./extract.sh in this folder.</li> <li>Analyse the data by running scripts/analysis_strategy/localStrategyComparison.sh $DATA from the precision-experiments-rca repository <em>(link will be provided upon acceptance)</em>, where $DATA is the folder of the data. This will yield pdf result files like given in RCA-strategy-results.tar.xz.</li> </ul> <p>To execute the measurements, use the precision-experiments-rca repository <em>(link will be provided upon acceptance)</em>.</p> <p>The measurement data were obtained by execution of https://github.com/DaGeRe/precision-experiments-rca/ on Java 1.8.0_312 running on Ubuntu 20.04 and on i7-6700 @ 3.40 GHz.</p> <p>&nbsp;</p>