Replication Package for the Paper: "Will Data Influence the Experiment Results?: A Replication Study of Automatic Identification of Decisions"

<p>This is the replication package for the paper: &quot;Will Data Influence the Experiment Results?: A Replication Study of Automatic Identification of Decisions&quot;.&nbsp;It contains the source code and dataset of our experiment for the&nbsp;replication&nbsp;by&nbsp;other&nbsp;researchers. In the meanwhile, we provide brief description of the files in the replication&nbsp;package below.</p> <p><strong>1. main_code folder</strong></p> <ul> <li><em>automatic_approach.py&nbsp;&nbsp;</em>contains the main source code of the automatic approach for identifying decisions in our experiment, which is conducted on MacOs&nbsp;and Python 3.7.9.&nbsp;<strong>Note that you may&nbsp;get slightly</strong>&nbsp;<strong>different experiment&nbsp;results when conducting the experiments&nbsp;on different environment configurations.</strong></li> <li><em>requirement.txt</em>&nbsp; records all the installation packages and their version numbers needed for the current program to run.&nbsp;You&nbsp;can use &quot;<em>pip install -r requirement.txt</em>&quot; to rebuild the project and install all dependencies. <strong>Note that you may&nbsp;get slightly different experiment&nbsp;results when using different packages or versions.&nbsp;</strong></li> </ul> <p><strong>2. dataset folder</strong></p> <ul> <li><em>EASE2020 - 650 decisions.xlsx&nbsp;&nbsp;</em>contains 650&nbsp;decision sentences&nbsp;from our previous work (EASE2020)</li> <li><em>EASE2020 - 650 non decisions.xlsx&nbsp;&nbsp;</em>contains 650 non-decision sentences&nbsp;from our previous work (EASE2020)</li> <li><em>Our 844 relabeled decisions.xlsx</em> contains 844 relabeled decisions in this work.</li> <li><em>Our 750 assumptions.xlsx</em> contains 750 assumptions from our previous work (APSEC2019)</li> </ul> <p><strong>3. RQ1 folder</strong></p> <ul> <li><em>experiment_RQ1.py</em> contains the main source code of the experiment for answering RQ1, which is conducted on the same environment configuration as the&nbsp;<em>automatic_approach.py.</em></li> </ul> <p><strong>4. RQ2&nbsp;folder</strong></p> <ul> <li><em>experiment_RQ2.py</em> contains the main source code of the experiment for answering RQ2, which is conducted on the same environment configuration as the&nbsp;<em>automatic_approach.py.</em></li> </ul> <p>&nbsp;</p> <p><strong>5. RQ3&nbsp;folder</strong></p> <ul> <li><em>experiment_RQ3.py</em> contains the main source code of the experiment for answering RQ3, which is conducted on the same environment configuration as the&nbsp;<em>automatic_approach.py.</em></li> </ul> <p>&nbsp;</p>