Dataset for "Evaluation Methods and Replicability of Software Architecture Research Objects"

<p># Content<br> In this package, please find the&nbsp; following content:</p> <p>* Investigated Papers.bib<br> &nbsp;&nbsp; &nbsp;A BibTeX file with all papers investigated in the paper &quot;Evaluation Methods and Replicability of Software Architecture Research Objects&quot;<br> * Raw-Data-Table Content-Data.html and Raw-Data-Table Meta-Data.html<br> &nbsp;&nbsp; &nbsp;Tables with the raw data as extracted during the systematic literature review<br> * Colection of Data Visualizations.pdf<br> &nbsp;&nbsp; &nbsp;Multiple visualizations of the raw data for analysis. A copy of summary.pdf as described below.<br> * Data and Visualization<br> &nbsp;&nbsp; &nbsp;Contains:<br> &nbsp;&nbsp; &nbsp;- The data as CSV files,<br> &nbsp;&nbsp; &nbsp;- scripts for creating visualizations<br> &nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;- *.awk -- Awk scripts are used to create the corresponding of the *.csv files in data<br> &nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;- *.rb -- Ruby scripts to build the respective figures in figs as *.tex files<br> &nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;- make-all.sh -- A script to call all other scripts for creating diagrams and the summary<br> &nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;- make-paper-figures.sh -- A script to build &quot;paper-figures.pdf&quot; with all diagrams used in the accompanying paper<br> &nbsp;&nbsp; &nbsp;- A documentation of the contained scripts (Data and Visualization/README.md)<br> &nbsp;&nbsp; &nbsp;- summary.pdf -- A collection of diagrams (as built by make-all.sh)<br> &nbsp;&nbsp; &nbsp;- paper-figures.pdf -- A collection of all diagrams as used in the accompanying paper (as built by make-paper-figures.sh and make-all.sh)<br> * Wiki/<br> &nbsp;&nbsp; &nbsp;A copy of the wiki used during data extraction.<br> &nbsp;&nbsp; &nbsp;Constains:<br> &nbsp;&nbsp; &nbsp;- descriptions of all data items<br> &nbsp;&nbsp; &nbsp;- the process description<br> &nbsp;&nbsp; &nbsp;- the taxonomy used for data extraction</p> <p><br> # Reproduction<br> You can reproduce the visualizations with the following commands in a UNIX command line environment.</p> <p>&gt; cd &quot;Data and Visualization&quot;<br> &gt; ./make-paper-figures.sh<br> &gt; ./make-all.sh</p> <p>The requirements are:<br> * A UNIX command line environment (e.g., bash) with awk installed<br> * Ruby (&gt;2.5)<br> * latex (e.g., tex-live)</p> <p>The command &quot;./make-paper-figures.sh&quot; produces the file &ldquo;paper-figures.pdf&rdquo;, which contains all diagrams that are used in the paper.<br> The command &quot;./make-all.sh&quot; produces the file &quot;summary.pdf&quot;, which contains diagrams used for data analysis, and the file &quot;paper-figures.pdf&quot;. All figures describing the results in the paper are also in &quot;summary.pdf&quot;.<br> These commands each take about 2 (&quot;/make-paper-figures.sh&quot;) / 8 (&quot;./make-all.sh&quot;) minutes to run on current standard laptop (Intel i5-8250U, 16 GB memory).<br> Calling the commands produces many log statements (information and warnings), which show the progress and can be ignored.</p>