Dataset for Stack overflow Manual Results about challenges in developing Spark applications

<p>This dataset contains&nbsp;Stack Overflow manual study results for the paper &quot;An Empirical Study on the Challenges that Developers Encounter When Developing Apache Spark Applications&quot;.</p> <ul> <li>the <em>data</em>&nbsp;folder contains the&nbsp;<em>Stackoverflow Manual Results.csv&nbsp;</em>file that is the manual analysis result for the Stack Overflow posts. The CSV file contains information on the classification of the data, the reasons and the number of views, etc.&nbsp;</li> </ul> <p>&nbsp;</p> <ul> <li>the <em>scripts</em> folder&nbsp;contains the python and SQL files that are used for data collection and data analysis. <ul> <li><em>query_data.sql</em>&nbsp;is used to collect data from the Stack Exchange website.</li> <li><em>sample.py</em>&nbsp;is used to sample data for the manual analysis in the paper.</li> <li><em>common_issue.py</em>&nbsp;is used to study the percentage of common issues in rq1.&nbsp;</li> <li><em>popularity.py&nbsp;</em>is used to calculate the average of normalized view counts in rq2.</li> <li><em>popularity_difficulty.py</em>&nbsp;is used to calculate the average of raw view counts and the median hours to receive an answer in rq2.</li> <li><em>root_cuase.py</em>&nbsp;is used to study the percentage of root causes in rq3.&nbsp;</li> </ul> </li> </ul>