Replication Kit: "Skill Models for Programming Language Concepts"

<p><strong>Structure</strong></p> <ul> <li><strong>data</strong>: contains the data we used for our case study <ul> <li><strong>skillmodels</strong>: data sets generated from the raw data in the database</li> <li><strong>raw</strong>: raw data collected in SmartAPE [1] containing the source code of the students as well as the assessment results of the system</li> </ul> </li> <li><strong>results</strong>: contains the complete results of our case study <ul> <li>Results of AUC and RMSE&nbsp;for each meta-parametrization and each skill model in .csv and .Rda format</li> <li>boxplots of our AUC and RMSE distributions for each skill model and each meta-parameter in .pdf format</li> </ul> </li> <li>calculation scripts: <ul> <li><strong>sm_trainer.R</strong>: script to fit different models for different meta-parametrizations and test them using different performance metrics. Uses <em>data/skillmodels&nbsp;</em>as input</li> <li><strong>comparison.R</strong>: script that performs statistical tests to compare meta-parameters. Uses <em>results//results_pfa.Rda,&nbsp;results//results_afm.Rda, and&nbsp;results/results_prop.Rda</em>&nbsp;as input</li> </ul> </li> </ul> <p><strong>References</strong></p> <p>[1]&nbsp;Albrecht, Ella et al. &ldquo;Experiences in Introducing Blended Learning in an Introductory Programming Course.&rdquo;&nbsp;<em>ECSEE</em>&nbsp;(2018).</p>