A Code Token Type Taxonomy-enhanced dataset with pre-computed token types for Python150k

<p>Code Token Type Taxonomy (CT3) is a methodology for refined evaluation of ML-based code completion approaches.</p> <p>We published the&nbsp;CT3-enhanced dataset with pre-computed token types for each token in the <a href="https://www.sri.inf.ethz.ch/py150">Python150k dataset</a>.</p> <p>The dataset was obtained from&nbsp;an empirical study of the below paper:</p> <p>Kim Tuyen Le, Gabriel Rashidi, and Artur Andrzejak. A Methodology for Refined Evaluation of ML-based Code Completion Approaches. In <em>Special Issue on Programming Language Processing, Data Mining and Knowledge Discovery</em>.</p> <p>Please read the README.txt file for detailed information of structuring the enhanced dataset.</p>