Preprocessed C Code Corpus
<p>A preprocessed code corpus for the C programming language.<br> The corpus was used for the experiments in the paper Big Code != Big Vocabulary: Open-Vocabulary Models for Source Code.<br> It contains preprocessed-tokenized files for training, validation, testing, and BPE encoding learning.<br> The BPE segmented versions of the above files are also included for three different encoding sizes i,e., 2000, 5000, and 10000 BPE merge operations as well as the learned BPE encodings.<br> Similar versions are also contained for splitting compound identifiers on camelCase and snake_case as in (Allamanis et al., 2015) as well as the corresponding subtoken maps.</p>
ShareScore
32/100
Overall dataset sharing score
Score breakdown
These five areas show where the dataset supports — or may limit — practical reuse.
- Stewardship
- 8
- Harmonization
- 4
- Access
- 16
- Reuse readiness
- 0
- Engagement
- 4
Topics
Dataset details
- Repository
- zenodo
- Published
- January 26, 2020
- License
- cc-by-4.0
- DOI
- 10.5281/zenodo.3628637
Scored with release 0.9.0
ScienceDex for faculty
Your academic CV and NIH biosketch
Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.