Skip to main content
zenodoopen

A scheduler log replayer and logs for BFTrainer evaluation

<p>This is a temporary repository to host source for paper:&nbsp;<code>BFTrainer: Low-Cost Training of Neural Networks on Unfillable Supercomputer Nodes.</code></p> <p>Files</p> <ul> <li><code>BFTrainer-replay.py</code>&nbsp;the main program to replay real scheduler to evaluate our resource allocation algorithm</li> <li><code>jobs.py</code>&nbsp;implements functions to manage jobs.</li> <li><code>progCBC.py</code>&nbsp;or&nbsp;<code>progGRB.py</code>&nbsp;the implementation of mixed Integer linear programming using Gurobi optimizer (progGRB.py). We also open source our implementation (progGRB.py) using free optimizer (e.g., CBC, Pulp and JuMP). You can get an Trial Licenses or Free Academic Licenses from Gurobi if you want to run the current version. You need to adjust the import source in the&nbsp;<code>BFTrainer-replay.py</code>&nbsp;to use the CBC based solver.</li> <li><code>trace.py</code>&nbsp;has functions to manage scheduler logs for the replay evaluation.</li> </ul>

ShareScore

36/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
4
Harmonization
4
Access
16
Reuse readiness
8
Engagement
4

ScienceDex for faculty

Your academic CV and NIH biosketch

Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.