Skip to main content
zenodoopen

Scaling plots for 80% and 100% text-pretrained

<p>Scaling plots for 80% and 100% (text80 and text100) in the name<br>All are text-pretrained with 4 epochs of fine-tuning and 28b of image-text training with 10% image caption and 90% text (ratio 0p1 in the name)<br>plots with various ablations at 154m, 411m, 1b scale (appended in the name)</p> <p>The text data is DCLM dataset and the image data is DatacompDR</p>

ShareScore

40/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
8
Harmonization
4
Access
20
Reuse readiness
8
Engagement
0

ScienceDex for faculty

Your academic CV and NIH biosketch

Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.