Skip to main content
zenodoopen

Biomedical ELECTRA based deep language representation models for biomedical text mining.

<p>The gzipped tar file contains two biomedical language representation models based on ELECTRA&nbsp; (Clark et al., 2020)&nbsp;&nbsp;deep transformers architecture to be used for down-stream biomedical text mining tasks.&nbsp;</p> <p>Bio-ELECTRA is pre-trained from scratch on PubMed abstracts for 1.8 million steps. Bio-ELECTRA++ is the further pre-trained version of Bio-ELECTRA trained on a corpus of open access full papers from PubMed.</p>

ShareScore

32/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
8
Harmonization
4
Access
16
Reuse readiness
0
Engagement
4

Topics