polyOne Data Set - 100 million hypothetical polymers including 29 properties

<p><strong>polyOne Data Set</strong></p> <p>The data set contains 100 million hypothetical polymers each with 29 predicted properties using&nbsp;machine learning models. We use&nbsp;PSMILES strings to represent&nbsp;polymer structures,&nbsp;see <a href="https://www.polymergenome.org/guide/index.php?m=3">here</a> and <a href="https://github.com/Ramprasad-Group/psmiles">here</a>. The polymers are generated by decomposing previously synthesized polymers into unique chemical fragments.&nbsp;Random and enumerative compositions of these fragments yield 100 million hypothetical PSMILES strings. All PSMILES strings are chemically valid polymers but, mostly, have never been synthesized before. More information can be found in the paper. Please note the&nbsp;license agreement in the LICENSE file.</p> <p><strong>Full data set including the properties</strong></p> <p>The data files are in Apache&nbsp;Parquet format. The files start with `polyOne_*.parquet`.</p> <p>I recommend using dask (`pip install dask`) to load and process the data set.&nbsp;&nbsp;Pandas also works but is slower.</p> <p>Load sharded data set with dask<br> ```python<br> import dask.dataframe as dd<br> ddf = dd.read_parquet(&quot;*.parquet&quot;, engine=&quot;pyarrow&quot;)<br> ```</p> <p>For example, compute the description of data set<br> ```python<br> df_describe = ddf.describe().compute()<br> df_describe</p> <p>```</p> <p><strong>PSMILES strings only</strong></p> <ul> <li>generated_polymer_smiles_train.txt -&nbsp;80 million PSMILES strings for training&nbsp;polyBERT.&nbsp;One string per line.</li> <li>generated_polymer_smiles_dev.txt - 20 million PSMILES strings&nbsp;for testing&nbsp;polyBERT. One string per line.</li> </ul>