LTW2V: The Large Thai Word2Vec

<p>LTW2V is The large Thai Word2Vec. It trained from OSCAR Corpus (Open Super-large Crawled Aggregated coRpus).</p> <p>For Version 1.0, It trained from OSCAR Corpus (Open Super-large Crawled Aggregated coRpus) and use newmm in PyThaiNLP 4.0 for word segmentation. We cleand the dataset before training that customize the pre-processing script from <a href="https://github.com/cstorm125/thai2fit">thai2fit</a> and trained 5 window, 15 windows. It trained with Gensim (50 epochs), so you can use the model from Gensim.</p> <p><strong>About Word2Vec</strong></p> <ul> <li>vector dimension = 400</li> <li>window size = 5, 15</li> <li>word minimum count = 5</li> </ul> <p>Source code at GitHub: <a href="https://github.com/PyThaiNLP/large-thaiword2vec">https://github.com/PyThaiNLP/large-thaiword2vec</a></p> <p><strong>File</strong></p> <ul> <li>LTW2V_v1.0-window5.bin - 5 window with newmm in PyThaiNLP 4.0 for word segmentation and Gensim 4.0.</li> <li>LTW2V_v1.0-window15.bin - 15 window with newmm in PyThaiNLP 4.0 for word segmentation and Gensim 4.0.</li> </ul>