Embedding Evaluation Data for South African Languages

<p><strong>WordSim and Simlex Data for South African Languages</strong></p> <ul> <li>Setswana</li> <li>Sepedi</li> </ul> <p><strong>Embedding Evaluation Data for South African Languages</strong></p> <p><strong>Dataset Information\</strong></p> <p>The datasets(Simlex and WordSim) contain pairs of Setswana and Sepedi words that have been assigned similarity ratings by humans to measure semantic relatedness. The word-pairs(Simlex and WordSim) are manually translated from English to Setswana and Sepedi. The evaluation task aims to find the degree of correlation between the scores provided by the model and the human rating, the score of the model is collected by computing the cosine similarity of corresponding vectors for word pairs.</p> <p>Online Repository link</p> <ul> <li><a href="https://zenodo.org/record/5673974">Zenodo Data Repository</a>&nbsp;- Link to the data repository.</li> </ul> <p>Authors</p> <ul> <li><strong>Vukosi Marivate</strong>&nbsp;-&nbsp;<a href="https://twitter.com/vukosi">@vukosi</a></li> <li><strong>Valencia Wagner</strong></li> <li><strong>Mack Makgatho</strong></li> <li><strong>Tshephisho Sefara</strong></li> </ul> <p>See also the list of&nbsp;<a href="https://github.com/dsfsi/embedding-eval-data//contributors">contributors</a>&nbsp;who participated in this project.</p> <p>Citing the dataset</p> <p>To appear in conference proceedings</p> <blockquote> <p>@article{Makgatho_Marivate_Sefara_Wagner_2022, title={Training Cross-Lingual embeddings for Setswana and Sepedi},&nbsp;<br> volume={3},&nbsp;<br> url={https://upjournals.up.ac.za/index.php/dhasa/article/view/3822},&nbsp;<br> DOI={10.55492/dhasa.v3i03.3822},&nbsp;<br> number={03},<br> journal={Journal of the Digital Humanities Association of Southern Africa },<br> author={Makgatho, Mack and Marivate, Vukosi and Sefara, Tshephisho and Wagner, Valencia},&nbsp;<br> year={2022},&nbsp;<br> month={Feb.}}</p> </blockquote>