Modern-Botok. Custom dictionary for modern Tibetan

<p>Tsikchen.tsv is a customised dictionary to be integrated into the Tibetan tokenizer&nbsp;<a href="https://github.com/OpenPecha/Botok">BoTok</a>. BoTok can tokenize classical Tibetan text or traditional genres out of the box. However, since it depends on a dictionary for tokenization, it lacks capabilities for modern Tibetan, in particular, the language of modern newspapers published in the PRC or on the subcontinent. Adding this customised dictionary adds functionality for modern Tibetan to BoTok.</p> <p>The custom dictionary tsikchen was compiled from&nbsp;<a href="https://github.com/christiansteinert/tibetan-dictionary/tree/master/_input/dictionaries/public">Christian Steinert's collection</a> and contains the following dictionaries:</p> <ol> <li> <ol> <li>Grand Monlam Dictionary (default dictionary of Botok)</li> <li><a href="https://github.com/christiansteinert/tibetan-dictionary/blob/master/_input/dictionaries/public/07-JimValby">Jim Valby</a></li> <li><a href="https://github.com/christiansteinert/tibetan-dictionary/blob/master/_input/dictionaries/public/08-IvesWaldo">Ives Waldo</a></li> <li><a href="https://github.com/christiansteinert/tibetan-dictionary/blob/master/_input/dictionaries/public/09-DanMartin">Dan Martin</a></li> <li><a href="https://github.com/christiansteinert/tibetan-dictionary/blob/master/_input/dictionaries/public/25-tshig-mdzod-chen-mo-Tib">Tshig mdzod chen mo</a></li> <li><a href="https://github.com/christiansteinert/tibetan-dictionary/blob/master/_input/dictionaries/public/34-dung-dkar-tshig-mdzod-chen-mo-Tib">Dung dkar</a></li> <li><a href="https://github.com/christiansteinert/tibetan-dictionary/blob/master/_input/dictionaries/public/48-TibTermProject">Tibetan Terminology Project</a></li> </ol> </li> </ol> <p>The resulting dictionary was cleaned up and edited by the Divergent Discourses project to the project's requirements (removal of double entries, phraseologisms, ungrammatical entries, etc; addition of ca. 1000 personal and place names).</p> <p>For its installation, see the Divergent Discourses' <a href="https://github.com/Divergent-Discourses/modern-botok">modern-botok</a> repository on github.</p>