Time shifting word2vec models from Times

<p>Time-shifting word2vec models based on Times news paper. These models were generated using the &quot;Generate time shifting models&quot;&nbsp;scripts found <a href="https://github.com/c-martinez/w2v-convergence/#generate-time-shifting-models">here</a>.</p> <p>In summary, these scripts generate a collection of sentences for every 2 years period, and trains a word2vec model on this period using <a href="https://radimrehurek.com/gensim/">gensim</a>. The original text from the Times news paper articles is processed as follows:</p> <ul> <li>Articles are divided into sentences using punctuation.</li> <li>Punctuation symbols are removed.</li> <li>Text is converted to lower case.</li> <li>Word are validated to ensure they are valid English non-stop words (using nltk).</li> </ul> <p>The two year time period was selected following the Measure convergence for a range described <a href="https://github.com/c-martinez/w2v-convergence/#measure-convergence-for-a-range">here</a>.</p> <p>This data publication was made possible thanks to collaboration with the <a href="https://dig.hum.uu.nl/">Utrecht Digital Humanities Lab</a>.</p> <p>Unfortunately original Times data set is not publicly available.</p>