Word Sense Change Testset

<p><strong>Overview</strong></p> <p>This testset consists of 23 terms which have experienced word sense change during the past centuries. The main changes for each term were found using Wikipedia, dictionary.com and the Oxford English Dictionary. We consider major changes in usage as well as changes to sense. In cases where multiple (fine-grained) senses were available, we opted to accept the widest sense. E.g. for the term <em>rock</em> we consider a music sense without any distinction between different types of <em>rock music</em>, because our dataset is unlikely to have fine-grained sense differentiations. If a clear time point cannot be pinpointed, we choose the earliest possible. For comparison purposes we also chose a set of 11 terms that have experienced minimal change during the investigated period, i.e., stable terms.</p> <p> </p> <p><strong>Supplementary material</strong></p> <p><em>1. testset.txt </em></p> <p>Contains a list of all terms and the different change types for each term with a short description of the sense and change.</p> <p> </p> <p><em>2. Files of the kind "TERM.txt"</em></p> <p>The header tells us the term, which clustering coefficient was used, which similarity threshold and which similarity measure.</p> <p>A path starts with "Path:". </p> <p>A unit starts with "UNIT:"</p> <p>and the numbers following indicate 1. the number of years that the unit spans, and then a list of all years that the internal clusters stem from.</p> <p>E.g., UNIT: 83 1785, 1787, 1790, 1793, 1798, 1801, 1823, 1867, spanns 83 years and consists of clusters from year  1785, 1787, 1790 etc.</p> <p>Indentation shows the tree structure, more indentation means lower level branch in the tree.</p> <p>As an example, in AEROPLANE.txt unit UNIT: 23 1908, 1909, 1910, 1911, 1914, 1918, 1930, 1908 is the root node and the unit is related to UNIT: 27 1916, 1919, 1924, 1932, 1942, 1916.</p> <p> </p> <p><strong>Interesting findings</strong></p> <p>The longest units and paths are found for stable terms, e.g., <em>newspaper</em>. These are statistically significantly longer than the average units and paths for terms that later evolve.</p> <p><em>Newspaper</em> has a unit that spans 145 years and the first path spans from 1852 - 2007.</p> <p> </p> <p><em>FLIGHT.txt</em></p> <p>For the term <em>flight</em> we find that the first unit captures a name, <em>Flight &amp; Robson</em> who were organ builders.</p> <p>The second unit (it its own path) represents the <em>flight</em> over a hurdle: UNIT: 28 1868, 1869, 1870, 1877, 1885, 1889, 1890, 1892, 1893, 1894, 1895</p> <p>There is a unit (it its own path) that represents the <em>flight</em> of a cricket ball: UNIT: 29 1938, 1957, 1966</p> <p>Finally, the last path represents <em>flight</em> as in a means of transportation, in particular for holidays, starting with  UNIT: 19 1962, 1970, 1973, 1980</p> <p> </p> <p><em>TAPE.txt</em></p> <p>The first path for tape is a path related to <em>sowing tape</em>.</p> <p>Then there is a second path starting with  UNIT: 38 1970, 1974, 2007 that takes up the <em>musical tape</em>.</p> <p>The last path end in the same units that the second path ends in, also related to the <em>musical tape</em>.</p> <p>The <em>music tape</em> and the <em>sowing tape</em> should be related because of their shape, but we cannot find any relation as there are few or no overlapping terms.</p> <p> </p>