Toloker Graph: Interaction of Crowd Annotators

<p>The graph contains 11,758 nodes and 519,000 edges representing interactions between crowd annotators on a project labeled on the&nbsp;<a href="https://toloka.ai/">Toloka</a>&nbsp;crowdsourcing platform (see the&nbsp;<a href="https://toloka.ai/en/docs/guide/concepts/overview">Toloka overview</a>&nbsp;for the details on the used terminology).</p> <p>Each node represents an individual annotator; nodes are provided with four numerical and three categorical features. An edge is drawn between a pair of annotators if they annotated the same task. Also, each node is provided with a label showing whether the annotator was banned on this project, or not.</p> <p><strong>Nodes</strong> are stored in the&nbsp;<a href="https://github.com/Toloka/TolokerGraph/blob/main/nodes.tsv">nodes.tsv</a>&nbsp;file in the TSV format of the following structure:</p> <ul> <li><code>id</code>: unique identifier of the annotator</li> <li><code>approved_rate</code>: percentage of the approved labels of this annotator</li> <li><code>skipped_rate</code>: percentage of the skipped tasks of this annotator</li> <li><code>expired_rate</code>: percentage of the expired tasks of this annotator</li> <li><code>rejected_rate</code>: percentage of the rejected labels of this annotator</li> <li><code>education</code>: level of education as self-reported by this annotator (<code>none</code>,&nbsp;<code>basic</code>,&nbsp;<code>middle</code>,&nbsp;<code>high</code>)</li> <li><code>english_profile</code>: knowledge of English as self-reported by this annotator (<code>0</code>&nbsp;for no,&nbsp;<code>1</code>&nbsp;for yes)</li> <li><code>english_tested</code>: whether the annotator passed the Toloka language test for English (<code>0</code>&nbsp;for no,&nbsp;<code>1</code>&nbsp;for yes)</li> <li><code>banned</code>: whether the annotator was banned on this project (<code>0</code>&nbsp;for no,&nbsp;<code>1</code>&nbsp;for yes)</li> </ul> <p>The&nbsp;<code>*_rate</code>&nbsp;attributes should sum up to 1.</p> <p><strong>Edges</strong> are stored in the&nbsp;<a href="https://github.com/Toloka/TolokerGraph/blob/main/edges.tsv">edges.tsv</a>&nbsp;file in the TSV format of the following structure:</p> <ul> <li><code>source</code>: source identifier of the annotator</li> <li><code>target</code>: target identifier of the annotator</li> </ul> <p>As the graph is undirected,&nbsp;<code>source</code>&nbsp;and&nbsp;<code>target</code>&nbsp;can be interchanged for the given pair of nodes.</p>