PAN23 Trigger Detection
<p>This is the dataset for the shared task on <a href="https://pan.webis.de/clef23/pan23-web/trigger-detection.html">Trigger Detection at PAN@CLEF2023</a>. Please consult the task's page for further details on the format, the dataset's creation, and links to baselines and utility code.</p> <p>You can find a more refined version of this work here: <a href="https://github.com/webis-de/ACL-23">github.com/webis-de/ACL-23</a>.</p> <p><strong>Task:</strong> In trigger detection, we want to assign trigger warning labels to documents that contain potentially discomforting or distressing (triggering) content. We model trigger detection as a multi-label document classification challenge: assign each document all appropriate trigger warnings, but not more. All warnings are chosen from the author's perspective, i.e. the work's author decided which kind of trigger the document contains.</p> <p><strong>Dataset: </strong>This dataset contains annotated works of fanfiction, extracted from <a href="https://archiveofourown.org/">archiveofourown.org</a> (AO3). Each work is between 50 and 6,000 words long and has between 1 and many trigger warnings assigned. Our training dataset contains 307,102 examples, with 17,104 in validation and 17,040 in the test split. The label set contains 32 different trigger warnings. All labels are based on the <a href="https://archiveofourown.org/wrangling_guidelines/11#Warnings%20and%20triggers:~:text=Warnings%20and-,triggers,-General%20warnings%20(e">freeform content warnings</a> added to a fanwork by its author.</p> <p><strong>Versioning:</strong> </p> <ul> <li>1.0: initial upload</li> <li>1.1 fixed a minor bug where some works in the labels.jsonl contained labels that are not used in the competition (heteronormativity and religious-discrimination). Those labels have been removed. </li> <li>1.2 added labels.jsonl for the test dataset.</li> </ul>
ShareScore
24/100
Overall dataset sharing score
Score breakdown
These five areas show where the dataset supports — or may limit — practical reuse.
- Stewardship
- 8
- Harmonization
- 4
- Access
- 8
- Reuse readiness
- 0
- Engagement
- 4
Topics
Dataset details
- Repository
- zenodo
- Published
- February 1, 2023
- License
- Not reported
- DOI
- 10.5281/zenodo.7600049
Scored with release 0.9.0
ScienceDex for faculty
Your academic CV and NIH biosketch
Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.