Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
3
datasets available to search
ShareScore release 0.9.0
Dataset results
3 results for “Europarl”
Europarl Direct Translationese Dataset
<p>Monolingual and multilingual translationese corpora as described in the paper </p> <p><a href="https://aclanthology.org/2021.motra-1.1.pdf"><strong>Do not Rely on Relay Translations: Multilingual Parallel Direct Europarl</strong></a><br> <em>Kwabena Amponsah-Kaakyire, Daria Pylypenko, Cristina España-Bonet, Josef van Genabith<br> In: 23rd Nordic Conference on Computational Linguistics. Workshop on Modelling Translation: Translatology in the Digital Age (MoTra-2021) May 31-June 2 Virtual Iceland Seiten 1-7 Linköping Electronic Conference Proceedings Association for Computational Linguistics 5/2021.</em></p> <p><strong>Single-source monolingual datasets:</strong><br> mono_de_en: text in DE with DE originals and translations from EN<br> mono_de_es: text in DE with DE originals and translations from ES<br> mono_en_de: text in EN with EN originals and translations from DE<br> mono_en_es: text in EN with EN originals and translations from ES<br> mono_es_de: text in ES with ES originals and translations from DE<br> mono_es_en: text in ES with ES originals and translations from EN</p> <p><strong>Multisource monolingual datasets:</strong><br> mono_de_multisource: text in DE with DE originals and translations from EN, ES<br> mono_en_multisource: text in EN with EN originals and translations from DE, ES<br> mono_es_multisource: text in ES with ES originals and translations from DE, EN</p> <p><strong>Multilingual datasets:</strong><br> multi3 - texts in DE, EN, ES with originals and translations from DE, EN, ES<br> multi8 - texts in DE, EL, EN, ES, FR, IT, NL, PT with originals and translations from DE, EL, EN, ES, FR, IT, NL, PT</p>
EN-DE-Bidirectional-Europarl-UdS corpus
<h2><strong>Bidirectional document- and sentence-aligned corpus of Europarl proceedings (EN-DE, DE-EN).</strong></h2> <p>The corpus is described in the paper:</p> <p><strong>Mitigating Translationese with GPT-4: Strategies and Performance</strong></p> <p><em>Maria Kunilovskaya, Koel Dutta Chowdhury, Heike Przybyl, Cristina España-Bonet, Josef van Genabith</em></p> <p><em>in: </em>Proceedings of the 25th Annual conference of the European Association for Machine Translation (EAMT-2024) 24-27 June, Sheffield (UK) Association for Computational Linguistics</p> <p>This version of Europarl-UdS corpus is built from the Europarl proceedings (published up to 10 July 2018) collected using Jose Martinez's pipeline (https://github.com/chozelinek/europarl) in November 2023.</p> <p><br>We include several versions and subsets of this parallel corpus:</p> <ol> <li>The initial input (0_align/xml_translationese/) to the parallel corpus-building pipeline <ul> <li><a href="../api/records/11127626/draft/files/xml_translationese.zip/content" target="_blank" rel="noopener noreferrer">xml_translationese.zip</a></li> </ul> </li> <li>Raw-text-based sentence-aligned documents for both translation directions (columns=['sdoc_id', 'sseg_id', 'sseg', 'tseg', 'hunalign_qua']): <ul> <li><a href="../api/records/11127626/draft/files/deen_wide2018_cap0_score0.3.tsv.gz/content" target="_blank" rel="noopener noreferrer">deen_wide2018_cap0_score0.3.tsv.gz</a></li> <li><a href="../api/records/11127626/draft/files/deen_wide2018_cap0_score0.3.tsv.gz/content" target="_blank" rel="noopener noreferrer">ende_wide2018_cap0_score0.5.tsv.gz</a></li> <li>meta.zip contains four files with XML tags with metadata to each document in the corpus. </li> </ul> </li> <li>The same documents annotated with Stanza (with the conllu-style vertical format for each segment and document wrapped in XML tags containing metadata) <ul> <li>ORG_WR_DE_EN.conllu.xml.gz (original German)</li> <li>ORG_WR_EN_DE.conllu.xml.gz (original English)</li> <li>TR_DE_EN.conllu.xml.gz (translated English)</li> <li>TR_EN_DE.conllu.xml.gz (translated German)</li> </ul> </li> <li>The sentence-level subset of the corpus with extracted morphosyntactic (or lexicogrammatical) features as described in the paper (documents longer than 450 tokens, 1500 documents per translation direction) <ul> <li>seg-450-1500.feats.tsv.gz</li> </ul> </li> <li>A multi-parallel subset of 200 most_translated documents re-written by GPT-4 under various prompting conditions as described in the paper <ul> <li>ratio2.5_de_7aligned_2056segs.tsv</li> <li>ratio2.5_en_7aligned_2109segs.tsv</li> </ul> </li> </ol> <p>Note that the annotation retains the alignment. The processing code is available here https://github.com/SFB1102/b7-b6-prompting-eamt2024/1_parse_extract_feats</p> <p> </p>
English and Portuguese CBOW Models from Europarl Corpus, version 7, using FastText with Subwords Option
<p>The models were trained using FastText, model CBOW, 40 epochs, and subwords. Each *.BIN file has its *.VEC file with the vocabulary ordered by frequency. The *.BIN file can return a vector to represent an out-of-vocabulary (OOV) word if the necessary parts of the OOV word were used in training. FastText and Gensim can use these files. The English and Portuguese models are identified in the file name, <strong>_en_</strong> and <strong>_pt_</strong> respectively.</p> <p>An Excel file has the neighborhood changes of some selected words during training on each epoch. A previous exercise to find words with more than one meaning.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.