Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
31
datasets available to search
ShareScore release 0.9.0
Dataset results
31 results for “Wikidata Subset”
Generated Wikidata Subset for Taxons based on dump: 20201102-all
<p>Source file: GeneTaxon_wikidata-20201102-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Generated Wikidata Subset for Taxons based on dump: GeneTaxon_wikidata-20190121-all
<p>Source file: GeneTaxon_wikidata-20190121-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Generated Wikidata Subset for Taxons based on dump: GeneTaxon_wikidata-20180115-all
<p>Source file: GeneTaxon_wikidata-20180115-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Generated Wikidata Subset for Taxons based on dump: 20170821-all
<p>Source file: GeneTaxon_wikidata-20170821-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Generated Wikidata Subset for Taxons based on dump: wikidata-20150601-all
<p>Source file: GeneTaxon_wikidata-20150601-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Generated Wikidata Subset for Taxons based on dump: 20160613-all
<p>Source file: GeneTaxon_wikidata-20160613-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Generated Wikidata Subset for Taxons based on dump: 20220630-all
<p>Source file: GeneTaxon_wikidata-20220630-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Generated Wikidata Subset for Taxons based on dump: 20210531-all
<p>Source file: GeneTaxon_wikidata-20210531-all.ttl.gz</p> <p>ShEx: https://github.com/kg-subsetting/paper-wikidata-subsetting-2023/blob/master/flexibility-experiments/genes%2Btaxons/GeneTaxon.shex</p> <p>More information: https://www.semantic-web-journal.net/content/wikidata-subsetting-approaches-tools-and-evaluation</p>
Wikidata Subsetting: Reference-based Subsetting Experiment Datasets
<p>Files in this dataset have been produced during Flexibility experiments of Wikidata subsetting practical tools: Subsetting based on references using WDSub.</p>
Wikidata Subsetting: Performance and Accuracy Experiment Datasets
<p>Files in this dataset have been produced during Performance and Accuracy experiments of Wikidata subsetting practical tools: WDumper, KGTK, WDSub, WDF.</p>
Wikidata Subsets and Specification Files Created by WDumper
<p>WDumper is a third-party tool enables users to craete custom dump of Wikidata. Here we create some topical subset of Wikidata by WDumper. There are 4 usecases:</p> <ol> <li>politicians: People with occupation of politicians in Wikidata</li> <li>militPoliticians: People with occupation of politicians which are military and also have a military rank of General in Wikidata</li> <li>ukUniversities: All United Kingdom universities in Wikidata</li> <li>geneWiki: A subset from <a href="https://elifesciences.org/articles/52614/figures#fig1">this class-diagram</a></li> </ol> <p>The subsets are in .nt.gz format. For each usecase there are two types of subsets in terms of content, one with References and Qualifiers that has a "withRQFS" in the name, and one without this feature. Also for each use case, there are two extracted subsets one from 27 April 2015 and another from 13 November 2020. The corresponding JSON file for each use case is the WDumper specification file.</p>
Wikidata subset with revision history information [RDF]
<p>This dataset is composed of 300 instances from the 100 most important classes in Wikidata, for a total of around 30000 entities and 390000 triples. The dataset is geared towards knowledge graph refinement models that leverage edit history information from the graph. There are two versions of the dataset:</p> <ul> <li>The <strong>static</strong> version (files postfixed with '_static') contains the simple statements of each entity fetched from Wikidata.</li> <li>The <strong>dynamic</strong> version (files postfixed with '_dynamic') contains information about the operations and revisions made to these entities, and the triples that were added or removed.</li> </ul> <p>Each version is split into three subsets: train, validation (val), and test. Each split contains every entity from the dataset. The train split contains the first 70% of revisions made to each entity, the validation split contains the 70% to 85% revisions, and the test set contains the last 15% revisions.</p> <p>This is a sample from the static datasets:</p> <pre><code>wd:Q217432 a uo:entity ; wdt:P1082 1.005904e+06 ; wdt:P1296 "0052280" ; wdt:P1791 wd:Q18704103 ; wdt:P18 "Pitakwa.jpg" ; wdt:P244 "n80066826" ; wdt:P571 "+1912-00-00T00:00:00Z" ; wdt:P6766 "421180027" .</code></pre> <p>Each entity has the type <em>uo:entity</em>, and contains the statements added during that time period following Wikidata's data model.</p> <p>In the following code snippet we show an example from the dynamic dataset:</p> <pre><code>uo:rev703872813 a uo:revision ; uo:timestamp "2018-06-28T22:31:32Z" . uo:op703872813_0 a uo:operation ; uo:fromRevision uo:rev703872813 ; uo:newObject wd:Q82955 ; uo:opType uo:add ; uo:revProp wdt:P106 ; uo:revSubject wd:Q6097419 . uo:op703878666_0 a uo:operation ; uo:fromRevision uo:rev703878666 ; uo:opType uo:remove ; uo:prevObject wd:Q1108445 ; uo:revProp wdt:P460 ; uo:revSubject wd:Q1147883 .</code></pre> <p>This dataset is composed of revisions, which have a timestamp. Each revision is composed of 1 to n operations, in which there is a change to a statement from the entity. There are two types of operations: <em>uo:add</em> and <em>uo:remove</em>. In both cases, the property and the subject being modified are shown with the <em>uo:revProp</em> and <em>uo:revSubject</em> properties. In the case of additions, <em>uo:newObject</em> and <em>uo:prevObject</em> properties are added to show the previous and new objects after the addition. In the case of removals, there is a <em>uo:prevObject </em>property to record the object that was removed.</p>
Wikidata 3 Topical Subsets (Gene Wiki, Music, Ships) and 4 Random Subsets
<p>This dataset contains the N-Triples files of 3 Wikidata topical subsets corresponding to 3 Wikidata WikiProject: Gene Wiki, Music, and Ships along with 4 random subsets in different sizes: two of 100K items, one 500K items, and one 1M items. Subsets are extracted from the <a href="https://academictorrents.com/details/229cfeb2331ad43d4706efd435f6d78f40a3c438">3 January 2022 dump</a>. All subsets have been extracted with <a href="https://github.com/seyedahbr/wdumper">WDumper</a> using these <a href="https://github.com/seyedahbr/RQSS_Evaluation/tree/main/WDumper%20Specification%20Files">JSON specification files</a>. The files are:</p> <ul> <li>GeneWiki.zip: contains 25 `.nt.gz` RDF files each of which corresponds to one of the main Gene Wiki WikiProject classes, e.g. protein, gene, chemical compound, etc.</li> <li>music.nt.gz: the RDF file corresponding to the Music WikiProject.</li> <li>ships.nt.gz: the RDF file corresponding to the Ships WikiProject.</li> <li>Random100K_1.zip: contains 2 `nt.gz` RDF files each of which includes (about) 50,000 random Wikidata items, 100,000 items in total.</li> <li>Random100K_2.zip: contains 2 `nt.gz` RDF files each of which includes (about) 50,000 random Wikidata items, 100,000 items in total.</li> <li>Random500K.zip: contains 10 `nt.gz` RDF files each of which includes (about) 50,000 random Wikidata items, 500,000 items in total.</li> <li>Random1M.zip: contains 20 `nt.gz` RDF files each of which includes (about) 50,000 random Wikidata items, 1,000,000 items in total.</li> </ul> <p> </p>
Wikidata subset from 2018 dumps created with WDSub at Biohackathon 2022 - Turtle format
<p>Subset of Wikidata obtained using this Shape Expression: https://github.com/kg-subsetting/datasets-biohackathon2022/blob/main/GeneWiki/GeneWiki.shex</p> <p>And the wdsub tool version 0.0.28: https://github.com/weso/wdsub</p> <p>The input dump is: wikidata-20180115-all</p> <p>And the dumpformat is TURTLE</p>
Simple dataset obtained as a Wikidata subset from 2022 dump using entity schema about taxon
<p>The subset has been obtained using wdsub version 0.0.33 and the schema:</p> <p> </p> <pre>PREFIX p: <http://www.wikidata.org/prop/> PREFIX ps: <http://www.wikidata.org/prop/statement/> PREFIX prov: <http://www.w3.org/ns/prov#> PREFIX wd: <http://www.wikidata.org/entity/> PREFIX wdt: <http://www.wikidata.org/prop/direct/> start = @<taxon_by_wd_ontology> OR @<taxon_by_identifier> <taxon_by_wd_ontology> { wdt:P31 [wd:Q16521] ; } <taxon_by_identifier> {wdt:P685 . +;} OR # NCBI taxonomy ID {wdt:P846 . +;} OR # GBIF taxon ID {wdt:P3151 . +;} OR # iNaturalist taxon ID {wdt:P3444 . +;} # eBird taxon ID</pre>
Datalog subsetting input files (Wikidata 2015 NTriple-to-CSV dump)
<p>This is a Wikidata 2015 NTriple dump in which the delimiter is changed to ','. The file is used in subsetting experiment via <a href="https://github.com/seyedahbr/radlog">Radlog</a>.</p>
Wikidata Subsets of 4 Gene Wiki Classes
<p>Chemical compound (Q11173), disease (Q12136), gene (Q7187), and protein (Q8054) are some of the main classes containing the Gene Wiki WikiProjects. In this repository, we put the corresponding subsets of each class. The subsets contain all instances of the four main classes (no sub-classes). All subsets are extracted from the Wikidata JSON dump of 3 January 2022 (<a href="https://t.co/vdmJc8V1v2">https://t.co/vdmJc8V1v2</a>)</p>
Wikidata Subsets of 4 Gene Wiki Classes (wdsub)
<p>Chemical compound (Q11173), disease (Q12136), gene (Q7187), and protein (Q8054) are some of the main classes containing the Gene Wiki WikiProjects. In this repository, we put the corresponding subsets of each class. The subsets contain all instances of the four main classes (no sub-classes). All subsets are extracted from the Wikidata JSON dump of 3 January 2022 (<a href="https://t.co/vdmJc8V1v2">https://t.co/vdmJc8V1v2</a>) using wdsub (https://github.com/weso/wdsub)</p>
Wikidata Subsets of 6 Wikiproject (Gene Wiki, Taxonomy, Astronomy, Music, Law, Ships)
<p>This dataset contains the N-Triples files of 6 Wikidata subsets corresponding to 6 different Wikidata WikiProject extracted from October 2016 and June 2021 dumps. For each project, there are .nt.gz files containing RDF data. The projects are:</p> <ul> <li>Gene Wiki: There is a GeneWiki_2016.zip (extracted from the 2016 dump) and a GeneWiki_2021.zip (extracted from the 2021 dump), Each of which contains 25 .nt.gz files extracted by the WDumper tool.</li> <li>Astronomy: Astronomy_2016.nt.gz (extracted from the 2016 dump) and Astronomy_2021.nt.gz (extracted from the 2021 dump).</li> <li>Taxonomy: There is a Taxonomy_2016.zip (extracted from the 2016 dump) and a Taxonomy_2021.zip (extracted from the 2021 dump), Each of which contains two .nt.gz files.</li> <li>Law: Law_2016.nt.gz (extracted from the 2016 dump) and Law_2021.nt.gz (extracted from the 2021 dump).</li> <li>Music: Music_2016.nt.gz (extracted from the 2016 dump) and Music_2021.nt.gz (extracted from the 2021 dump).</li> <li>Ships: Ships_2016.nt.gz (extracted from the 2016 dump) and Ships_2021.nt.gz (extracted from the 2021 dump).</li> </ul> <p> </p> <ul> </ul>
Initial wikidata subsets on genes and diseases
<p>These two data sets are initial subsets generated at the Elixir Biohackathon 2022 from the Wikidata dump from Jan 3rd, 2022 using the WDSub application. The wikidata dump is in JSON, the generated subsets in Turtle</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.