Web Data Commons (December 2020) Property and Datatype Usage Dataset

<p>This is a dataset about the usage of properties and datatypes in the <a href="http://webdatacommons.org/structureddata/2020-12/stats/stats.html">Web Data Commons RDFa, Microdata, Embedded JSON-LD, and Microformats Data Sets (December 2020)</a> based on the <a href="http://commoncrawl.org/2020/10/september-2020-crawl-archive-now-available/">Common Crawl September 2020 archive</a>. The dataset has been produced using the <a href="https://doi.org/10.5281/zenodo.6258887">RDF Property and Datatype Usage Scanner v1.0.0</a>, which is based on the <a href="https://jena.apache.org/">Apache Jena</a> framework. Only RDFa and embedded JSON-LD data were considered, as Microdata and Microformats do not incorporate explicit datatypes.</p> <p><strong>Dataset Properties</strong></p> <ul> <li><strong>Size</strong>: 0.6 GiB compressed, 11.0 GiB uncompressed, 53&nbsp;641&nbsp;457 rows&nbsp;plus 1 head line determined using <code class="language-bash">gunzip -c measurements.csv.gz | wc -l</code></li> <li><strong>Parsing Failures</strong>: The scanner failed to parse 45&nbsp;307&nbsp;472 triples (~0.1 %) of the source dataset (containing 37&nbsp;971&nbsp;812&nbsp;425 triples). The main reasons for failures were malformed IRIs and illegal character encodings.</li> <li><strong>Content</strong>: <ul> <li>CATEGORY: The category (<em>html-embedded-jsonld</em> or <em>html-rdfa</em>) of the Web Data Commons file that has been measured.</li> <li>FILE_URL: The URL of the Web Data Commons file that has been measured.</li> <li>MEASUREMENT: The applied measurement with specific conditions, one of: <ul> <li><strong>UnpreciseRepresentableInDouble</strong>: The number of lexicals that are in the lexical space but not in the value space of <code>xsd:double</code>.</li> <li><strong>UnpreciseRepresentableInFloat</strong>: The number of lexicals that are in the lexical space but not in the value space of <code>xsd:float</code>.</li> <li><strong>UsedAsDatatype</strong>: The total number of literals with the datatype.</li> <li><strong>UsedAsPropertyRange</strong>: The number of statements that specify the datatype as range of the property.</li> <li><strong>ValidDateNotation</strong>: The number of lexicals that are in the lexical space of <code>xsd:date</code>.</li> <li><strong>ValidDateTimeNotation</strong>: The number of lexicals that are in the lexical space of <code>xsd:dateTime</code>.</li> <li><strong>ValidDecimalNotation</strong>: The number of lexicals that represent a number with decimal notation and whose lexical representation is thereby in the lexical space of <code>xsd:decimal</code>, <code>xsd:float</code>, and <code>xsd:double</code>.</li> <li><strong>ValidExponentialNotation</strong>: The number of lexicals that represent a number with exponential notation and whose lexical representation is thereby in the lexical space of <code>xsd:float</code>, and <code>xsd:double</code>.</li> <li><strong>ValidInfOrNaNNotation</strong>: The number of lexicals that equals either <code>INF</code>, <code>+INF</code>, <code>-INF</code> or <code>NaN</code> and whose lexical representation is thereby in the lexical space of <code>xsd:float</code>, and <code>xsd:double</code>.</li> <li><strong>ValidIntegerNotation</strong>: The number of lexicals that represent an integer number and whose lexical representation is thereby in the lexical space of <code>xsd:integer</code>, <code>xsd:decimal</code>, <code>xsd:float</code>, and <code>xsd:double</code>.</li> <li><strong>ValidTimeNotation</strong>: The number of lexicals that are in the lexical space of <code>xsd:time</code>.</li> <li><strong>ValidTrueOrFalseNotation</strong>: The number of lexicals that equal either <code>true</code> or <code>false</code> and whose lexical representation is thereby in the lexical space of <code>xsd:boolean</code>.</li> <li><strong>ValidZeroOrOneNotation</strong>: The number of lexicals that equal either <code>0</code> or <code>1</code> and whose lexical representation is thereby in the lexical space of <code>xsd:boolean</code>, and <code>xsd:integer</code>, <code>xsd:decimal</code>, <code>xsd:float</code>, and <code>xsd:double</code>.</li> </ul> <strong>Note</strong>: Lexical representation of <code>xsd:double</code> values in embedded JSON-LD got normalized to always use exponential notation with up to 16 fractional digits (see <a href="https://github.com/jsonld-java/jsonld-java/blob/v0.13.1/core/src/main/java/com/github/jsonldjava/core/RDFDataset.java#L648">related code</a>). Be careful by drawing conclusions from according <strong>Valid&hellip;</strong> and <strong>Unprecise&hellip;</strong> measures.</li> <li>PROPERTY: The property that has been measured.</li> <li>DATATYPE: The datatype that has been measured.</li> <li>QUANTITY: The count of statements that fulfill the condition specified by the measurement per file, property and datatype.</li> </ul> </li> </ul> <p><strong>Preview</strong></p> <pre><code>"CATEGORY","FILE_URL","MEASUREMENT","PROPERTY","DATATYPE","QUANTITY" "html-embedded-jsonld","http://data.dws.informatik.uni-mannheim.de/structureddata/2020-12/quads/dpef.html-embedded-jsonld.nq-00000.gz","UnpreciseRepresentableInDouble","http://schema.org/height","http://www.w3.org/2001/XMLSchema#string","11" "html-embedded-jsonld","http://data.dws.informatik.uni-mannheim.de/structureddata/2020-12/quads/dpef.html-embedded-jsonld.nq-00000.gz","UnpreciseRepresentableInDouble","http://www.w3.org/ns/csvw#value","http://www.w3.org/2001/XMLSchema#string","27" "html-embedded-jsonld","http://data.dws.informatik.uni-mannheim.de/structureddata/2020-12/quads/dpef.html-embedded-jsonld.nq-00000.gz","UnpreciseRepresentableInDouble","http://schema.org/saturatedFatContent","http://www.w3.org/2001/XMLSchema#string","1" … "html-rdfa","http://data.dws.informatik.uni-mannheim.de/structureddata/2020-12/quads/dpef.html-rdfa.nq-05166.gz","ValidZeroOrOneNotation","http://purl.org/goodrelations/v1#hasMaxValue","http://www.w3.org/2001/XMLSchema#float","2" "html-rdfa","http://data.dws.informatik.uni-mannheim.de/structureddata/2020-12/quads/dpef.html-rdfa.nq-05166.gz","ValidZeroOrOneNotation","http://purl.org/goodrelations/v1#hasMinValue","http://www.w3.org/2001/XMLSchema#float","4" "html-rdfa","http://data.dws.informatik.uni-mannheim.de/structureddata/2020-12/quads/dpef.html-rdfa.nq-05166.gz","ValidZeroOrOneNotation","http://rdfs.org/sioc/ns#num_replies","http://www.w3.org/2001/XMLSchema#integer","1062"</code> </pre> <p><strong>Note</strong>: The data contain malformed IRIs, like &quot;<code>xsd:dateTime</code>&quot; (instead of probably &quot;<code>http://www.w3.org/2001/XMLSchema#dateTime</code>&quot;), which are caused by missing namespace definitions in the original source website.</p>