ORBITAAL: cOmpRehensive BItcoin daTaset for temporAl grAph anaLysis

<h3>Dataset Construction</h3> <p>This dataset captures the temporal network of Bitcoin (BTC) flow exchanged between entities at the finest time resolution in UNIX timestamp. Its construction is based on the blockchain covering the period from January, 3rd&nbsp; of 2009 to January the 25th of 2021. The blockchain extraction has been made using bitcoin-etl&nbsp; (<a href="https://github.com/blockchain-etl/bitcoin-etl">https://github.com/blockchain-etl/bitcoin-etl</a>) Python package. The entity-entity network is built by aggregating Bitcoin addresses using the common-input heuristic [1] as well as popular Bitcoin users' addresses provided by <a href="https://www.walletexplorer.com/">https://www.walletexplorer.com/</a></p> <p>[1] M. Harrigan and C. Fretter, "The Unreasonable Effectiveness of Address Clustering,"&nbsp;<em>2016 Intl IEEE Conferences on Ubiquitous Intelligence &amp; Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld)</em>, Toulouse, France, 2016, pp. 368-373, doi: 10.1109/UIC-ATC-ScalCom-CBDCom-IoP-SmartWorld.2016.0071.<br>keywords: {Online banking;Merging;Protocols;Upper bound;Bipartite graph;Electronic mail;Size measurement;bitcoin;cryptocurrency;blockchain},</p> <p>&nbsp;</p> <h3>Dataset Description</h3> <p><strong>Bitcoin Activity Temporal Coverage</strong>: From 03 January 2009 to 25 January 2021</p> <h4>Overview:</h4> <p>This <strong>dataset </strong>provides a <strong>comprehensive</strong> representation of <strong>Bitcoin exchanges</strong> between entities over a s<strong>ignificant temporal span</strong>, spanning from the inception of Bitcoin to recent years. It encompasses <strong>various temporal resolutions</strong> and <strong>representations</strong> to <strong>facilitate Bitcoin transaction network analysis </strong>in the context of <strong>temporal graphs</strong>.</p> <p>Every dates have been retrieved from bloc UNIX timestamp and GMT timezone.</p> <h4>Contents:</h4> <p>The dataset is distributed across three compressed archives:</p> <p>All data are stored in the&nbsp;<strong>Apache Parquet file format</strong>, a columnar storage format optimized for analytical queries. It can be used with pyspark Python package.</p> <ol> <li> <p><strong>orbitaal-stream_graph.tar.gz</strong>:</p> <ul> <li>The root directory is <em>STREAM_GRAPH/</em></li> <li>Contains a <strong>stream graph</strong> representation of Bitcoin exchanges at the <strong>finest temporal scale</strong>, corresponding to the validation time of <strong>each block</strong> (averaging approximately 10 minutes).</li> <li>The stream graph is divided into 13 files, one for each year</li> <li>Files format is parquet</li> <li>Name format is <strong>orbitaal-stream_graph-date-[YYYY]-file-id-[ID].snappy.parquet,</strong> where <em>[YYYY]</em> stands for the corresponding <em>year</em> and <em>[ID]</em> is <em>an integer</em> from 1 to N (number of files here) such as sorting in increasing [ID] ordering is similar to sort by increasing year ordering</li> <li>These files are in the subdirectory <em>STREAM_GRAPH/EDGES/</em></li> </ul> </li> <li> <p><strong>orbitaal-snapshot-all.tar.gz</strong>:</p> <ul> <li>The root directory is <em>SNAPSHOT/</em></li> <li>Contains the <strong>snapshot</strong> network representing <strong>all transactions aggregated </strong>over the whole dataset period (from Jan. 2009 to Jan. 2021).</li> <li>Files format is parquet</li> <li>Name format is <strong>orbitaal-snapshot-all.snappy.parquet</strong>.</li> <li>These files are in the subdirectory <em>SNAPSHOT/EDGES/ALL/</em></li> </ul> </li> <li> <p><strong>orbitaal-snapshot-year.tar.gz</strong>:</p> <ul> <li>The root directory is <em>SNAPSHOT/</em></li> <li>Contains the <strong>yearly</strong><em> </em>resolution of <strong>snapshot</strong> networks</li> <li>Files format is parquet</li> <li>Name format is <strong>orbitaal-snapshot-date-[YYYY]-file-id-[ID].snappy.parquet</strong>, where&nbsp;<em>[YYYY]</em> stands for the corresponding <em>year </em>and <em>[ID]</em> is an <em>integer </em>from 1 to N (number of files here) such as sorting in increasing [ID] ordering is similar to sort by increasing year ordering</li> <li>These files are in the subdirectory <em>SNAPSHOT/EDGES/year/</em></li> </ul> </li> <li> <p><strong>orbitaal-snapshot-month.tar.gz</strong>:</p> <ul> <li>The root directory is <em>SNAPSHOT/</em></li> <li>Contains the <strong>monthly </strong>resoluted <strong>snapshot </strong>networks</li> <li>Files format is parquet</li> <li>Name format is <strong>orbitaal-snapshot-date-[YYYY]-[MM]-file-id-[ID].snappy.parquet</strong>, where</li> <li><em>[YYYY] </em>and <em>[MM] </em>stands for the corresponding <em>year </em>and <em>month, </em>and <em>[ID] </em>is an <em>integer </em>from 1 to N (number of files here) such as sorting in increasing [ID] ordering is similar to sort by increasing year and month ordering</li> <li>These files are in the subdirectory <em>SNAPSHOT/EDGES/month/</em></li> </ul> </li> <li> <p><strong>orbitaal-snapshot-day.tar.gz</strong>:</p> <ul> <li>The root directory is <em>SNAPSHOT/</em></li> <li>Contains the <strong>daily </strong>resoluted <strong>snapshot </strong>networks</li> <li>Files format is parquet</li> <li>Name format is <strong>orbitaal-snapshot-date-[YYYY]-[MM]-[DD]-file-id-[ID].snappy.parquet</strong>, where</li> <li><em>[YYYY]</em>, <em>[MM]</em>, and&nbsp; <em>[DD] </em>stand for the corresponding <em>year</em>, <em>month</em>, and <em>day</em>, and <em>[ID] </em>is an <em>integer </em>from 1 to N (number of files here) such as sorting in increasing [ID] ordering is similar to sort by increasing year, month, and day ordering</li> <li>These files are in the subdirectory <em>SNAPSHOT/EDGES/day/</em></li> </ul> </li> <li> <p><strong>orbitaal-snapshot-hour.tar.gz</strong>:</p> <ul> <li>The root directory is <em>SNAPSHOT/</em></li> <li>Contains the <strong>hourly </strong>resoluted <strong>snapshot </strong>networks</li> <li>Files format is parquet</li> <li>Name format is <strong>orbitaal-snapshot-date-[YYYY]-[MM]-[DD]-[hh]-file-id-[ID].snappy.parquet</strong>, where</li> <li><em>[YYYY]</em>, <em>[MM]</em>, <em>[DD]</em>, and <em>[hh]</em> stand for the corresponding <em>year, month, day, </em>and <em>hour</em>, and <em>[ID] </em>is an <em>integer </em>from 1 to N (number of files here) such as sorting in increasing [ID] ordering is similar to sort by increasing year, month, day and hour ordering</li> <li>These files are in the subdirectory <em>SNAPSHOT/EDGES/hour/</em></li> </ul> </li> <li> <p><strong>orbitaal-nodetable.tar.gz</strong>:</p> <ul> <li>The root directory is <em>NODE_TABLE/</em></li> <li>Contains two files in parquet format, the first one gives&nbsp;<strong>information </strong>related to <strong>nodes </strong>present in stream graphs and snapshots such as <strong>period of activity</strong> and associated global <strong>Bitcoin balance</strong>, and the other one contains the list of <strong>all associated Bitcoin addresses.</strong></li> </ul> </li> </ol> <p>&nbsp;</p> <p>Small samples in CSV format</p> <ol> <li> <p><strong>orbitaal-stream_graph-2016_07_08.csv</strong> and <strong>orbitaal-stream_graph-2016_07_09.csv</strong></p> <ul> <li>These two CSV files are related to stream graph representations of an halvening happening in 2016.</li> </ul> </li> <li> <p><strong>orbitaal-snapshot-2016_07_08.csv </strong>and<strong> orbitaal-snapshot-2016_07_09.csv</strong></p> <ul> <li>These two CSV files are related to daily snapshot representations of an halvening happening in 2016.</li> <li><strong>&nbsp;</strong></li> </ul> </li> </ol> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p>