Skip to main content
zenodoopen

Job workload data and transaction logs for the eBlocBroker

<p><strong>* What is eBlocBroker?</strong></p> <p>eBlocBroker is a blockchain based autonomous computational resource broker.</p> <p><strong>* Job workload data and transaction logs for the eBlocBroker</strong></p> <p>This repository contains job workload data and test results for the paper titled: &nbsp;<em>&quot;eBlocBroker: A&nbsp;Blockchain Based Autonomous Computational Resource Broker&quot;</em>. eBlocBroker and its driver programs are&nbsp;available from the following GitHub repository:&nbsp;<a href="https://github.com/ebloc/ebloc-broker">https://github.com/ebloc/ebloc-broker</a>.</p> <p>We first deployed our eBlocBroker contract on bloxberg. Then we tested eBlocBroker and the&nbsp;robustness of our Python scripts that&nbsp;allow provider and requester nodes to interact with each other&nbsp;through eBlocBroker and cloud storage services using two types of&nbsp;synthetic CPU workloads explained&nbsp;as follows:</p> <ol> <li>This workload helps to test running source code in combination with already cached and not cached&nbsp;datasets on the provider. As the &nbsp;&nbsp;source code, the&nbsp;<a href="https://dl.acm.org/doi/abs/10.1145/3330481">cppr</a> (colored parallel rush-relabel algorithm)&nbsp;is&nbsp;used, which runs with additional datasets. Three cppr processes&nbsp;run one after another with&nbsp;different randomly selected datasets. All four providers have the same 12 medium-size datasets,&nbsp;of which&nbsp;only 3 distinct ones from each other have lower prices. Two data files are the&nbsp;provider&rsquo;s registered data, and one is from the&nbsp;requester&rsquo;s local storage.</li> <li>The <a href="https://www.nas.nasa.gov/software/npb.html">NAS Parallel Benchmarks</a>, a small group of&nbsp;programs targeting the performance evaluation&nbsp;of parallel supercomputers. One of&nbsp;the NAS&nbsp;serialized benchmarks in Class B (Block Tridiagonal solver,&nbsp;Scalar Pentadiagonal solver,&nbsp;Unstructured Adaptive mesh, and&nbsp;Lower-Upper Gauss-Seidel solver) is&nbsp;selected randomly. Since&nbsp;providers&rsquo; prices are the same, the calculated cost for NAS jobs will&nbsp;be the&nbsp;same for all&nbsp;providers.</li> </ol> <p>In the test, our helper Python script maintains one hundred synthetic requesters within the&nbsp;requester node continually submit the&nbsp;following chosen workload randomly for 14 hours and 30&nbsp;minutes.</p> <p>This record provides logs of clusters and clients, results of the submitted jobs on each cluster&nbsp;that is either completed of failed and their gained and returned fees, logs of the submitted jobs&nbsp;and their transaction hashes, and Slurm&#39;s job submission information, which are&nbsp;generated by the&nbsp;Driver programs.</p> <p><strong>**&nbsp;Transactions are taken from bloxberg (<a href="https://blockexplorer.bloxberg.org">https://blockexplorer.bloxberg.org</a>)</strong></p> <p>- Transactions deployed on the eBlocBroker Smart Contract:<br> <a href="https://blockexplorer.bloxberg.org/address/0xa0Fac3232234478E6A0d4d5564ed239c956A21f0/transactions">https://blockexplorer.bloxberg.org/address/0xa0Fac3232234478E6A0d4d5564ed239c956A21f0/transactions</a></p> <p>-&nbsp;<a href="https://blockexplorer.bloxberg.org/address/0x29e613B04125c16db3f3613563bFdd0BA24Cb629/transactions">Transactions of the <em>provider0_0x29e613B04125c16db3f3613563bFdd0BA24Cb629</em></a><br> <em>-&nbsp;</em><a href="https://blockexplorer.bloxberg.org/address/0x1926b36af775e1312fdebcc46303ecae50d945af/transactions">Transactions of the <em>provider1_0x1926b36af775e1312fdebcc46303ecae50d945af</em></a><br> -&nbsp;<a href="https://blockexplorer.bloxberg.org/address/0x4934a70Ba8c1C3aCFA72E809118BDd9048563A24/transactions">Transactions of the<em> provider2_0x4934a70Ba8c1C3aCFA72E809118BDd9048563A24</em></a>&nbsp;&nbsp;<br> -&nbsp;<a href="https://blockexplorer.bloxberg.org/address/0x51e2b36469cdbf58863db70cc38652da84d20c67/transactions">Transactions of the <em>provider3_0x51e2b36469cdbf58863db70cc38652da84d20c67</em></a>&nbsp;&nbsp;</p> <p><strong>* Files</strong></p> <p>Each provider contains <em>eudat, gdrive, ipfs, and ipfs_gpg&nbsp;</em>folders that contains the patch results&nbsp;that obtained from the named cloud storage.</p> <p>$&nbsp;tree -L 2 .<br> ├── README.org<br> ├── base_test_eblocbroker<br> │ &nbsp; ├── NPB3.3-SER_source_code<br> │ &nbsp; ├── README.md<br> │ &nbsp; ├── _cppr<br> │ &nbsp; ├── cppr<br> │ &nbsp; ├── cppr_example.sh<br> │ &nbsp; ├── datasets<br> │ &nbsp; ├── run_cppr<br> │ &nbsp; ├── setup.sh<br> │ &nbsp; └── test_data<br> ├── check_list.org<br> ├── provider0_0x29e613B04125c16db3f3613563bFdd0BA24Cb629<br> │ &nbsp; ├── ebloc-broker<br> │ &nbsp; ├── eudat<br> │ &nbsp; ├── gdrive<br> │ &nbsp; ├── ipfs<br> │ &nbsp; ├── ipfs_gpg<br> │ &nbsp; ├── jobs_info_0x29e613b04125c16db3f3613563bfdd0ba24cb629.out<br> │ &nbsp; ├── result_ipfs_hashes.txt<br> │ &nbsp; ├── transactions_0x29e613B04125c16db3f3613563bFdd0BA24Cb629.csv<br> │ &nbsp; └── watch_0x29e613b04125c16db3f3613563bfdd0ba24cb629.out<br> ├── provider1_0x1926b36af775e1312fdebcc46303ecae50d945af<br> │ &nbsp; ├── ebloc-broker<br> │ &nbsp; ├── eudat<br> │ &nbsp; ├── gdrive<br> │ &nbsp; ├── ipfs<br> │ &nbsp; ├── ipfs_gpg<br> │ &nbsp; ├── jobs_info_0x1926b36af775e1312fdebcc46303ecae50d945af.out<br> │ &nbsp; ├── result_ipfs_hashes.txt<br> │ &nbsp; ├── transactions_0x1926b36af775e1312fdebcc46303ecae50d945af.csv<br> │ &nbsp; └── watch_0x1926b36af775e1312fdebcc46303ecae50d945af.out<br> ├── provider2_0x4934a70Ba8c1C3aCFA72E809118BDd9048563A24<br> │ &nbsp; ├── ebloc-broker<br> │ &nbsp; ├── eudat<br> │ &nbsp; ├── ipfs<br> │ &nbsp; ├── ipfs_gpg<br> │ &nbsp; ├── jobs_info_0x4934a70ba8c1c3acfa72e809118bdd9048563a24.out<br> │ &nbsp; ├── result_ipfs_hashes.txt<br> │ &nbsp; ├── transactions_0x4934a70Ba8c1C3aCFA72E809118BDd9048563A24.csv<br> │ &nbsp; └── watch_0x4934a70ba8c1c3acfa72e809118bdd9048563a24.out<br> ├── provider3_0x51e2b36469cdbf58863db70cc38652da84d20c67<br> │ &nbsp; ├── ebloc-broker<br> │ &nbsp; ├── eudat<br> │ &nbsp; ├── gdrive<br> │ &nbsp; ├── ipfs<br> │ &nbsp; ├── ipfs_gpg<br> │ &nbsp; ├── jobs_info_0x51e2b36469cdbf58863db70cc38652da84d20c67.out<br> │ &nbsp; ├── result_ipfs_hashes.txt<br> │ &nbsp; ├── transactions_0x51e2b36469cdbf58863db70cc38652da84d20c67.csv<br> │ &nbsp; └── watch_0x51e2b36469cdbf58863db70cc38652da84d20c67.out<br> ├── requesters<br> │ &nbsp; ├── ebloc-broker-logs<br> │ &nbsp; └── gdrive<br> └── transactions_contract_0xa0Fac3232234478E6A0d4d5564ed239c956A21f0.csv</p>

ShareScore

40/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
8
Harmonization
4
Access
16
Reuse readiness
8
Engagement
4

Topics