GenBank PLN (Plantae, Fungi, Algae) Sequence Index in TSV, CSV, JSONL formats hash://sha256/bc7368469e50020ce8ae27b9d6a9a869e0b9a2a0a9b5480c69ce6751fa4b870e hash://md5/f6f78f64e3b3ff06adc3229badbd578b

<p>GenBank [1]&nbsp;makes sequence records openly available.&nbsp;</p> <p>This publication contains an index of all accession records from the GenBank PLN division release v256 as seen around 27&nbsp;June 2023 (2023-06-27) by Preston [2]. PLN division is said to include sequence associated with plants, fungi and algae.</p> <p>included files:</p> <p>00_gbpln.json.gz - gzipped archive of simple line-json representation of records in gbpln sequence archives.</p> <p>00_gbpln.sample.json&nbsp;- first 10 lines of line-json representation of records in gbpln sequence archives.</p> <p>00_gbpln.tsv.gz - gzipped archive of tab-separated values (tsv)&nbsp;representation of records in gbpln sequence archives.</p> <p>00_gbpln.sample.tsv - first 10 lines of tab-separated values (tsv)&nbsp;representation of records in gbpln sequence archives.</p> <p>00_gbpln.csv.gz - gzipped archive of comma-separated values (csv)&nbsp;representation of records in gbpln sequence archives.</p> <p>00_gbpln.sample.csv - first 10 lines of&nbsp;comma-separated values (csv)&nbsp;representation of records in gbpln sequence archives.</p> <p>Also include Preston provenance records in files with 64 long character filenames (e.g., hash://sha256/bc7368469e50020ce8ae27b9d6a9a869e0b9a2a0a9b5480c69ce6751fa4b870e).</p> <p>Please do note that, at time of writing (2023-07-05), the actual GenBank Sequence archives are hosted at Arizona State University Biodiversity Knowledge Integration Center via Preston remote https://biokic6.rc.asu.edu/preston/gbpln . And this ASU remote is currently proxied via https://linker.bio.&nbsp;</p> <p>Examples:</p> <p>To stream json structure data directly from zenodo and only include records with &quot;OBI&quot; in it:</p> <pre><code class="language-bash"># Stream records from this publication # and print first record containing "OBI" in gbpln.json.gz # using bash, jq, gunzip, head, and curl curl https://zenodo.org/record/8117720/files/00_gbpln.json.gz\ | gunzip\ | grep -E "[^a-zA-Z]OBI[^a-zA-Z]"\ | head -n1\ | jq . </code></pre> <p>with expected result:</p> <pre><code class="language-json">{ "accession": "JF951063", "http://www.w3.org/2000/01/rdf-schema#seeAlso": "https://ncbi.nlm.nih.gov/nuccore/JF951063", "definition": "Phalaris californica isolate CAL1ITS 5.8S ribosomal RNA gene and internal transcribed spacer 2, partial sequence.", "organism": "Phalaris californica", "specimen_voucher": "D. Keil s.n. (OBI)", "db_xref": "taxon:1108036", "country": "USA", "http://www.w3.org/ns/prov#wasDerivedFrom": "line:gz:hash://sha256/80f3e67d9a954cc8ca7223a10d1951c1ff84ca2844e7840bcb32eeac61181964!/L1400532-L1400572", "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": "genbank-flatfile" } </code></pre> <p>Similar example, but using csv :</p> <pre><code class="language-bash"># Stream records from this publication # and print first record containing "OBI" in 00_gbpln.csv.gz # using bash, jq, gunzip, head, and curl curl https://zenodo.org/record/8117720/files/00_gbpln.csv.gz\ | gunzip\ | grep -E "[^a-zA-Z]OBI[^a-zA-Z]"\ | head -n1 </code></pre> <p>with expected results:</p> <pre><code>JF951063,https://ncbi.nlm.nih.gov/nuccore/JF951063,"Phalaris californica isolate CAL1ITS 5.8S ribosomal RNA gene and internal transcribed spacer 2, partial sequence.",taxon:1108036,Phalaris californica,USA,null,D. Keil s.n. (OBI),null,line:gz:hash://sha256/80f3e67d9a954cc8ca7223a10d1951c1ff84ca2844e7840bcb32eeac61181964!/L1400532-L1400572 </code></pre> <p>with header, extracted using:</p> <pre><code class="language-bash">curl https://zenodo.org/record/8117720/files/00_gbpln.csv.gz\ | gunzip\ | head -n1</code></pre> <p>&nbsp;</p> <pre><code>accession,rdfs:seeAlso,definition,db_xref,organism,country,host,specimen_voucher,isolation_source,prov:wasDerivedFrom</code></pre> <p>The same results can be obtained using Preston, a biodiversity dataset tracker:</p> <pre><code class="language-bash">preston ls\ --anchor hash://sha256/bc7368469e50020ce8ae27b9d6a9a869e0b9a2a0a9b5480c69ce6751fa4b870e\ --remote https://linker.bio,https://zenodo.org/record/8117720/files/,https://biokic6.rc.asu.edu/preston/gbpln\ | grep urn:x-ncbi:gbpln.csv.gz\ | head -n1\ | preston cat\ --remote https://linker.bio,https://zenodo.org/record/8117720/files/,https://biokic6.rc.asu.edu/preston/gbpln\ | gunzip\ | grep -E "[^a-zA-Z]OBI[^a-zA-Z]"\ | head -n1 </code></pre> <p>References&nbsp;</p> <p>[1] Sayers E, Cavanaugh M, Clark K, Ostell J, Pruitt K, Karsch-Mizrachi I, &quot;GenBank&quot;, Nucleic Acids Research, Volume 47, Issue D1, January 2019, pp. D94-D99 PMID:30365038 PMCID:PMC6323954 DOI:10.1093/nar/gky989</p> <p>[2]&nbsp;Elliott, M.J., Poelen, J.H. &amp; Fortes, J.A.B. Signing data citations enables data verification and citation persistence. Sci Data 10, 419 (2023). doi:10.1038/s41597-023-02230-y hash://sha256/f849c870565f608899f183ca261365dce9c9f1c5441b1c779e0db49df9c2a19d</p> <p>PS To clone all data (including &gt;200GB source data):</p> <pre><code class="language-bash">preston clone\ --remote https://linker.bio,https://zenodo.org/record/8117720/files/,https://biokic6.rc.asu.edu/preston/gbpln\ --anchor hash://sha256/bc7368469e50020ce8ae27b9d6a9a869e0b9a2a0a9b5480c69ce6751fa4b870e </code></pre>