Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
7
datasets available to search
ShareScore release 0.9.0
Dataset results
7 results for “scientific text”
Invasion Biology WikiProject Scientific Papers: Text Data Mining and LLM-based Information Extraction of Species, Locations, Habitats, and Ecosystems
<p>This dataset contains the abstract and full-text for publication DOIs from the Invasion Biology WikiProject (DOI: <a href="https://www.doi.org/10.5281/zenodo.12518036">10.5281/zenodo.12518036</a>). The data was retrieved using the <a href="https://ask.orkg.org/">ask.orkg.org</a> <a href="https://api.ask.orkg.org/docs#tag/Semantic-Neural-Search/operation/explore_documents_index_explore_get">API</a>. For the <a href="https://github.com/jd-coderepos/invasion-biology-IE/blob/main/scripts/ask-doi-list-fulltext-search.py">script</a> used to obtain the data, refer to the accompanying GitHub repository: <a href="https://github.com/jd-coderepos/invasion-biology-IE/" target="_blank" rel="noopener">https://github.com/jd-coderepos/invasion-biology-IE/</a>.</p> <p>The resulting CSV file includes the following fields: <code>"ASK ID"</code>, <code>"DOI"</code>, <code>"Title"</code>, <code>"Abstract"</code>, and <code>"Full-text"</code>.</p> <p>Of the 49,438 queried DOIs, the ASK database provided:</p> <ul> <li><strong>Total DOIs processed:</strong> 12,636</li> <li><strong>DOIs with neither abstract nor full-text:</strong> 36 (abstract token count was less than 10)</li> <li><strong>DOIs with abstracts but no full-text:</strong> 12,636</li> <li><strong>DOIs with both abstract and full-text:</strong> 2,834</li> </ul> <p>The second part of the dataset contains structured information extracted from the publications using the GPT-4o Large Language Model. This structured data is included in the zipped folder <code>structured-publications.zip</code>.</p> <p>The accompanying GitHub repository provides access to the code and scripts used at various stages of the information extraction (IE) process.</p> <p><strong>Theme of the Study:</strong><br>"Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Models."</p>
Bilingual English-German word embedding models for scientific text
<p>This data set contains three word embedding models, constructed from the same training corpus of English and German parallel scientific texts (abstracts and research project descriptions). All text was pre-processed by language-specific stemming with the Porter stemming algorithm, removing numbers, and lower-casing.</p> <p>The first model is a 1000-dimensional Latent Semantic Analysis model, constructed from concatenating the English and German texts. The input data was a m×n (297,852×923,864) document-term matrix of tf-idf weights. This was processed with truncated SVD. There are two files, the word vectors in file lsa_1000_Vmat.csv (the V* term by latent factors matrix of right singular values) and the dimension weights in lsa_1000_d_weights.csv (the 1000 values of the diagonal of the <span class="math-tex">\(\Sigma\)</span> matrix.</p> <p>lsa_1000_Vmat.csv has two fields, the term and its vector representation in LSA space, separated by a "|" character. The structure looks like this:</p> <p>tarifplural|{5.00599733151825e-08,-1.43071379136936e-08,8.32862290483082e-08,-6.08010721687266e-08,1.15831140150142e-07,-2.46470313387358e-08,3.43215595753282e-07,6.24301666802575e-07,-2.62907158945831e-07,-1.04120313981517e-07,4.5864574355164e-07,-2.31799632277312e-07,8.37354377858843e-07,8.22507467711628e-07,4.07585381069368e-07,-4.26358988941922e-08,-8.38652991154651e-07,1.98091851171759e-07,-3.94768548759816e-08,-4.28802181962385e-07, ...}</p> <p>The other two models are a basic Random Indexing and a Reflective Random Indexing model, contained in same file, RI_training.csv. Both models have 1000 dimensions. The data structure is as follows.</p> <ul> <li>language: either "en" (English) or "de" (German), the language of the term</li> <li>term: the term as a character string</li> <li>term_collection_count: integer, number of times the term occurred in the training data</li> <li>c_vector: vector of 1000 reals, RI context vector of the term. formatted like this: "{0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0.12309149,0,0,-0.12309149,0,0,0,0,0,0,0,0,0,0,0,0,0,0, ...}"</li> <li>n_docs: integer, number of different documents which contained the term</li> <li>c_vector_o2: vector of 1000 reals, RRI context vector of the term, formatted like c_vector above</li> </ul> <p>1,034,860 rows.</p> <p>All files are aggressively compressed with GNU gzip and will require much more disk space when uncompressed. Note the special formatting of the vector numeric variables, which are different for the two models.</p>
Text-fig. 1. The pioneers of scientific palaeobotany whose ideas laid the foundations of how we now name plant fossil-taxa. a: Ernst von Schlotheim (1764 – 1821); b: Kaspar Maria von Sternberg (1761 – 1837), reproduced by permission from J. Kvaček (National Museum, Prague); c: Adolphe Brongniart (1801 – 1876). Adapted from Cleal and Thomas (2019: fig. 2.1). in Naming Of Parts: The Use Of Fossil-Taxa In Palaeobotany
Text-fig. 1. The pioneers of scientific palaeobotany whose ideas laid the foundations of how we now name plant fossil-taxa. a: Ernst von Schlotheim (1764 – 1821); b: Kaspar Maria von Sternberg (1761 – 1837), reproduced by permission from J. Kvaček (National Museum, Prague); c: Adolphe Brongniart (1801 – 1876). Adapted from Cleal and Thomas (2019: fig. 2.1).
Cross-modal (text and figures) Analysis of a Scientific Corpus from Semantic Scholar - model weights
<p>In the related <a href="https://github.com/HybridNLP2018/tutorial">notebook </a>we show the application of cross-modal techniques to improve the categorization of scientific papers through content related to figures, using both the textual part (captions) and the visual part (figures, diagrams, images) jointly. To this purpose, we use several CNN models and execute some experiments, illustrating our approach. This deposit contains the model weights trained on such large corpora.</p>
Cross-modal (text and figures) Analysis of a Scientific Corpus from Semantic Scholar - images
<p>In this notebook we show the application of cross-modal techniques to improve the categorization of scientific papers through content related to figures, using both the textual part (captions) and the visual part (figures, diagrams, images) jointly. To this purpose, we use several CNN models and execute some experiments, illustrating our approach. This deposit contains high quality versions of the images used in the analysis.</p>
BVS Corpus: A Multilingual Parallel Corpus and Translation Experiments of Biomedical Scientific Texts
<p>The BVS database (Health Virtual Library) is a centralized source of biomedical information for Latin America and Carib, created in 1998 and coordinated by BIREME in agreement with the Pan American Health Organization (OPAS). Abstracts are available in English, Spanish, and Portuguese, with a subset in more than one language, thus being a possible source of parallel corpora. In this article, we present the development of parallel corpora from BVS in three languages: English, Portuguese, and Spanish. Sentences were automatically aligned using the Hunalign algorithm for EN/ES and EN/PT language pairs, and for a subset of trilingual articles also. We demonstrate the capabilities of our corpus by training a Neural Machine Translation (OpenNMT) system for each language pair, which outperformed related works on scientific biomedical articles. Sentence alignment was also manually evaluated, presenting an average 96\% of correctly aligned sentences across all languages. Our parallel corpus is freely available, with complementary information regarding article metadata.</p> <p> </p> <p>Copyright (c) 2019 Secretaría de Estado para el Avance Digital</p>
Mathematics and Astronomy [IO Islamic 1270] Anthology of scientific texts
<ul> <li><strong>Mathematics and Astronomy.</strong></li> <li><strong>This manuscript is now IO Islamic 1270 </strong><strong>in the India Office collections.</strong></li> <li><strong>[metadata:</strong><a href="https://de.wikipedia.org/wiki/Otto_Loth"> <strong>Otto Loth, </strong></a><strong><em><a href="http://doi.org/10.5281/zenodo.3923636">A Catalogue of the Arabic Manuscripts in the Library of the India Office</a></em>, (volume 1), no. 734 here with further notations and hyperlinks]</strong>.</li> </ul> <p>734.</p> <p>1270. Size 11 in. by 4<sup>1/2</sup> in.; foll. 123. Thirty-three lines in a page.</p> <p><strong>I. Foll. 1-9</strong>. كتاب ثابت بن قرة فى سنة الشمس بالارصاد .</p> <p>A treatise of THÂBIT B. ḲURRAH (d. A.H. 288) on the Solar Year. Cf. Casiri i., p. 390, 1. 21, and Fihrist, ed. Flügel, ٢٧٢.</p> <p>Begins:</p> <p>ان الاوائل قد اختلفوا فى سنة الشمس </p> <p>The first Ieaf is mutilated. Several blanks.</p> <p><strong>II. Fol. 10</strong>. A small tract, inscribed</p> <p>استخراج بعد ما بين المركزين المجسطى الشاهى لابى نصر بف (؟) عراق (sic)</p> <p>Then follow various treatises of AL-ḤASAN B. AL-ḤASAN B. AL-HAITHAM (Baṣrî, d. A.H. 430). Compare, in general, Casiri i. 414 sqq., and Woepcke, l’Algèbre d’Omar Alkhayyâmî, p. 73 sqq., where most of these treatises are mentioned. They are as follows:-</p> <p><strong>III. Foll. 10<em>v</em>.-12</strong>. قول الحسن بن الحسن بن الهيثم فى اضواء الكواكب . On the Light of the Stars. Cf. Cat. Bodl. i. 190.</p> <p>Begins:</p> <p>قد يظن قوم من المتفلسفين ان اضواء الكواكب مكتسبة من ضوء الشمس </p> <p><strong>IV. Foll. 12<em>v</em>.-17</strong>. قول الحسن ... فى الضوء . On Light.</p> <p>Begins:</p> <p>الكلام فى ماهية الضوء من العلوم الطبيعية و الكلام فى كيفية اشراق الضوء محتاج الى العلوم التعليمية </p> <p><strong>V. Foll. 18-21</strong>. مقالة الحسن ... فى المرايا المحرقة بالقطوع</p> <p>On some kind of burning – glasses. See Catal. Lugd. iii. 61.</p> <p>Begins: ان من اشرف ما استنبطه المهندسون .</p> <p><strong>VI. Foll. 21<em>v</em>.-25</strong>. مقالة للحسن ... فى المرايا المحرقة بالدائرة <sup>1</sup> . On circular burning-glasses.</p> <p>Begins:</p> <p>الشعاع الشمسى يخرج من الشمس على خطوط مستقيمة </p> <p><strong>VII. Foll. 25<em>v</em>.-27</strong>. قول الحسن ... فى المكان On Place.</p> <p>Begins:</p> <p>قد اختلف اهل النظر المتحققون بالبحث عن حقائق الامور الموجودة فى مائية المكان </p> <p><strong>VIII. Foll. 28-32</strong>. قول الحسن ... فى شكل بنى موسى .</p> <p>On a Proposition from the Prolegomena of the <em>Banu Mûsa</em> (Muḥammad, al-Ḥasan and Aḥmad) to Apollonius’ Book of Conic Sections. See Cat. Mus. Brit. 443 sq., and below, no. 745. Cf. regarding the Banu Mûsa, Fihrist, ed. Flügel, ٢٧١.</p> <p><strong>IX. Foll. 32<em>v</em>.-47</strong>. مقالة لابى على الحسن ... فى ضوء القمر On the Light of the Moon.</p> <p>Begins:</p> <p>ان جرم القمر فى تغير احواله الخ </p> <p>Then follows –</p> <p><strong>X. Foll. 48-56</strong>. مقالة فى الجبر للحكيم السيّد الاوحد ابى الفتح عمر بن ابرهيم الخيّامى حرس الله جماله .</p> <p>The Algebra of ‘OMAR KHAIYÂMÎ (who flourished in the fifth century). See the edition of Woepcke, Paris, 1851.</p> <p>Foll. 48 and 49 should be placed after fol. 50.</p> <p>Then follow again treatises by AL-ḤASAN B. AL-ḤASAN B. AL-HAITHAM, viz.—</p> <p><strong>XI. Foll. 56<em>v</em>.-69</strong>. مقالة للحسن ... فى مساحة المجسّم المكافئ . On the mensuration of parabolic solids.</p> <p>The preface begins:</p> <p>كل قول و كل تاليف فان فان لقائله و مؤلفه محرك </p> <p>The author says that he had met with two earlier works on the subject, one by Thâbit b. Ḳurrah, which was rather large and difficult, and the other by Abu Sahl Kûhî, which was limited to the easier of the two species of solids in question.</p> <p><strong>XII. Foll. 70-78</strong>. مقالة مستقصاة للحسن .... فى الاشكال الهلالية . On the segments of the circle. This is an enlarged and improved edition of a short treatise which he had written for a friend at an earlier date. <sup>1</sup></p> <p>Begins:</p> <p>كان بعض اخوانى سالنى عن الشكل الهلالى الذى يعمل على محيط الدائرة فالفت قولا مختصراً فى الاشكال الهلالية </p> <p><strong>XIII. Foll. 79-86</strong>. مقالة للحسن ... فى صورة الكسوف .</p> <p>On the Eclipse of the Sun. Cf. Cat. Bodl. i. 190<em>a</em>.</p> <p>Begins:</p> <p>قد يوجد صورة ضوء الشمس فى وقت كسوفها </p> <p>Then follows ---</p> <p><strong>XIV. Foll. 87-100</strong>. Demonstration of select propositions Of <em>Euclid</em>, ascribed to ABU SA’ÎD AḤMAD B. MUḤAMMAD B. ‘ABD AL-JALÎL (Sijzî, who flourished in the fourth century).<sup>2</sup></p> <p>Begins: ثبت براهين بعض اشكال كتاب اوقليدس فى الاصول استخراج الشيخ الفاضل ابى سعيد احمد بن محمد بن عبدالجليل فى الشكل الثانى من المقالة الاولى نريد ان نصل بنقطة مفروضة الخ.</p> <p>Incomplete, terminating abruptly.</p> <p>Then follow more treatises by AL-ḤASAN B. AL-ḤASAN B. AL-HAITHAM, viz.—</p> <p><strong>XV. Foll. 101-116</strong>. قول للحسن ... فى هيئة العالم On the Configuration of the Universe.</p> <p>The preface begins: قال لم يزل كثير من اصحاب التعاليم ممّن انعم النظر فى علم الهيئة فادرك حقائق الصور الموجودة لجملة العالم و لجلّ اجزائه يجرّدون قولا مسلا الخ.</p> <p>At the end is an additional note by the author, inscribed: تعليق وجدناه بخط الشيخ اطال الله بقاءه فى آخر هذه المقالة فنقلناه كما وجدناه .</p> <p><strong>XVI. Foll. 116<em>v</em>.-118</strong>. A treatise on the use and construction of certain compasses wherewith to draw large circles. It is styled in the conclusion الرسالة فى بركار الدوائر العظام . Cf. the list in Casiri i. 416, 1.7 infr., and Woepcke, p. 74, pen., no. 22. This treatise is probably identical with Cat. Lugd. iii. p. 94, no. MLXIV.</p> <p>Begins:</p> <p>العزة لله ان احد (sic) الحيل الهندسية التى نسخ لخادم مولانا الوزير الامير الاجل ادام الله سلطانه استخراجها آلة صغيرة المقدار تجرى مجرى البركار ترسم مع صغرها دوائر فى غاية العظم الخ.</p> <p><strong>XVII. Foll. 118<em>v</em>.-119</strong>. قول للحسن ... فى مسئلة عددية مجسمة . An algebraic problem.</p> <p>Begins: نريد ان نقسم عددا معلوما بقسمين حتى يكون احدهما مكعب الاخر .</p> <p><strong>XVIII. Fol. 119<em>v</em></strong>. قول للحسن بن الهيثم فى قسمة الخط الذى استعمله ارشميدس فى الكرة و الاسطوانة .</p> <p>This treatise has been translated by Woepcke, l.e., p. 91. Cf. Cat. Lugd. iii. 60.</p> <p><strong>XIX.Fol. 120</strong>. مسئلة فى اختلاف منظر القمر استخراج الشيخ الجليل ابى على الحسن الخ. On the Parallax of the Moon.</p> <p>Begins:</p> <p>اذا كان ارتفاع القمر اقل من ثلثين درجة </p> <p><strong>XX. Fol. 121</strong>. قول للحسن ... فى استخراج مسئلة عددية . Solution of an arithmetical problem.</p> <p>Begins:</p> <p>المسئلة نريد ان نجد عددًا اذا قسم على اثنين بقى منه واحد و ان قسم على ثلثة بقى منه واحد</p> <p><strong>XXI. Foll. 122-123</strong>. فصل للحسن ... فى مقدمة ضلع المسبع . On the Side of the Septangle, which is to be drawn in a circle; referring to the treatise of <em>Archimedes</em>, تسبيع الدائرة or المسبّع فى الدائرة . Cf. Fihrist ٢٦٦, Wenrich, de auctor. Grace. vers., p. 193.</p> <p>Begins:</p> <p>ان ارشميدس بنى ضلع المسبع على المربع الذى قدمه </p> <p>Well written in a small hand, with numerous neatly drawn diagrams. Of about the tenth century. Worm-eaten.</p> <p>[<a href="https://doi.org/10.5281/zenodo.4085990">Johnson</a>.]</p> <p> </p> <p><sup>1</sup> Or بالدوائر , as the conclusion has.</p> <p><sup>1</sup> Both of these editions are mentioned by <a href="https://en.wikipedia.org/wiki/Franz_Woepcke">Woepcke</a>, <a href="https://archive.org/details/lalgbredomaralk00khaygoog/page/n6/mode/2up">l’Algèbre d’Omar Alkhayyâmî</a>, second list, p.74, nos. 20 and 21.</p> <p><sup>2</sup> See Woepcke, l.c., p. 117.</p> <p> </p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.