Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
167
datasets available to search
ShareScore release 0.9.0
Dataset results
167 results for “large language models”
Open Large Language Model Framework
Open the record for dataset details and reuse information.
Are Large Language Models Good Software Librarians?
Open the record for dataset details and reuse information.
Automated electrosynthesis reaction mining with multimodal large language models - raw data and prompts
<p>Compilation of the prompts used, together with the raw response files from the tested MLMM models. </p>
Evaluating Large Language Models' Proficiency in Answering Arabic GAT Exam Questions
Open the record for dataset details and reuse information.
An Architecture for Integrating Large Language Models into Metamodeling Platforms: The Example of MM-AR
Open the record for dataset details and reuse information.
Supplementary Material for Paper "Distilling Event Sequence Knowledge From Large Language Models"
<p>Supplementary Material for Paper:<br>Distilling Event Sequence Knowledge From Large Language Models<br>Somin Wadhwa, Oktie Hassanzadeh, Debarun Bhattacharjya, Ken Barker, and Jian Ni</p> <p>Appendix:<br>- <code>Appendix.pdf</code>: contains our prompts and a description of our human evaluation details.</p> <p>Data:<br>- <code>base_kg_v7.jsonl</code>: Our Wikidata-based Event Causal Knowledge Graph.</p> <p>Outputs:<br>- <code>sample_new_patterns_discovered.txt</code>: examples of observed new patters through application of sequential pattern mining algorithms, described in section 3.<br>- <code>precision_eval_sample.txt:</code> examples of output evaluated with a precision-evaluator model. <br>- <code>bsumm_output.txt</code>: sample outputs of identified influencing events through the application of binary summary markov model, described in section 5.2.</p> <p>Code:<br>- <code>src/generator.py</code>: ingests ICL prompts and generates requisite event sequences.<br>- <code>src/benchmarking.py</code>: ingests a _trained_ Flan-style seq2seq model to evaluate precision, and recall from the base KG.<br>- <code>src/utils.py</code>: utilities for generator and benchmarking.</p> <p>To cite:</p> <pre><code>@inproceedings{WadhwaHBBN24, author = {Somin Wadhwa and Oktie Hassanzadeh and Debarun Bhattacharjya and Ken Barker and Jian Ni}, title = {Distilling Event Sequence Knowledge From Large Language Models}, booktitle = {The Semantic Web - 23rd International Conference, {ISWC} 2024}, series = {Lecture Notes in Computer Science}, publisher = {Springer}, year = {2024}, }</code></pre>
Evaluating Inductive Reasoning Capabilities of Large Language Models With The One Dimensional Abstract Reasoning Corpus
Open the record for dataset details and reuse information.
Investigating Gender Bias in Large Language Models Through Text Generation
<p>Presented at the 7th International Conference on Natural Language and Speech Processing (ICNLSP 2024). Published in the ACL Anthology.</p>
Dataset of the Automatic Unit Test Generation for Programming Assignments Using Large Language Models
Open the record for dataset details and reuse information.
Dataset for "The Politics of AI – An Evaluation of Political Preferences in Large Language Models from a European Perspective"
Open the record for dataset details and reuse information.
Advancing Automated Code Review Comment Generation Using Large Language Models
Open the record for dataset details and reuse information.
Automated Program Repair in the Era of Large Pre-trained Language Models
<p>Code used for the paper along with the generated outputs</p>
The Plastic Surgery Hypothesis in the Era of Large Language Models
<p>Correct Patches generated by FitRepair and Source code.</p>
Evaluating Accuracy Improvements of Large Language Models Using Retrieval Augmented Generation
<p>Original data</p>
Data and code for, "Large language models design sequence-defined macromolecules via evolutionary optimization"
<div> <pre># Codes and data for "Large language models design sequence-defined macromolecules via evolutionary optimization"<br><br>Note this repository contains codes and data files for the manuscript. This is a snapshot of the repository, frozen at the time of submission.<br><br># Codes<br><br>## LLM codes<br>- `run_claude.py` - the routine for performing LLM-based rollouts; intended for command line execution using argparse<br>- `message_utils.py` - utilities for constructing and parsing messages for LLM I/O<br>- `model_utils.py` - lightweight utilities for retrieving formatted predictions from the RNN ensemble<br>- `target_defs.py` - defines the sequence, locations, and natural language descriptions of the target structures<br>- `ask_about_oracle.ipynb` - asks the LLM to speculate about the nature of the optimization task<br><br>## other algorithms<br>- `active_learning.ipynb` - use EI acquisition with RF surrogate to label new sequences; includes an unused tokenization scheme<br>- `evolutionary_algorithm.ipynb` - use DEAP library to perform evolutionary optimization<br>- `random_sampling.ipynb` - sample sequences randomly from all possible sequences<br><br>## postprocessing<br>- `process_aggregated_logs.py` - reads data from the raw log files and prepares them for visualization<br>- `process_sample_rollouts.py` - reads data from the raw log files and prepares individual rollouts<br><br>## visualization<br>- `figure1b.ipynb` - renders panel b of Fig. 1<br>- `figure1efg.ipynb` - renders the last row of Fig. 1 (panels e-g)<br>- `figure2.ipynb` - renders all of Fig. 2<br>- `figure_si.ipynb` - renders Figs. S1 and S2<br>- `figure_md_validation.ipynb` - renders Fig. S3<br><br># Data files<br><br>- `prompts/`<br> - `prompt-scientific-v4.4.yml` - the full text of the scientific prompt, to be read by `run_claude.py`<br> - `prompt-oracle-v4.4.yml` - the full text of the oracle prompt, to be read by `run_claude.py`<br>- `models/` - the TorchScript RNN models used to make predictions<br>- `data/`<br> - `embeddings` - calculated embeddings for a collection of sequences from our prior work<br> - `llm-logs` - the raw logs obtained from the Claude 3.5 Sonnet LLM (other algorithms made to look like the LLM logs after the fact)<br> - `llm-logs-opus` - the raw logs obtained from the Claude 3.0 Opus LLM (used in the first draft of the article, replaced by Claude 3.5 Sonnet) <br> - `all-rollouts-kltd.csv` - postprocessed logs for all the rollouts using the "top $k < d^*$" metric<br> - `all-rollouts-topkd.csv` - postprocessed logs for all the rollouts using the "mean $d$ for top $k$" metric<br> - `sample-rollout-membranes-x-3.csv` - postprocessed logs for a single rollout replica, `x` = each algorithm type<br> - `snapshots` - png snapshots of MD simulation results at different locations in the manifold</pre> </div>
Can Feedback From a Large Language Model Improve Health Care Quality?
ClinicalTrials.gov study NCT06823765. IPD Sharing: YES. Countries: 1. Publications: 0.
Enhancing Interdisciplinary Understanding of Ophthalmology Notes Through a Local Large Language Model
ClinicalTrials.gov study NCT06624605. IPD Sharing: YES. Countries: 1. Publications: 0.
Application of large language models in radiology: evaluating longitudinal diagnostic yield of imaging for abdominal pain.
<p>Annotated dataset belonging to the paper "Application of large language models in radiology: evaluating longitudinal diagnostic yield of imaging for abdominal pain".</p>
Automated Fairness Testing of Large Language Models
<p>This directory contains the evaluation data for the proposal presented in the Master's Thesis "Automated Fairness Testing of Large Language Models". Specifically, it includes the following:</p> <ul> <li><em>base-experiment/</em>: Contains the test cases (<em>test-cases/</em>) generated to address RQ1 and RQ2, along with the results obtained (<em>executions/</em>) after running them on the models under test.</li> <li><em>stability-experiment/</em>: Contains the test cases (<em>test-cases/</em>) generated to address RQ3, along with the results obtained (<em>executions/</em>) after running them a total of 30 times on the models under test.</li> </ul>
Raw data for Large Language Models Reflect Human Citation Patterns with a Heightened Citation Bias
Open the record for dataset details and reuse information.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.