Skip to main content
zenodoopen

Repository for "Evaluating LLMs for Hardware Design and Test"

<h2>Data Repository for "Evaluating LLMs for Hardware Design and Test"</h2> <p>This repository contains the conversations and related scripts for the paper "Evaluating LLMs for Hardware Design and Test", submitted to ISLAD 2024.</p> <p>The repository is organized as follows:</p> <ul> <li>&nbsp;`scripted-benchmarks` - this contains additional data used in the paper, which examines a more rigid process when exploring the potential applications for LLMs in hardware design. Here, each model chats are separated by subdirectory.</li> <li>`scripted-benchmarks-gpt4-tt03` - this contains just the benchmarks used in the paper, made by the first run of GPT-4, which were used for tapeout in Tiny Tapeout 3.</li> </ul> <p>The tt03 directory contains the GitHub action scripts required to invoke OpenLane and produce synthesis files, as well as used to perform simulation tests.</p>

ShareScore

20/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
4
Harmonization
4
Access
12
Reuse readiness
0
Engagement
0