Metadata Enrichment of Long Text Documents using Large Language Models

<p><span lang="EN-US"><span>In this project, we semantically enriched and enhanced the metadata of long text documents, </span><span>theses</span><span> and dissertations, retrieved from the </span><span>HathiTrust</span><span> Digital Library in English published from 1920 to 2020 through a combination of manual efforts and large language models. This dataset provides a valuable resource for advancing research in areas such as computational social science, digital humanities, and information science. Our paper shows that enriching metadata using LLMs is particularly beneficial for digital repositories by introducing </span><span>additional</span><span> metadata access points that may not have originally been </span><span>foreseen</span><span> to accommodate various content types. This approach is particularly effective for repositories that have significant missing data in their existing metadata fields, enhancing search results, and improving the accessibility of the digital repository.</span></span><span>&nbsp;</span></p>