Evaluating Large Language Models in Summarizing Developer Chat Conversations: A Linguistic Perspective

<p>This is a replication package that includes:</p> <ul> <li>GoldenSet: contains the best summaries by participants for each conversation and the corresponding LLM generated summaries)</li> <li>LinguisticAnalysis_HumanGenerated: linguistic analysis such as speech tags, entities, etc. for summaries created by the Mturk participants (golden set)</li> <li>LinguisticAnalysis_LLMGenerated: linguistic analysis such as speech tags, entities etc. for summaries generated by the large language models</li> </ul> <p>&nbsp;</p>