2 Jul 2024 | Hang Jiang, Xiajie Zhang, Robert Mahari, Daniel Kessler, Eric Ma, Tal August, Irene Li, Alex 'Sandy' Pentland, Yoon Kim, Deb Roy, Jad Kabbara
This paper explores the use of large language models (LLMs) in legal education to help non-experts understand complex legal concepts through storytelling. The authors introduce the LEGALSTORIES dataset, which includes 294 complex legal doctrines, each accompanied by a story and multiple-choice questions generated by LLMs. The dataset is constructed using an expert-in-the-loop approach, where legal experts provide feedback to refine the stories and questions. The effectiveness of LLM-generated stories is evaluated through randomized controlled trials (RCTs) with legal novices, both native and non-native English speakers. The results show that LLM-generated stories enhance comprehension of legal concepts and interest in law among non-native speakers compared to definitions alone. Additionally, the stories consistently help participants relate legal concepts to their personal lives and show higher retention rates in follow-up assessments. The study highlights the potential of LLMs in advancing legal education and promoting general legal literacy.This paper explores the use of large language models (LLMs) in legal education to help non-experts understand complex legal concepts through storytelling. The authors introduce the LEGALSTORIES dataset, which includes 294 complex legal doctrines, each accompanied by a story and multiple-choice questions generated by LLMs. The dataset is constructed using an expert-in-the-loop approach, where legal experts provide feedback to refine the stories and questions. The effectiveness of LLM-generated stories is evaluated through randomized controlled trials (RCTs) with legal novices, both native and non-native English speakers. The results show that LLM-generated stories enhance comprehension of legal concepts and interest in law among non-native speakers compared to definitions alone. Additionally, the stories consistently help participants relate legal concepts to their personal lives and show higher retention rates in follow-up assessments. The study highlights the potential of LLMs in advancing legal education and promoting general legal literacy.