Better Call GPT, Comparing Large Language Models Against Lawyers

Better Call GPT, Comparing Large Language Models Against Lawyers

24 Jan 2024 | LAUREN MARTIN, NICK WHITEHOUSE, STEPHANIE YIU, LIZZIE CATTERSON, RIVINDU PERERA, AI Center of Excellence, Onit Inc., New Zealand
This paper presents a groundbreaking comparison between Large Language Models (LLMs) and traditional legal contract reviewers—Junior Lawyers and Legal Process Outsourcers (LPOs). The study aims to assess whether LLMs can outperform humans in accuracy, speed, and cost-efficiency during contract review. Through empirical analysis, the research benchmarks LLMs against Senior Lawyers, who serve as the ground truth. The findings indicate that advanced LLMs match or exceed human accuracy in determining legal issues, complete reviews in mere seconds, and offer a 99.97% reduction in cost compared to traditional methods. These results signal a significant shift in legal practice, highlighting the potential for LLMs to enhance accessibility and efficiency in legal services. The study contributes to the understanding of LLMs' capabilities and limitations in the legal domain, providing valuable insights for practitioners and researchers. The research also discusses the ethical considerations and future directions for further exploration.This paper presents a groundbreaking comparison between Large Language Models (LLMs) and traditional legal contract reviewers—Junior Lawyers and Legal Process Outsourcers (LPOs). The study aims to assess whether LLMs can outperform humans in accuracy, speed, and cost-efficiency during contract review. Through empirical analysis, the research benchmarks LLMs against Senior Lawyers, who serve as the ground truth. The findings indicate that advanced LLMs match or exceed human accuracy in determining legal issues, complete reviews in mere seconds, and offer a 99.97% reduction in cost compared to traditional methods. These results signal a significant shift in legal practice, highlighting the potential for LLMs to enhance accessibility and efficiency in legal services. The study contributes to the understanding of LLMs' capabilities and limitations in the legal domain, providing valuable insights for practitioners and researchers. The research also discusses the ethical considerations and future directions for further exploration.
Reach us at info@study.space