This study evaluates the ability of large language model chatbots to simplify and accurately interpret pathology reports for patients. The research involved 1134 pathology reports from a multispecialty hospital in Brooklyn, New York, and used two chatbots, Bard (Google Inc) and GPT-4 (OpenAI), to explain the reports in simple terms and identify key information. The results showed that both chatbots significantly reduced the readability grade level and improved the readability scores of the reports. Chatbot 1 correctly interpreted 87.57% of the reports, while chatbot 2 correctly interpreted 97.44%. However, both chatbots made some inaccuracies and hallucinations. The study concludes that while chatbots can simplify pathology reports, they should be reviewed by clinicians before being distributed to patients to ensure medical accuracy. The findings suggest that chatbots have the potential to enhance patient understanding of complex medical information but require further development and validation to address current limitations.This study evaluates the ability of large language model chatbots to simplify and accurately interpret pathology reports for patients. The research involved 1134 pathology reports from a multispecialty hospital in Brooklyn, New York, and used two chatbots, Bard (Google Inc) and GPT-4 (OpenAI), to explain the reports in simple terms and identify key information. The results showed that both chatbots significantly reduced the readability grade level and improved the readability scores of the reports. Chatbot 1 correctly interpreted 87.57% of the reports, while chatbot 2 correctly interpreted 97.44%. However, both chatbots made some inaccuracies and hallucinations. The study concludes that while chatbots can simplify pathology reports, they should be reviewed by clinicians before being distributed to patients to ensure medical accuracy. The findings suggest that chatbots have the potential to enhance patient understanding of complex medical information but require further development and validation to address current limitations.