This study examines the effects of online distance learning versus traditional in-person education at King Saud University in Saudi Arabia, focusing on student achievement. The research is particularly relevant given the rapid shift to online learning during the COVID-19 pandemic. By analyzing final test scores of freshman students in five core courses over the 2020 (in-person) and 2021 (online) academic years, the study provides empirical insights into the efficacy of different educational modalities. Initial observations suggested that online students scored lower in most courses, but after adjusting for variables like gender, class size, and admission scores using multiple linear regression, a more nuanced picture emerged. Three courses showed better performance in the 2021 online cohort, one favored the 2020 in-person group, and one was unaffected by the teaching format. The study emphasizes the need for a data-driven, nuanced approach in integrating online learning within higher education systems, highlighting that the success of educational methodologies is highly contingent on specific contextual factors. Educational administrators and policymakers are encouraged to exercise careful judgment when adopting online learning modalities, considering how different subjects and instructional approaches might interact with online formats, and evaluating their impact on learning outcomes. This approach ensures that decisions about implementing online education are made with a comprehensive understanding of its diverse and context-specific impacts, aiming to optimize educational effectiveness and student success.This study examines the effects of online distance learning versus traditional in-person education at King Saud University in Saudi Arabia, focusing on student achievement. The research is particularly relevant given the rapid shift to online learning during the COVID-19 pandemic. By analyzing final test scores of freshman students in five core courses over the 2020 (in-person) and 2021 (online) academic years, the study provides empirical insights into the efficacy of different educational modalities. Initial observations suggested that online students scored lower in most courses, but after adjusting for variables like gender, class size, and admission scores using multiple linear regression, a more nuanced picture emerged. Three courses showed better performance in the 2021 online cohort, one favored the 2020 in-person group, and one was unaffected by the teaching format. The study emphasizes the need for a data-driven, nuanced approach in integrating online learning within higher education systems, highlighting that the success of educational methodologies is highly contingent on specific contextual factors. Educational administrators and policymakers are encouraged to exercise careful judgment when adopting online learning modalities, considering how different subjects and instructional approaches might interact with online formats, and evaluating their impact on learning outcomes. This approach ensures that decisions about implementing online education are made with a comprehensive understanding of its diverse and context-specific impacts, aiming to optimize educational effectiveness and student success.