Assessing text comprehension proficiency: Indonesian higher education students vs ChatGPT

Assessing text comprehension proficiency: Indonesian higher education students vs ChatGPT

January 2024 | Juanda – Iswan Afandi
This study compares the text comprehension abilities of Indonesian higher education students with ChatGPT, focusing on gender and university differences. The research involved 288 students from three universities in Makassar: Universitas Negeri Makassar (UNM), Universitas Timor (Unimor), and Makassar Health Polytechnic (Poltekkes Makassar). The study used quantitative methods, including descriptive statistics, independent sample t-tests, and Welch One-Way ANOVA to analyze the data. The results showed that ChatGPT outperformed students in most aspects of text comprehension, including content and writing style. However, UNM students scored slightly higher in the Multiple Choice Test (MCT) compared to ChatGPT and the other two universities. Poltekkes students scored significantly higher in content understanding and writing style than UNM and Unimor students. The study also found no significant difference in text comprehension between male and female students. The research highlights the need to revise and develop the Indonesian curriculum to improve students' text comprehension abilities, as ChatGPT demonstrates superior performance in this area. The findings suggest that AI can be a valuable tool in education, but there is a need for further research to explore the broader impact of AI in language education and its potential social and ethical implications. The study contributes to the development of the Indonesian curriculum by integrating AI technology, which can help improve the quality of education. The research also emphasizes the importance of AI literacy in education, as it enables students to better understand and use AI tools. The study underscores the need for educators to develop their AI literacy and to incorporate AI into the curriculum to enhance students' learning experiences.This study compares the text comprehension abilities of Indonesian higher education students with ChatGPT, focusing on gender and university differences. The research involved 288 students from three universities in Makassar: Universitas Negeri Makassar (UNM), Universitas Timor (Unimor), and Makassar Health Polytechnic (Poltekkes Makassar). The study used quantitative methods, including descriptive statistics, independent sample t-tests, and Welch One-Way ANOVA to analyze the data. The results showed that ChatGPT outperformed students in most aspects of text comprehension, including content and writing style. However, UNM students scored slightly higher in the Multiple Choice Test (MCT) compared to ChatGPT and the other two universities. Poltekkes students scored significantly higher in content understanding and writing style than UNM and Unimor students. The study also found no significant difference in text comprehension between male and female students. The research highlights the need to revise and develop the Indonesian curriculum to improve students' text comprehension abilities, as ChatGPT demonstrates superior performance in this area. The findings suggest that AI can be a valuable tool in education, but there is a need for further research to explore the broader impact of AI in language education and its potential social and ethical implications. The study contributes to the development of the Indonesian curriculum by integrating AI technology, which can help improve the quality of education. The research also emphasizes the importance of AI literacy in education, as it enables students to better understand and use AI tools. The study underscores the need for educators to develop their AI literacy and to incorporate AI into the curriculum to enhance students' learning experiences.
Reach us at info@study.space
Understanding Assessing text comprehension proficiency%3A Indonesian higher education students vs ChatGPT