Artificial Intelligence Supported Adaptive Learning: Examining Its Impact on Students' Critical Thinking, Self-Regulated Learning, and Academic Achievement in Higher Education
DOI:
https://doi.org/10.65310/6ahn6386Keywords:
Adaptive learning, Artificial intelligence, Critical thinking, Higher education, Self-regulated learning.Abstract
Artificial intelligence (AI)-supported adaptive learning is increasingly used in higher education, yet its effects on critical thinking, self-regulated learning, and academic achievement remain unevenly understood. This study examined these outcomes using a quantitative comparative design based on secondary empirical data from a controlled university learning intervention involving 61 students, comprising 31 participants in an AI-guided treatment group and 30 in a control group. Critical thinking, self-regulated learning dimensions, and academic achievement were analyzed using descriptive statistics and covariance-based comparisons. The treatment group showed a larger critical-thinking gain than the control group (4.30 vs. 0.80 points), with a significant adjusted effect, F = 41.73, p < .001, partial η² = .418. Significant effects were also observed for cognitive engagement, behavioral engagement, self-efficacy, intrinsic motivation, and reduced amotivation. Academic achievement improved significantly at posttest, F = 6.10, p = .017, partial η² = .100, and delayed test, F = 8.20, p = .006, partial η² = .124. These findings indicate that structured AI guidance can strengthen cognitive, regulatory, and achievement outcomes when pedagogically integrated within carefully designed contemporary higher education learning environments
Downloads
References
Albadarin, Y., Saqr, M., Pope, N., & Tukiainen, M. (2024). A systematic literature review of empirical research on ChatGPT in education. Discover Education, 3, 60. https://doi.org/10.1007/s44217-024-00138-2
Bhullar, P. S., Joshi, M., & Chugh, R. (2024). ChatGPT in higher education—A synthesis of the literature and a future research agenda. Education and Information Technologies, 29, 21501–21522. https://doi.org/10.1007/s10639-024-12723-x
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024). A meta systematic review of artificial intelligence in higher education: A call for increased ethics, collaboration, and rigour. International Journal of Educational Technology in Higher Education, 21, 4. https://doi.org/10.1186/s41239-023-00436-z
Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20, 43. https://doi.org/10.1186/s41239-023-00411-8
Chang, D. H., Lin, M. P.-C., Hajian, S., & Wang, Q. Q. (2023). Educational design principles of using AI chatbot that supports self-regulated learning in education: Goal setting, feedback, and personalization. Sustainability, 15(17), 12921. https://doi.org/10.3390/su151712921
Chen, S., & Cheung, A. C. K. (2025). Effect of generative artificial intelligence on university students learning outcomes: A systematic review and meta-analysis. Educational Research Review, 49, 100737. https://doi.org/10.1016/j.edurev.2025.100737
Chiu, T. K. F. (2024). A classification tool to foster self-regulated learning with generative artificial intelligence by applying self-determination theory: A case of ChatGPT. Educational Technology Research and Development, 72, 2401–2416. https://doi.org/10.1007/s11423-024-10366-w
Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4, 100118. https://doi.org/10.1016/j.caeai.2022.100118
Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20, 22. https://doi.org/10.1186/s41239-023-00392-8
Dibek, M. I., Kursad, M. S., & Erdogan, T. (2025). Influence of artificial intelligence tools on higher order thinking skills: A meta-analysis. Interactive Learning Environments, 33(3), 2216–2238. https://doi.org/10.1080/10494820.2024.2402028
Dong, L., Tang, X., & Wang, X. (2025). Examining the effect of artificial intelligence in relation to students’ academic achievement: A meta-analysis. Computers and Education: Artificial Intelligence, 8, 100400. https://doi.org/10.1016/j.caeai.2025.100400
Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6, 100198. https://doi.org/10.1016/j.caeai.2023.100198
Essien, A. E., Bukoye, O., O’Dea, C., & Kremantzis, M. D. (2024). The influence of AI text generators on critical thinking skills in UK business schools. Studies in Higher Education, 49(5), 865–882. https://doi.org/10.1080/03075079.2024.2316881
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61(3), 460–474. https://doi.org/10.1080/14703297.2023.2195846
García-Martínez, I., Fernández-Batanero, J. M., Fernández-Cerero, J., & León, S. P. (2023). Analysing the impact of artificial intelligence and computational sciences on student performance: Systematic review and meta-analysis. Journal of New Approaches in Educational Research, 12, 171–197. https://doi.org/10.7821/naer.2023.1.1240
Grassini, S. (2023). Shaping the future of education: Exploring the potential and consequences of AI and ChatGPT in educational settings. Education Sciences, 13(7), 692. https://doi.org/10.3390/educsci13070692
Guan, R., Raković, M., Chen, G., & Gašević, D. (2025). How educational chatbots support self-regulated learning? A systematic review of the literature. Education and Information Technologies, 30, 4493–4518. https://doi.org/10.1007/s10639-024-12881-y
Hooshyar, D., Weng, X., Sillat, P. J., Tammets, K., Wang, M., & Hämäläinen, R. (2024). The effectiveness of personalized technology-enhanced learning in higher education: A meta-analysis with association rule mining. Computers & Education, 223, 105169. https://doi.org/10.1016/j.compedu.2024.105169
Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education, 20, 37. https://doi.org/10.1186/s41239-023-00406-5
Jo, H. (2024). From concerns to benefits: A comprehensive study of ChatGPT usage in education. International Journal of Educational Technology in Higher Education, 21, 35. https://doi.org/10.1186/s41239-024-00471-4
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022). Explainable artificial intelligence in education. Computers and Education: Artificial Intelligence, 3, 100074. https://doi.org/10.1016/j.caeai.2022.100074
Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T. (2024). Empowering ChatGPT with guidance mechanism in blended learning: Effect of self-regulated learning, higher-order thinking skills, and knowledge construction. International Journal of Educational Technology in Higher Education, 21, 16. https://doi.org/10.1186/s41239-024-00447-4
Li, C., Cui, H., & Hagedorn, L. S. (2026). The cognitive impact of ChatGPT in higher education: A systematic review of critical and creative thinking outcomes. Computers and Education: Artificial Intelligence, 10, 100571. https://doi.org/10.1016/j.caeai.2026.100571
Lim, W. M., Gunasekara, A., Pallant, J. L., Pallant, J. I., & Pechenkina, E. (2023). Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators. The International Journal of Management Education, 21(2), 100790. https://doi.org/10.1016/j.ijme.2023.100790
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
Merino-Campos, C. (2025). The impact of artificial intelligence on personalized learning in higher education: A systematic review. Trends in Higher Education, 4(2), 17. https://doi.org/10.3390/higheredu4020017
Molenaar, I. (2022). Towards hybrid human-AI learning technologies. European Journal of Education, 57, 632–645. https://doi.org/10.1111/ejed.12527
Naseer, F., Khan, M. N., Tahir, M., Addas, A., & Aejaz, S. M. H. (2024). Integrating deep learning techniques for personalized learning pathways in higher education. Heliyon, 10(11), e32628. https://doi.org/10.1016/j.heliyon.2024.e32628
Ouyang, F., Zheng, L., & Jiao, P. (2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27(6), 7893–7925. https://doi.org/10.1007/s10639-022-10925-9
Sallam, M., Elsayed, W., Al-Shorbagy, M., Barakat, M., El Khatib, S., Ghach, W., Alwan, N., Hallit, S., & Malaeb, D. (2024). ChatGPT usage and attitudes are driven by perceptions of usefulness, ease of use, risks, and psycho-social impact: A study among university students in the UAE. Frontiers in Education, 9, 1414758. https://doi.org/10.3389/feduc.2024.1414758
Sandu, R., Gide, E., & Elkhodr, M. (2024). The role and impact of ChatGPT in educational practices: Insights from an Australian higher education case study. Discover Education, 3, 71. https://doi.org/10.1007/s44217-024-00126-6
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, 15. https://doi.org/10.1186/s40561-023-00237-x
Weng, X., Xia, Q., Ahmad, Z., & Chiu, T. K. F. (2024). Personality traits for self-regulated learning with generative artificial intelligence: The case of ChatGPT. Computers and Education: Artificial Intelligence, 7, 100315. https://doi.org/10.1016/j.caeai.2024.100315
Youssef, E., Medhat, M., Abdellatif, S., & Al Malek, M. (2024). Examining the effect of ChatGPT usage on students’ academic learning and achievement: A survey-based study in Ajman, UAE. Computers and Education: Artificial Intelligence, 7, 100316. https://doi.org/10.1016/j.caeai.2024.100316
Kırcaburun, K. (2026). Generative AI use and critical thinking dispositions in higher education: A cross-sample study of the sequential role of metacognitive weakness and epistemic laziness. Journal of Intelligence, 14(7), 147. https://doi.org/10.3390/jintelligence14070147
