Algorithmic feedback vs. human feedback
A comparative study of generative AI in STEM assessment practices
DOI:
https://doi.org/10.32674/c2d27f86Keywords:
algorithmic feedback, formative assessment, generative AI, higher education, STEM educationAbstract
Generative AI has renewed interest in automated formative feedback, yet evidence from STEM assessment remains limited. This comparative study examined algorithmic and human feedback in undergraduate Biology, Chemistry, and Calculus courses. 126 students were assigned to a course to receive either large language model-generated feedback or instructor feedback on a draft constructed-response task. Outcomes included revision quality, transfer performance, expert audit ratings of feedback, and student perceptions. Algorithmic feedback was substantially faster and more extensive, but human feedback was more accurate, more actionable, more aligned with the rubric, and associated with greater revision gains and higher transfer scores. Students also reported greater trust, usefulness, fairness, and overall satisfaction with human feedback.
References
Ba, S., Yang, L., Yan, Z., Looi, C. K., & Gašević, D. (2025). Unraveling the mechanisms and effectiveness of AI-assisted feedback in education: A systematic literature review. Computers and Education Open, 9, Article 100284. https://doi.org/10.1016/j.caeo.2025.100284
Bearman, M., Tai, J., Dawson, P., Boud, D., & Ajjawi, R. (2024). Developing evaluative judgement for a time of generative artificial intelligence. Assessment & Evaluation in Higher Education, 49(6), 893-905. https://doi.org/10.1080/02602938.2024.2335321
Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315-1325. https://doi.org/10.1080/02602938.2018.1463354
CAST. (2024). Universal Design for Learning Guidelines version 3.0 [Graphic organizer]. https://udlguidelines.cast.org
Chamola, V., Dave, D., Goyal, I., & Sharma, S. (2026). Generative artificial intelligence in STEM education: A review of applications, benefits, and challenges. Expert Systems, 43(2), Article e70201. https://doi.org/10.1111/exsy.70201
Cooper, G., Ilich, K., & Sturrock, K. (2026). Using generative artificial intelligence to reimagine feedback in higher education: A collaborative autoethnography. Assessment & Evaluation in Higher Education. Advance online publication. https://doi.org/10.1080/02602938.2026.2653889
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228-239. https://doi.org/10.1080/14703297.2023.2190148
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2019). What makes for effective feedback: Staff and student perspectives. Assessment & Evaluation in Higher Education, 44(1), 25-36. https://doi.org/10.1080/02602938.2018.1467877
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-112. https://doi.org/10.3102/003465430298487
Henderson, M., Bearman, M., Chung, J., Fawns, T., Buckingham Shum, S., Matthews, K. E., & de Mello Heredia, J. (2025). Comparing generative AI and teacher feedback: Student perceptions of usefulness and trustworthiness. Assessment & Evaluation in Higher Education. Advance online publication. https://doi.org/10.1080/02602938.2025.2502582
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Stadler, M., Weller, J., Kuhn, J., & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. https://doi.org/10.1016/j.lindif.2023.102274
Narciss, S. (2013). Designing and evaluating tutoring feedback strategies for digital learning environments on the basis of the interactive tutoring feedback model. Digital Education Review, 23, 7-26. https://revistes.ub.edu/index.php/der/article/view/11284
Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199-218. https://doi.org/10.1080/03075070600572090
Nyaaba, M., & Zhai, X. (2026). Generative AI-based automated assessment generation. In X. Zhai & G. Lee (Eds.), Artificial Intelligence for STEM education research (pp. 39-59). Springer. https://doi.org/10.1007/978-3-032-06565-0_3
OECD. (2026). OECD Digital Education Outlook 2026: Exploring effective uses of generative AI in education. OECD Publishing. https://doi.org/10.1787/062a7394-en
Pardo, A. (2018). A feedback model for data-rich learning experiences. Assessment & Evaluation in Higher Education, 43(3), 428-438. https://doi.org/10.1080/02602938.2017.1356905
Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189. https://doi.org/10.3102/0034654307313795
Steinert, S., Avila, K. E., Ruzika, S., Kuhn, J., & Küchemann, S. (2024). Harnessing large language models to develop research-based learning assistants for formative feedback. Smart Learning Environments, 11, Article 62. https://doi.org/10.1186/s40561-024-00354-1
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024). Comparing the quality of human and ChatGPT feedback of students’ writing. Learning and Instruction, 91, Article 101894. https://doi.org/10.1016/j.learninstruc.2024.101894
Weidlich, J., Gotsch, F., Schudel, K., Marusic-Würscher, C., Mazzarella, J., Bolten, H., Bütler, D., Luger, S., Wohlfender, B., & Maag Merki, K. (2025). Teacher, peer, or AI? Comparing effects of feedback sources in higher education. Computers and Education Open, 9, Article 100300. https://doi.org/10.1016/j.caeo.2025.100300
Winstone, N. E., Gravett, K., Bearman, M., Noble, C., Jensen, L. X., Jones, A., & Nicola-Richmond, K. (2026). The care-full craft of feedback in an age of generative AI. Assessment & Evaluation in Higher Education, 1-17. https://doi.org/10.1080/02602938.2026.2643333
Winstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2017). Supporting learners’ agentic engagement with feedback: A systematic review and a taxonomy of recipience processes. Educational Psychologist, 52(1), 17-37. https://doi.org/10.1080/00461520.2016.1207538
Wisniewski, B., Zierer, K., & Hattie, J. (2020). The power of feedback revisited: A meta-analysis of educational feedback research. Frontiers in Psychology, 10, Article 3087. https://doi.org/10.3389/fpsyg.2019.03087
Zhang, K., Li, S., & Huang, Y. (2026). Generative AI-driven feedback in higher education: A scoping review. Assessment & Evaluation in Higher Education, 1-18. https://doi.org/10.1080/02602938.2026.2617157
Additional Files
Published
Issue
Section
License
Copyright (c) 2026 Joedel Peñaranda
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) [year] [author]
This work is licensed under a Creative Commons Attribution 4.0 International License.
This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. https://creativecommons.org/licenses/by/4.0
Call for Special Issue Proposals 
