Navigating compiler errors with AI assistance - a study of GPT hints in an introductory programming course
Date
2024
Authors
Pankiewicz, M.
Baker, R.S.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE, 2024, vol.1, pp.94-100
Statement of Responsibility
Conference Name
29th Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE) (8 Jul 2024 - 10 Jul 2024 : Milan, Italy)
Abstract
We examined the efficacy of AI-assisted learning in an introductory programming course at the university level by using a GPT-4 model to generate personalized hints for compiler errors within a platform for automated assessment of programming assignments. The control group had no access to GPT hints. In the experimental condition GPT hints were provided when a compiler error was detected, for the first half of the problems in each module. For the latter half of the module, hints were disabled. Students highly rated the usefulness of GPT hints. In affect surveys, the experimental group reported significantly higher levels of focus and lower levels of confrustion (confusion and frustration) than the control group. For the six most commonly occurring error types we observed mixed results in terms of performance when access to GPT hints was enabled for the experimental group. However, in the absence of GPT hints, the experimental group's performance surpassed the control group for five out of the six error types.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright 2024 ACM