Towards Dynamic and AI‑Based Multimodal Cognitive‑Load Assessment with Low‑Hardware Setup for Programming Learning

Creators: Kostarev, Pavel and Bartel, Alexander
Title: Towards Dynamic and AI‑Based Multimodal Cognitive‑Load Assessment with Low‑Hardware Setup for Programming Learning
Item Type: Conference or Workshop Item
Event Title: (Proceedings of the) 12th International Conference on Higher Education Advances (HEAd’26)
Event Location: Valencia, Spain
Event Dates: June, 15-16, 2026
Page Range: pp. 973-980
Additional Information: Open Access
Date: 30 June 2026
Divisions: Informationsmanagement
Abstract (ENG): In this paper, we address the issue of accessibility in personalized learning for undergraduate students in programming education. We have designed an adaptive learning framework that uses continuous data collection through eye tracking and mouse movements to measure overall cognitive load (CL) in short intervals. The aim is to provide students with constructive, continuous feedback in the form of brief hints generated by a Large Language Model (LLM). Our paper streamlines the methodology and makes the concept of adaptive learning approachable by designing a lightweight model for CL assessment via pupil dilation, blink rate and mouse click patterns. This reduces deployment costs, since the model can be run on any PC with a standard webcam. It also ensures privacy and empowers researchers with affordable tools for collecting longitudinal evidence for long-term studies.
Forthcoming: No
Language: English
Uncontrolled Keywords: Cognitive load estimation ; Human‑computer interaction (HCI) in education ; Learning Analytics ; Adaptive Learning ; Eye-tracking ; Mouse-movement analytics
Link eMedia: Download
Citation:

Kostarev, Pavel and Bartel, Alexander (2026) Towards Dynamic and AI‑Based Multimodal Cognitive‑Load Assessment with Low‑Hardware Setup for Programming Learning. In: (Proceedings of the) 12th International Conference on Higher Education Advances (HEAd’26), June, 15-16, 2026, Valencia, Spain, pp. 973-980.

Actions for admins (login required)

View Item in edit mode (academic staff only) View Item in edit mode (academic staff only)