Cognitively informed reading embeddings from eye-tracking for programming learning materials in German

Creators: Kostarev, Pavel and Bartel, Alexander
Title: Cognitively informed reading embeddings from eye-tracking for programming learning materials in German
Item Type: Conference or Workshop Item
Event Title: (Proceedings of the) 18th annual International Conference on Education and New Learning Technologies (EDULEARN26)
Event Location: Palma, Spain
Event Dates: June, 29 - July, 1, 2026
Paper No. / Type of Paper: 1445
Date: 24 July 2026
Divisions: Informationsmanagement
Abstract (ENG): Modern adaptive learning environments require difficulty estimates that reflect how learners process text while reading. In order to implicitly identify parts of text associated with a higher overall cognitive load, we present a reading embedding model based on individual eye tracking data. To achieve this, we combine pre-trained German sentence and word embeddings with eye-tracking-based labels that summarise the overall reader's cognitive load and serve as a metric for sentence-level reading difficulty. For each sentence, we extract a sentence embedding from a pre-trained German Transformer encoder and aggregate the embeddings of all its tokens into a sentence-level word representation. We then compute a continuous difficulty score derived from fixation durations, fixation counts, pupil size, and blink count in the eye-tracking data. A small neural adapter then maps the concatenated sentence- and word-level representations into a lower-dimensional space and predicts the corresponding sentence-level difficulty score. Using a small proprietary eye‑tracking dataset, we show that the resulting embedding can distinguish sentence‑level reading effort for unseen items, enabling meaningful ranking of candidate rewrites as relatively easier or harder. Our model can be integrated into adaptive learning systems and large language model–based rewriting tools, where its difficulty estimates can inform the selection of alternative phrasings that facilitate the explanation of programming concepts with reduced cognitive load. We also outline the requirements for expanding the approach to larger datasets and evaluating it on a greater number of students.
Forthcoming: No
Language: English
Uncontrolled Keywords: AI-driven Learning Analytics; Personalized Learning; Eye-tracking; Word embedding models
Link eMedia: Download
Citation:

Kostarev, Pavel and Bartel, Alexander (2026) Cognitively informed reading embeddings from eye-tracking for programming learning materials in German. In: (Proceedings of the) 18th annual International Conference on Education and New Learning Technologies (EDULEARN26), June, 29 - July, 1, 2026, Palma, Spain, Paper 1445. ISBN 9788409884445

Actions for admins (login required)

View Item in edit mode (academic staff only) View Item in edit mode (academic staff only)