Applying Transfer Testing to Identify Annotation Discrepancies in Facial Emotion Data Sets

Creators: Dreher, Sarah and Gebele, Jens and Brune, Philipp
Title: Applying Transfer Testing to Identify Annotation Discrepancies in Facial Emotion Data Sets
Item Type: Book Section
Projects: TTZ-GZ
Page Range: pp. 157-174
Date: 27 October 2023
Divisions: Informationsmanagement
Abstract (ENG): The field of Artificial Intelligence (AI) has a significant impact on the way computers and humans interact. The topic of (facial) emotion recognition has gain a lot of attention in recent years. Majority of research literature focuses on improvement of algorithms and Machine Learning (ML) models for single data sets. Despite the impressive results achieved, the impact of the (training) data quality with its potential biases and annotation discrepancies is often neglected. Therefore, this paper demonstrates an approach to detect and evaluate annotation label discrepancies between three separate (facial) emotion recognition databases by a Transfer Test with three ML models. The findings indicate Transfer Testing to be a new promising method to detect inconsistencies in data annotations of emotional states, implying label bias and/or ambiguity. Therefore, Transfer Testing is a method to verify the transferability of trained ML models. Such research is the foundation for developing more accurate AI-based emotion recognition systems, which are also robust in real-life scenarios.
Forthcoming: No
Main areas or research: Transformationmanagement
Language: English
Citation:

Dreher, Sarah and Gebele, Jens and Brune, Philipp (2023) Applying Transfer Testing to Identify Annotation Discrepancies in Facial Emotion Data Sets. In: Proceedings of the 9th International Conference on Mobile, Secure and Programmable Networking - MSPN / Bouzeframe, S. et al. (Eds). Paris: Springer, pp. 157-174. (Lecture Notes in Computer Science; 14482). ISBN 9783031524264

Actions for admins (login required)

View Item in edit mode View Item in edit mode