A computational study on aging effect for facial expression recognition

Abstract

This work uses newly introduced variations of the sparse representation-based classifier (SRC) to challengethe issue of automatic facial expression recognition (FER) with faces belonging to a wide span of ages. Since facialexpression is one of the most powerful and immediate ways to disclose individuals’ emotions and intentions, the studyof emotional traits is an active research topic both in psychology and in engineering fields. To date, automatic FERsystems work well with frontal and clean faces, but disturbance factors can dramatically decrease their performance.Aging is a critical disruption element, which is present in any real-world situation and which can finally be consideredthanks to the recent introduction of new databases storing expressions over a lifespan. This study addresses the FERwith aging challenge using sparse coding (SC) that represents the input signal as the linear combination of the columnsof a dictionary. Dictionary learning (DL) is a subfield of SC that aims to learn from the training samples the bestspace capable of representing the query image. Focusing on one of the main challenges of SC, this work compares theperformance of recently introduced DL algorithms. We run both a mixed-age experiment, where all faces are mixed,and a within-age experiment, where faces of young, middle-aged, and old actors are processed independently. We firstwork with the entire face and then we improve our initial performance using only discriminative patches of the face.Experimental results provide a fair comparison between the two recently developed DL techniques. Finally, the samealgorithms are also tested on a database of expressive faces without the aging disturbance element, so as to evaluate DLalgorithms’ performance strictly on FER.