Facial emotion recognition in presence of speech using a default ARTMAP classifier

Abstract

This paper proposes a scheme for facial emotion recognition in the presence of speech, i.e. the interacting subjects are also speaking. We propose the usage of default ARTMAP, a variant of fuzzy ARTMAP, as a classifier for facial emotions using feature vectors derived from facial animation parameters (FAP). The proposed scheme is tested on Interactive Emotional Dyadic Motion Capture (IEMOCAP) database. The results show the effectiveness of the approach as a standalone facial emotion classifier as well as its relatively superior performance on IEMOCAP in comparison to the existing similar approaches.