Enhanced AlexNet with Gabor and Local Binary Pattern Features for Improved Facial Emotion Recognition

Abstract

Facial emotion recognition (FER) is vital for improving human-machine interactions, serving as the foundation for AI systems that integrate cognitive and emotional intelligence. This helps bridge the gap between mechanical processes and human emotions, enhancing machine engagement with humans. Considering the constraints of low hardware specifications often encountered in real-world applications, this study leverages recent advances in deep learning to propose an enhanced model for FER. The model effectively utilizes texture information from faces through Gabor and Local Binary Pattern (LBP) feature extraction techniques. By integrating these features into a specially modified AlexNet architecture, our approach not only classifies facial emotions more accurately but also demonstrates significant improvements in performance and adaptability under various operational conditions. To validate the effectiveness of our proposed model, we conducted evaluations using the FER2013 and RAF-DB benchmark datasets, where it achieved impressive accuracies of 98.10% and 93.34% for the two datasets, with standard deviations of 1.63% and 3.62%, respectively. On the FER-2013 dataset, the model attained a precision of 98.2%, a recall of 97.9%, and an F1-score of 98.0%. Meanwhile, for the other dataset, it achieved a precision of 93.54%, a recall of 93.12%, and an F1-score of 93.34%. These results underscore the model's robustness and its capability to deliver high-precision emotion recognition, making it an ideal solution for deployment in environments where hardware limitations are a critical concern.

Keywords: AlexNet; deep learning; emotion recognition; feature extraction.

Figure 3

Emotion distribution in the FER2013 dataset.

Figure 4

Emotion distribution in the RAF-DB dataset.

Figure 1

Proposed method workflow.

Figure 2

Modified AlexNet architecture.

Figure 5

Performance metrics by emotion on the FER2013 dataset.

Figure 6

Performance metrics by emotion on the RAF-DB dataset.

Figure 7

Random experiment results of the proposed model.