Automatic Classification of Emotions Based on Cardiac Signals: A Systematic Literature Review
- PMID: 37543539
- DOI: 10.1007/s10439-023-03341-8
Automatic Classification of Emotions Based on Cardiac Signals: A Systematic Literature Review
Abstract
Emotions play a pivotal role in human cognition, exerting influence across diverse domains of individuals' lives. The widespread adoption of artificial intelligence and machine learning has spurred interest in systems capable of automatically recognizing and classifying emotions and affective states. However, the accurate identification of human emotions remains a formidable challenge, as they are influenced by various factors and accompanied by physiological changes. Numerous solutions have emerged to enable emotion recognition, leveraging the characterization of biological signals, including the utilization of cardiac signals acquired from low-cost and wearable sensors. The objective of this work was to comprehensively investigate the current trends in the field by conducting a Systematic Literature Review (SLR) that focuses specifically on the detection, recognition, and classification of emotions based on cardiac signals, to gain insights into the prevailing techniques employed for signal acquisition, the extracted features, the elicitation process, and the classification methods employed in these studies. A SLR was conducted using four research databases, and articles were assessed concerning the proposed research questions. Twenty seven articles met the selection criteria and were assessed for the feasibility of using cardiac signals, acquired from low-cost and wearable devices, for emotion recognition. Several emotional elicitation methods were found in the literature, including the algorithms applied for automatic classification, as well as the key challenges associated with emotion recognition relying solely on cardiac signals. This study extends the current body of knowledge and enables future research by providing insights into suitable techniques for designing automatic emotion recognition applications. It emphasizes the importance of utilizing low-cost, wearable, and unobtrusive devices to acquire cardiac signals for accurate and accessible emotion recognition.
Keywords: Artificial intelligence; Automatic emotion recognition; Cardiac signal; Electrocardiography; Heart rate variability; Photoplethysmography; Physiological signal processing; Wearable emotion recognition.
© 2023. The Author(s) under exclusive licence to Biomedical Engineering Society.
Similar articles
-
Advancing emotion recognition with Virtual Reality: A multimodal approach using physiological signals and machine learning.Comput Biol Med. 2025 Jul;193:110310. doi: 10.1016/j.compbiomed.2025.110310. Epub 2025 May 26. Comput Biol Med. 2025. PMID: 40424763
-
Emotion recognition in EEG signals using deep learning methods: A review.Comput Biol Med. 2023 Oct;165:107450. doi: 10.1016/j.compbiomed.2023.107450. Epub 2023 Sep 9. Comput Biol Med. 2023. PMID: 37708717 Review.
-
Multi-physiological signal fusion for objective emotion recognition in educational human-computer interaction.Front Public Health. 2024 Nov 26;12:1492375. doi: 10.3389/fpubh.2024.1492375. eCollection 2024. Front Public Health. 2024. PMID: 39659721 Free PMC article.
-
An Ensemble Learning Approach for Electrocardiogram Sensor Based Human Emotion Recognition.Sensors (Basel). 2019 Oct 16;19(20):4495. doi: 10.3390/s19204495. Sensors (Basel). 2019. PMID: 31623279 Free PMC article.
-
Electrocardiogram-Based Emotion Recognition Systems and Their Applications in Healthcare-A Review.Sensors (Basel). 2021 Jul 23;21(15):5015. doi: 10.3390/s21155015. Sensors (Basel). 2021. PMID: 34372252 Free PMC article. Review.
Cited by
-
Multimodal automatic assessment of acute pain through facial videos and heart rate signals utilizing transformer-based architectures.Front Pain Res (Lausanne). 2024 Mar 27;5:1372814. doi: 10.3389/fpain.2024.1372814. eCollection 2024. Front Pain Res (Lausanne). 2024. PMID: 38601923 Free PMC article.
References
-
- Abadi, M. K., R. Subramanian, S. M. Kia, P. Avesani, I. Patras, and N. Sebe. DECAF: MEG-based multimodal database for decoding affective physiological responses. IEEE Trans. Affect. Comput. 2015. https://doi.org/10.1109/TAFFC.2015.2392932 . - DOI
-
- Al-Nafjan, A., M. Hosny, Y. Al-Ohali, and A. Al-Wabil. Review and classification of emotion recognition based on EEG brain-computer interface system re-search: a systematic review. Appl. Sci. 2017. https://doi.org/10.3390/app7121239 . - DOI
-
- Althobaiti, T., S. Katsigiannis, D. West, M. Bronte-Stewart, and N. Ramzan. Affect detection for human-horse interaction. In: 2018 21st Saudi Computer Society National Computer Conference (NCC). IEEE. 2018. https://doi.org/10.1109/NCG.2018.8593113
-
- Anand, A., A. Vijayvargiya, V. Moorthy, and S. Kumar. EmoSens: emotion recognition based on sensor data analysis using LightGBM. arXiv preprint. 2022; https://doi.org/10.48550/arXiv.2207.14640
-
- Arora, M., and M. Kumar. AutoFER: PCA and PSO based automatic facial emotion recognition. Multimed. Tools Appl. 2021. https://doi.org/10.1007/s11042-020-09726-4 . - DOI
Publication types
LinkOut - more resources
Full Text Sources
Miscellaneous