Modeling Emotion Recognition System from Facial Images Using Convolutional Neural Networks
DOI:
https://doi.org/10.21512/commit.v18i2.8873Keywords:
Emotion Recognition, Facial Images, Convolutional Neural NetworksAbstract
Emotion classification is the process of identifying human emotions. Implementing technology to help people with emotional classification is considered a relatively popular research field. Until now, most of the work has been done to automate the recognition of facial cues (e.g., expressions) from several modalities (e.g., image, video, audio, and text). Deep learning architecture such as Convolutional Neural Networks (CNN) demonstrates promising results for emotion recognition. The research aims to build a CNN model while improving accuracy and performance. Two models are proposed in the research with some hyperparameter tuning followed by two datasets and other existing architecture that will be used and compared with the proposed architecture. The two datasets used are Facial Expression Recognition 2013 (FER2013) and Extended Cohn-Kanade (CK+), both of which are commonly used datasets in FER. In addition, the proposed model is compared with the previous model using the same setting and dataset. The result shows that the proposed models with the CK+ dataset gain higher accuracy, while some models with the FER2013 dataset have lower accuracy compared to previous research. The model trained with the FER2013 dataset has lower accuracy because of overfitting. Meanwhile, the model trained with CK+ has no overfitting problem. The research mainly explores the CNN model due to limited resources and time.
Plum Analytics
References
J. Sujanaa and S. Palanivel, “Fusion of deep-CNN and texture features for emotion recognition using support vector machines,” International Journal of Engineering Research & Technology (IJERT), vol. 9, no. 5, pp. 286–291, 2021.
P. Ekman and W. Friesen, Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press, 1978.
P. Ekman, W. V. Friesen, and J. C. Hager, Facial action coding system. Human Face, 2002.
P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews, “The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression,” in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, 2010, pp. 94–101.
A. Jaiswal, A. K. Raju, and S. Deb, “Facial emotion detection using deep learning,” in 2020 International Conference for Emerging Technology (INCET). IEEE, 2020, pp. 1–5.
M. M. T. Zadeh, M. Imani, and B. Majidi, “Fast facial emotion recognition using convolutional neural networks and Gabor filters,” in 2019 5th Conference on Knowledge Based Engineering and Innovation (KBEI). IEEE, 2019, pp. 577–581.
M. A. Shejwadkar, C. M. D. Souza, V. B. M. Raj, and V. J. Fernandes, “Facial emotion recognition using convolutional neural network,” International Journal of Research in Engineering, Science and Management, vol. 4, no. 7, pp. 288–290, 2021.
I. Lasri, A. R. Solh, and M. El Belkacemi, “Facial emotion recognition of students using convolutional neural network,” in 2019 Third International Conference on Intelligent Computing In Data Sciences (ICDS). IEEE, 2019, pp. 1–6.
A. Verma, P. Singh, and J. S. R. Alex, “Modified convolutional neural network architecture analysis for facial emotion recognition,” in 2019 International Conference on Systems, Signals And Image Processing (IWSSIP). IEEE, 2019, pp. 169–173.
S. Modi and M. H. Bohara, “Facial emotion recognition using convolution neural network,” in 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS). IEEE, 2021, pp. 1339–1344.
R. Jadhav, J. Bhuke, and N. Patil, “Facial emotion detection using convolutional neural network,” International Research Journal of Engineering and Technology (IRJET), vol. 6, no. 5, pp. 1077–1082, 2019.
E. Pranav, S. Kamal, C. S. Chandran, and M. H. Supriya, “Facial emotion recognition using deep convolutional neural network,” in 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS). IEEE, 2020, pp. 317–320.
N. Jain, S. Kumar, A. Kumar, P. Shamsolmoali, and M. Zareapoor, “Hybrid deep neural networks for face emotion recognition,” Pattern Recognition Letters, vol. 115, pp. 101–106, 2018.
A. Chowanda, “Separable convolutional neural networks for facial expressions recognition,” Journal of Big Data, vol. 8, pp. 1–17, 2021.
H. Yang, J. Han, and K. Min, “A multi-column CNN model for emotion recognition from EEG signals,” Sensors, vol. 19, no. 21, pp. 1–12, 2019.
M. K. Chowdary, T. N. Nguyen, and D. J. Hemanth, “Deep learning-based facial emotion recognition for human–computer interaction applications,” Neural Computing and Applications, vol. 35, no. 32, pp. 23 311–23 328, 2023.
M. A. H. Akhand, S. Roy, N. Siddique, M. A. S. Kamal, and T. Shimamura, “Facial emotion recognition using transfer learning in the deep CNN,” Electronics, vol. 10, no. 9, pp. 1–19, 2021.
C. Li, Z. Bao, L. Li, and Z. Zhao, “Exploring temporal representations by leveraging attentionbased bidirectional LSTM-RNNs for multi-modal emotion recognition,” Information Processing & Management, vol. 57, no. 3, 2020.
D. Y. Liliana, “Emotion recognition from facial expression using deep convolutional neural network,” in 2018 International Conference of Computer and Informatics Engineering (IC2IE), vol. 1193. IOP Publishing, 2019, pp. 1–5.
T. Mitchell, Machine learning. McGraw Hill, 1997.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Jasen Wanardi Kusno, Andry Chowanda
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License - Share Alike that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
USER RIGHTS
All articles published Open Access will be immediately and permanently free for everyone to read and download. We are continuously working with our author communities to select the best choice of license options, currently being defined for this journal as follows: Creative Commons Attribution-Share Alike (CC BY-SA)
