Convolutional Neural Network With Batch Normalization for Classification of Emotional Expressions Based on Facial Images
DOI:
https://doi.org/10.30812/matrik.v21i1.1526Keywords:
Convolutional Neural Network, Batch Normalization, Classification, Emotional Expressions, Facial ImagesAbstract
Emotion recognition through facial images is one of the most challenging topics in human psychological interactions with machines. Along with advances in robotics, computer graphics, and computer vision, research on facial expression recognition is an important part of intelligent systems technology for interactive human interfaces where each person may have different emotional expressions, making it difficult to classify facial expressions and requires training data. large, so the deep learning approach is an alternative solution., The purpose of this study is to propose a different Convolutional Neural Network (CNN) model architecture with batch normalization consisting of three layers of multiple convolution layers with a simpler architectural model for the recognition of emotional expressions based on human facial images in the FER2013 dataset from Kaggle. The experimental results show that the training accuracy level reaches 98%, but there is still overfitting where the validation accuracy level is still 62%. The proposed model has better performance than the model without using batch normalization.
Downloads
Download data is not yet available.
References
[1] V. P. Jr, C. Bortolini, H. R. Gamba, G. B. Borba, and H. Medeiros, “Facial Expression Classification Using Convolutional Neural Network and Support Vector Machine,†in Conference: WVC 2016 - Workshop de Visão Computacional, At Campo Grande, Mato Grosso, Brazil, 2016, no. November, pp. 329–333.
[2] N. Meeki, A. Amine, M. A. Boudia, and N. Meeki, “Deep Learning for Non Verbal Sentiment Analysis : Facial Emotional Expressions,†in GeCoDe Laboratory, Department of Computer Science, Tahar Moulay University of Saida., 2020, vol. 3014, pp. 1–11.
[3] S. Agarwal, B. Santra, and D. P. Mukherjee, “Anubhav: recognizing emotions through facial expression,†Vis. Comput., vol. 34, no. 2, pp. 177–191, 2018.
[4] M. M and M. A, “Facial geometric feature extraction based emotional expression classification using machine learning algorithms,†PLoS One, vol. 16, no. 2, pp. 1–12, 2021.
[5] A. Hassouneh, A. M. Mutawa, and M. Murugappan, “Development of a Real-Time Emotion Recognition System Using Facial Expressions and EEG based on machine learning and deep neural network methods,†Informatics Med. Unlocked, vol. 20, p. 100372, 2020.
[6] M. Bedeloglu et al., “Image-based Analysis of Emotional Facial Expressions in Full Face Transplants,†J. Med. Syst., vol. 42, no. 3, pp. 1–10, 2018.
[7] Y. Lu, S. Wang, W. Zhao, and Y. Zhao, “WGAN-Based Robust Occluded Facial Expression Recognition,†IEEE Access, vol. 7, pp. 93594–93610, 2019.
[8] M. Magdin, L. Benko, and Š. Koprda, “A case study of facial emotion classification using affdex,†Sensors, vol. 19, no. 9, pp. 1–17, 2019.
[9] D. M. Watson, B. B. Brown, and A. Johnston, “A data-driven characterisation of natural facial expressions when giving good and bad news,†PLoS Comput. Biol., vol. 16, no. 10, pp. 1–13, 2020.
[10] F. Qin, J. Guo, and W. Sun, “Object-oriented ensemble classification for polarimetric SAR Imagery using restricted Boltzmann machines,†Remote Sens. Lett., vol. 8, no. 3, pp. 204–213, 2017.
[11] L. Duran-Lopez, J. P. Dominguez-Morales, A. F. Conde-Martin, S. Vicente-Diaz, and A. Linares-Barranco, “PROMETEO: A CNN-Based Computer-Aided Diagnosis System for WSI Prostate Cancer Detection,†IEEE Access, vol. 8, pp. 128613–128628, 2020.
[12] G. H. de Rosa and J. P. Papa, “Soft-Tempering Deep Belief Networks Parameters Through Genetic Programming,†J. Artif. Intell. Syst., vol. 1, no. 1, pp. 43–59, 2019.
[13] D. Hamester, P. Barros, and S. Wermter, “Face expression recognition with a 2-channel Convolutional Neural Network,†Proc. Int. Jt. Conf. Neural Networks, vol. 2015-Septe, no. July, pp. 1787–1794, 2015.
[14] A. George and S. Marcel, “Learning One Class Representations for Face Presentation Attack Detection Using Multi-Channel Convolutional Neural Networks,†IEEE Trans. Inf. Forensics Secur., vol. 16, pp. 361–375, 2021.
[15] B. K. Triwijoyo, “Model Fast Tansfer Learning pada Jaringan Syaraf Tiruan Konvolusional untuk Klasifikasi Gender Berdasarkan Citra Wajah,†MATRIK J. Manajemen, Tek. Inform. dan Rekayasa Komput., vol. 18, no. 2, pp. 211–221, 2019.
[2] N. Meeki, A. Amine, M. A. Boudia, and N. Meeki, “Deep Learning for Non Verbal Sentiment Analysis : Facial Emotional Expressions,†in GeCoDe Laboratory, Department of Computer Science, Tahar Moulay University of Saida., 2020, vol. 3014, pp. 1–11.
[3] S. Agarwal, B. Santra, and D. P. Mukherjee, “Anubhav: recognizing emotions through facial expression,†Vis. Comput., vol. 34, no. 2, pp. 177–191, 2018.
[4] M. M and M. A, “Facial geometric feature extraction based emotional expression classification using machine learning algorithms,†PLoS One, vol. 16, no. 2, pp. 1–12, 2021.
[5] A. Hassouneh, A. M. Mutawa, and M. Murugappan, “Development of a Real-Time Emotion Recognition System Using Facial Expressions and EEG based on machine learning and deep neural network methods,†Informatics Med. Unlocked, vol. 20, p. 100372, 2020.
[6] M. Bedeloglu et al., “Image-based Analysis of Emotional Facial Expressions in Full Face Transplants,†J. Med. Syst., vol. 42, no. 3, pp. 1–10, 2018.
[7] Y. Lu, S. Wang, W. Zhao, and Y. Zhao, “WGAN-Based Robust Occluded Facial Expression Recognition,†IEEE Access, vol. 7, pp. 93594–93610, 2019.
[8] M. Magdin, L. Benko, and Š. Koprda, “A case study of facial emotion classification using affdex,†Sensors, vol. 19, no. 9, pp. 1–17, 2019.
[9] D. M. Watson, B. B. Brown, and A. Johnston, “A data-driven characterisation of natural facial expressions when giving good and bad news,†PLoS Comput. Biol., vol. 16, no. 10, pp. 1–13, 2020.
[10] F. Qin, J. Guo, and W. Sun, “Object-oriented ensemble classification for polarimetric SAR Imagery using restricted Boltzmann machines,†Remote Sens. Lett., vol. 8, no. 3, pp. 204–213, 2017.
[11] L. Duran-Lopez, J. P. Dominguez-Morales, A. F. Conde-Martin, S. Vicente-Diaz, and A. Linares-Barranco, “PROMETEO: A CNN-Based Computer-Aided Diagnosis System for WSI Prostate Cancer Detection,†IEEE Access, vol. 8, pp. 128613–128628, 2020.
[12] G. H. de Rosa and J. P. Papa, “Soft-Tempering Deep Belief Networks Parameters Through Genetic Programming,†J. Artif. Intell. Syst., vol. 1, no. 1, pp. 43–59, 2019.
[13] D. Hamester, P. Barros, and S. Wermter, “Face expression recognition with a 2-channel Convolutional Neural Network,†Proc. Int. Jt. Conf. Neural Networks, vol. 2015-Septe, no. July, pp. 1787–1794, 2015.
[14] A. George and S. Marcel, “Learning One Class Representations for Face Presentation Attack Detection Using Multi-Channel Convolutional Neural Networks,†IEEE Trans. Inf. Forensics Secur., vol. 16, pp. 361–375, 2021.
[15] B. K. Triwijoyo, “Model Fast Tansfer Learning pada Jaringan Syaraf Tiruan Konvolusional untuk Klasifikasi Gender Berdasarkan Citra Wajah,†MATRIK J. Manajemen, Tek. Inform. dan Rekayasa Komput., vol. 18, no. 2, pp. 211–221, 2019.
Downloads
Published
2021-11-27
Issue
Section
Articles
How to Cite
[1]
B. K. Triwijoyo, A. Adil, and A. Anggrawan, “Convolutional Neural Network With Batch Normalization for Classification of Emotional Expressions Based on Facial Images”, MATRIK, vol. 21, no. 1, pp. 197–204, Nov. 2021, doi: 10.30812/matrik.v21i1.1526.
Similar Articles
- Ni Wayan Sumartini Saraswati, I Wayan Dharma Suryawan, Ni Komang Tri Juniartini, I Dewa Made Krishna Muku, Poria Pirozmand, Weizhi Song, Recognizing Pneumonia Infection in Chest X-Ray Using Deep Learning , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 23 No. 1 (2023)
- sayuti rahman, Marwan Ramli, Arnes Sembiring, Muhammad Zen, Rahmad B.Y Syah, Normalization Layer Enhancement in Convolutional Neural Network for Parking Space Classification , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 23 No. 3 (2024)
- Bambang Suprihatin, Yuli Andriani, Fauziah Nuraini Kurdi, Anita Desiani, Ibra Giovani Dwi Putra, Muhammad Akmal Shidqi, Lungs X-Ray Image Segmentation and Classification of Lung Disease using Convolutional Neural Network Architectures , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 23 No. 1 (2023)
- Muhammad Furqan Nazuli, Muhammad Fachrurrozi, Muhammad Qurhanul Rizqie, Abdiansah Abdiansah, Muhammad Ikhsan, A Image Classification of Poisonous Plants Using the MobileNetV2 Convolutional Neural Network Model Method , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 24 No. 2 (2025)
- Miftahus Sholihin, Mohd Farhan Bin Md. Fudzee, Lilik Anifah, A Novel CNN-Based Approach for Classification of Tomato Plant Diseases , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 24 No. 3 (2025)
- Melinda Melinda, Zharifah Muthiah, Fitri Arnia, Elizar Elizar, Muhammad Irhmasyah, Image Data Acquisition and Classification of Vannamei Shrimp Cultivation Results Based on Deep Learning , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 23 No. 3 (2024)
- Bambang Krismono Triwijoyo, Model Fast Tansfer Learning pada Jaringan Syaraf Tiruan Konvolusional untuk Klasifikasi Gender Berdasarkan Citra Wajah , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 18 No. 2 (2019)
- Sri Suwarno, Erick Kurniawan, Multi-Level Pooling Model for Fingerprint-Based Gender Classification , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 22 No. 2 (2023)
- Fitra Ahya Mubarok, Mohammad Reza Faisal, Dwi Kartini, Dodon Turianto Nugrahadi, Triando Hamonangan Saragih, Gender Classification of Twitter Users Using Convolutional Neural Network , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 23 No. 1 (2023)
- Tjut Awaliyah Zuraiyah, Sufiatul Maryana, Asep Kohar, Automatic Door Access Model Based on Face Recognition using Convolutional Neural Network , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 22 No. 1 (2022)
1-10 of 125
Next
You may also start an advanced similarity search for this article.
Most read articles by the same author(s)
- Christofer Satria, Anthony Anggrawan, Aplikasi K-Means berbasis Web untuk Klasifikasi Kelas Unggulan , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 21 No. 1 (2021)
- Donny Kurniawan, Anthony Anggrawan, Hairani Hairani, Graduation Prediction System on Students Using C4.5 Algorithm , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 19 No. 2 (2020)
- Ni Gusti Ayu Dasriani, Mayadi Mayadi, Anthony Anggrawan, Klasterisasi Lokasi Promosi PMB Dengan Fuzzy C-means Masa Pandemi Covid 19 , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 21 No. 2 (2022)
- Khaerul Yasin, Ahmat Adil, Implementasi Google Maps API Pemetaan Jalur Evakuasi Bencana Alam di Kabupatem Lombok Utara , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 19 No. 1 (2019)
- Kiki Rizki, Ahmat Adil, Implementasi Google Maps Api Berbasis Android untuk Lokasi Fasilitas Umum di Kabupaten Sumbawa , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 17 No. 2 (2018)
- Christofer Satria, Peter Wijaya Sugijanto, Anthony Anggrawan, I Nyoman Yoga Sumadewa, Aprilia Dwi Dayani, Rini Anggriani, Multi-Algorithm Approach to Enhancing Social Assistance Efficiency Through Accurate Poverty Classification , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 24 No. 1 (2024)
- Mayadi Mayadi, Anthony Anggrawan, Pengembangan Sistem Informasi Pemantauan Harga Beras dan Gabah dengan Short Message Gateway , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 21 No. 2 (2022)
- Dadang Priyanto, Bambang Krismono Triwijoyo, Deny Jollyta, Hairani Hairani, Ni Gusti Ayu Dasriani, Data Mining Earthquake Prediction with Multivariate Adaptive Regression Splines and Peak Ground Acceleration , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 22 No. 3 (2023)
- Muhammad Tajuddin, Ahmat Adil, Andi Sofyan Anas, Game for Sasak Script Based on Knuth Morris Pratt Algorithm and ADDIE Model , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 22 No. 1 (2022)
- Ni Gusti Ayu Dasriani, Anthony Anggrawan, Pengembangan Sistem Aplikasi Cerdas Memprediksi Penjualan Mebel Berbasis website , MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer: Vol. 21 No. 1 (2021)
.png)
