Emotion detection from facial expression using image processing

P. Kanagaraju; M. A. Ranjith; K. Vijayasarathy

doi:10.53730/ijhs.v6nS6.9748

Authors

P. Kanagaraju Assistant professor in Computer Science and Engineering, K.S.Rangasamy College of Technology, Tiruchengode-637 215, Namakkal District, Tamil Nadu, India
M. A. Ranjith Students of Computer Science and Engineering, K.S.Rangasamy College of Technology, Tiruchengode-637 215, Namakkal District, Tamil Nadu, India
K. Vijayasarathy Students of Computer Science and Engineering, K.S.Rangasamy College of Technology, Tiruchengode-637 215, Namakkal District, Tamil Nadu, India

Keywords:

convolutional neural network, image processing, facial expression recognition, real time testing, emotion based video

Abstract

Abstract: Facial expression recognition is a powerful tool for communicating our emotions, understanding, and intent with each other. It is an intelligent human-computer interaction technology. Various studies have been conducted to classify facial expressions. Six fundamental universal emotions can be expressed through facial expressions: happiness, sadness, anger, fearful, surprised, and neutral. In this project, emotion detection can be implemented in real time with the help of a webcam. Our work proposed a CNN-based VGG16 architecture for emotion detection systems. A model would be trained by using the FER-2013 dataset. Then the images from the dataset are first pre-processed, which includes operations such as image scaling, changing the colour mode, and so on. Following that, a CNN model with multiple layers was created. After that, the model would be trained with the specified dataset, resulting in the .h5 file, which is a pre-trained model file. Instead of repeatedly training the model, the results can be predicted using this file.

Downloads

Download data is not yet available.

References

Ning Zhou, Renyu Liang, and Wenqian Shi (2020), “A Lightweight Convolutional Neural Network for Real-Time Facial Expression Detection”, IEEE Access, vol. 9, pp. 5573-5584.

Aya Hassouneh, Mutawa A.M., and Murugappan M. (2020), “Development of a Real-Time Emotion Recognition System using Facial Expression and EEG based on machine learning and deep neural network methods”, Science Direct on Informatics in Medicine Unlocked, vol. 20.

Yuanyuan Ding, Qin Zhao, Baoqing Li, and Xiaobing Yuan (2017), “Facial Expression Recognition from Image Sequence Based on LBP and Taylor Expansion”, IEEE Access, vol. 5, pp. 19409-19419.

Biao Yang, Jinmeng Cao, Rongrong Ni, and Yuyu Zhang (2017), “Facial Expression Recognition using Weighted Mixture Deep Neural Network Based on Double-Channel Facial Images”, IEEE Access, vol. 6, pp. 4630-4650.

[5]Ithaya Rani P., and Muneeswaran K. (2018), “Emotion Recognition based on facial components”, Indian Academy of Science.

Guihua Wen, Tianyuan Chang, Huihui Li, and Lijun Jiang (2020), “Dynamic Objectives Learning for Facial Expression Recognition”, IEEE Transactions on Multimedia, vol. 22, pp. 2914-2925.

Pawel Tarnowski, Marcin Kolodziej, Andrzej Majkowski, and Remigiusz J. Rak (2017), “Emotion recognition using facial expression”, Science Direct on Procedia Computer Science, vol. 108, pp. 1175-1184.

Charvi Jain, Kshitij Sawant, Mohammed Rehman, and Rajesh Kumar (2018), “Emotion Detection and characterization using Facial Features”, 3rd International Conference and workshops on Recent Advance and Innovations in Engineering (ICRAIE).

Shivam Gupta (2018), “Facial emotion recognition in real-time and static images”, 2nd International Conference on Inventive System and Control (ICISC).

Leonid Ivanovsky, Vladimir Khryashchev, Anton Lebedev, and Igor Kosterin (2017), “Facial Expression Recognition Algorithm Based on Deep Convolution Neural Network”, 21st Conference of Open Innovations Association (FRUCT).

[11] Sanghyuk Kim, Gwon Hwan An, and Suk-Ju Kang (2017), “Facial Expression Recognition System using Machine Learning”, International SoC Design Conference (ISOCC).

Alaramzana Nujun Navaz, Serhani Mohamed Adel, and Sujith Samuel Mthew (2019), “Facial Image Pre-Processing and Emotion Classification: A Deep learning Approach”, IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA).

Mehemet Akif Ozdemir, Berkay Elaggoz, Aysegul Alaybeyoglu, Reza Sadighzadeh, and Aydin Akan (2019), “Real Time Emotion Recognition from Facial Expressions using CNN Architecture”, Medical Technologies Congress (TIPTEKNO).

Parvathi D.S.L., Leelavathi N., Ravikumar J.M.S.V., and Sujatha B. (2020), “Emotion Analysis using Deep Learning”, International Conference on Electronics and Sustainable Communication Systems (ICESC).

Yassine Rabhi, Makrem Mrabet, Farhat Fnaiech, and Mounir Sayadi (2018), “A Real-time Emotion Recognition System for disabled persons”, 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

Shekhar Singh, and Fatma Nasoz (2020), “Facial Expression Recognition with Convolutional Neural Networks”,10th Annual Computing and Communication workshop and Conference (CCWC).

Kustina, K.T., Dewi, G.A.A.O., Prena, G.D., Suryasa, W. (2019). Branchless banking, third-party funds, and profitability evidence reference to banking sector in indonesia. Journal of Advanced Research in Dynamical and Control Systems, 11(2), 290-299.

Suryasa, I. W., Rodríguez-Gámez, M., & Koldoris, T. (2021). Get vaccinated when it is your turn and follow the local guidelines. International Journal of Health Sciences, 5(3), x-xv. https://doi.org/10.53730/ijhs.v5n3.2938

Kusumawati, A. H., Wulan, I. R., & Ridwanuloh, D. (2020). Formulation and physical evaluation sheet mask from red rice (Oryza Nivara) and virgin coconut oil (Cocos Nucifera L). International Journal of Health & Medical Sciences, 3(1), 60-64. https://doi.org/10.31295/ijhms.v3n1.148