2690-6791ISSN (Online)
2769-786XISSN (Print)
Volume 14 , Issue 1 , PP: 141-153, 2025 | Cite this article as | XML | Html | PDF | Full Length Article
Rajesh .D 1 , S. Thenappan 2 * , Prachi Juyal 3 , Thiyagarajan .V .S 4 , D. M. Kalai Selvi 5 , J. Rajeswari 6 , M. Hema Kumar 7 , V. Saravanan 8
Doi: https://doi.org/10.54216/JISIoT.140111
Facial emotion recognition (FER) technology in autonomous vehicle drivers can considerably strengthen the efficiency and safety of the driving experience. The system can analyze facial expressions in real-time by employing advanced computer vision (CV) techniques, which identify emotions such as stress, fatigue, or distraction. This enables the vehicle to adapt its behavior, triggering interventions or alerts where applicable to alleviate possible threats. Ensuring the emotional well-being of the driver promotes a safer road environment, improving overall road safety and diminishing the possibility of accidents in the era of autonomous vehicles. FER using (Deep Learning) DL is an advanced technique that leverages deep neural network (DNN) to automatically interpret and identify emotions from facial expressions. DL algorithms, especially Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) have attained outstanding results in this field since they allow us to learn temporal dependencies hierarchy and features within the data. This research develops a novel Computer Vision with Optimal DL-based Emotion Recognition (CVODL-ER) model for Autonomous Vehicle Drivers. The CVODL-ER method concentrates on the automated classification of various sorts of emotions of autonomous vehicle drives. To accomplish this, the CVODL-ER technique makes use of the SE-ResNet model for learning intrinsic patterns from the driver's facial images. Besides, the hyper parameter tuning of the SE-ResNet model takes place via a quasi-oppositional Jaya (QO-Jaya) algorithm. For the recognition of driver emotions, the CVODL-ER system executes the deep belief network (DBN) algorithm. The performance analysis of the CVODL-ER technique takes place using a benchmark facial image database. The obtained results underline the improved efficiency of the CVODL-ER technique over other models.
Facial Emotion Recognition , Autonomous Vehicle Drive , Computer Vision , Jaya Algorithm , Deep Learning
[1] Sini, J., Marceddu, A.C. and Violante, M., 2020. Automatic emotion recognition for the calibration of autonomous driving functions. Electronics, 9(3), p.518.
[2] Lee, K.H., 2020, October. Design of a convolutional neural network for speech emotion recognition. In 2020 International Conference on Information and Communication Technology Convergence (ICTC) (pp. 1332-1335). IEEE.
[3] Kandeel, A.A., Abbas, H.M. and Hassanein, H.S., 2021, January. Explainable Model Selection of a Convolutional Neural Network for Driver’s Facial Emotion Identification. In International Conference on Pattern Recognition (pp. 699-713). Springer, Cham.
[4] Izquierdo-Reyes, J., Ramirez-Mendoza, R.A., Bustamante-Bello, M.R., Pons-Rovira, J.L. and Gonzalez-Vargas, J.E., 2018. Emotion recognition for semi-autonomous vehicles framework. International Journal on Interactive Design and Manufacturing (IJIDeM), 12(4), pp.1447-1454.
[5] Lu, H., Liu, Q., Tian, D., Li, Y., Kim, H. and Serikawa, S., 2019. The cognitive internet of vehicles for autonomous driving. IEEE Network, 33(3), pp.65-73.
[6] Meshram, H.A., Sonkusare, M.G., Acharya, P. and Prakash, S., 2020, November. Facial Emotional Expression Regulation to Control the Semi-Autonomous Vehicle Driving. In 2020 IEEE International Conference for Innovation in Technology (INOCON) (pp. 1-5). IEEE.
[7] Shafaei, S., Hacizade, T. and Knoll, A., 2018, December. Integration of driver behavior into emotion recognition systems: a preliminary study on the steering wheel and vehicle acceleration. In Asian Conference on Computer Vision (pp. 386-401). Springer, Cham.
[8] Garg, M., Ubhi, J.S. and Aggarwal, A.K., 2022. Neural style transfer for image steganography and destylization with supervised image-to-image translation. Multimedia Tools and Applications, pp.1-18.
[9] Chen, L., Lin, S., Lu, X., Cao, D., Wu, H., Guo, C., Liu, C. and Wang, F.Y., 2021. Deep neural network based vehicle and pedestrian detection for autonomous driving: a survey. IEEE Transactions on Intelligent Transportation Systems, 22(6), pp.3234-3246.
[10] Arefnezhad, S., Eichberger, A., Frühwirth, M., Kaufmann, C., Moser, M. and Koglbauer, I.V., 2022. Driver Monitoring of Automated Vehicles by Classification of Driver Drowsiness using a Deep Convolutional Neural Network Trained by Scalograms of ECG Signals. Energies, 15(2), p.480
[11] Jain, D.K., Dutta, A.K., Verdú, E., Alsubai, S. and Sait, A.R.W., 2023. An automated hyperparameter tuned deep learning model enabled facial emotion recognition for autonomous vehicle drivers. Image and Vision Computing, 133, p.104659.
[12] Said, Y. and Barr, M., 2021. Human emotion recognition based on facial expressions via deep learning on high-resolution images. Multimedia Tools and Applications, 80(16), pp.25241-25253.
[13] Zaman, K., Sun, Z., Shah, S.M., Shoaib, M., Pei, L. and Hussain, A., 2022. Driver Emotions recognition based on improved faster R-CNN and neural architectural search network. Symmetry, 14(4), p.687.
[14] Saranya, R., Vijayaragavan, M., Kalilulah, S.I., Satyanarayana, K.N.V., Suresh, M. and Srimathi, S., 2023, December. Automated Facial Emotion Detection using Arithmetic Optimization Algorithm with Deep Convolutional Neural Network for Autonomous Vehicle Drivers. In 2023 2nd International Conference on Automation, Computing and Renewable Systems (ICACRS) (pp. 823-828). IEEE.
[15] Chen, J., Dey, S., Wang, L., Bi, N. and Liu, P., 2021, July. Multi-modal fusion enhanced model for driver’s facial expression recognition. In 2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (pp. 1-4). IEEE.
[16] Sahoo, G.K., Das, S.K. and Singh, P., 2022, May. Deep learning-based facial emotion recognition for driver healthcare. In 2022 National Conference on Communications (NCC) (pp. 154-159). IEEE.
[17] Sarvakar, K., Senkamalavalli, R., Raghavendra, S., Kumar, J.S., Manjunath, R. and Jaiswal, S., 2023. Facial emotion recognition using convolutional neural networks. Materials Today: Proceedings, 80, pp.3560-3564.
[18] Chand, H.V. and Karthikeyan, J., 2022. CNN Based Driver Drowsiness Detection System Using Emotion Analysis. Intelligent Automation & Soft Computing, 31(2).
[19] Chen, T., Qin, H., Li, X., Wan, W. and Yan, W., 2023. A Non-Intrusive Load Monitoring Method Based on Feature Fusion and SE-ResNet. Electronics, 12(8), p.1909.
[20] Jiang, X., Hong, Z., Feng, Y. and Tan, J., 2024. Multi-Objective Optimization of VBHF in Deep Drawing Based on the Improved QO-Jaya Algorithm. Chinese Journal of Mechanical Engineering, 37(1), p.5.
[21] Yin, X., Huang, X., Pan, Y. and Liu, Q., 2023. Point and interval estimation of rock mass boreability for tunnel boring machine using an improved attribute-weighted deep belief network. Acta Geotechnica, 18(4), pp.1769-1791.
[22] Lundqvist, D.; Flykt, A.; Öhman, A. Karolinska directed emotional faces. Cogn. Emot. 1998. https://kdef.se/
[23] KMU-FED. Available online: http://cvpr.kmu.ac.kr/KMU-FED.htm
