Journal of Cognitive Human-Computer Interaction

Journal DOI

https://doi.org/10.54216/JCHCI

Submit Your Paper

2771-1463ISSN (Online) 2771-1471ISSN (Print)

Volume 8 , Issue 2 , PP: 32-45, 2024 | Cite this article as | XML | Html | PDF | Full Length Article

Personalized Music Playlists via Deep Learning Emotion Detection

M. Spoorthi 1 * , Harshitha H. M. 2 * , Pooja R. 3 , Anusha M. K. 4 * , Preethi R. 5

  • 1 Department of Information Science and Engineering, Maharaja Institute of Technology, Thandavapura, Mysore, India - (mspoorthi03@gmail.com)
  • 2 Department of Information Science and Engineering, Maharaja Institute of Technology, Thandavapura, Mysore, India - (harshitha@gmail.com)
  • 3 Department of Information Science and Engineering, Maharaja Institute of Technology, Thandavapura, Mysore, India - (poojarchnagar8@gmail.com)
  • 4 Department of Information Science and Engineering, Maharaja Institute of Technology, Thandavapura, Mysore, India. - (anu.anushakempraj@gmail.com)
  • 5 Department of Information Science and Engineering, Maharaja Institute of Technology, Thandavapura, Mysore, India - (preethi4mn20is020@gmail.com)
  • Doi: https://doi.org/10.54216/JCHCI.080204

    Received: October 24, 2023 Revised: January 27, 2024 Accepted: April 28, 2024
    Abstract

    Music holds significant sway in enriching the lives of individuals, serving as a vital source of entertainment for enthusiasts and listeners alike. Moreover, it transcends mere amusement, often adopting a therapeutic role in people’s lives. In the ever-evolving landscape of music and technology, this project emerges as a groundbreaking endeavor, driven by the profound impact music holds on individuals’ lives. Leveraging technological advancements in music players, such as playback control and genre classification, our focus is on revolutionizing playlist creation. Instead of the laborious manual curation of playlists, we introduce automation based on users’ emotional states, identified through real-time facial expression analysis via a camera. The human face, a rich source of mood indicators, becomes the key input for our system. By directly extracting emotional cues from facial expressions, the project aims to swiftly deduce the user’s emotional state, crafting a tailored playlist without the need for time-consuming manual efforts. Implemented through deep learning using VGG16 model, the system ensures intricate emotion recognition from image input. Python, OpenCV, and Keras facilitate seamless video processing and deep learning functionalities, complemented by a music player library for smooth playback control. This amalgamation of computer vision and deep learning delivers an interactive music player that dynamically selects tracks aligned with users’ real-time emotional expressions, offering a personalized and immersive musical experience.

    Keywords :

    Visual Geometry Group (VGG16) , Computer Vision , Emotion Detection , Deep Learning

    References

    [1]   ChaohuiLv, Shengnan Li and Linxiao Huang, “Music Emotion Recognition Based on Feature Analysis”, In proceedings 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI 2018) 2018.

    [2]   Mehmet Bilal Er and Ibrahim Berkan Aydilek, ” Music Emotion Recognition by Using Chroma Spectrogram and Deep Visual Features ”, International Journal of Computational Intelligence Systems, pp. 1622-1634, 2019.

    [3]   Harsha Vijay Bodhe, ” Movie and Music Recommendation System Based on Facial Expression ”, International Research Journal of Modernization in Engineering Technology and Science, pp. 1014-1019, Jauuary-2024.

    [4]   Chukwuemeka C Atabansi, Tong Chen, Ranlei Cao and Xueming Xu, ” Transfer Learning Technique with VGG-16 for Near-Infrared Facial Expression Recognition ”, Journal of Physics: Conference Series, pp. 1- 11, 2021.

    [5]   R. Venkatesan,M.Sumithra,B. Buvaneswari,R. Selvalingeshwaran. (2022). Food Ordering Systems' Newness. Journal of Cognitive Human-Computer Interaction, 4 ( 1 ), 15-20.

    [6]   M. Sumithra,B. Buvaneswar,Jessica Judith S,,Dymphna Mary C,Punitha R,,Pavithraa S. "Innovation for Better Education System using Artificial Intelligence." Journal of Cognitive Human-Computer Interaction, Vol. 2, No. 1, 2022 ,PP. 19-28.

    [7]   Indumathi S K, Sireesha K and Kavan MC, ” REAL TIME EMOTION BASED MUSIC PLAYER USINGCNN AR-

    CHITECTURES ”, EPRA International Journal of Multidisciplinary Research (IJMR), pp.272-278, July 2022.

    [8]   KrittrinChankuptarat, RaphatsakSriwatanaworachai and SupannadaChotipant, ” Emotion-Based Music Player”, In proceedings 978-1-7281-0067-8/19/$31.00 ©2019 IEEE.

    [9]   Pream Anand S.,Manamalli D.,Vasanthi D.,Mythily M.,Naveen N. E.. "Optimization of Performance Attributes Using RTDA Controller for Dual CSTR." Journal of Cognitive Human-Computer Interaction, Vol. 5, No. 1, 2023 ,PP. 08-19.

    [10]       Pradeep Kalansooriya, G. A. D Ganepola and T. S. Thalagala, ”Affective gaming in real-time emotion detection and music emotion recognition: Implementation approach with electroencephalogram ”, In proceedings 2020 International Research Conference on Smart Computing and System Engineering ( SCSE

    ), pp. 111-116, 2020

    [11]       Sulaiman Muhammad, Safeer Ahmed and Dinesh Naik, ” Real Time Emotion Based Music Player Using CNN Architectures ”, In proceedings 2021 6th International Conference for Convergence in Technology (I2CT) Pune, India, pp. 1-5, 2021.

    [12]       R. Manish,M. Sumithra,,Lokhitha D.,Mahalakshmi L.,Durga V.,Nirmala G.. "Accident Detection System Using GPS and GSM by IOT." Journal of Cognitive Human-Computer Interaction, Vol. 4, No. 1, 2022 ,PP. 39-51.

    [13]       S. Deebika, K. A. Indira and Dr. Jesline , ” A Machine Learning Based Music Player by Detecting Emotions ”, In proceedings 2019 Fifth International Conference on Science Technology Engineering and Mathematics (ICONSTEM), pp. 196-200, 2019.

    [14]       Prof.Siddaraj M G, Avais Ismail, Mohammed Aleem, Sanchitha H N and Supritha B U, ” Mood Based Music System Using Machine Learning Techniques ”, International Journal of Advances in Engineering and Management (IJAEM), pp. 1132-1136, 2022.

    [15]       Shubham S. Mishra, Krutika B. Abgul, Pallavi Patil and Umashankar Singh, ” Mood Recognition and Playlist Generator ”, International Journal of Research Publication and Reviews, pp. 2326-2330, October 2023.

    [16]       Gaikwad Uday Vijaysinh, Ghodake Shubham Shivaji, Mokalkar Renuka Ashok, and Jagtap HrutvikShahaji, ” Emotion based Music Recommendation System ”, International Journal of Innovative Science and Research Technology, pp. 542-545, December – 2022.

    [17]       M.Sree Vani and N.Sree Divya, ” EMOTION BASED MUSIC RECOMMENDATION SYSTEM ”, nternational Journal of Creative Research Thoughts (IJCRT), pp. 697-702, June 2022.

    [18]       P.VishaliM.Phil and Dr.V.Narayani, ” A Survey on Emotion-Based Music Player ”, International International Research Journal of Engineering and Technology (IRJET) , pp. 5888-5891, Mar 2020.

    [19]       Meena Talele, Yash Gurnani, Hirday Rochani, Manish Patil and Kapil Soneja, ” SMART MUSIC PLAYER USING MOOD DETECTION ”, International Research Journal of Modernization in Engineering Technology and Science , pp. 2201-2207, March 2022.

    [20]       Sarthak Kalpande, Ramkrishna Allampallewar, Prathamesh Vyavhare, Arun Kinwad and Saurabh Sargaiyye, ” EMOTION BASED MUSIC PLAYER ”, International Research Journal of Modernization in Engineering Technology and Science , pp. 2752-2753, May-2023.

    [21]       Gayatri Pranita Prabhakar Sutar, Kashish Kumari, Ritesh Pandey, Prof. Laxmikant Malphedwar and Dr. Rajesh V. Kherde, ” A PRELIMENERY REPORT ON EMOTION BASED API MUSIC PLAYER ”, International Research Journal of Modernization in Engineering Technology and Science , pp.2716-2722, May-2022.

    [22]       Manoj. K. N ,R. Adhithya. S ,A. H. Calvin ,Heaven. R. A ,K.S. Suriya. "Smart Parking System with IoT." Journal of Cognitive Human-Computer Interaction, Vol. 3, No. 2, 2022 ,PP. 08-15.

    [23]       Mrs. Madhuri Gurale, Sarthak Kalpande, Ramkrishna Allampallewar, Prathamesh Vyavhare, Arun Kinwad and Saurabh Sargaiyye, ” EMOTION BASED MUSIC PLAYER: ENHANCING MUSIC EXPERIENCES ”, pp. 7594-7598, May-

    2023.

    [24]       Chilipiti Mounika, Dr. Srinivasan Jagannathan and V Maruthi Prasad, ” SMART MUSIC PLAYER THAT IS BASED ON REAL-TIME FACIAL EXPRESSION IN REAL TIME ”, International Journal of Creative Research Thoughts (IJCRT), pp. 451-457, August 2022.

    [25]       Swarnalatha K.S ,ChitteniSai Sanjay, C Koushik, M Sai Krupananda and B M Charan, ” Emotion-Sensitive Music Player Leveraging Facial Recognition Technology ” In proceedings Emotion-Sensitive Music Player

    Cite This Article As :
    Spoorthi, M.. , H., Harshitha. , R., Pooja. , M., Anusha. , R., Preethi. Personalized Music Playlists via Deep Learning Emotion Detection. Journal of Cognitive Human-Computer Interaction, vol. , no. , 2024, pp. 32-45. DOI: https://doi.org/10.54216/JCHCI.080204
    Spoorthi, M. H., H. R., P. M., A. R., P. (2024). Personalized Music Playlists via Deep Learning Emotion Detection. Journal of Cognitive Human-Computer Interaction, (), 32-45. DOI: https://doi.org/10.54216/JCHCI.080204
    Spoorthi, M.. H., Harshitha. R., Pooja. M., Anusha. R., Preethi. Personalized Music Playlists via Deep Learning Emotion Detection. Journal of Cognitive Human-Computer Interaction , no. (2024): 32-45. DOI: https://doi.org/10.54216/JCHCI.080204
    Spoorthi, M. , H., H. , R., P. , M., A. , R., P. (2024) . Personalized Music Playlists via Deep Learning Emotion Detection. Journal of Cognitive Human-Computer Interaction , () , 32-45 . DOI: https://doi.org/10.54216/JCHCI.080204
    Spoorthi M. , H. H. , R. P. , M. A. , R. P. [2024]. Personalized Music Playlists via Deep Learning Emotion Detection. Journal of Cognitive Human-Computer Interaction. (): 32-45. DOI: https://doi.org/10.54216/JCHCI.080204
    Spoorthi, M. H., H. R., P. M., A. R., P. "Personalized Music Playlists via Deep Learning Emotion Detection," Journal of Cognitive Human-Computer Interaction, vol. , no. , pp. 32-45, 2024. DOI: https://doi.org/10.54216/JCHCI.080204