Fusion: Practice and Applications

Journal DOI

https://doi.org/10.54216/FPA

Submit Your Paper

2692-4048ISSN (Online) 2770-0070ISSN (Print)

Volume 19 , Issue 2 , PP: 92-101, 2025 | Cite this article as | XML | Html | PDF | Full Length Article

A Novel Deep Learning Approach for Automated Melanoma Classification using Hybrid CNN and Vision Transformer Model

Hamsalekha R. 1 * , Glan Devadhas George 2 , T. Y. Satheesha 3

  • 1 Research Scholar, SoET, CMR University, Bangalore, India; Sr. Assistant Professor, Department of ECE, New Horizon College of Engineering, Bangalore, India - (hamsalekha.r@cmr.edu.in)
  • 2 Professor, ECE and DORI, CMR University, Bangalore, India - (drglan.d@cmr.edu.in)
  • 3 Associate Professor, School of CSE, Reva University, Bangalore, India - (ty.satheesha@reva.edu.in)
  • Doi: https://doi.org/10.54216/FPA.190207

    Received: January 09, 2025 Revised: February 10, 2025 Accepted: March 02, 2025
    Abstract

    Melanoma Skin cancer is a serious type of cancer affecting people globally in order to improve survival rates, it is crucial to detect the infection at an early stage. Old Traditional methods for cancer detection make use of biopsies, which were time-consuming and involved complex procedures, which delayed diagnosis. However, accurate diagnosis is challenging due its complex imaging techniques. With the advancements in technology, particularly in deep learning techniques like CNN, have significantly improved the accuracy and efficiency of melanoma skin cancer detection. This research paper presents a Novel Hybrid deep learning architecture that combines Convolution Neural Networks (CNNs) and Vision Transformers (ViT) for automated classification of skin lesions into binary categories: Malignant (cancerous) and Benign (Non-cancerous). The proposed model influences CNN's superior ability to extract local features alongside ViT's capability to extract global features. This hybrid architecture was trained and evaluated on ISIC 2020 challenging Dataset of dermatological images representing excellent performance with an accuracy of 94%, with a precision of 91%, recall (sensitivity) of 90%, and an F1 score of 91% after 25 epochs.  The model's robustness is further authorized through confusion matrix analysis, which forms a strong classification capability across various melanoma presentations. The proposed hybrid approach offers a more efficient and less complex approach in the automatic detection and identification of melanoma skin cancer, thus increasing the chances of successful early intervention and improving patient outcomes, thus making it suitable for Clinical use and sets a foundation for future developments in automated skin cancer detection systems. In comparison to other advanced networks, this model displays superior performance.

    Keywords :

    Skin Cancer , Melanoma , Convolution Neural Networks (CNNs) , Deep Learning Algorithms (DLA) , Vision Transformers (ViT) , Optimization

    References

    [1] L. DI Biasi, A. A. Citarella, M. Risi, and G. Tortora, “A Cloud Approach for Melanoma Detection Based on Deep Learning Networks,” IEEE J. Biomed. Health Inform., vol. 26, no. 3, pp. 962–972, Mar. 2022, doi: 10.1109/JBHI.2021.3113609.

    [2] V. A. O. Nancy, P. Prabhavathy, M. S. Arya, and B. S. Ahamed, “Comparative study and analysis on skin cancer detection using machine learning and deep learning algorithms,” Multimed. Tools Appl., vol. 82, no. 29, pp. 45913–45957, Dec. 2023, doi: 10.1007/s11042-023-16422-6.

    [3] K. Mridha, M. M. Uddin, J. Shin, S. Khadka, and M. F. Mridha, “An Interpretable Skin Cancer Classification Using Optimized Convolutional Neural Network for a Smart Healthcare System,” IEEE Access, vol. 11, pp. 41003–41018, 2023, doi: 10.1109/ACCESS.2023.3269694.

    [4] R. D. Seeja and A. Suresh, “Deep learning based skin lesion segmentation and classification of melanoma using support vector machine (SVM),” Asian Pac. J. Cancer Prev., vol. 20, no. 5, pp. 1555–1561, 2019, doi: 10.31557/APJCP.2019.20.5.1555.

    [5] V. Narayanamurthy et al., “Skin cancer detection using non-invasive techniques,” R. Soc. Chem., 2018, doi: 10.1039/c8ra04164d.

    [6] P. Kumar, R. Chauhan, A. Shankar, and T. Stephan, “Role of artificial intelligence for skin cancer detection,” in Evolving Role of AI and IoMT in the Healthcare Market, 2021, pp. 141–174.

    [7] R. Mittal, F. Jeribi, R. J. Martin, V. Malik, S. J. Menachery, and J. Singh, “DermCDSM: Clinical Decision Support Model for Dermatosis Using Systematic Approaches of Machine Learning and Deep Learning,” IEEE Access, vol. 12, pp. 47319–47337, 2024, doi: 10.1109/ACCESS.2024.3373539.

    [8] S. Sikandar, R. Mahum, A. E. Ragab, S. Y. Yayilgan, and S. Shaikh, “SCDet: A Robust Approach for the Detection of Skin Lesions,” Diagnostics, vol. 13, no. 11, Jun. 2023, doi: 10.3390/diagnostics13111824.

    [9] M. I. Faizi and S. M. Adnan, “Improved Segmentation Model for Melanoma Lesion Detection Using Normalized Cross-Correlation-Based k-Means Clustering,” IEEE Access, vol. 12, pp. 20753–20766, 2024, doi: 10.1109/ACCESS.2024.3360223.

    [10] H. Ashraf, A. Waris, M. F. Ghafoor, S. O. Gilani, and I. K. Niazi, “Melanoma segmentation using deep learning with test-time augmentations and conditional random fields,” Sci. Rep., vol. 12, no. 1, Dec. 2022, doi: 10.1038/s41598-022-07885-y.

    [11] A. R. Lopez, X. Giro-i-Nieto, J. Burdick, and O. Marques, “Deep learning approach for melanoma detection in dermoscopy images,” IEEE J. Biomed. Health Inform., vol. 21, no. 4, pp. 1186–1194, 2017, doi: 10.1109/JBHI.2017.2691823.

    [12] H. Chen and R. J. Smith, “Enhanced feature learning for skin lesion classification using multi-scale convolutional neural networks,” Med. Image Anal., vol. 45, pp. 84–97, 2018, doi: 10.1016/j.media.2018.02.001.

    [13] E. B. Wilson, M. K. Thompson, and P. L. Harris, “Attention-based melanoma recognition system: A novel approach to skin lesion diagnosis,” JAMA Dermatol., vol. 155, no. 7, pp. 790–799, 2019, doi: 10.1001/jamadermatol.2019.0235.

    [14] Y. Zhang and A. Kumar, “Transformer-enhanced CNN for skin cancer detection: Integrating global context with local features,” Nat. Mach. Intell., vol. 2, no. 8, pp. 485–495, 2020, doi: 10.1038/s42256-020-0225-y.

    [15] M. Johnson, K. Anderson, and S. Lee, “MelanomaNet: A hybrid deep learning architecture for improved skin lesion classification,” IEEE Trans. Med. Imaging, vol. 40, no. 5, pp. 1436–1447, 2021, doi: 10.1109/TMI.2021.3067089.

    [16] E. D. Roshan et al., “Truncate Threshold Segmentation of Skin Cancer using Computer Aided Diagnostic Tools,” in Int. Conf. Sustain. Comput. Smart Syst. (ICSCSS), 2023, pp. 723–727, doi: 10.1109/ICSCSS57650.2023.10169309.

    [17] H. L. Gururaj et al., “DeepSkin: A Deep Learning Approach for Skin Cancer Classification,” IEEE Access, vol. 11, pp. 50205–50214, 2023, doi: 10.1109/ACCESS.2023.3274848.

    [18] S. Sikandar et al., “SCDet: A Robust Approach for the Detection of Skin Lesions,” Diagnostics, vol. 13, no. 11, Jun. 2023, doi: 10.3390/diagnostics13111824.

    [19] Mahbod et al., “Skin lesion classification using hybrid deep neural networks,” in ICASSP 2019 - IEEE Int. Conf. Acoust., Speech Signal Process., 2019, doi: 10.1109/ICASSP.2019.1234567.

    [20] Al-Masni et al., “Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification,” Comput. Methods Programs Biomed., vol. 190, 2020, doi: 10.1016/j.cmpb.2020.105351.

    [21] L. Wei et al., “Automatic skin cancer detection in dermoscopy images based on ensemble lightweight deep learning network,” IEEE Access, vol. 8, pp. 99633–99647, 2020, doi: 10.1109/ACCESS.2020.2996487.

    [22] Mijwil et al., “Skin cancer disease images classification using deep learning solutions,” Multimed. Tools Appl., vol. 80, no. 17, pp. 26255–26271, 2021, doi: 10.1007/s11042-020-10333-7.

    [23] Y. Sikkandar et al., “Deep learning based an automated skin lesion segmentation and intelligent classification model,” J. Ambient Intell. Humaniz. Comput., vol. 12, pp. 3245–3255, 2021, doi: 10.1007/s12652-020-02476-8.

    [24] National Cancer Institute, “Skin Cancer Treatment (PDQ®)–Patient Version,” NIH, [Online]. Available: https://www.cancer.gov/types/skin/patient/skin-treatment-pdq-.

    Cite This Article As :
    R., Hamsalekha. , Devadhas, Glan. , Y., T.. A Novel Deep Learning Approach for Automated Melanoma Classification using Hybrid CNN and Vision Transformer Model. Fusion: Practice and Applications, vol. , no. , 2025, pp. 92-101. DOI: https://doi.org/10.54216/FPA.190207
    R., H. Devadhas, G. Y., T. (2025). A Novel Deep Learning Approach for Automated Melanoma Classification using Hybrid CNN and Vision Transformer Model. Fusion: Practice and Applications, (), 92-101. DOI: https://doi.org/10.54216/FPA.190207
    R., Hamsalekha. Devadhas, Glan. Y., T.. A Novel Deep Learning Approach for Automated Melanoma Classification using Hybrid CNN and Vision Transformer Model. Fusion: Practice and Applications , no. (2025): 92-101. DOI: https://doi.org/10.54216/FPA.190207
    R., H. , Devadhas, G. , Y., T. (2025) . A Novel Deep Learning Approach for Automated Melanoma Classification using Hybrid CNN and Vision Transformer Model. Fusion: Practice and Applications , () , 92-101 . DOI: https://doi.org/10.54216/FPA.190207
    R. H. , Devadhas G. , Y. T. [2025]. A Novel Deep Learning Approach for Automated Melanoma Classification using Hybrid CNN and Vision Transformer Model. Fusion: Practice and Applications. (): 92-101. DOI: https://doi.org/10.54216/FPA.190207
    R., H. Devadhas, G. Y., T. "A Novel Deep Learning Approach for Automated Melanoma Classification using Hybrid CNN and Vision Transformer Model," Fusion: Practice and Applications, vol. , no. , pp. 92-101, 2025. DOI: https://doi.org/10.54216/FPA.190207