1
Department of Information Technology, Panimalar Engineering College, Chennai, India
(karthikeyan.b32@gmail.com)
2
C.K. College of Engineering&Technology, Cuddalore-607003, India
(seethan1989@gmail.com)
3
Department of Computer Scienec and Engineering, Sona College of Technology, Salem, India
(nandinivijaykumar@sonatech.ac.in)
4
Department of Computer Science and Engineering, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Saveetha University, Chennai, Tamil Nadu, India
(vinothd.sse@saveetha.com)
5
Department of Cyber Security, Paavai Engineering College( Autonomous), Namakkal, India
(muthu.namakkal@gmail.com)
6
Associate Dean, College of Engineering, Prairie View A & M University, Texas, USA
(kibellam@pvamu.edu)
Abstract :
Lung cancer detection is the process of detecting the presence of lung tumor or abnormalities in the lungs. Early diagnosis is crucial for increasing the chances of patient survival and successful treatment. When compared to X-rays, Computed Tomography (CT) images are more sensitive and are increasingly being used for the diagnosis and screening of lung tumors. They provide complete cross-sectional images of the lungs and it will even detect small lesions. AI and Machine learning (ML) approaches are most commonly employed to analyse medical images (e.g. CT scans) and detect lung cancer. This algorithm can help radiologists identify patterns indicative or subtle abnormalities of cancer. Medical diagnosis, particularly in complex diseases such as lung cancer, frequently involves ambiguity. The diagnostic system can alleviate ambiguity via cross-verifying findings from various sources by fusing multimodal features. Multimodal feature fusion using deep learning (DL) algorithm is an advanced technology that leverages the abilities of deep neural networks to combine data from three different modalities or sources for better robustness in several applications, namely natural language processing, image, and data analysis, etc. This study introduces a Multimodal Feature Fusion using an Optimal Transfer Learning Method for Lung Cancer Detection and Classification (MFFOTL-LCDC) methodology on CT images. The chief objective of the MFFOTL-LCDC methodology is to exploit the feature fusion process for the identification and classification of lung tumor. To attain this, the MFFOTL-LCDC model undergoes a multimodal feature fusion approach to derive feature vectors using 3 DL approaches such as SqueezeNet, CapsNet, and Inception v3 models. Besides, the MFFOTL-LCDC technique applies the remora optimization algorithm (ROA) for the hyperparameter choice of 3 DL models. For lung cancer recognition, the MFFOTL-LCDC algorithm exploits the deep extreme learning machine (DELM) algorithm. A series of simulations were conducted to ensure the greater lung cancer recognition outcomes of the MFFOTL-LCDC methodology. The extensive outcomes determine the improved results of the MFFOTL-LCDC technique over recent DL approaches.
Keywords :
Lung cancer; Multimodality; Feature fusion; Deep learning; CT images; Computer-aided diagnosis
References :
[1] Tyagi, S. and Talbar, S.N., 2023. LCSCNet: A multi-level approach for lung cancer stage classification using 3D dense convolutional neural networks with concurrent squeeze-and-excitation module. Biomedical Signal Processing and Control, 80, p.104391.
[2] Agarwal, A., Patni, K. and Rajeswari, D., 2021, July. Lung cancer detection and classification based on alexnet CNN. In 2021 6th International Conference on Communication and Electronics Systems (ICCES) (pp. 1390-1397). IEEE.
[3] Sourlos, N., Wang, J., Nagaraj, Y., van Ooijen, P. and Vliegenthart, R., 2022. Possible Bias in Supervised Deep Learning Algorithms for CT Lung Nodule Detection and Classification. Cancers, 14(16), p.3867.
[4] Riquelme, D. and Akhloufi, M.A., 2020. Deep learning for lung cancer nodules detection and classification in CT scans. Ai, 1(1), pp.28-67.
[5] Saturi, S. and Sandhya, B., 2022, October. Cancer Detection and Classification Using 3D-Convolutional Neural Networks. In 2022 IEEE 2nd Mysore Sub Section International Conference (MysuruCon) (pp. 1-7). IEEE.
[6] Zhao, H., Su, Y., Lyu, Z., Tian, L., Xu, P., Lin, L., Han, W. and Fu, P., 2023. Non-invasively Discriminating the Pathological Subtypes of Non-small Cell Lung Cancer with Pretreatment 18F-FDG PET/CT Using Deep Learning. Academic Radiology.
[7] Sajja, T., Devarapalli, R. and Kalluri, H., 2019. Lung Cancer Detection Based on CT Scan Images by Using Deep Transfer Learning. Traitement du Signal, 36(4), pp.339-344.
[8] Masood, A., Sheng, B., Yang, P., Li, P., Li, H., Kim, J. and Feng, D.D., 2020. Automated decision support system for lung cancer detection and classification via enhanced RFCN with multilayer fusion RPN. IEEE Transactions on Industrial Informatics, 16(12), pp.7791-7801.
[9] Varchagall, M., Nethravathi, N.P., Chandramma, R., Nagashree, N. and Athreya, S.M., 2023. Using Deep Learning Techniques to Evaluate Lung Cancer Using CT Images. SN Computer Science, 4(2), p.173.
[10] Rahman, M.S., Shill, P.C. and Homayra, Z., 2019, February. A new method for lung nodule detection using deep neural networks for CT images. In 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE) (pp. 1-6). IEEE.
[11] Raza, R., Zulfiqar, F., Khan, M.O., Arif, M., Alvi, A., Iftikhar, M.A. and Alam, T., 2023. Lung-EffNet: Lung cancer classification using EfficientNet from CT-scan images. Engineering Applications of Artificial Intelligence, 126, p.106902.
[12] Chenyang, L. and Chan, S.C., 2020. A joint detection and recognition approach to lung cancer diagnosis from CT images with label uncertainty. IEEE Access, 8, pp.228905-228921.
[13] Vaiyapuri, T., Liyakathunisa, Alaskar, H., Parvathi, R., Pattabiraman, V. and Hussain, A., 2022. Cat swarm optimization-based computer-aided diagnosis model for lung cancer classification in computed tomography images. Applied Sciences, 12(11), p.5491.
[14] Vishwa Kiran, S., Kaur, I., Thangaraj, K., Saveetha, V., Kingsy Grace, R. and Arulkumar, N., 2023. Machine Learning with Data Science-Enabled Lung Cancer Diagnosis and Classification Using Computed Tomography Images. International Journal of Image and Graphics, 23(03), p.2240002.
[15] Shankara, C. and Hariprasad, S.A., 2022. Artificial neural network for lung cancer detection using CT images. International Journal of Health Sciences, (II), pp.2708-2724.
[16] Gugulothu, V.K. and Balaji, S., 2023. A novel deep learning approach for the detection and classification of lung nodules from CT images. Multimedia Tools and Applications, pp.1-24.
[17] Nawreen, N., Hany, U. and Islam, T., 2021, July. Lung cancer detection and classification using CT scan image processing. In 2021 International Conference on Automation, Control and Mechatronics for Industry 4.0 (ACMI) (pp. 1-6). IEEE.
[18] Gugulothu, V.K. and Balaji, S., 2023. An early prediction and classification of lung nodule diagnosis on CT images based on hybrid deep learning techniques. Multimedia Tools and Applications, pp.1-21.
[19] Merlin Linda, G., Sree Rathna Lakshmi, N.V.S., Murugan, N.S., Mahapatra, R.P., Muthukumaran, V. and Sivaram, M., 2022. Intelligent recognition system for viewpoint variations on gait and speech using CNN-CapsNet. International Journal of Intelligent Computing and Cybernetics, 15(3), pp.363-382.
[20] Tsivgoulis, M., Papastergiou, T. and Megalooikonomou, V., 2022. An improved SqueezeNet model for the diagnosis of lung cancer in CT scans. Machine Learning with Applications, 10, p.100399.
[21] Reddy, A.S.K., Rao, K.B., Soora, N.R., Shailaja, K., Kumar, N.S., Sridharan, A. and Uthayakumar, J., 2023. Multi-modal fusion of deep transfer learning based COVID-19 diagnosis and classification using chest x-ray images. Multimedia Tools and Applications, 82(8), pp.12653-12677.
[22] Sasmal, B., Hussien, A.G., Das, A., Dhal, K.G. and Saha, R., 2023. Reptile Search Algorithm: Theory, Variants, Applications, and Performance Evaluation. Archives of Computational Methods in Engineering, pp.1-29.
[23] Wang, H., Luo, J., Zhu, G. and Li, Y., 2023. Enhanced Whale Optimization Algorithm with Wavelet Decomposition for Lithium Battery Health Estimation in Deep Extreme Learning Machines. Applied Sciences, 13(18), p.10079.
[24] http://www.via.cornell.edu/lungdb.html
[25] Yang, E., Shankar, K., Kumar, S., Seo, C., & Moon, I. (2023). Equilibrium Optimization Algorithm with Deep Learning Enabled Prostate Cancer Detection on MRI Images. Biomedicines, 11(12), 3200.
[26] Lakshmanaprabu, S.K., Mohanty, S.N., Shankar, K., Arunkumar, N. and Ramirez, G., 2019. Optimal deep learning model for classification of lung cancer on CT images. Future Generation Computer Systems, 92, pp.374-382.
[27] Vidyul Narayanan, Nithya P., Sathya M.. "Effective lung cancer detection using deep learning network." Journal of Cognitive Human-Computer Interaction, Vol. 5, No. 2, 2023 ,PP. 15-23 (Doi : https://doi.org/10.54216/JCHCI.050202)
| Style | # |
|---|---|
| MLA | B. Karthikeyan, N. Seethalakshmi, V. Nandhini, D. Vinoth, P. Muthusamy, Kiran Bellam. "Multimodal Feature Fusion Using Optimal Transfer Learning Approach for Lung Cancer Detection and Classification on CT Images." Journal of Intelligent Systems and Internet of Things, Vol. 12, No. 1, 2024 ,PP. 84-96 (Doi : https://doi.org/10.54216/JISIoT.120107) |
| APA | B. Karthikeyan, N. Seethalakshmi, V. Nandhini, D. Vinoth, P. Muthusamy, Kiran Bellam. (2024). Multimodal Feature Fusion Using Optimal Transfer Learning Approach for Lung Cancer Detection and Classification on CT Images. Journal of Journal of Intelligent Systems and Internet of Things, 12 ( 1 ), 84-96 (Doi : https://doi.org/10.54216/JISIoT.120107) |
| Chicago | B. Karthikeyan, N. Seethalakshmi, V. Nandhini, D. Vinoth, P. Muthusamy, Kiran Bellam. "Multimodal Feature Fusion Using Optimal Transfer Learning Approach for Lung Cancer Detection and Classification on CT Images." Journal of Journal of Intelligent Systems and Internet of Things, 12 no. 1 (2024): 84-96 (Doi : https://doi.org/10.54216/JISIoT.120107) |
| Harvard | B. Karthikeyan, N. Seethalakshmi, V. Nandhini, D. Vinoth, P. Muthusamy, Kiran Bellam. (2024). Multimodal Feature Fusion Using Optimal Transfer Learning Approach for Lung Cancer Detection and Classification on CT Images. Journal of Journal of Intelligent Systems and Internet of Things, 12 ( 1 ), 84-96 (Doi : https://doi.org/10.54216/JISIoT.120107) |
| Vancouver | B. Karthikeyan, N. Seethalakshmi, V. Nandhini, D. Vinoth, P. Muthusamy, Kiran Bellam. Multimodal Feature Fusion Using Optimal Transfer Learning Approach for Lung Cancer Detection and Classification on CT Images. Journal of Journal of Intelligent Systems and Internet of Things, (2024); 12 ( 1 ): 84-96 (Doi : https://doi.org/10.54216/JISIoT.120107) |
| IEEE | B. Karthikeyan, N. Seethalakshmi, V. Nandhini, D. Vinoth, P. Muthusamy, Kiran Bellam, Multimodal Feature Fusion Using Optimal Transfer Learning Approach for Lung Cancer Detection and Classification on CT Images, Journal of Journal of Intelligent Systems and Internet of Things, Vol. 12 , No. 1 , (2024) : 84-96 (Doi : https://doi.org/10.54216/JISIoT.120107) |