Volume 10 , Issue 2 , PP: 01-19, 2025 | Cite this article as | XML | Html | PDF | Full Length Article
Ehsan Khodadadi 1 * , P. K. Dutta 2 , Amel Ali Alhussan 3 , Marawa Metwally 4
Doi: https://doi.org/10.54216/JAIM.100201
The ability to accurately classify retinal fundus images has been made possible by rapid improvements in deep learning (DL) and artificial intelligence (AI). This motivation led to developing a new AI-driven hybrid Convolutional Neural Network with Long Short-Term Memory (CNN-LSTM) architecture for precisely categorizing retinal diseases. The model first receives high-resolution retinal fundus images to extract various spatial properties, which are then processed by two parallel CNN branches after a standard convolutional layer. These branches use residual learning with convolutional and identity blocks to extract features. Following the reshaping and concatenation of the features from both branches, an LSTM layer captures inter-feature relationships. Eight retinal disorders are then predicted to belong to the same disease class via a fully linked classifier. Extensive simulations were run on a benchmark retinal OCT dataset, and performance was assessed using various criteria. The experimental results showed that the suggested hybrid model was adequate, with a high overall accuracy of 93% with F1-score values of 0.93, 0.94, and 0.93 for precision, recall, and accuracy, respectively. The model demonstrated considerable predictive abilities for all classes while perfectly classifying AMD, CNV, CSR, DME, DR, MH, and routine diseases to reveal its clinical value as an automated retinal processor.
Retinal disease classification , Deep learning , CNN-LSTM architecture , Fundus imaging , Residual learning , Optical Coherence Tomography (OCT) , Medical image analysis
[1] P. Mani, N. Ramachandran, S. J. Paul, and P. V. Ramesh, “Laceration assessment: Advanced segmentation and classification framework for retinal disease categorization in optical coherence tomography images.,” Journal of the Optical Society of America. A, Optics, image science, and vision, 2025. DOI: 10.1364/JOSAA.526142.
[2] K. Du et al., “Detection of disease features on retinal oct scans using retfound.,” Bioengineering (Basel, Switzerland), 2025. DOI: 10.3390/bioengineering11121186.
[3] K. Du et al., “Inter-rater reliability in labeling quality and pathological features of retinal oct scans:A customized annotation software approach.,” PloS one, 2024. DOI: 10.1371/journal.pone. 0314707.
[4] C. Ou et al., “A deep learning network for accurate retinal multidisease diagnosis using multiview fusion of en face and b-scan images: A multicenter study.,” Translational vision science technology, 2024. DOI: 10.1167/tvst.13.12.31.
[5] M. Guo, D. Gong, and W. Yang, “In-depth analysis of research hotspots and emerging trends in ai for retinal diseases over the past decade.,” Frontiers in medicine, 2024. DOI: 10.3389/fmed.2024. 1489139.
[6] A. M. Alenezi et al., “Multiscale attention-over-attention network for retinal disease recognition in oct radiology images.,” Frontiers in medicine, 2024. DOI: 10.3389/fmed.2024.1499393.
[7] J. Bell et al., “Validation of inter-reader agreement/consistency for quantification of ellipsoid zone integrity and sub-rpe compartmental features across retinal diseases.,” Diagnostics (Basel, Switzerland), 2024. DOI: 10.3390/diagnostics14212395.
[8] Q. Zuo et al., “Multi-resolution visual mamba with multi-directional selective mechanism for retinal disease detection.,” Frontiers in cell and developmental biology, 2024. DOI: 10 . 3389 / fcell . 2024.1484880.
[9] J. Yang et al., “Dry age-related macular degeneration classification from optical coherence tomography images based on ensemble deep learning architecture.,” Frontiers in medicine, 2024. DOI: 10.3389/ fmed.2024.1438768.
[10] A. Domalpally et al., “Data harmonization, standardization, and collaboration for diabetic retinal disease (drd) research: Report from the 2024 mary tyler moore vision initiative workshop on data.,” Translational vision science technology, 2024. DOI: 10.1167/tvst.13.10.4.
[11] M. Kulyabin et al., “Segment anything in optical coherence tomography: Sam 2 for volumetric segmentation of retinal biomarkers.,” Bioengineering (Basel, Switzerland), 2024. DOI: 10 . 3390 / bioengineering11090940.
[12] J. Zhang, P. Zhao, Y. Zhao, C. Li, and D. Hu, “Few-shot class-incremental learning for retinal disease recognition.,” IEEE journal of biomedical and health informatics, 2024. DOI: 10 . 1109 / JBHI . 2024.3457915.
[13] D. J. Williamson et al., “Artificial intelligence to facilitate clinical trial recruitment in age-related macular degeneration.,” Ophthalmology science, 2024. DOI: 10.1016/j.xops.2024.100566.
[14] F. H. Rizk, M. E. Mohamed, B. Sameh, A. M. Zaki, M. M. Eid, and E.-S. M. El-kenawy, “Predictive Modeling of Portuguese Student Performance: Comparative Machine Learning Analysis,” in 2024 International Telecommunications Conference (ITC-Egypt), Jul. 2024, pp. 26–31. DOI: 10 . 1109 / ITC-Egypt61547.2024.10620557.
[15] J. R. Taylor, J. Drinkwater, D. C. Sousa, V. Shah, and A. W. Turner, “Real-world evaluation of retcad deep-learning system for the detection of referable diabetic retinopathy and age-related macular degeneration.,” Clinical experimental optometry, 2024. DOI: 10 . 1080 / 08164622 . 2024 . 2385565.
[16] A. A. A. El-Khalek et al., “A comprehensive review of ai diagnosis strategies for age-related macular degeneration (amd).,” Bioengineering (Basel, Switzerland), 2024. DOI: 10 . 3390 / bioengineering11070711.
[17] A. Laouarem, C. Kara-Mohamed, E.-B. Bourennane, and A. Hamdi-Cherif, “Htc-retina: A hybrid retinal diseases classification model using transformer-convolutional neural network from optical coherence tomography images.,” Computers in biology and medicine, 2024. DOI: 10.1016/j.compbiomed. 2024.108726.
[18] J. Zhao, J. Zhu, J. He, G. Cao, and C. Dai, “Multi-label classification of retinal diseases based on fundus images using resnet and transformer.,” Medical biological engineering computing, 2024. DOI: 10.1007/s11517-024-03144-6.
[19] S. V. Priyan, R. V. Kumar, C Moorthy, and V. S. Nishok, “A fusion of deep neural networks and game theory for retinal disease diagnosis with oct images.,” Journal of X-ray science and technology, 2024. DOI: 10.3233/XST-240027.
[20] J. Wang, H. Peng, S. Chen, and S. Ren, “Ensemble learning for retinal disease recognition under limited resources.,” Medical biological engineering computing, 2024. DOI: 10 . 1007 / s11517 - 024 - 03101-3.
[21] J. Carmichael, E. Costanza, A. Blandford, R. Struyven, P. A. Keane, and K. Balaskas, “Diagnostic decisions of specialist optometrists exposed to ambiguous deep-learning outputs.,” Scientific reports, 2024. DOI: 10.1038/s41598-024-55410-0.
[22] A. J. Prabha, C Venkatesan, M. S. Fathimal, K. K. Nithiyanantham, and S. P. A. Kirubha, “Rd-oct net: Hybrid learning system for automated diagnosis of macular diseases from oct retinal images.,” Biomedical physics engineering express, 2024. DOI: 10.1088/2057-1976/ad27ea.
[23] P. D. Angeli et al., “Splicing defects and crispr-cas9 correction in isogenic homozygous photoreceptor precursors harboring clustered deep-intronic abca4 variants.,” Molecular therapy. Nucleic acids, 2024. DOI: 10.1016/j.omtn.2023.102113.
[24] D. Wang, J. Lian, and W. Jiao, “Multi-label classification of retinal disease via a novel vision transformer model.,” Frontiers in neuroscience, 2024. DOI: 10.3389/fnins.2023.1290803.
[25] J. Peng, J. Lu, J. Zhuo, and P. Li, “Multi-scale-denoising residual convolutional network for retinal disease classification using oct.,” Sensors (Basel, Switzerland), 2024. DOI: 10.3390/s24010150.
[26] A. Torimura et al., “Profiling mirnas in tear extracellular vesicles: A pilot study with implications for diagnosis of ocular diseases.,” Japanese journal of ophthalmology, 2023. DOI: 10.1007/s10384- 023-01028-0.
[27] M. Bhandari, T. B. Shahi, and A. Neupane, “Evaluating retinal disease diagnosis with an interpretable lightweight cnn model resistant to adversarial attacks.,” Journal of imaging, 2023. DOI: 10.3390/ jimaging9100219.
[28] Y. Yan et al., “Clinical evaluation of deep learning systems for assisting in the diagnosis of the epiretinal membrane grade in general ophthalmologists.,” Eye (London, England), 2023. DOI: 10 . 1038 / s41433-023-02765-9.
[29] B. A. Hammou, F. Antaki, M.-C. Boucher, and R. Duval, “Mbt: Model-based transformer for retinal optical coherence tomography image and video multi-classification.,” International journal of medical informatics, 2023. DOI: 10.1016/j.ijmedinf.2023.105178.
[30] P. Dutta, K. A. Sathi, M. A. Hossain, and M. A. A. Dewan, “Conv-vit: A convolution and vision transformer-based hybrid feature extraction method for retinal disease detection.,” Journal of imaging, 2023. DOI: 10.3390/jimaging9070140.
[31] C.-T. Wu, T.-Y. Lin, C.-J. Lin, and D.-K. Hwang, “The future application of artificial intelligence and telemedicine in the retina: A perspective.,” Taiwan journal of ophthalmology, 2023. DOI: 10.4103/ tjo.TJO-D-23-00028.
[32] M. J. M. Zedan, M. A. Zulkifley, A. A. Ibrahim, A. M. Moubark, N. A. M. Kamari, and S. R. Abdani, “Automated glaucoma screening and diagnosis based on retinal fundus images using deep learning approaches: A comprehensive review.,” Diagnostics (Basel, Switzerland), 2023. DOI: 10 . 3390 / diagnostics13132180.
[33] S. A. Gocuk, J. K. Jolly, T. L. Edwards, and L. N. Ayton, “Female carriers of x-linked inherited retinal diseases - genetics, diagnosis, and potential therapies.,” Progress in retinal and eye research, 2023. DOI: 10.1016/j.preteyeres.2023.101190.
[34] X. Huang et al., “Gabnet: Global attention block for retinal oct disease classification.,” Frontiers in neuroscience, 2023. DOI: 10.3389/fnins.2023.1143422.
[35] N. N. El-Den et al., “Scale-adaptive model for detection and grading of age-related macular degeneration from color retinal fundus images.,” Scientific reports, 2023. DOI: 10.1038/s41598- 023-35197-2.
[36] A. R. ChÅ‚opowiec, K. Karanowski, T. Skrzypczak, M. Grzesiuk, A. B. ChÅ‚opowiec, and M. Tabakov, “Counteracting data bias and class imbalance-towards a useful and reliable retinal disease recognition system.,” Diagnostics (Basel, Switzerland), 2023. DOI: 10.3390/diagnostics13111904.
[37] M. A. Manan, F. Jinchao, T. M. Khan, M. Yaqub, S. Ahmed, and I. S. Chuhan, “Semantic segmentation of retinal exudates using a residual encoder-decoder architecture in diabetic retinopathy.,” Microscopy research and technique, 2023. DOI: 10.1002/jemt.24345.
[38] M. D. Varela et al., “Artificial intelligence in retinal disease: Clinical application, challenges, and future directions.,” Graefe’s archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie, 2023. DOI: 10 . 1007 / s00417 - 023 - 06052-x.
[39] R Greeshma and P. Simon, “Deep learning approach based plant seedlings classification with xception model,” in International Conference on IoT Based Control Networks and Intelligent Systems, Springer, 2023, pp. 65–76. DOI: https://doi.org/10.1007/978-981-99-6586-1_5.
[40] A. G. Howard et al., “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” arXiv preprint arXiv:1704.04861, 2017. DOI: http://arxiv.org/abs/1704. 04861.
[41] C. Szegedy et al., “Going deeper with convolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 1–9. DOI: 10.1109/CVPR.2015.7298594.
[42] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2818–2826. DOI: 10.1109/CVPR.2016.308.
[43] F. Chollet, “Xception: Deep learning with depthwise separable convolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 1251–1258. DOI: 10.1109/ CVPR.2017.195.