2690-6791ISSN (Online)
2769-786XISSN (Print)
Volume 14 , Issue 2 , PP: 140-152, 2025 | Cite this article as | XML | Html | PDF | Full Length Article
Zena M. Saadi 1 * , Ahmed T. Sadiq 2 , Omar Z. Akif 3 , El-Sayed M. El-kenawy 4
Doi: https://doi.org/10.54216/JISIoT.140212
With the continuous progress of image retrieval technology, the speed of searching for the required image from a large amount of image data has become an important issue. Convolutional neural networks (CNNs) have been used in image retrieval. However, many image retrieval systems based on CNNs have poor ability to express image features. Content-based Image Retrieval (CBIR) is a method of finding desired images from image databases. However, CBIR suffers from lower accuracy in retrieving images from large-scale image databases. In this paper, the proposed system is an improvement of the convolutional neural network for greater accuracy and a machine learning tool that can be used for automatic image retrieval. It includes two phases; the first phase (offline processing) consist of two stages; stage1 for CNN model classification while stage 2 for extracts high-level features directly from CNN by a flattening layer, which will be stored into a vector. In the second phase (online processing), the retrieval depends on query by image (QBI) from the system, which relies on the online CNN model stage to extract the features of the transmitted image. Afterward, an evaluation is conducted between the extracted features and the features that were previously stored by employing the Hamming distance to return all similar images. Last, it retrieves all the images and sends them to the system. Classification for images was achieved with 97.94% deep learning results, while for retrieved images, the deep learning was 98.94%. For this paper, work done on COREL image dataset. The images in the dataset used for training are more difficult than image classification due to the need for more computational resources. In the experimental part, training images using CNN achieved high accuracy, proving that the model has high accuracy in image retrieval.
Convolutional Neural Network (CNN) , Images Classification , Retrieval images , COREL's Image Dataset , Deep Learning
[1]C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, Rethinking the inception architecture for computer vision. 2016. doi: 10.1109/cvpr.2016.308. Available: https://doi.org/10.1109/cvpr.2016.308
[2]Y. Chen, Y. Tian, and M. He, “Monocular human pose estimation: A survey of deep learning-based methods,” Computer Vision and Image Understanding, vol. 192, p. 102897, Mar. 2020, doi: 10.1016/j.cviu.2019.102897. Available: https://doi.org/10.1016/j.cviu.2019.102897
[3]H. Ahn and C. Yim, “Convolutional Neural Networks Using Skip Connections with Layer Groups for Super-Resolution Image Reconstruction Based on Deep Learning,” Applied Sciences, vol. 10, no. 6, p. 1959, Mar. 2020, doi: 10.3390/app10061959. Available: https://doi.org/10.3390/app10061959
[4]D. Ciresan, U. Meier, and J. Schmidhuber, “Multi-column deep neural networks for image classification,” IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2012, doi: 10.1109/cvpr.2012.6248110. Available: https://doi.org/10.1109/cvpr.2012.6248110
[5]A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Communications of the ACM, vol. 60, no. 6, pp. 84–90, May 2017, doi: 10.1145/3065386. Available: https://doi.org/10.1145/3065386
[6]B. Patel, K. Yadav, and D. Ghosh, “Current Trend and Methodologies of Content-Based Image Retrieval: Survey,” in Algorithms for intelligent systems, 2021, pp. 647–665. doi: 10.1007/978-981-15-6707-0_64. Available: https://doi.org/10.1007/978-981-15-6707-0_64
[7]X. Li, J. Yang, and J. Ma, “Recent developments of content-based image retrieval (CBIR),” Neurocomputing, vol. 452, pp. 675–689, Sep. 2021, doi: 10.1016/j.neucom.2020.07.139. Available: https://doi.org/10.1016/j.neucom.2020.07.139
[8]M. H. Hadid, Q. M. Hussein, Z. T. Al-Qaysi, M. A. Ahmed, and M. M. Salih, “An Overview of Content-Based Image Retrieval Methods and Techniques,” Iraqi Journal for Computer Science and Mathematics, pp. 66–78, Jul. 2023, doi: 10.52866/ijcsm.2023.02.03.006. Available: https://doi.org/10.52866/ijcsm.2023.02.03.006
[9]R. Gupta, P. Mukherjee, B. Lall, and V. Gupta, Semantics Preserving Hierarchy based Retrieval of Indian heritage monuments. 2020. doi: 10.1145/3423323.3423409. Available: https://doi.org/10.1145/3423323.3423409
[10]Z. Cao, S. Mu, Y. Xu, and M. Dong, Image retrieval method based on CNN and dimension reduction. 2018. doi: 10.1109/spac46244.2018.8965601. Available: https://doi.org/10.1109/spac46244.2018.8965601
[11]C.-H. Kuo, Y.-H. Chou, and P.-C. Chang, “Using deep convolutional neural networks for image retrieval,” Electronic Imaging, vol. 28, no. 2, pp. 1–6, Feb. 2016, doi: 10.2352/issn.2470-1173.2016.2.vipc-231. Available: https://doi.org/10.2352/issn.2470-1173.2016.2.vipc-231
[12]H.-K. Huang, C.-F. Chiu, C.-H. Kuo, Y.-C. Wu, N. N. Y. Chu, and P.-C. Chang, “Mixture of deep CNN-based ensemble model for image retrieval,” IEEE 5th Global Conference on Consumer Electronics, Oct. 2016, doi: 10.1109/gcce.2016.7800375. Available: https://doi.org/10.1109/gcce.2016.7800375
[13]U. A. Khan and A. Javed, “A hybrid CBIR system using novel local tetra angle patterns and color moment features,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 10, pp. 7856–7873, Jul. 2022, doi: 10.1016/j.jksuci.2022.07.005. Available: https://doi.org/10.1016/j.jksuci.2022.07.005
[14]K. Ma, B. Wang, Y. Li, and J. Zhang, “Image retrieval for local architectural heritage recommendation based on deep hashing,” Buildings, vol. 12, no. 6, p. 809, Jun. 2022, doi: 10.3390/buildings12060809. Available: https://doi.org/10.3390/buildings12060809
[15]L. D. Medus, M. Saban, J. V. Francés-Víllora, M. Bataller-Mompeán, and A. Rosado-Muñoz, “Hyperspectral image classification using CNN: Application to industrial food packaging,” Food Control, vol. 125, p. 107962, Feb. 2021, doi: 10.1016/j.foodcont.2021.107962. Available: https://doi.org/10.1016/j.foodcont.2021.107962
[16]S. Kiranyaz, O. Avci, O. Abdeljaber, T. Ince, M. Gabbouj, and D. J. Inman, “1D convolutional neural networks and applications: A survey,” Mechanical Systems and Signal Processing, vol. 151, p. 107398, Nov. 2020, doi: 10.1016/j.ymssp.2020.107398. Available: https://doi.org/10.1016/j.ymssp.2020.107398
[17]X. Zhang et al., “Hierarchical bilinear convolutional neural network for image classification,” IET Computer Vision, vol. 15, no. 3, pp. 197–207, Mar. 2021, doi: 10.1049/cvi2.12023. Available: https://doi.org/10.1049/cvi2.12023
[18]A. Shabbir et al., “Satellite and scene image classification based on transfer learning and fine tuning of RESNET50,” Mathematical Problems in Engineering, vol. 2021, pp. 1–18, Jul. 2021, doi: 10.1155/2021/5843816. Available: https://doi.org/10.1155/2021/5843816
[19]J. Li and J. Z. Wang, “Real-Time computerized annotation of pictures,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 6, pp. 985–1002, Jun. 2008, doi: 10.1109/tpami.2007.70847. Available: https://doi.org/10.1109/tpami.2007.70847
[20]U. A. Khan, A. Javed, and R. Ashraf, “An effective hybrid framework for content based image retrieval (CBIR),” Multimedia Tools and Applications, vol. 80, no. 17, pp. 26911–26937, May 2021, doi: 10.1007/s11042-021-10530-x. Available: https://doi.org/10.1007/s11042-021-10530-x
[21]D. Gupta, R. Loane, S. Gayen, and D. Demner-Fushman, “Medical image retrieval via nearest neighbor search on pre-trained image features,” Knowledge-Based Systems, vol. 278, p. 110907, Aug. 2023, doi: 10.1016/j.knosys.2023.110907. Available: https://doi.org/10.1016/j.knosys.2023.110907
[22]W. Chen et al., “Deep learning for instance retrieval: a survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 6, pp. 7270–7292, Nov. 2022, doi: 10.1109/tpami.2022.3218591. Available: https://doi.org/10.1109/tpami.2022.3218591
[23]S. A. Hasan and G. M. Hadi, “Review about SIFT and Local Feature Extraction in Content Based Image Retrieval,” 5th International Conference on Communication Engineering and Computer Science, Jan. 2024, doi: 10.24086/cocos2024/paper.1533. Available: https://doi.org/10.24086/cocos2024/paper.1533
[24]E. M. Alsaedi and A. K. Farhan, “Retrieving encrypted images using convolution neural network and fully homomorphic encryption,” Baghdad Science Journal, vol. 20, no. 1, p. 0206, Feb. 2023, doi: 10.21123/bsj.2022.6550. Available: https://doi.org/10.21123/bsj.2022.6550
[25]Q. Zhang, M. Zhang, T. Chen, Z. Sun, Y. Ma, and B. Yu, “Recent advances in convolutional neural network acceleration,” Neurocomputing, vol. 323, pp. 37–51, Jan. 2019, doi: 10.1016/j.neucom.2018.09.038. Available: https://doi.org/10.1016/j.neucom.2018.09.038
[26]C. Lu, M. Kozakai, and L. Jing, “Sign Language Recognition with Multimodal Sensors and Deep Learning Methods,” Electronics, vol. 12, no. 23, p. 4827, Nov. 2023, doi: 10.3390/electronics12234827. Available: https://doi.org/10.3390/electronics12234827
[27]R. Raj and A. Kos, “An improved human activity recognition technique based on convolutional neural network,” Scientific Reports, vol. 13, no. 1, Dec. 2023, doi: 10.1038/s41598-023-49739-1. Available: https://doi.org/10.1038/s41598-023-49739-1
[28]J. Cheng, M. Sadiq, O. A. Kalugina, S. A. Nafees, and Q. Umer, “Convolutional neural network based approval prediction of enhancement reports,” IEEE Access, vol. 9, pp. 122412–122424, Jan. 2021, doi: 10.1109/access.2021.3108624. Available: https://doi.org/10.1109/access.2021.3108624
[29]Y. H. Ali et al., “Optimization system based on convolutional neural network and internet of medical things for early diagnosis of lung cancer,” Bioengineering, vol. 10, no. 3, p. 320, Mar. 2023, doi: 10.3390/bioengineering10030320. Available: https://doi.org/10.3390/bioengineering10030320
[30]A. F. Al-Zubidi, A. K. Farhan, and S. M. Towfek, “Predicting DoS and DDoS attacks in network security scenarios using a hybrid deep learning model,” Journal of Intelligent Systems, vol. 33, no. 1, Jan. 2024, doi: 10.1515/jisys-2023-0195. Available: https://doi.org/10.1515/jisys-2023-0195
[31]M. Manikandakumar and P. Karthikeyan, “Weed classification using particle swarm optimization and deep learning models,” Computer Systems Science and Engineering, vol. 44, no. 1, pp. 913–927, Jan. 2023, doi: 10.32604/csse.2023.025434. Available: https://doi.org/10.32604/csse.2023.025434
[32]M. Hong, B. Rim, H. Lee, H. Jang, J. Oh, and S. Choi, “Multi-Class Classification of lung diseases using CNN models,” Applied Sciences, vol. 11, no. 19, p. 9289, Oct. 2021, doi: 10.3390/app11199289. Available: https://doi.org/10.3390/app11199289
