2692-4048ISSN (Online)
2770-0070ISSN (Print)
Volume 19 , Issue 2 , PP: 01-14, 2025 | Cite this article as | XML | Html | PDF | Full Length Article
Mela G. Abdul-Haleem 1 * , Loay E. George 2
Doi: https://doi.org/10.54216/FPA.190201
A strong sign language recognition system can break down the barriers that separate hearing and speaking members of society from speechless members. A novel fast recognition system with low computational cost for digital American Sign Language (ASL) is introduced in this research. Different image processing techniques are used to optimize and extract the shape of the hand fingers in each sign. The feature extraction stage includes a determination of the optimal threshold based on statistical bases and then recognizing the gap area in the zero sign and calculating the heights of each finger in the other digits. The classification stage depends on the gap area in the zero signs and the number of opened fingers in the other signs as well as the sequence in which the opened fingers appear for those that have the same number of opened fingers. The conducted test results showed the system’s high capability to classify all the digits; where both the precision and F-score percentages of the proposed model reached the desired optimal value (100%).
ASL , Global thresholding , Chain coding , Edge detection , Elbow point extraction , Gaps\blots removal
[1] N. F. Attia, M. T. F. S. Ahmed, and M. A. M. Alshewimy, "Efficient deep learning models based on tension techniques for sign language recognition," Intelligent Systems with Applications, vol. 20, p. 200284, 2023. doi: 10.1016/j.iswa.2023.200284.
[2] S. Wilcox and J. Peyton, "American Sign Language as a foreign language," CAL. Dig., pp. 159-160, 1999.
[3] A. Sultan, W. Makram, M. Kayed, and A. A. Ali, "Sign language identification and recognition: A comparative study," Open Computer Science, vol. 12, no. 1, pp. 191-210, 2022. doi: 10.1515/comp-2022-0240.
[4] Z. Katılmış and C. Karakuzu, "Double handed dynamic Turkish Sign Language recognition using Leap Motion with meta learning approach," Expert Systems with Applications, vol. 228, p. 120453, 2023. doi: 10.1016/j.eswa.2023.120453.
[5] A. Sharma, N. Sharma, Y. Saxena, et al., "Benchmarking deep neural network approaches for Indian Sign Language recognition," Neural Computing & Applications, vol. 33, no. 12, pp. 6685-6696, 2021. doi: 10.1007/s00521-020-05448-8.
[6] A. Wadhawan and P. Kumar, "Deep learning-based sign language recognition system for static signs," Neural Computing & Applications, vol. 32, no. 12, pp. 7957-7968, 2020. doi: 10.1007/s00521-019-04691-y.
[7] D. Bragg, O. Koller, M. Bellard, L. Berke, P. Boudreault, A. Braffort, et al., "Sign language recognition, generation, and translation: An interdisciplinary perspective," in 21st International ACM SIGACCESS Conference on Computers and Accessibility, pp. 16-31, 2019. doi: 10.1145/3308561.3353774.
[8] K. Wangchuk, P. Riyamongkol, and R. Waranusast, "Real-time Bhutanese Sign Language digits recognition system using Convolutional Neural Network," ICT Express, vol. 7, no. 2, pp. 215-220, 2021. doi: 10.1016/j.icte.2020.08.002.
[9] H. I. Mohammed and J. Waleed, "Hand gesture recognition using a convolutional neural network for Arabic sign language," AIP Conference Proceedings, vol. 2475, no. 1, p. 070012, 2023. doi: 10.1063/5.0104256.
[10] S. Sharma and S. Singh, "Vision-based hand gesture recognition using deep learning for the interpretation of sign language," Expert Systems with Applications, vol. 182, p. 115657, 2021. doi: 10.1016/j.eswa.2021.115657.
[11] A. Orbay and L. Akarun, "Neural sign language translation by learning tokenization," in 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pp. 222-228, 2020. doi: 10.1109/FG47880.2020.00002.
[12] W. Abdul, M. Alsulaiman, S. U. Amin, M. Faisal, G. Muhammad, E. R. Albogamy, M. A. Bencherif, and H. Ghaleb, "Intelligent real-time Arabic sign language classification using attention-based inception and BiLSTM," Computers & Electrical Engineering, vol. 95, p. 107395, 2021. doi: 10.1016/j.compeleceng.2021.107395.
[13] Q. Zhang, D. Wang, R. Zhao, and Y. Yu, "MyoSign: Enabling end-to-end sign language recognition with wearables," in Proceedings of the 24th International Conference on Intelligent User Interfaces, pp. 650-660, 2019. doi: 10.1145/3301275.3302296.
[14] M. S. Alom, M. J. Hasan, and M. F. Wahid, "Digit recognition in sign language based on convolutional neural network and support vector machine," in 2019 International Conference on Sustainable Technologies for Industry 4.0 (STI), pp. 1-5, 2019. doi: 10.1109/STI47673.2019.9067999.
[15] B. W. Salim and S. R. M. Zeebaree, "Kurdish Sign Language recognition based on transfer learning," International Journal of Intelligent Systems and Applications in Engineering, vol. 11, no. 6s, pp. 232-245, 2023. [Online]. Available: https://ijisae.org/index.php/IJISAE/article/view/2843.
[16] B. Fang, J. Co, and M. Zhang, "DeepASL: Enabling ubiquitous and non-intrusive word and sentence-level sign language translation," in Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems, Delft, The Netherlands, Nov. 6–8, 2017, p. 13. doi: 10.1145/3131672.3131693.
[17] H. M. Hammed, O. M. H. Almiahi, and O. Shauchuk, "Detection of anthropogenic objects based on the spatial characteristics of their contour in aerial image," Indonesian Journal of Electrical Engineering and Computer Science, vol. 23, no. 1, pp. 206-215, 2021. doi: 10.11591/ijeecs.v23.i1.pp206-215.
[18] A. Hussain, S. U. Amin, M. Fayaz, and S. Seo, "An efficient and robust hand gesture recognition system of sign language employing finetuned Inception-V3 and EfficientNet-B0 network," Computer Systems Science and Engineering, vol. 46, no. 3, pp. 3509-3525, 2023. doi: 10.32604/csse.2023.037258.
[19] M. A. Hameed, S. B. Al-Khoja, and R. R. Ismail, "Small binary codebook design for image compression depending on rotating blocks," Iraqi Journal of Science, vol. 62, no. 10, pp. 3719-3723, 2021. doi: 10.24996/ijs.2021.62.10.30.
[20] M. G. Abdul-Haleem, L. E. George, and A. G. Abdul-Haleem, "A system for rapid localization and intensity evaluation of saponins accumulation in plant tissues," Journal of Theoretical and Applied Information Technology, vol. 97, no. 3, pp. 1030-1040, 2019. [Online]. Available: https://www.jatit.org/volumes/Vol97No3/27Vol97No3.pdf.
[21] A. Shihab, H. Salah, and M. Mocanu, "Detection and diagnosis of skin cancer based on K-means cluster and convolutional neural network," in 2021 23rd International Conference on Control Systems and Computer Science (CSCS), pp. 143-150, Bucharest, Romania, 2021. doi: 10.1109/CSCS52396.2021.00031.
[22] L. Abualigah, N. K. Al-Okbi, E. M. Awwad, et al., "Correction: Boosted Aquila Arithmetic Optimization Algorithm for multi-level thresholding image segmentation," Evolving Systems, 2024. doi: 10.1007/s12530-024-09576-7.
[23] M. A. Rajab and L. E. George, "Car logo image extraction and recognition using K-medoids, Daubechies wavelets, and DCT transforms," Iraqi Journal of Science, vol. 65, no. 1, pp. 431-442, 2024. doi: 10.24996/ijs.2024.65.1.35.
[24] L. Wang, Q. Meng, H. Wang, et al., "Digital image processing realized by memristor-based technologies," Discover Nano, vol. 18, p. 120, 2023. doi: 10.1186/s11671-023-03901-w.
[25] I. Mahmud, T. Tabassum, M. P. Uddin, E. Ali, A. M. Nitu, and M. I. Afjal, "Efficient noise reduction and HOG feature extraction for sign language recognition," in 2018 International Conference on Advancement in Electrical and Electronic Engineering (ICAEEE), pp. 1-4, Gazipur, Bangladesh, 2018. doi: 10.1109/ICAEEE.2018.8642983.
[26] A. Sharma, A. Mittal, S. Singh, and V. Awatramani, "Hand gesture recognition using image processing and feature extraction techniques," Procedia Computer Science, vol. 173, pp. 181-190, 2020. doi: 10.1016/j.procs.2020.06.022.
[27] I. A. Adeyanju, O. O. Bello, and M. A. Azeez, "Development of an American sign language recognition system using Canny edge and histogram of oriented gradient," Nigerian Journal of Technological Development, vol. 19, no. 3, pp. 195-205, 2022. doi: 10.4314/njtd.v19i3.2.
[28] S. Lahoti, S. Kayal, S. Kumbhare, I. Suradkar, and V. Pawar, "Android based American sign language recognition system with skin segmentation and SVM," in 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1-6, Bengaluru, India, 2018. doi: 10.1109/ICCCNT.2018.8493838.
[29] C. M. Jin, Z. Omar, and M. H. Jaward, "A mobile application of American sign language translation via image processing algorithms," in 2016 IEEE Region 10 Symposium (TENSYMP), pp. 104-109, Bali, Indonesia, 2016. doi: 10.1109/TENCONSpring.2016.7519386.
[30] I. Mahfudi, M. Sarosa, R. A. Asmara, and M. A. Gustalika, "Indonesian sign language number recognition using SIFT algorithm," in IOP Conference Series: Materials Science and Engineering, vol. 336, no. 1, p. 012010, 2018. doi: 10.1088/1757-899X/336/1/012010.
[31] A. Mavi, "A new dataset and proposed convolutional neural network architecture for classification of American sign language digits," arXiv preprint arXiv:2011.08927, 2020.
[32] W. K. Mutlag, S. K. Ali, Z. M. Aydam, and B. H. Taher, "Feature extraction methods: A review," Journal of Physics: Conference Series, vol. 1591, no. 1, p. 012028, 2020. doi: 10.1088/1742-6596/1591/1/012028.
[33] I. H. Abbas and M. Q. Ismael, "Automated pavement distress detection using image processing techniques," Engineering, Technology & Applied Science Research, vol. 11, no. 5, pp. 7702-7708, 2021. doi: 10.48084/etasr.4450.
[34] M. R. Naeemah, "Textural analysis of liver tumor using watershed segmentation based on statistical and geometrical features," Iraqi Journal of Science, vol. 60, no. 8, pp. 1877-1887, 2019. doi: 10.24996/ijs.2019.60.8.25.
[35] N. M. Hashem, H. Kh. Abbas, and H. J. Mohamad, "Detection and recognition of car plates in parking lots at Baghdad University," Iraqi Journal of Science, vol. 64, no. 2, pp. 1018-1029, 2023. doi: 10.24996/ijs.2023.64.2.43.
[36] A. Kulkarni, D. Chong, and F. A. Batarseh, "Foundations of data imbalance and solutions for a data democracy," in F. A. Batarseh and R. Yang, Eds., Data Democracy, Academic Press, pp. 83-106, 2020. doi: 10.1016/B978-0-12-818366-3.00005-8.
[37] R. K. Pathan, M. Biswas, S. Yasmin, et al., "Sign language recognition using the fusion of image and hand landmarks through multi-headed convolutional neural network," Scientific Reports, vol. 13, no. 1, p. 16975, 2023. doi: 10.1038/s41598-023-43852-x.
