Volume 16 , Issue 1 , PP: 28-40, 2025 | Cite this article as | XML | Html | PDF | Full Length Article
Hima Bindu Gogineni 1 * , Hemanta Kumar Bhuyan 2 , E. Laxmi Lydia 3
Doi: https://doi.org/10.54216/JISIoT.160103
Pedestrian detection using object detection and deep learning has been found to be effective method for identifying pedestrians in video frames or images accurately. It is more commonly used in many real-time applications, such as security observing systems, autonomous driving systems, and robotics. The combination of deep learning techniques and object detection algorithms allows efficient and robust detection of pedestrians in several real-time scenarios. However, it is necessary to improve the detection efficacy for complex environments such as cases with worse visibility due to weather or daytime, crowd scenes, and rare pose samples. Continuous improvement and research in DL algorithms, dataset collection, and TRA models contribute to accelerating the robustness and acc of pedestrian detection systems. Therefore, this research models a novel marine predator algorithm with DL-based pedestrian detection and classification (MPADLB-PDC) method. The objective of the MPADLB-PDC system lies in the accurate recognition and identification of pedestrians. To achieve this, the MPADLB-PDC technique involves two major processes, namely object detection and classification. In the first stage, the MPADLB-PDC technique uses an improved YOLOv7 object detector for the recognition of the objects in the frame. Next, in the second stage, the ensemble classifier comprises three classifiers such as deep feed-forward neural networks (DFFNNs), extreme learning machine (ELM), and long short-term memory (LSTM). To improve the recognition performance of the ensemble classifier, the MPA is used to optimally select the parameters related to it. The simulation outcome of the MPADLB-PDC technique was authorized on the pedestrian database, and the outcome can be studied in terms of various aspects. The experimentation values validated the better outcome of the MPADLB-PDC approach compared to other approaches.
Computer vision , Deep learning , Pedestrian detection , Marine predator&rsquo , s algorithm , Ensemble learning
[1] K. V. Kumar, E. L. Lydia, A. K. Dutta, V. S. Parvathy, G. Ramasamy, I. Pustokhina, and D. A. Pustokhin, “Deep Learning Enabled Object Detection and Tracking Model for Big Data Environment,” CMC-Computers, Materials & Continua, vol. 73, no. 2, pp. 2541–2554, 2022.
[2] M. Jayasuriya, G. Dissanayake, R. Ranasinghe, and N. Gandhi, “Leveraging Deep Learning Based Object Detection for Localising Autonomous Personal Mobility Devices in Sparse Maps,” in Proc. 2019 IEEE Intelligent Transportation Systems Conference (ITSC), 2019, pp. 4081–4086.
[3] A. Syed, “Forecasting Pedestrian Trajectory Using Deep Learning,” Ph.D. dissertation, Univ. of Nevada, Las Vegas, 2021.
[4] B. B. Elallid, S. E. Hamdani, N. Benamar, and N. Mrani, “Deep learning-based modeling of pedestrian perception and decision-making in refuge island for autonomous driving,” in Computational Intelligence in Recent Communication Networks, Cham: Springer International Publishing, 2022, pp. 135–146.
[5] O. Angah and A. Y. Chen, “Tracking multiple construction workers through deep learning and the gradient-based method with re-matching based on multi-object tracking acc,” Automation in Construction, vol. 119, p. 103308, 2020.
[6] F. Sezgin, D. Vriesman, P. Held, A. Zimmer, and T. Brandmeier, “A Deep Learning Approach for Pedestrian Behavior Interpretation Based on Radar Point Clouds,” in Proc. 2021 18th European Radar Conference (EuRAD), 2022, pp. 66–69.
[7] X. Wu, D. Sahoo, and S. C. Hoi, “Recent advances in deep learning for object detection,” Neurocomputing, vol. 396, pp. 39–64, 2020.
[8] B. S. Murugan, M. Elhoseny, K. Shankar, and J. Uthayakumar, “Region-based scalable smart system for anomaly detection in pedestrian walkways,” Computers & Electrical Engineering, vol. 75, pp. 146–160, 2019.
[9] A. Hamadi, “Real-Time Multi-Object Tracking Using Deep Learning,” 2021.
[10] D. Kido, T. Fukuda, and N. Yabuki, “Diminished reality system with real-time object detection using deep learning for onsite landscape simulation during redevelopment,” Environmental Modelling & Software, vol. 131, p. 104759, 2020.
[11] A. Li, S. Sun, Z. Zhang, M. Feng, C. Wu, and W. Li, “A Multi-Scale Traffic Object Detection Algorithm for Road Scenes Based on Improved YOLOv5,” Electronics, vol. 12, no. 4, p. 878, 2023.
[12] P. K. Y. Wong, H. Luo, M. Wang, P. H. Leung, and J. C. Cheng, “Recognition of pedestrian trajectories and attributes with computer vision and deep learning techniques,” Advanced Engineering Informatics, vol. 49, p. 101356, 2021.
[13] M. S. Ansarnia, E. Tisserand, P. Schweitzer, M. A. Zidane, and Y. Berviller, “Contextual detection of pedestrians and vehicles in orthophotography by fusion of deep learning algorithms,” Sensors, vol. 22, no. 4, p. 1381, 2022.
[14] J. Kolluri and R. Das, “Intelligent multimodal pedestrian detection using hybrid metaheuristic optimization with deep learning model,” Image and Vision Computing, p. 104628, 2023.
[15] P. Sharma, S. Gupta, S. Vyas, and M. Shabaz, “Object detection and recognition using deep learning‐based techniques,” IET Communications, 2022.
[16] S. M. Azimi, M. Kraus, R. Bahmanyar, and P. Reinartz, “Multiple pedestrians and vehicles tracking in aerial imagery using a convolutional neural network,” Remote Sensing, vol. 13, no. 10, p. 1953, 2021.
[17] M. A. B. Fayyaz and C. Johnson, “Object detection at level crossing using deep learning,” Micromachines, vol. 11, no. 12, p. 1055, 2020.
[18] B. Zhou, P. Wu, Z. Gu, Z. Wu, and C. Yang, “XDRNet: Deep Learning-based Pedestrian and Vehicle Dead Reckoning Using Smartphones,” in Proc. 2022 IEEE 12th International Conference on Indoor Positioning and Indoor Navigation (IPIN), 2022, pp. 1–8.
[19] J. Chen, H. Liu, Y. Zhang, D. Zhang, H. Ouyang, and X. Chen, “A Multiscale Lightweight and Efficient Model Based on YOLOv7: Applied to Citrus Orchard,” Plants, vol. 11, no. 23, p. 3260, 2022.
[20] B. Amirshahi and S. Lahmiri, “Hybrid deep learning and GARCH-family models for forecasting volatility of cryptocurrencies,” Machine Learning with Applications, vol. 12, p. 100465, 2023.
[21] Y. Chen, M. Huang, K. Song, and T. Wang, “Prediction of Ship Traffic Flow and Congestion Based on Extreme Learning Machine with Whale Optimization Algorithm and Fuzzy c-Means Clustering,” Journal of Advanced Transportation, 2023.
[22] B. Amirshahi and S. Lahmiri, “Hybrid deep learning and GARCH-family models for forecasting volatility of cryptocurrencies,” Machine Learning with Applications, vol. 12, p. 100465, 2023.
[23] R. Bodalal and F. Shuaeib, “Marine Predators Algorithm for Sizing Optimization of Truss Structures with Continuous Variables,” Computation, vol. 11, no. 5, p. 91, 2023.
[24] [Online]. Available: https://github.com/YoungYoung619/pedestrian-detection-in-hazy-weather
[25] D. K. Jain, X. Zhao, G. González-Almagro, C. Gan, and K. Kotecha, “Multimodal pedestrian detection using metaheuristics with deep convolutional neural network in crowded scenes,” Information Fusion, vol. 95, pp. 401–414, 2023.