970 691
Full Length Article
Fusion: Practice and Applications
Volume 2 , Issue 1, PP: 42-60 , 2020 | Cite this article as | XML | Html |PDF

Title

Pixel Level Image Fusion in Moving objection Detection and Tracking with Machine Learning

  Piyush K. Pareek 1 *

1  Advisor IPR, Nitte Meenakshi Institute of Technology Bengaluru, India
    (piyushkumarpareek88@ieee.org)


Doi   :   https://doi.org/10.54216/FPA.020105

Received: February 10, 2020 Revised: April 02, 2020 Accepted: May 27, 2020

Abstract :

It is not feasible for a single image sensor to convey all of the information essential to comprehend a circumstance thoroughly. The output of many image sensors combined in one place would supply more accurate or comprehensive information on the topic at hand. In recent years, multi-sensor fusion has emerged in the academic world as an emerging topic that has the potential to produce beneficial results. This is because it can aggregate the data from several different sensors. One of the primary objectives is to devise various methods for combining kinematic and visual data to track a moving object. These methods should allow us to achieve this aim. This article looks into the intricacies of various techniques to evaluate the current condition of a target and explores the outcomes of those approaches. These sorts of methods include, for instance, the Kalman filter and its expanded version, the extended Kalman filter. The study of the proposed work is to demonstrate the specifics of the development of an interacting multiple-model Kalman filter to monitor the performance of the moving target in response to a wide variety of tuning parameters. The proposed technique includes the Principal Component Analysis and spatial frequency to integrate the hazy images that were all shot with the same sensor modalities. This action was taken to achieve the aimed-for outcome. The effectiveness of the fusion is evaluated based on the results of several distinct metrics.

Keywords :

wavelet-based image fusion; sum absolute difference; hazy images; Kalman filter

References :

[1] Adriano, B., Xia, J., Baier, G., Yokoya, N., & Koshimura, S. (2019). Multi-source data fusion

based on ensemble learning for rapid building damage mapping during the 2018 sulawesi

earthquake and tsunami in Palu, Indonesia. Remote Sensing, 11(7), 886.

[2] AlZu'bi, S., & Jararweh, Y. (2020, April). Data fusion in autonomous vehicles research,

literature tracing from imaginary idea to smart surrounding community. In 2020 Fifth

International Conference on Fog and Mobile Edge Computing (FMEC) (pp. 306-311). IEEE.

[3] Ashish Khare, Uma Shanker Tiwary, Pedrycz, W & Moongu Jeon 2010, ‗Multilevel adaptive

thresholding and shrinkage technique for denoising using Daubechies complex wavelet

transform‘, The Imaging Science Journal, vol. 58, no. 6, pp. 340-358.

[4] Bing Nan, Li, Chee Kong Chui, Ong, SH & Stephen Chang 2009, ‗Integrating FCM and Level

Sets for Liver Tumor Segmentation‘, ICBME 2008, Proceedings, vol.23, pp. 202-205.

[5] Bovolo, F, Bruzzone, L, Capobianco, L, Garzelli, A, Marchesi, S & Nencini, F 2010, ‗Analysis

of the effects of pansharpening in change detection on VHR images‘, IEEE Geoscience &

Remote Sensing Letters, vol. 7, pp. 53-57. 7.

[6] Bruzzone, L & Melgani, F 2003, ‗A data fusion approach to unsupervised change detection‘,

Proceedings, IEEE International, vol. 2, pp. 1374-1376.

[7] Changtao He, Quanxi Liu, Hongliang Li & Haixu Wang 2010, ‗Multimodal medical image

fusion based on IHS and PCA‘, Procedia Engineering, no. 7, pp. 280–285.

[8] Comba, L., Biglia, A., Aimonino, D. R., Barge, P., Tortia, C., & Gay, P. (2019, October). 2D

and 3D data fusion for crop monitoring in precision agriculture. In 2019 IEEE International

Workshop on Metrology for Agriculture and Forestry (MetroAgriFor) (pp. 62-67). IEEE.

[9] Dey, S., Ye, Q., & Sampalli, S. (2019). A machine learning based intrusion detection scheme for

data fusion in mobile clouds involving heterogeneous client networks. Information Fusion, 49,

205-215.

[10] Diez-Olivan, A., Del Ser, J., Galar, D., & Sierra, B. (2019). Data fusion and machine learning for

industrial prognosis: Trends and perspectives towards Industry 4.0. Information Fusion, 50, 92-

111.

[11] Dr. Ajay B. Gadicha , Dr. Vijay B. Gadicha, Implicit Authentication Approach by Generating

Strong Password through Visual Key Cryptography, Journal of Cybersecurity and Information

Management, Vol. 1 , No. 1 , (2020) : 5-16 (Doi : https://doi.org/10.54216/JCIM.010102)

[12] Eleftheroglou, N., Zarouchas, D., Loutas, T., Alderliesten, R., & Benedictus, R. (2018).

Structural health monitoring data fusion for in-situ life prognosis of composite

structures. Reliability Engineering & System Safety, 178, 40-54.

[13] Gao, J., Li, P., Chen, Z., & Zhang, J. (2020). A survey on deep learning for multimodal data

fusion. Neural Computation, 32(5), 829-864.

[14] Ghamisi, P., Rasti, B., Yokoya, N., Wang, Q., Hofle, B., Bruzzone, L., ... & Benediktsson, J. A.

(2019). Multisource and multitemporal data fusion in remote sensing: A comprehensive review

of the state of the art. IEEE Geoscience and Remote Sensing Magazine, 7(1), 6-39.

[15] Hisham Elhoseny , Hazem EL-Bakry, Utilizing Service Oriented Architecture (SOA) in IoT

Smart Applications, Journal of Cybersecurity and Information Management, Vol. 0 , No. 1 ,

(2019) : 15-31 (Doi : https://doi.org/10.54216/JCIM.000102)

[16] Hossam M. Moftah , Taha M. Mohamed, A Novel Fuzzy Bat Based Ambulance Detection and

Traffic Counting Approach, Journal of Cybersecurity and Information Management, Vol. 1 , No.

2 , (2020) : 41-54 (Doi : https://doi.org/10.54216/JCIM.010203)

[17] Ji, W., Adamchuk, V. I., Chen, S., Su, A. S. M., Ismail, A., Gan, Q., ... & Biswas, A. (2019).

Simultaneous measurement of multiple soil properties through proximal sensor data fusion: A

case study. Geoderma, 341, 111-128

[18] Liu, J., Li, T., Xie, P., Du, S., Teng, F., & Yang, X. (2020). Urban big data fusion based on deep

learning: An overview. Information Fusion, 53, 123-133.

[19] Liu, M., Yang, W., Zhu, X., Chen, J., Chen, X., Yang, L., & Helmer, E. H. (2019). An Improved

Flexible Spatiotemporal DAta Fusion (IFSDAF) method for producing high spatiotemporal

resolution normalized difference vegetation index time series. Remote Sensing of

Environment, 227, 74-89.

[20] MAHMOUD A. SALAM , M.M.EL-GAYAR, A Novel Hybrid Bio-Inspiration Technique for

Service Composition, Journal of Cybersecurity and Information Management, Vol. 0 , No. 1 ,

(2019) : 05-14 (Doi : https://doi.org/10.54216/JCIM.000101)

[21] Pan, Y., Ren, C., Liang, Y., Zhang, Z., & Shi, Y. (2020). Inversion of surface vegetation water

content based on GNSS-IR and MODIS data fusion. Satellite Navigation, 1(1), 1-15.

[22] Pham, V. T., Le, Q. B., Nguyen, D. A., Dang, N. D., Huynh, H. T., & Tran, D. T. (2019). Multisensor

data fusion in a real-time support system for on-duty firefighters. Sensors, 19(21), 4746.

[23] Radhakrishna, V., Aljawarneh, S., Kumar, P. V., Janaki, V., & Cheruvu, A. (2019, June). Tree

based data fusion approach for mining temporal patterns. In Proceedings of the 5th International

Conference on Engineering and MIS (pp. 1-5).

[24] Senanayaka, J. S. L., Van Khang, H., & Robbersmyr, K. G. (2018). Multiple classifiers and data

fusion for robust diagnosis of gearbox mixed faults. IEEE Transactions on Industrial

Informatics, 15(8), 4569-4579.

[25] Shahrbabaki, M. R., Safavi, A. A., Papageorgiou, M., & Papamichail, I. (2018). A data fusion

approach for real-time traffic state estimation in urban signalized links. Transportation research

part C: emerging technologies, 92, 525-548.

[26] Wang, Z., Hong, T., & Piette, M. A. (2019). Data fusion in predicting internal heat gains for

office buildings through a deep learning approach. Applied energy, 240, 386-398.


Cite this Article as :
Style #
MLA Piyush K. Pareek. "Pixel Level Image Fusion in Moving objection Detection and Tracking with Machine Learning." Fusion: Practice and Applications, Vol. 2, No. 1, 2020 ,PP. 42-60 (Doi   :  https://doi.org/10.54216/FPA.020105)
APA Piyush K. Pareek. (2020). Pixel Level Image Fusion in Moving objection Detection and Tracking with Machine Learning. Journal of Fusion: Practice and Applications, 2 ( 1 ), 42-60 (Doi   :  https://doi.org/10.54216/FPA.020105)
Chicago Piyush K. Pareek. "Pixel Level Image Fusion in Moving objection Detection and Tracking with Machine Learning." Journal of Fusion: Practice and Applications, 2 no. 1 (2020): 42-60 (Doi   :  https://doi.org/10.54216/FPA.020105)
Harvard Piyush K. Pareek. (2020). Pixel Level Image Fusion in Moving objection Detection and Tracking with Machine Learning. Journal of Fusion: Practice and Applications, 2 ( 1 ), 42-60 (Doi   :  https://doi.org/10.54216/FPA.020105)
Vancouver Piyush K. Pareek. Pixel Level Image Fusion in Moving objection Detection and Tracking with Machine Learning. Journal of Fusion: Practice and Applications, (2020); 2 ( 1 ): 42-60 (Doi   :  https://doi.org/10.54216/FPA.020105)
IEEE Piyush K. Pareek, Pixel Level Image Fusion in Moving objection Detection and Tracking with Machine Learning, Journal of Fusion: Practice and Applications, Vol. 2 , No. 1 , (2020) : 42-60 (Doi   :  https://doi.org/10.54216/FPA.020105)