Journal of Intelligent Systems and Internet of Things

Journal DOI

https://doi.org/10.54216/JISIoT

Submit Your Paper

2690-6791ISSN (Online) 2769-786XISSN (Print)

Volume 13 , Issue 2 , PP: 08-24, 2024 | Cite this article as | XML | Html | PDF | Full Length Article

Digital Forensic Based Object Recognition for Enhanced Crime Scene Interpretation

Vikash Kumar Singh 1 * , Durga Sivashankar 2 , Siddharth Sriram 3 , Manish Nagpal 4 , Warish Patel 5 , Shweta Loonkar 6

  • 1 Principal Software Engineer, IT, Societe Generale, India - (vikashsd@gmail.com)
  • 2 Technical Lead, IT, Siemens Healthineers, India - (durga.sivashankar@yahoo.com)
  • 3 Centre of Research Impact and Outcome, Chitkara University, Rajpura- 140417, Punjab, India - (siddharth.sriram.orp@chitkara.edu.in)
  • 4 Chitkara Centre for Research and Development, Chitkara University, Himachal Pradesh-174103 India - (manish.nagpal.orp@chitkara.edu.in)
  • 5 Associate Professor, Department of Computer Science and Engineering, Parul Institute of Engineering and Technology, Parul University, Vadodara, Gujarat, India - (warishkumar.patel@paruluniversity.ac.in)
  • 6 Assistant Professor, Department of ISME, ATLAS SkillTech University, Mumbai, Maharashtra, India - (shweta.loonkar@atlasuniversity.edu.in)
  • Doi: https://doi.org/10.54216/JISIoT.130201

    Received: September 18, 2023 Revised: February 02, 2024 Accepted: June 17, 2024
    Abstract

    This research introduces a novel and comprehensive framework for digital forensics-based crime scene interpretation. The proposed framework comprises five algorithms, each serving a distinct purpose in enhancing image quality, extracting features, matching, and constructing a database, recognizing, and reconstructing objects in 3D, and conducting context-aware analysis. An ablation study validates the necessity of each algorithmic step. The framework consistently outperforms existing methods in terms of accuracy, precision, recall, and processing time. A detailed comparative analysis of parameters further highlights its cost-effectiveness, moderate complexity, superior data integration, and scalability. Visualizations underscore its dominance across multiple metrics and parameters, positioning it as an advanced solution for digital forensic-based object recognition in crime scene interpretation.

    Keywords :

    Digital forensics , Crime scene interpretation , Object recognition , Preprocessing , Feature extraction , Database construction , 3D reconstruction , Context-aware analysis , Decision support , Performance comparison

    References

    [1]      K. Nogueira, O. Penatti, and J. Santos, "Towards better exploiting convolutional neural networks for remote sensing scene classification," Pattern Recognition, vol. 61, pp. 539–556, 2016. [Online]. Available: Google Scholar

    [2]      X. Qi, C.-G. Li, G. Zhao, X. Hong, and M. Pietikäinen, "Dynamic texture and scene classification by transferring deep image features," Neurocomputing, vol. 171, no. 6, pp. 1230–1241, 2016. [Online]. Available: Publisher Site | Google Scholar

    [3]      C. Gong, Z. Li, X. Yao, L. Guo, and Z. Wei, "Remote sensing image scene classification using bag of convolutional features," IEEE Geoscience & Remote Sensing Letters, vol. 14, no. 10, pp. 1735–1739, 2017. [Online]. Available: Google Scholar

    [4]      D. Pathak and R. Kashyap, "Neural correlate-based E-learning validation and classification using convolutional and Long Short-Term Memory networks," Traitement du Signal, vol. 40, no. 4, pp. 1457-1467, 2023. [Online]. Available: https://doi.org/10.18280/ts.400414

    [5]      R. Kashyap, "Stochastic Dilated Residual Ghost Model for Breast Cancer Detection," J Digit Imaging, vol. 36, pp. 562–573, 2023. [Online]. Available: https://doi.org/10.1007/s10278-022-00739-z

    [6]      D. Bavkar, R. Kashyap, and V. Khairnar, "Deep Hybrid Model with Trained Weights for Multimodal Sarcasm Detection," in Inventive Communication and Computational Technologies, G. Ranganathan, G. A. Papakostas, and Á. Rocha, Eds. Singapore: Springer, 2023, vol. 757, Lecture Notes in Networks and Systems. [Online]. Available: https://doi.org/10.1007/978-981-99-5166-6_13

    [7]      M. Hayat, S. H. Khan, M. Bennamoun, and S. An, "A spatial layout and scale invariant feature representation for indoor scene classification," IEEE Transactions on Image Processing, vol. 25, no. 10, pp. 4829–4841, 2016. [Online]. Available: Publisher Site | Google Scholar

    [8]      H. Phan, L. Hertel, M. Maass, P. Koch, R. Mazur, and A. Mertins, "Improved audio scene classification based on label-tree embeddings and convolutional neural networks," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 25, no. 6, pp. 1278–1290, 2017. [Online]. Available: Publisher Site | Google Scholar

    [9]      A. Rakotomamonjy, "Supervised representation learning for audio scene classification," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 25, no. 6, pp. 1253–1265, 2017. [Online]. Available: Publisher Site | Google Scholar

    [10]    M. Raissi and G. E. Karniadakis, "Hidden physics models: machine learning of nonlinear partial differential equations," Journal of Computational Physics, vol. 357, pp. 125–141, 2018. [Online]. Available: Publisher Site | [Google Scholar](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Hidden+physics+models%3A+

    [11]    J. G. Kotwal, R. Kashyap, and P. M. Shafi, "Artificial Driving based EfficientNet for Automatic Plant Leaf Disease Classification," Multimed Tools Appl, 2023. [Online]. Available: https://doi.org/10.1007/s11042-023-16882-w

    [12]    V. Roy et al., “Detection of sleep apnea through heart rate signal using Convolutional Neural Network,” International Journal of Pharmaceutical Research, vol. 12, no. 4, pp. 4829-4836, Oct-Dec 2020.

    [13]    R. Kashyap, "Machine Learning, Data Mining for IoT-Based Systems," in Research Anthology on Machine Learning Techniques, Methods, and Applications, Information Resources Management Association, Ed. IGI Global, 2022, pp. 447-471. [Online]. Available: https://doi.org/10.4018/978-1-6684-6291-1.ch025

    [14]    W. Yang and S. Krishnan, "Combining temporal features by local binary pattern for acoustic scene classification," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 25, no. 6, pp. 1315–1321, 2017. [Online]. Available: Publisher Site | Google Scholar

    [15]    M. A. Alamir, "A novel acoustic scene classification model using the late fusion of convolutional neural networks and different ensemble classifiers," Applied Acoustics, vol. 172, no. 3, pp. 112–122, 2020. [Online]. Available: Google Scholar

    [16]    X. Lin, X. Wang, and L. Li, "Intelligent detection of edge inconsistency for mechanical workpiece by machine vision with deep learning and variable geometry model," Applied Intelligence, vol. 50, no. 7, pp. 2105–2119, 2020. [Online]. Available: Publisher Site | Google Scholar

    [17]    T. Kim, I. Y. Jung, and Y. C. Hu, "Automatic, location-privacy preserving dashcam video sharing using blockchain and deep learning," Human-centric Computing and Information Sciences, vol. 10, no. 1, pp. 1–23, 2020. [Online]. Available: Publisher Site | Google Scholar

    [18]    H. P. Sahu and R. Kashyap, "FINE_DENSEIGANET: Automatic medical image classification in chest CT scan using Hybrid Deep Learning Framework," International Journal of Image and Graphics [Preprint], 2023. [Online]. Available: https://doi.org/10.1142/s0219467825500044

    [19]    S. Stalin, V. Roy, P. K. Shukla, A. Zaguia, M. M. Khan, P. K. Shukla, A. Jain, "A Machine Learning-Based Big EEG Data Artifact Detection and Wavelet-Based Removal: An Empirical Approach," Mathematical Problems in Engineering, vol. 2021, Article ID 2942808, 11 pages, 2021. [Online]. Available: https://doi.org/10.1155/2021/2942808

    [20]    Y. Mitsukura, "EEG signal processing for real applications," Journal of Signal Processing, vol. 20, no. 1, pp. 1–7, 2016. [Online]. Available: Publisher Site | Google Scholar

    [21]    F. a. Zhao, X. Zhang, X. Mu, Z. Yi, and Z. Yang, "Learning multi-modality features for scene classification of high-resolution remote sensing images," Journal of Computer and Communications, vol. 06, no. 11, pp. 185–193, 2018. [Online]. Available: Publisher Site | [Google Scholar]

    [22]    Rishabh Singh , Rishabh Reddy , Vidhi Kapoor , Prathamesh Churi, K-means Clustering Analysis of Crimes on Indian Women, Journal of Cybersecurity and Information Management, Vol. 4 , No. 1 , (2020) : 05-25 (Doi   :  https://doi.org/10.54216/JCIM.040101)

    [23]    Gautam Gupta,Prachi Aggarwal,Achin Jain,Puneet Singh Lamba,Arun Kumar Dubey, Gopal Chaudhary, Crime Anomaly Detection using CNN and Ensemble Model, Journal of Fusion: Practice and Applications, Vol. 11 , No. 1 , (2023) : 89-99 (Doi   :  https://doi.org/10.54216/FPA.110107)

    [24]    Mahmoud lsmail , Naif El-Rashidy, Nabil M. Abdel-aziz, Mobile Cloud Database Security: Problems and Solutions, Fusion: Practice and Applications, Vol. 7, No. 1, (2022) 15-29 (Doi htps://doi.org/10.54216/FPA.070102)

    [25]    Mahmoud A. Zaher, Mohmaed A. Labib, Artificial Flora Optimization Algorithm with Functional Link Neural Network for DoS Attack Classification in WSN, International Journal of Wireless and Ad Hoc Communication, Vol. 4, No. 1, (2022) : 08- 18 (Doi https://doi.org/10.54216/1JWAC.040101)

    [26]    Prabu S., Alekhya A. Kiran K. Chatragadda, Venkateswarlu Lingala, Secured Authentication of Node in Mobile Adhoc Network, International Journal of Wireless and Ad Hoc Communication, Vol. 5, No. 2, (2022): 19- 29 (Doi : https:/doi.org/10.54216/\JWAC.050202)

    [27]    S.P. Samyuktha, Dr.P. Kavitha, V.A Kshaya, P. Shalini, R. Ramya, A Survey on Cyber Security Meets Artificial Intelligence: A- Driven Cyber Security, Journal of Cognitive Human-Computer Interaction, Vol. 2, No. 2, (2022):50- 55 (Doi : https:/doi.org/10.54216/JCHCI.020202)

    [28]    M. Sumithra , Kiruthika.S , Nithya S , Poornima B , DharanyaS, Enhancement Of Cloud User Data Access Security Entrusted to AI Face Recognition Techniques, Journal of Cognitive Human-Computer Interaction, Vol. 2 , No. 2 , (2022) : 60-64 (Doi   :  https://doi.org/10.54216/JCHCI.020204)

    [29]    Mustafa El-Taie,Aaras Y.Kraidi, Cybersecurity Detection Model using Machine Learning Techniques, Journal of Journal of Cybersecurity and Information Management, Vol. 12 , No. 1 , (2023) : 41-49 (Doi   :  https://doi.org/10.54216/JCIM.120104)

    [30]    Raaid Alubady, Rawan A.shlaka, Hussein Alaa Diame, Sarah Ali Abdulkareem, Ragheed Hussam, Sahar Yassine, Venkatesan Rajinikanth,  Blockchain-based e-Medical Record and Data Security Service Management based on IoMT resource,  Journal of Intelligent Systems and Internet of Things,  Vol. 8 ,  No. 2 ,  (2023) : 86-100 (Doi   :  https://doi.org/10.54216/JISIoT.080207)

     
    Cite This Article As :
    Kumar, Vikash. , Sivashankar, Durga. , Sriram, Siddharth. , Nagpal, Manish. , Patel, Warish. , Loonkar, Shweta. Digital Forensic Based Object Recognition for Enhanced Crime Scene Interpretation. Journal of Intelligent Systems and Internet of Things, vol. , no. , 2024, pp. 08-24. DOI: https://doi.org/10.54216/JISIoT.130201
    Kumar, V. Sivashankar, D. Sriram, S. Nagpal, M. Patel, W. Loonkar, S. (2024). Digital Forensic Based Object Recognition for Enhanced Crime Scene Interpretation. Journal of Intelligent Systems and Internet of Things, (), 08-24. DOI: https://doi.org/10.54216/JISIoT.130201
    Kumar, Vikash. Sivashankar, Durga. Sriram, Siddharth. Nagpal, Manish. Patel, Warish. Loonkar, Shweta. Digital Forensic Based Object Recognition for Enhanced Crime Scene Interpretation. Journal of Intelligent Systems and Internet of Things , no. (2024): 08-24. DOI: https://doi.org/10.54216/JISIoT.130201
    Kumar, V. , Sivashankar, D. , Sriram, S. , Nagpal, M. , Patel, W. , Loonkar, S. (2024) . Digital Forensic Based Object Recognition for Enhanced Crime Scene Interpretation. Journal of Intelligent Systems and Internet of Things , () , 08-24 . DOI: https://doi.org/10.54216/JISIoT.130201
    Kumar V. , Sivashankar D. , Sriram S. , Nagpal M. , Patel W. , Loonkar S. [2024]. Digital Forensic Based Object Recognition for Enhanced Crime Scene Interpretation. Journal of Intelligent Systems and Internet of Things. (): 08-24. DOI: https://doi.org/10.54216/JISIoT.130201
    Kumar, V. Sivashankar, D. Sriram, S. Nagpal, M. Patel, W. Loonkar, S. "Digital Forensic Based Object Recognition for Enhanced Crime Scene Interpretation," Journal of Intelligent Systems and Internet of Things, vol. , no. , pp. 08-24, 2024. DOI: https://doi.org/10.54216/JISIoT.130201