Fusion: Practice and Applications

Journal DOI

https://doi.org/10.54216/FPA

Submit Your Paper

2692-4048ISSN (Online) 2770-0070ISSN (Print)

Volume 17 , Issue 1 , PP: 209-220, 2025 | Cite this article as | XML | Html | PDF | Full Length Article

Leveraging LSTM and Attention for High-Accuracy Credit Card Fraud Detection

Ola Imran Obaid 1 * , Ali Yakoob Al-Sultan 2

  • 1 College of Science for Women-Computer Science Dept, University of Babylon, Babylon, Iraq - (ola.alghazaly.gsci135@student.uobabylon.edu.iq)
  • 2 College of Science for Women-Computer Science Dept, University of Babylon, Babylon, Iraq - (ali.alsultan@uobabylon.edu.iq)
  • Doi: https://doi.org/10.54216/FPA.170115

    Received: November 26, 2023 Revised: March 16, 2024 Accepted: July 20, 2024
    Abstract

    The increasing use of credit cards, especially for online payments, has led to a significant increase in fraud involving credit card payment technologies. Financial companies must enhance fraud detection systems to mitigate significant losses. This study introduces a methodology for developing a credit card fraud detection system that uses the Synthetic Minority Oversampling Technique (SMOTE) to address an imbalanced dataset problem and an attention layer to identify important features in the input sequence, two long short-term memory (LSTM) layers modeling long-run dependencies within a sequence of transactions, a dropout layer that neglects values lower than 0.3, and two dense layers, which allows enhancing the accuracy of prediction of fraudulent transactions. When implemented, the proposed system achieves an accuracy of 0.9434% on the IEEE dataset, 0.9850% on the Banksim dataset, and 0.9757% on the European dataset. This methodology shows improvements in fraud detection, emphasizing its ability to enhance financial security systems and reduce misclassification in credit card transactions.

    Keywords :

    Fraud Detection , Credit Cards , Deep Learning , SMOTE , Attention Mechanism , Long short-Term Memory

    References

    [1]     H. John and S. Naaz, “Credit Card Fraud Detection using Local Outlier Factor and Isolation Forest International Journal of Computer Sciences and Engineering Open Access Credit Card Fraud Detection using Local Outlier Factor and Isolation,” no. April, 2019, doi: 10.26438/ijcse/v7i4.10601064.

    [2]     H. Ahmad, B. Kasasbeh, B. Aldabaybah, and E. Rawashdeh, “Class balancing framework for credit card fraud detection based on clustering and similarity-based selection (SBS),” Int. J. Inf. Technol., vol. 15, no. 1, pp. 325–333, 2023, doi: 10.1007/s41870-022-00987-w.

    [3]     H. Wang, P. Zhu, X. Zou, and S. Qin, “An ensemble learning framework for credit card fraud detection based on training set partitioning and clustering,” Proc. - 2018 IEEE SmartWorld, Ubiquitous Intell. Comput. Adv. Trust. Comput. Scalable Comput. Commun. Cloud Big Data Comput. Internet People Smart City Innov. SmartWorld/UIC/ATC/ScalCom/CBDCo, pp. 94–98, 2018, doi: 10.1109/SmartWorld.2018.00051.

    [4]     Y. Jain, N. Tiwari, S. Dubey, and S. Jain, “A comparative analysis of various credit card fraud detection techniques,” Int. J. Recent Technol. Eng., vol. 7, no. 5, pp. 402–407, 2019.

    [5]     T. Y. Wu and Y. T. Wang, “Locally Interpretable One-Class Anomaly Detection for Credit Card Fraud Detection,” Proc. - 2021 Int. Conf. Technol. Appl. Artif. Intell. TAAI 2021, pp. 25–30, 2021, doi: 10.1109/TAAI54685.2021.00014.

    [6]     H. Najadat, O. Altiti, A. A. Aqouleh, and M. Younes, “Credit Card Fraud Detection Based on Machine and Deep Learning,” 2020 11th Int. Conf. Inf. Commun. Syst. ICICS 2020, no. May, pp. 204–208, 2020, doi: 10.1109/ICICS49469.2020.239524.

    [7]     K. Vengatesan, A. Kumar, S. Yuvraj, V. D. Ambeth Kumar, and S. S. Sabnis, “Credit card fraud detection using data analytic techniques,” Adv. Math. Sci. J., vol. 9, no. 3, pp. 1185–1196, 2020, doi: 10.37418/amsj.9.3.43.

    [8]     I. Benchaji, S. Douzi, B. El Ouahidi, and J. Jaafari, “Enhanced credit card fraud detection based on attention mechanism and LSTM deep model,” J. Big Data, 2021, doi: 10.1186/s40537-021-00541-8.

    [9]     E. Amusan et al., “Credit Card Fraud Detection on Skewed Data using Machine Learning Techniques,” LAUTECH J. Comput. Informatics, vol. 2, no. 1, pp. 49–56, 2021, [Online]. Available: https://www.researchgate.net/publication/354780529

    [10]   S. Al-Faqir and O. Ouda, “Credit Card Frauds Scoring Model Based on Deep Learning Ensemble,” J. Theor. Appl. Inf. Technol., vol. 100, no. 14, pp. 5223–5234, 2022.

    [11]   Kanika, J. Singla, A. K. Bashir, Y. Nam, N. U. I. Hasan, and U. Tariq, “Handling class imbalance in online transaction fraud detection,” Comput. Mater. Contin., vol. 70, no. 2, pp. 2861–2877, 2022, doi: 10.32604/cmc.2022.019990.

    [12]   A. Mniai, M. Tarik, and K. Jebari, “A Novel Framework for Credit Card Fraud Detection,” IEEE Access, vol. 11, no. October, pp. 112776–112786, 2023, doi: 10.1109/ACCESS.2023.3323842.

    [13]   S. Jiang, R. Dong, J. Wang, and M. Xia, “Credit Card Fraud Detection Based on Unsupervised Attentional Anomaly Detection Network,” Systems, vol. 11, no. 6, pp. 1–14, 2023, doi: 10.3390/systems11060305.

    [14]   S. Peneti, S. Rama Krishna, A. Kiran, and H. K. Tripathy, “Credit Card Fraud Detection Using Machine Learning,” Proc. 2nd Int. Conf. Adv. Smart, Secur. Intell. Comput. ASSIC 2024, no. November, 2024, doi: 10.1109/ASSIC60049.2024.10508010.

    [15]   D. P. Prabha and C. V. Priscilla, “Estimation of optimal threshold shifting to handle class imbalance in credit card fraud detection using machine learning techniques,” AIP Conf. Proc., vol. 2802, no. 1, 2024, doi: 10.1063/5.0182386.

    [16]   V. N. Dornadula and S. Geetha, “Credit Card Fraud Detection using Machine Learning Algorithms,” Procedia Comput. Sci., vol. 165, pp. 631–641, 2019, doi: 10.1016/j.procs.2020.01.057.

    [17]   I. Benchaji, S. Douzi, and B. El Ouahidi, “Credit card fraud detection model based on LSTM recurrent neural networks,” J. Adv. Inf. Technol., vol. 12, no. 2, pp. 113–118, 2021, doi: 10.12720/jait.12.2.113-118.

    [18]   M. J. Madhurya, H. L. Gururaj, B. C. Soundarya, K. P. Vidyashree, and A. B. Rajendra, “Exploratory analysis of credit card fraud detection using machine learning techniques,” vol. 3, no. April, pp. 31–37, 2022, doi: 10.1016/j.gltp.2022.04.006.

    [19]   S. Rao, P. Poojary, J. Somaiya, and P. Mahajan, “a Comparative Study Between Various Preprocessing Techniques for Machine Learning,” Int. J. Eng. Appl. Sci. Technol., vol. 5, no. 3, pp. 431–438, 2020, doi: 10.33564/ijeast.2020.v05i03.069.

    [20]   O. S. Yee, S. Sagadevan, and N. H. A. H. Malim, “Credit card fraud detection using machine learning as data mining technique,” J. Telecommun. Electron. Comput. Eng., vol. 10, no. 1–4, pp. 23–27, 2018.

    [21]   U. Ependi, A. F. Rochim, and A. Wibowo, “A Hybrid Sampling Approach for Improving the Classification of Imbalanced Data Using ROS and NCL Methods,” Int. J. Intell. Eng. Syst., vol. 16, no. 3, pp. 345–361, 2023, doi: 10.22266/ijies2023.0630.28.

    [22]   Z. Zhao and T. Bai, “Using SMOTE and Machine Learning Algorithms,” Entropy, vol. 24, no. 1157, pp. 1–18, 2022, doi: org/10.3390/e24081157.

    [23]   Y. Sun et al., “Borderline SMOTE Algorithm and Feature Selection‐Based Network Anomalies Detection Strategy,” Energies, vol. 15, no. 13, 2022, doi: 10.3390/en15134751.

    [24]   M. H. Al-Tai and B. M. Nema, “Detecting Arabic Misinformation Using an Attention Mechanism-Based Model,” Iraqi J. Comput. Sci. Math., vol. 5, no. 1, pp. 285–298, 2024, doi: 10.52866/ijcsm.2024.05.01.020.

    [25]   H. Song, K. Huang, X. Ji, and F. Wan, “Fraud web page detection based on bidirectional LSTM and attention mechanism,” vol. 12329, no. Aiea, p. 100, 2022, doi: 10.1117/12.2646903.

    [26]   M. Fazil, A. K. Sah, and M. Abulaish, “DeepSBD: A Deep Neural Network Model with Attention Mechanism for SocialBot Detection,” IEEE Trans. Inf. Forensics Secur., vol. 16, pp. 4211–4223, 2021, doi: 10.1109/TIFS.2021.3102498.

    [27]   K. Mohiuddin et al., “Retention Is All You Need,” Int. Conf. Inf. Knowl. Manag. Proc., no. Nips, pp. 4752–4758, 2023, doi: 10.1145/3583780.3615497.

    [28]   G. Wang, J. Ma, and G. Chen, “Attentive statement fraud detection: Distinguishing multimodal financial data with fine-grained attention,” Decis. Support Syst., vol. 167, no. December 2022, p. 113913, 2023, doi: 10.1016/j.dss.2022.113913.

    [29]   A. Mohari, J. Dowerah, K. Das, F. Koucher, and D. J. Bora, “Credit Card Fraud Detection Techniques: A Review,” no. July, pp. 157–166, 2021, doi: 10.1007/978-981-16-1048-6_12.

    Cite This Article As :
    Imran, Ola. , Yakoob, Ali. Leveraging LSTM and Attention for High-Accuracy Credit Card Fraud Detection. Fusion: Practice and Applications, vol. , no. , 2025, pp. 209-220. DOI: https://doi.org/10.54216/FPA.170115
    Imran, O. Yakoob, A. (2025). Leveraging LSTM and Attention for High-Accuracy Credit Card Fraud Detection. Fusion: Practice and Applications, (), 209-220. DOI: https://doi.org/10.54216/FPA.170115
    Imran, Ola. Yakoob, Ali. Leveraging LSTM and Attention for High-Accuracy Credit Card Fraud Detection. Fusion: Practice and Applications , no. (2025): 209-220. DOI: https://doi.org/10.54216/FPA.170115
    Imran, O. , Yakoob, A. (2025) . Leveraging LSTM and Attention for High-Accuracy Credit Card Fraud Detection. Fusion: Practice and Applications , () , 209-220 . DOI: https://doi.org/10.54216/FPA.170115
    Imran O. , Yakoob A. [2025]. Leveraging LSTM and Attention for High-Accuracy Credit Card Fraud Detection. Fusion: Practice and Applications. (): 209-220. DOI: https://doi.org/10.54216/FPA.170115
    Imran, O. Yakoob, A. "Leveraging LSTM and Attention for High-Accuracy Credit Card Fraud Detection," Fusion: Practice and Applications, vol. , no. , pp. 209-220, 2025. DOI: https://doi.org/10.54216/FPA.170115