Journal of Cybersecurity and Information Management

Journal DOI

https://doi.org/10.54216/JCIM

Submit Your Paper

2690-6775ISSN (Online) 2769-7851ISSN (Print)

Volume 14 , Issue 2 , PP: 352-366, 2024 | Cite this article as | XML | Html | PDF | Full Length Article

An Efficient Algorithm for Stock Market Prediction Using Attention Mechanism

Zena Kreem Minsoor 1 * , Ali Yakoob Al-Sultan 2

  • 1 Department of Computer, College of Science for Women, University of Babylon, Babylon, Iraq - (scw734.zynh.kareem@student.uobablyon.edu.iq)
  • 2 Department of Computer, College of Science for Women, University of Babylon, Babylon, Iraq - (ali.alsultan@uobabylon.edu.iq)
  • Doi: https://doi.org/10.54216/JCIM.140226

    Received: January 30, 2024 Revised: April 10, 2024 Accepted: July 13, 2024
    Abstract

    Forecasting the stock market is a significant challenge in the financial industry due to its time series' complicated, noisy, chaotic, dynamic, volatile, and non-parametric nature. Nevertheless, due to computer advancements, an intelligent model can assist investors and expert analysts mitigate the risk associated with their investments. In recent years, substantial research has been conducted on deep learning models. Many studies have investigated using these techniques to anticipate stock values by analyzing historical data and technical indications. However, since the goal is to create predictions for the financial market, validating the model using profitability indicators and model performance is crucial. This article incorporates the attention mechanism model, incorporating attention from both feature and time perspectives. Utilize artificial neural networks. This approach addresses issues in time series prediction. The issue is the varying degrees of influence that many input features have on the target sequence. To tackle this, the method utilizes a feature attention mechanism to obtain the weights of distinct input features. An enhanced feature association relationship is achieved, whereas the data before and following the sequence exhibit a significant time correlation. An attention technique is employed to address this issue, allowing for the acquisition of weights at various time intervals to enhance robustness and temporal dependence. The system is applied to the three global SMs (TESLA, S&P500, and NASDAQ) datasets, the best enhancement results are 99% in Acc, and the better results improvement to minimize error in MSE, MAPE, and RMSE are 0.004, 0.004 and 0.01 respectively.

    Keywords :

    Stock market Prediction , Deep learning , Neural networks , Sentiment analysis , Reinforcement learning , Financial markets , Trading strategies

    References

    [1]       P. Patil, C. S. M. Wu, K. Potika, and M. Orang, “Stock market prediction using ensemble of graph theory, machine learning and deep learning models,” ACM Int. Conf. Proceeding Ser., pp. 85–92, 2020, doi: 10.1145/3378936.3378972.

    [2]       P. He, Y. Sun, Y. Zhang, and T. Li, “COVID–19’s Impact on Stock Prices Across Different Sectors—An Event Study Based on the Chinese Stock Market,” Emerg. Mark. Financ. Trade, vol. 56, no. 10, pp. 2198–2212, 2020, doi: 10.1080/1540496X.2020.1785865.

    [3]       E. Blankespoor, E. deHaan, and I. Marinovic, “Disclosure processing costs, investors’ information choice, and equity market outcomes: A review,” J. Account. Econ., vol. 70, no. 2–3, 2020, doi: 10.1016/j.jacceco.2020.101344.

    [4]       S. Singh, T. K. Madan, J. Kumar, and A. K. Singh, “Stock Market Forecasting using Machine Learning: Today and Tomorrow,” 2019 2nd Int. Conf. Intell. Comput. Instrum. Control Technol. ICICICT 2019, pp. 738–745, 2019, doi: 10.1109/ICICICT46008.2019.8993160.

    [5]       K. Bhushanwar and K. Barua, “Analyzing the Impact of Global Influencing Features with Weighted Attention Model for Stock Market Forecasting,” Int. J. Intell. Syst. Appl. Eng., vol. 11, no. 11s, pp. 352–367, 2023.

    [6]       L. Hang, D. Liu, and F. Xie, “A Hybrid Model Using PCA and BP Neural Network for Time Series Prediction in Chinese Stock Market with TOPSIS Analysis,” Sci. Program., vol. 2023, 2023, doi: 10.1155/2023/9963940.

    [7]       D. Shah, H. Isah, and F. Zulkernine, “Stock market analysis: A review and taxonomy of prediction techniques,” Int. J. Financ. Stud., vol. 7, no. 2, 2019, doi: 10.3390/ijfs7020026.

    [8]       H. Agarwal, G. Jariwala, and A. Shah, Analysis and Prediction of Stock Market Trends Using Deep Learning, vol. 121, no. May. Springer Singapore, 2020. doi: 10.1007/978-981-15-3369-3_39.

    [9]       A. H. Khan et al., “A performance comparison of machine learning models for stock market prediction with novel investment strategy,” PLoS One, vol. 18, no. 9 September, pp. 1–19, 2023, doi: 10.1371/journal.pone.0286362.

    [10]     A. A. R. Hussien and N. A. Z. Abdullah, “A Review for Arabic Sentiment Analysis Using Deep Learning,” Iraqi J. Sci., vol. 64, no. 12, pp. 6572–6585, 2023, doi: 10.24996/ijs.2023.64.12.37.

    [11]     H. Chung and K. shik Shin, “Genetic algorithm-optimized multi-channel convolutional neural network for stock market prediction,” Neural Comput. Appl., vol. 32, no. 12, pp. 7897–7914, 2020, doi: 10.1007/s00521-019-04236-3.

    [12]     M. C. Wu, S. Y. Lin, and C. H. Lin, “An effective application of decision tree to stock trading,” Expert Syst. Appl., vol. 31, no. 2, pp. 270–274, 2006, doi: 10.1016/j.eswa.2005.09.026.

    [13]     Y. Lin, S. Liu, H. Yang, and H. Wu, “Stock Trend Prediction Using Candlestick Charting and Ensemble Machine Learning Techniques with a Novelty Feature Engineering Scheme,” IEEE Access, vol. 9, pp. 101433–101446, 2021, doi: 10.1109/ACCESS.2021.3096825.

    [14]     C. Lohrmann and P. Luukka, “Classification of intraday S&P500 returns with a Random Forest,” Int. J. Forecast., vol. 35, no. 1, pp. 390–407, 2019, doi: 10.1016/j.ijforecast.2018.08.004.

    [15]     M. Nabipour, P. Nayyeri, H. Jabani, A. Mosavi, E. Salwana, and S. Shahab, “Deep learning for stock market prediction,” Entropy, vol. 22, no. 8, 2020, doi: 10.3390/E22080840.

    [16]     P. V. Chandrika and K. S. Srinivasan, “Predicting stock market movements using artificial neural networks,” Univers. J. Account. Financ., vol. 9, no. 3, pp. 405–410, 2021, doi: 10.13189/ujaf.2021.090315.

    [17]     M. Zulqarnain, R. Ghazali, M. G. Ghouse, Y. M. M. Hassim, and I. Javid, “Predicting Financial Prices of Stock Market using Recurrent Convolutional Neural Networks,” Int. J. Intell. Syst. Appl., vol. 12, no. 6, pp. 21–32, 2020, doi: 10.5815/ijisa.2020.06.02.

    [18]     A. Shams and A. Shams, “Market Using Machine Learning Faria Prediction Market Prediction Using Machine Learning Stock Market Using Machine Learning Faria Prediction Market Prediction Using Machine Learning Abdulhamit Market Prediction Using Machine Learning Market Prediction Usi,” Procedia Comput. Sci., vol. 194, pp. 173–179, 2020, doi: 10.1016/j.procs.2021.10.071.

    [19]     H. Li, “Tesla stock prediction: a comparative study between four models,” Highlights Business, Econ. Manag., vol. 24, pp. 182–187, 2024, doi: 10.54097/y1yk0a33.

    [20]     G. Bathla, “Stock price prediction using LSTM and SVR,” PDGC 2020 - 2020 6th Int. Conf. Parallel, Distrib. Grid Comput., pp. 211–214, 2020, doi: 10.1109/PDGC50313.2020.9315800.

    [21]     H. S. Sim, H. I. Kim, and J. J. Ahn, “Is Deep Learning for Image Recognition Applicable to Stock Market Prediction ?,” vol. 2019, 2019.

    [22]     U. Gurav and N. Sidnal, “Adaptive Stock Forecasting Model using Modified Backpropagation Neural Network (MBNN),” Proc. Int. Conf. Comput. Tech. Electron. Mech. Syst. CTEMS 2018, pp. 380–385, 2018, doi: 10.1109/CTEMS.2018.8769290.

    [23]     I. Suryani and D. C. P. Buani, “Stock price prediction using artificial neural network integrated moving average,” J. Phys. Conf. Ser., vol. 1641, no. 1, pp. 916–922, 2020, doi: 10.1088/1742-6596/1641/1/012028.

    [24]     Y. Yan and D. Yang, “A Stock Trend Forecast Algorithm Based on Deep Neural Networks,” Sci. Program., vol. 2021, 2021, doi: 10.1155/2021/7510641.

    [25]     M. H. Guo et al., “Attention mechanisms in computer vision: A survey,” Comput. Vis. Media, vol. 8, no. 3, pp. 331–368, 2022, doi: 10.1007/s41095-022-0271-y.

    [26]     M. Biswas, A. Shome, M. A. Islam, A. J. Nova, and S. Ahmed, “Predicting stock market price: A logical strategy using deep learning,” ISCAIE 2021 - IEEE 11th Symp. Comput. Appl. Ind. Electron., pp. 218–223, 2021, doi: 10.1109/ISCAIE51753.2021.9431817.

    [27]     Z. Xie and Y. Wang, “Exploration of Stock Portfolio Investment Construction Using Deep Learning Neural Network,” Comput. Intell. Neurosci., vol. 2022, 2022, doi: 10.1155/2022/7957097.

    [28]     K. J. Kim, “Financial time series forecasting using support vector machines,” Neurocomputing, vol. 55, no. 1–2, pp. 307–319, 2003, doi: 10.1016/S0925-2312(03)00372-2.

    [29]     J. Ayala, M. García-Torres, J. L. V. Noguera, F. Gómez-Vela, and F. Divina, “Technical analysis strategy optimization using a machine learning approach in stock market indices[Formula presented],” Knowledge-Based Syst., vol. 225, 2021, doi: 10.1016/j.knosys.2021.107119.

    [30]     T. H. H. Aldhyani and A. Alzahrani, “Framework for Predicting and Modeling Stock Market Prices Based on Deep Learning Algorithms,” Electron., vol. 11, no. 19, 2022, doi: 10.3390/electronics11193149.

    [31]     E. El., “A New Particle Swarm Optimization Based Stock Market Prediction Technique,” Int. J. Adv. Comput. Sci. Appl., vol. 7, no. 4, pp. 322–327, 2016, doi: 10.14569/ijacsa.2016.070442.

    [32]     H. Chung and K. Shin, “Genetic algorithm-optimized multi-channel convolutional neural network for stock market prediction,” Neural Comput. Appl., vol. 32, pp. 7897–7914, 2020.

    [33]     S. Albahli, A. Awan, T. Nazir, A. Irtaza, A. Alkhalifah, and W. Albattah, “A deep learning method DCWR with HANet for stock market prediction using news articles,” Complex Intell. Syst., vol. 8, no. 3, pp. 2471–2487, 2022, doi: 10.1007/s40747-022-00658-0.

    [34]     D. K. Padhi, N. Padhy, A. K. Bhoi, J. Shafi, and S. H. Yesuf, “An Intelligent Fusion Model with Portfolio Selection and Machine Learning for Stock Market Prediction,” Comput. Intell. Neurosci., vol. 2022, 2022, doi: 10.1155/2022/7588303.

    [35]     M. Vijh, D. Chandola, V. A. Tikkiwal, and A. Kumar, “ScienceDirect Stock Closing Closing Price Price Prediction Prediction using using Machine Machine Learning Learning Techniques Techniques,” Procedia Comput. Sci., vol. 167, no. 2019, pp. 599–606, 2020, doi: 10.1016/j.procs.2020.03.326.

    [36]     N. N. M. Azam, M. A. Ismail, M. S. Mohamad, A. O. Ibrahim, and S. Jeba, “Classification of COVID-19 Symptoms Using Multilayer Perceptron,” Iraqi J. Comput. Sci. Math., vol. 4, no. 4, pp. 99–110, 2023, doi: 10.52866/ijcsm.2023.04.04.009.

    [37]     A. Kumar et al., “Generative adversarial network (GAN) and enhanced root mean square error (ERMSE): deep learning for stock price movement prediction,” Multimed. Tools Appl., vol. 81, no. 3, pp. 3995–4013, 2022, doi: 10.1007/s11042-021-11670-w.

    [38] Yahoo Finance. (2023, October 20). Historical Data. Retrieved from https://finance.yahoo.com

    Cite This Article As :
    Kreem, Zena. , Yakoob, Ali. An Efficient Algorithm for Stock Market Prediction Using Attention Mechanism. Journal of Cybersecurity and Information Management, vol. , no. , 2024, pp. 352-366. DOI: https://doi.org/10.54216/JCIM.140226
    Kreem, Z. Yakoob, A. (2024). An Efficient Algorithm for Stock Market Prediction Using Attention Mechanism. Journal of Cybersecurity and Information Management, (), 352-366. DOI: https://doi.org/10.54216/JCIM.140226
    Kreem, Zena. Yakoob, Ali. An Efficient Algorithm for Stock Market Prediction Using Attention Mechanism. Journal of Cybersecurity and Information Management , no. (2024): 352-366. DOI: https://doi.org/10.54216/JCIM.140226
    Kreem, Z. , Yakoob, A. (2024) . An Efficient Algorithm for Stock Market Prediction Using Attention Mechanism. Journal of Cybersecurity and Information Management , () , 352-366 . DOI: https://doi.org/10.54216/JCIM.140226
    Kreem Z. , Yakoob A. [2024]. An Efficient Algorithm for Stock Market Prediction Using Attention Mechanism. Journal of Cybersecurity and Information Management. (): 352-366. DOI: https://doi.org/10.54216/JCIM.140226
    Kreem, Z. Yakoob, A. "An Efficient Algorithm for Stock Market Prediction Using Attention Mechanism," Journal of Cybersecurity and Information Management, vol. , no. , pp. 352-366, 2024. DOI: https://doi.org/10.54216/JCIM.140226