2692-4048ISSN (Online)
2770-0070ISSN (Print)
Volume 17 , Issue 2 , PP: 294-314, 2025 | Cite this article as | XML | Html | PDF | Full Length Article
Ali Jaber Almalki 1 *
Doi: https://doi.org/10.54216/FPA.170222
Electric vehicles (EVs) have gained significant traction due to their environmental benefits and potential to revolutionize the transportation sector. Integrating EVs into the Vehicle-to-Grid (V2G) network presents an innovative solution for optimizing energy transactions and grid stability. However, managing energy transactions during peak hours poses a challenge. This research proposes a novel approach that combines the Deep Q-Network (DQN) algorithm with block chain technology to enhance energy transactions in the V2G network. In this study, a V2G network model is introduced consisting of EVs, charging stations, a grid control center, and a block chain infrastructure. The block chain ensures transparency, security, and decentralized energy transactions. The DQN algorithm learns optimal action policies based on current states and rewards, contributing to grid stability. To incentivize EV owners for peak-hour energy contributions, a block chain-enabled rewarding mechanism is implemented. The proposed methodology is rigorously evaluated through simulations conducted in a custom environment that emulates V2G network dynamics. Performance metrics such as load shifting efficiency, peak demand reduction, and energy efficiency are employed for comprehensive assessment. The proposed method showcases superior performance compared to traditional load shifting and demand response strategies. Furthermore, comparative analyses are conducted against different state-of-the-art methods, demonstrating the effectiveness of our approach. The results underscore the potential of integrating DQN-based energy management with block chain technology to achieve grid stability and incentivize sustainable energy behaviors. This research contributes to the advancement of smart grid technologies, paving the way for a more sustainable and efficient energy ecosystem.
Vehicle-to-grid , Electric vehicle , Block chain , Energy transaction , Deep Q-network , Accumulative reward , Action policy , Grid control center and charging station
[1] Wang, J., 2022. A novel electric vehicle charging chain design based on blockchain technology. Energy Reports, 8, pp.785-793.
[2] Tappeta, V.S.R., Appasani, B., Patnaik, S. and Ustun, T.S., 2022. A Review on Emerging Communication and Computational Technologies for Increased Use of Plug-In Electric Vehicles. Energies, 15(18), p.6580.
[3] Gao, Y., Ren, T., Zhao, X. and Li, W., 2022. Sustainable Energy Management in Intelligent Transportation. Journal of Interconnection Networks, 22(Supp04), p.2146009.
[4] Shirley, C.P., Sonia, S.E., Sathya, V., Manikandan, N., Vidhyalakshmi, M.K. and Reddy, C.V.K., 2023, March. Blockchain and Deep Learning Development of Smart Charging of Electric Vehicles to Meet the Demand Side Management. In 2023 International Conference on Sustainable Computing and Data Communication Systems (ICSCDS) (pp. 1377-1381). IEEE.
[5] Shoja, Z.M., Mirzaei, M.A., Seyedi, H. and Zare, K., 2022. Sustainable energy supply of electric vehicle charging parks and hydrogen refueling stations integrated in local energy systems under a risk-averse optimization strategy. Journal of Energy Storage, 55, p.105633.
[6] Sharma, S. and Jain, P., 2021. Risk‐averse integrated demand response and dynamic G2V charge scheduling of an electric vehicle aggregator to support grid stability. International Transactions on Electrical Energy Systems, 31(5), p.e12867.
[7] Iqbal, A., Rajasekaran, A.S., Nikhil, G.S. and Azees, M., 2021. A secure and decentralized blockchain based EV energy trading model using smart contract in V2G network. IEEE Access, 9, pp.75761-75777.
[8] Zhang, W., Yang, W., Chen, C., Li, N., Bao, Z. and Luo, M., 2022. Toward Privacy-Preserving Blockchain-Based Electricity Auction for V2G Networks in the Smart Grid. Security and Communication Networks, 2022.
[9] Haider, S., Walewski, J. and Schegner, P., 2022. Investigating peer-to-peer power transactions for reducing EV induced network congestion. Energy, 254, p.124317.
[10] Pradhan, N.R. and Singh, A.P., 2021, September. Performance analysis of a blockchain based peer-to-peer energy trading framework. In 2021 IEEE 4th International Conference on Computing, Power and Communication Technologies (GUCON) (pp. 1-7). IEEE.
[11] Zhang, L., Cheng, L., Alsokhiry, F. and Mohamed, M.A., 2022. A novel stochastic blockchain-based energy management in smart cities using V2S and V2G. IEEE Transactions on Intelligent Transportation Systems, 24(1), pp.915-922.
[12] Kumari, A., Chintukumar Sukharamwala, U., Tanwar, S., Raboaca, M.S., Alqahtani, F., Tolba, A., Sharma, R., Aschilean, I. and Mihaltan, T.C., 2022. Blockchain-Based Peer-to-Peer Transactive Energy Management Scheme for Smart Grid System. Sensors, 22(13), p.4826.
[13] Zhao, J., He, C., Peng, C. and Zhang, X., 2022. Blockchain for effective renewable energy management in the intelligent transportation system. Journal of Interconnection Networks, 22(Supp01), p.2141009.
[14] Bhaskar, K.B.R., Prasanth, A. and Saranya, P., 2022. An energy‐efficient blockchain approach for secure communication in IoT‐enabled electric vehicles. International Journal of Communication Systems, 35(11), p.e5189.
[15] Tanwar, S., Kakkar, R., Gupta, R., Raboaca, M.S., Sharma, R., Alqahtani, F. and Tolba, A., 2022. Blockchain‐based electric vehicle charging reservation scheme for optimum pricing. International Journal of Energy Research, 46(11), pp.14994-15007.
[16] Liang, Y., Wang, Z. and Abdallah, A.B., 2022. V2GNet: Robust Blockchain-Based Energy Trading Method and Implementation in Vehicle-to-Grid Network. IEEE Access, 10, pp.131442-131455.
[17] Luo, H., Yu, H. and Luo, J., 2023. PRAFT and RPBFT: A class of blockchain consensus algorithm and their applications in electric vehicles charging scenarios for V2G networks. Internet of Things and Cyber-Physical Systems, 3, pp.61-70.
[18] Lin, Y.J., Chen, Y.C., Zheng, J.Y., Chu, D., Shao, D.W. and Yang, H.T., 2022. Blockchain power trading and energy management platform. IEEE Access, 10, pp.75932-75948.
[19] Trivedi, M., Kakkar, R., Gupta, R., Agrawal, S., Tanwar, S., Niculescu, V.C., Raboaca, M.S., Alqahtani, F., Saad, A. and Tolba, A., 2022. Blockchain and Deep Learning-Based Fault Detection Framework for Electric Vehicles. Mathematics, 10(19), p.3626.
[20] Kumari, A., Trivedi, M., Tanwar, S., Sharma, G. and Sharma, R., 2022. SV2G-ET: a secure vehicle-to-grid energy trading scheme using deep reinforcement learning. International Transactions on Electrical Energy Systems, 2022.
[21] Said, D., Elloumi, M. and Khoukhi, L., 2022. Cyber-attack on P2P energy transaction between connected electric vehicles: A false data injection detection based machine learning model. IEEE Access, 10, pp.63640-63647
[22] Khan, P.W. and Byun, Y.C., 2021. Blockchain-based peer-to-peer energy trading and charging payment system for electric vehicles. Sustainability, 13(14), p.7962.
[23] Shang, X., Li, Y. and Huang, R., 2022. A Charging And Discharging Model For Electric Vehicles Based On Consortium Blockchain Using Multi-Objective Gray Wolf Algorithm. Recent Advances in Electrical & Electronic Engineering (Formerly Recent Patents on Electrical & Electronic Engineering), 15(8), pp.640-652.
[24] Cabrera-Gutiérrez, A.J., Castillo, E., Escobar-Molero, A., Cruz-Cozar, J., Morales, D.P. and Parrilla, L., 2023. Blockchain-Based Services Implemented in a Microservices Architecture Using a Trusted Platform Module Applied to Electric Vehicle Charging Stations. Energies, 16(11), p.4285.
[25] Teimoori, Z., Yassine, A. and Hossain, M.S., 2022. A secure cloudlet-based charging station recommendation for electric vehicles empowered by federated learning. IEEE Transactions on Industrial Informatics, 18(9), pp.6464-6473.
[26] Asgharzadeh, F., Tabar, V.S. and Ghassemzadeh, S., 2023. Stochastic bi-level allocation of electric vehicle charging stations in the presence of wind turbines, crypto-currency loads and demand side management. Electric Power Systems Research, 220, p.109383.
[27] Zhang, Y., Chen, X., Gu, Y., Li, Z. and Kai, W., 2023. Deep Reinforcement Learning-Based Battery Conditioning Hierarchical V2G Coordination for Multi-Stakeholder Benefits. arXiv preprint arXiv:2308.00218.
[28] Carta, S., Ferreira, A., Podda, A.S., Recupero, D.R. and Sanna, A., 2021. Multi-DQN: An ensemble of Deep Q-learning agents for stock market forecasting. Expert systems with applications, 164, p.113820.
