2690-6791ISSN (Online)
2769-786XISSN (Print)
Volume 11 , Issue 2 , PP: 08-21, 2024 | Cite this article as | XML | Html | PDF | Full Length Article
Arpita Choudhary 1 * , N. C. Barwar 2 , Vikas Chouhan 3
Doi: https://doi.org/10.54216/JISIoT.110201
Wireless Sensor Networks (WSNs) are crucial in several applications, highlighting the need of effective clustering and fault detection systems. This paper introduces a novel approach that uses Reinforcement Learning (RL) and Particle Swarm Optimization (PSO) to optimize cluster head selection and enhance fault detection capabilities within WSNs. The proposed hybrid algorithm operates in two phases, combining the explorative capabilities of RL with the optimization process of PSO to select cluster heads based on residual energy and connectivity considerations. By continuously monitoring the network's residual energy state and the number of active nodes, the proposed method ensures prolonged network lifetime and improved overall performance. Our experimental results demonstrate the superior performance of the hybrid RL-PSO approach compared to traditional clustering algorithms, showcasing significant improvements in optimizer accuracy, residual energy preservation, and fault detection efficiency.
Wireless Sensor Networks (WSNs) , Clustering , Reinforcement Learning (RL) , Particle Swarm Optimization (PSO) and Fault Detection
[1] Y. Xiuwu, Fan Feisheng Zhou Lixing and Z. Feng, "WSN Monitoring Area Partition Clustering Routing Algorithm for Energy-Balanced," IEEE, pp. 80-84, 2016.
[2] S. Bera, S. Misra, Sanku Kumar Roy and Mohammad S. Obaidat, "Soft-WSN: Software-Defined WSN Management System for IoT Applications," IEEE, pp. 1-8, 2016.
[3] An energy efficient NOMA based spectrum sharing techniques for cell free massive MIMO", Int. J. of Engineering Systems Modelling and Simulation. Special Issue: Artificial Intelligence enabled Computing System Development, Inderscience Publishers Scopus Indexed DOI: 10.1504/IJESMS.2021.10043076,2022
[4] An efficient LoRa based smart agriculture management and monitoring system using wireless sensor networks,International Journal of Ambient Energy, https://doi.org/10.1080/01430750.2021.1953591, Scopus, IF: 2.33, 2021, ISSN:0143-0750
[5] Muruganathan S D, Ma D C F, Bhasin R I, et al. A centralized energy-efficient routing protocol for wireless sensor networks[J]. IEEE Communications Magazine, 2005, 43(3): S8-13.
[6] Fareed M S, Javaid N, Akbar M, et al. Optimal number of cluster head selection for efficient distribution of sources in WSNs[C]//2012 Seventh International Conference on Broadband, Wireless Computing, Communication and Applications. IEEE, 2012: 632-637.
[7] Choudhary, A., Badholia, A., Sharma, A., Patel, B., & Jain, S. (2023). A dynamic K-means-based clustering algorithm using fuzzy logic for CH selection and data transmission based on machine learning. Soft Computing, 27(10), 6135-6149.
[8] Gurupriya, M., & Sumathi, A. (2022). HOFT-MP: A multipath routing algorithm using hybrid optimal fault tolerant system for WSNs using optimization techniques. Neural Processing Letters, 54(6), 5099-5124.
[9] Krishna, K. P. R., & Thirumuru, R. (2023). ENHANCED QOS ENERGY-EFFICIENT ROUTING ALGORITHM USING DEEP BELIEF NEURAL NETWORK IN HYBRID FALCON-IMPROVED ACO NATURE-INSPIRED OPTIMIZATION IN WIRELESS SENSOR NETWORKS. Neural Network World, (3).
[10] Ranjan Kumar Dash, Tu N. Nguyen, KorhanCengiz, Aditi Sharma, Fine-tuned support vector regression model for stock predictions, Neural Computing and Applicationshttps://doi.org/10.1007/s00521-021-05842-w, SCI, 2021, IF: 5.606, 0941-0643
[11] Hu, T. (2023, May). Data Fusion Algorithm For Wireless Sensor Networks Based On Cluster Routing And Deep Learning. In Journal of Physics: Conference Series (Vol. 2504, No. 1, p. 012043). IOP Publishing.
[12] Tyagi, L. K., & Kumar, A. (2023). A Hybrid Trust Based WSN protocol to Enhance Network Performance using Fuzzy Enabled Machine Learning Technique. International Journal of Intelligent Systems and Applications in Engineering, 11(9s), 131-144.
[13] Priyanga, M., Vimalraj, S. L. S., & Lydia, J. (2018, October). Energy aware multiuser & multi-hop hierarchical–based routing protocol for energy management in WSN-assisted IoT. In 2018 3rd International Conference on Communication and Electronics Systems (ICCES) (pp. 701-705). IEEE.
[14] Loukil, K. (2023). Energy Saving Multi-Relay Technique for Wireless Sensor Networks Based on Hw/Sw MPSoC System. IEEE Access, 11, 27919-27927.
[15] Zhang, D., & Gao, Z. (2020). Fault tolerant control using reinforcement learning and particle swarm optimization. IEEE Access, 8, 168802-168811.
[16] François-Lavet, V., Henderson, P., Islam, R., Bellemare, M. G., & Pineau, J. (2018). An introduction to deep reinforcement learning. Foundations and Trends® in Machine Learning, 11(3-4), 219-354.
[17] Vishal Goar, Aditi Sharma, Nagendra Singh Yadav, Subrata Chowdhury, Yu-Chen Hu, IoT-Based Smart Mask Protection against the Waves of COVID -19, Journal of Ambient Intelligence & Humanized Computing (AIHC), SCI (2022). https://doi.org/10.1007/s12652-022-04395-7, IF: 7.01
[18] Jain, M., Saihjpal, V., Singh, N., & Singh, S. B. (2022). An overview of variants and advancements of PSO algorithm. Applied Sciences, 12(17), 8392.
[19] De Oca, M. A. M., Stutzle, T., Birattari, M., & Dorigo, M. (2009). Frankenstein's PSO: a composite particle swarm optimization algorithm. IEEE Transactions on Evolutionary Computation, 13(5), 1120-1132.
[20] Singh, B., Lobiyal, D.K. A novel energy-aware cluster head selection based on particle swarm optimization for wireless sensor networks. Hum. Cent. Comput. Inf. Sci. 2, 13 (2012). https://doi.org/10.1186/2192-1962-2-13
[21] W. -K. Yun and S. -J. Yoo, "Q-Learning-Based Data-Aggregation-Aware Energy-Efficient Routing Protocol for Wireless Sensor Networks," in IEEE Access, vol. 9, pp. 10737-10750, 2021, doi: 10.1109/ACCESS.2021.3051360
[22] Jitendra Kumar Samriya, Chinmay Chakraborty, Aditi Sharma, Mohit Kumar and Sravanth Kumar, Adversarial ML- Based Secured Cloud Architecture for Consumer Internet of Things of Smart Healthcare, IEEE Transactions on Consumer Electronics, SCI, Q1, DOI: 10.1109/TCE.2023.3341696, ISSN: 0098-3063
[23] SVM-based compliance discrepancies detection using remote sensing for organic farms, Markkandan S, Aditi Sharma, S. P. Singh, VikasSolanki, S. Sethuramalingam, S. Singh in Arabian Journal of Geosciences, SCI, 14, 1334 (2021). https://doi.org/10.1007/s12517-021-07700-4 IF: 1.925
[24] Improving Data Processing Speed on Large Datasets in a Hadoop Multinode Cluster Using Enhanced Apriori Algorithm, Sundarakumar, M.R.a;Sharma, Ravia, Fathima, S.b, Gokul Rajan, V.a, Dhayanithi J.b, Marimuthu M.b, Mohanraj G.c, Sharma Aditi. Johny Renoald,26 July, 2023, DOI: 10.3233/JIFS-232048, Journal: Journal of Intelligent & Fuzzy Systems, vol. 45, no. 4, pp. 6161-6177, 2023,Published: 04 October 2023, SCI,IF:2,ISSN 1064-1246 (P)
[25] Venkataramanan, K.,Arun, M.b, Jha, Shankaranandc, Sharma, Aditi ‘Analyzing Stability and Structural Aspects of Embedded Fuzzy Type 2 PID Controller for Robot Manipulators’, DOI: 10.3233/JIFS-235338, vol. Pre-press, no. Pre-press, pp. 1-14, 2023, 20 November 2023
[26] Investigation on load harmonic reduction through solar-power utilization in intermittent SSFI using particle swarm, genetic, and modified firefly optimization algorithms,Albert, JohnyRenoald; Sharma, Aditi,Rajani, B., Mishra, Ashish,Saxena, Ankur, Nandagopal, C., Mewada, Shivlal, Journal of Intelligent & Fuzzy Systems, vol. 42, no. 4, pp. 4117-4133, 2022 SCI,IF:2 ,ISSN 1064-1246 (P)
[27] Utilizing the intelligence edge framework for robotic upper limb rehabilitation in home, MethodsX, Prashant K. Jamwal, Aibek Niyetkaliyev, Shahid Hussain, Aditi Sharma, Paulette Van Vliet, Volume 11, 2023, 102312, ISSN 2215-0161, https://doi.org/10.1016/j.mex.2023.102312, ESCI, Scopus,WoS
[28] Ant Colony Optimized XGBoost for Early Diabetes Detection: A Hybrid Approach in Machine Learning, Krishna, A.Y. ,Kiran, K.R.,Sai, N.R, Sharma Aditi, .Praveen, S.P.,Pandey, J., Journal of Intelligent Systems and Internet of Things, 2023, 10(2), pp. 76–89
[29] An Ensemble Learning Approach for detection of Chronic Kidney Disease (CKD), B. Narasimha Swamy,Rajeswari Nakka,Aditi Sharma,S. Phani Praveen,Venkata Nagaraju Thatha,Kumar Gautam. (2023), Journal of Intelligent Systems and Internet of Things, 10 ( 2 ), 38-48.
[30] Lisha Yugal,Suresh Kaswan,B. S. Bhatia,Aditi Sharma, IoT-based Emulated Performance Evaluation NLP Model for Advanced Learners in Academia 4.0 and Industries 4.0, Journal of Intelligent Systems and Internet of Things, Vol. 10 , No. 2 , (2023) : 36-75 (Doi : https://doi.org/10.54216/JISIoT.100206)
[31] Safeguarding Digital Essence: A Sub-band DCT Neural Watermarking Paradigm Leveraging GRNN and CNN for Unyielding Image Protection and Identification, Ashish Dixit,R. P. Aggarwal,B. K. Sharma,Aditi Sharma. (2023). Journal of Intelligent Systems and Internet of Things, 10 ( 1 ), 33-47.
[32] Maize Plant Leaf Disease Classification Using Supervised Machine Learning Algorithms, Ashish Patel,Richa Mishra ,Aditi Sharma. (2023). Fusion: Practice and Applications, 13 ( 2 ), 08-21.
[33] IOT enabled Intelligent featured imaging Bone Fractured Detection System, Journal of Intelligent Systems and Internet of Things, Gajender Kumar,Vinod Patidar,Prolay Biswas,Mukta Patel,Chaur SinghRajput,Anit Venugopal,Aditi Sharma,Vol.9,No.2,(2023):08-22(Doi: https://doi.org/10.54216/JISIoT.090201),
[34] Predicting Student Performance Using Educational Data Mining and Learning Analytics Technique, Rahul Sharma ,Shiv Shakti Shrivastava ,Aditi Sharma. (2023).Journal of Intelligent Systems and Internet of Things, 10 ( 2 ), 24-37.
[35] Intelligent Traffic Management using IoT and Machine Learning, Reem Atassi, Aditi Sharma, 2023/7/1, Journal of Intelligent Systems & Internet of Things, Volume 8, Issue 2, p8-19. 12p, (Doi : https://doi.org/10.54216/JISIoT.080201) ISSN: 2690-6791, Scopus Indexed
[36] Enhancing Fusion Teaching based Research from the Student Perspective, Fusion: Practice and Applications, Anita Venugopal,Aditi Sharma,F. Abdul Munaim Al Rawas,Rama Devi S., Vol. 12 , No. 2 , (2023) : 109-119 (Doi : https://doi.org/10.54216/FPA.120209), ISSN: 2692-4048, Scopus Indexed
[37] Ultrasound Image Noise Reduction and Enhancement Model based on Yellow Saddle Goatfish Optimization Algorithm, Anamika Goel,Jawed Wasim,Prabhat Kumar Srivastava,Aditi Sharma, Journal of Fusion: Practice and Applications, Vol. 12 , No. 2 , (2023) : 08-18 (Doi : https://doi.org/10.54216/FPA.120201), ISSN: 2692-4048, Scopus Indexed
[38] Spear-Phishing Emails Verification Method based on Verifiable Secret Sharing Scheme, Gunikhan Sonowal, Aditi Sharma, and LatikaKharb, Journal of Information Assurance and Security, ISSN: 1554-1010, Volume 16, Issue 3, 2021, pp. 117 – 124, ESCI, WOS
[39] Android Asset Packaging Tool based Forensics Security and Predictive Analysis, Vishal Goar, Aditi Sharma, and Deepak Chahal, Journal of Information Assurance and Security, ISSN: 1554-1010, Volume 16, Issue 3, 2021, pp. 125 – 131, ESCI, WOS
[40] Sensor Routing Protocol with Optimized Delay and Overheads in Mobile based WSN, Vivek Gupta, Naresh Kumar, Aditi Sharma, Ajith Abraham, Journal of Information Assurance and Security, ISSN: 1554-1010, Volume 16, Issue 4, 2021 pp. 132 – 139, ESCI, WOS
[41] Key Spreading and Mutual Validation schemes for Privacy Protection in Fog Computing Environment using MNSOR Protocols, Ashwani Kumar Vashishtha, AshwaniChauhan and Aditi Sharma, Journal of Information Assurance and Security, ISSN: 1554-1010, Volume 16, Issue 4, 2021,pp. 148 – 155, , ESCI, WOS
[42] An Energy Savings Approach Based on Data Mining by K-Means Clustering and R-Programming Framework, Goar, V., Kuri, M., Soni, R., Sharma, A.Lecture Notes in Networks and Systems, 2022, 392, pp. 609–622, Scopus Indexed, DOI: 10.1007/978-981-19-0619-0_53
[43] GP-MSJF: An Improved Load Balancing Generalized Priority-Based Modified SJF Scheduling in Cloud Computing, Gupta, N.K., Walia, A., Sharma, A., Lecture Notes in Networks and Systems, 2022, 392, pp. 589–597, Scopus Indexed,DOI: 10.1007/978-981-19-0619-0_51
[44] An Efficient and Secured Triple-Layered Wireless SensorNetwork with Machine Learning Techniques, Reem Atassi, Aditi Sharma, International Journal of Wireless and Ad Hoc Communication (IJWAC) Vol. 06, No. 02, PP. 08-17, 2023
