Volume 10 • Issue 1 • PP: 20-33 • 2023
Benchmarking Machine Learning for Sentimental Analysis of Climate Change Tweets in Social Internet of Things
View PDF Abstract
Climate change has become one of the most critical problems threatening our world, gaining increased attention in either academia or industry. Climate change has been demonstrated as the major barrier in the way of sustainable development strategy in the 2030 Agenda. Nowadays, the Social Internet of Things (SIoT) has paved new ways for public deliberations and has transformed the communication of global issues such as climate change. Thus, sentiment analysis of SIoT media streams can offer great help in improving the mitigation and adaptation to climate change. Machine learning (ML) is demonstrating great success in a wide range of SIoT applications. However, training ML algorithms for sentimental analysis of climate change is notoriously hard as it suffers from feature engineering issues, information squashing, unbalancing, and curse-of-dimensionality, which bounds their possible power for modeling social awareness of climate change. Besides, the absence of a standard benchmark with reasonable and dependable experimentations brings a practically intractable difficulty to the evaluation of the efficiency of new solutions. In this regard, this study introduces the first reasonable and reproducible benchmark devoted to evaluating the potential of ML algorithms in identifying users’ opinions about climate change. Moreover, a novel taxonomy is presented for categorizing the existing ML algorithms, exploring their optimal hyperparameter, and unifying their elementary settings. Inclusive experiments are then performed on real Twitter data with different families of ML algorithms. To promote further study, a detailed analysis is provided for the state of the field to uncover the open research challenges and promising future directions.
Keywords
References
[1] M. El Barachi, M. AlKhatib, S. Mathew, and F. Oroumchian, “A novel sentiment analysis framework for monitoring the evolving public opinion in real-time: Case study on climate change,” J. Clean. Prod., 2021, doi: 10.1016/j.jclepro.2021.127820.
[2] B. Dahal, S. A. P. Kumar, and Z. Li, “Topic modeling and sentiment analysis of global climate change tweets,” Soc. Netw. Anal. Min., 2019, doi: 10.1007/s13278-019-0568-8.
[3] F. Jost, A. Dale, and S. Schwebel, “How positive is ‘change’ in climate change? A sentiment analysis,” Environ. Sci. Policy, 2019, doi: 10.1016/j.envsci.2019.02.007.
[4] E. M. Cody, A. J. Reagan, L. Mitchell, P. S. Dodds, and C. M. Danforth, “Climate change sentiment on Twitter: An unsolicited public opinion poll,” PLoS One, 2015, doi: 10.1371/journal.pone.0136092.
[5] M. L. Loureiro and M. Alló, “Sensing climate change and energy issues: Sentiment and emotion analysis with social media in the U.K. and Spain,” Energy Policy, 2020, doi: 10.1016/j.enpol.2020.111490.
[6] T. M. Fagbola, A. Abayomi, M. B. Mutanga, and V. Jugoo, “Lexicon-Based Sentiment Analysis and Emotion Classification of Climate Change Related Tweets,” 2022, doi: 10.1007/978-3-030-96302-6_60.
[7] F. Qiao and J. Williams, “Topic Modelling and Sentiment Analysis of Global Warming Tweets,” J. Organ. End User Comput., 2022, doi: 10.4018/joeuc.294901.
[8] K. Schouten and F. Frasincar, “Survey on Aspect-Level Sentiment Analysis,” IEEE Trans. Knowl. Data Eng., 2016, doi: 10.1109/TKDE.2015.2485209.
[9] P. Ganesh et al., “Compressing large-scale transformer-based models: A case study on bert,” Trans. Assoc. Comput. Linguist., 2021, doi: 10.1162/tacl_a_00413.
[10] A. Nazir, Y. Rao, L. Wu, and L. Sun, “Issues and Challenges of Aspect-based Sentiment Analysis: A Comprehensive Survey,” IEEE Transactions on Affective Computing. 2022, doi: 10.1109/TAFFC.2020.2970399.
[11] V. K. Bongirwar, “A Survey on Sentence Level Sentiment Analysis,” Int. J. Comput. Sci. Trends Technol., 2015.
[12] Z. Rajabi and M. R. Valavi, “A Survey on Sentiment Analysis in Persian: a Comprehensive System Perspective Covering Challenges and Advances in Resources and Methods,” Cognit. Comput., 2021, doi: 10.1007/s12559-021-09886-x.
[13] M. Ling, Q. Chen, Q. Sun, and Y. Jia, “Hybrid Neural Network for Sina Weibo Sentiment Analysis,” IEEE Trans. Comput. Soc. Syst., 2020, doi: 10.1109/TCSS.2020.2998092.
[14] S. Zad, M. Heidari, J. H. Jones, and O. Uzuner, “A Survey on Concept-Level Sentiment Analysis Techniques of Textual Data,” 2021, doi: 10.1109/AIIoT52608.2021.9454169.
[15] M. Lepelaar et al., “Sentiment Analysis of Social Survey Data for Local City Councils,” J. Sens. Actuator Networks, 2022, doi: 10.3390/jsan11010007.
[16] S. Rani, “Sentiment Analysis: A Survey,” Int. J. Res. Appl. Sci. Eng. Technol., 2017, doi: 10.22214/ijraset.2017.8276.
[17] M. Birjali, M. Kasri, and A. Beni-Hssane, “A comprehensive survey on sentiment analysis: Approaches, challenges and trends,” Knowledge-Based Syst., 2021, doi: 10.1016/j.knosys.2021.107134.
[18] S. Behdenna, F. Barigou, and G. Belalem, “Document Level Sentiment Analysis: A survey,” EAI Endorsed Trans. Context. Syst. Appl., 2018, doi: 10.4108/eai.14-3-2018.154339.
[19] K. Yadav, N. Kumar, P. K. R. Maddikunta, and T. R. Gadekallu, “A comprehensive survey on aspect-based sentiment analysis,” Int. J. Eng. Syst. Model. Simul., 2021, doi: 10.1504/IJESMS.2021.119892.
[20] W. Medhat, A. Hassan, and H. Korashy, “Sentiment analysis algorithms and applications: A survey,” Ain Shams Eng. J., 2014, doi: 10.1016/j.asej.2014.04.011.
[21] N. Joshi and S. Itkat, “A Survey on Feature Level Sentiment Analysis,” Int. J. Comput. Sci. Inf. Technol., 2014.
[22] C. Valsecchi, V. Consonni, R. Todeschini, M. E. Orlandi, F. Gosetti, and D. Ballabio, “Parsimonious optimization of multitask neural network hyperparameters,” Molecules, 2021, doi: 10.3390/molecules26237254.
[23] G. Rong et al., “Comparison of tree-structured parzen estimator optimization in three typical neural network models for landslide susceptibility assessment,” Remote Sens., 2021, doi: 10.3390/rs13224694.
[24] H. P. Nguyen, J. Liu, and E. Zio, “A long-term prediction approach based on long short-term memory neural networks with automatic parameter optimization by Tree-structured Parzen Estimator and applied to time-series data of NPP steam generators,” Appl. Soft Comput. J., 2020, doi: 10.1016/j.asoc.2020.106116.
[25] K. Shen, H. Qin, J. Zhou, and G. Liu, “Runoff Probability Prediction Model Based on Natural Gradient Boosting with Tree-Structured Parzen Estimator Optimization,” Water (Switzerland), 2022, doi: 10.3390/w14040545.
[26] Y. Ozaki, Y. Tanigaki, S. Watanabe, and M. Onishi, “Multiobjective tree-structured parzen estimator for computationally expensive optimization problems,” 2020, doi: 10.1145/3377930.3389817.
Cite This Article
Choose your preferred format