Performance Evaluation of Reddit Comments Using Machine Learning and Natural Language Processing Methods in Sentiment Analysis

doi:10.1007/978-3-031-77489-8_2

	Performance Evaluation of Reddit Comments Using Machine Learning and Natural Language Processing Methods in Sentiment Analysis
	Zhang, Xiaoxia; Qi, Xiuyuan; Teng, Zixin
	2025
会议录名称	MECHANISMS AND MACHINE SCIENCE
ISSN	2211-0984
卷号	173 MMS
页码	14-24
DOI	10.1007/978-3-031-77489-8_2
摘要	Sentiment analysis, an increasingly vital field in both academia and industry, plays a pivotal role in machine learning applications, particularly on social media platforms like Reddit. However, the efficacy of sentiment analysis models is hindered by the lack of expansive and fine-grained emotion datasets. To address this gap, our study leverages the GoEmotions dataset, comprising a diverse range of emotions, to evaluate sentiment analysis methods across a substantial corpus of 58,000 comments. Distinguished from prior studies by the Google team, which limited their analysis to only two models, our research expands the scope by evaluating a diverse array of models. We investigate the performance of traditional classifiers such as Naive Bayes and Support Vector Machines (SVM), as well as state-of-the-art transformer-based models including BERT, RoBERTa, and GPT. Furthermore, our evaluation criteria extend beyond accuracy to encompass nuanced assessments, including hierarchical classification based on varying levels of granularity in emotion categorization. Additionally, considerations such as computational efficiency are incorporated to provide a comprehensive evaluation framework. Our findings reveal that the RoBERTa model consistently outperforms the baseline models, demonstrating superior accuracy in fine-grained sentiment classification tasks. This underscores the substantial potential and significance of the RoBERTa model in advancing sentiment analysis capabilities. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.
关键词	Adversarial machine learning Contrastive Learning Natural language processing systems Fine grained Language processing Learning languages Machine-learning Natural language processing Natural languages Performances evaluation Reddit RoBERTa Sentiment analysis
会议名称	30th International Conference on Computational and Experimental Engineering and Sciences, ICCES 2024
会议地点	Singapore, Singapore
会议日期	August 3, 2024 - August 6, 2024
收录类别	EI
语种	英语
出版者	Springer Science and Business Media B.V.
EI入藏号	20245117534837
EI主题词	Support vector machines
EISSN	2211-0992
EI分类号	1101 ; 1101.2 ; 1106.2 ; 1106.7
原始文献类型	Conference article (CA)
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/483883
专题	信息科学与技术学院_本科生
通讯作者	Zhang, Xiaoxia
作者单位	Shanghaitech University, Shanghai, China
第一作者单位	上海科技大学
通讯作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Zhang, Xiaoxia,Qi, Xiuyuan,Teng, Zixin. Performance Evaluation of Reddit Comments Using Machine Learning and Natural Language Processing Methods in Sentiment Analysis[C]:Springer Science and Business Media B.V.,2025:14-24.