融合多通道GRU和CNN的情感分析模型研究

梁一鸣, 范菁

PDF(2137 KB)
PDF(2137 KB)
云南民族大学学报(自然科学版) ›› 2025, Vol. 34 ›› Issue (03) : 330-341. DOI: 10.3969/j.issn.1672-8513.2025.03.011
信息与计算机科学

融合多通道GRU和CNN的情感分析模型研究

作者信息 +

Research on sentiment analysis model integrating multi-channel GRU and CNN

Author information +
History +

摘要

情感分析是自然语言处理中的一项核心任务,主要评估文本中表达的情绪或感情色彩.在当前的情感分析研究中,多数模型均依赖于双向变换器模型(BERT)作为特征提取器,且主要聚焦于较为简单的二分类或三分类任务.针对细粒度情感分析,提出了一种新的混合双通道门控循环单元和卷积神经网络(GRU-CNN)情感分析模型(GGC).该模型利用生成式预训练变换器(GPT)作为特征提取器,更精准地捕获文本中的深层含义.在此基础上,模型将提取到的文本特征输入到多通道的GRU和CNN中,分别捕获全局和局部特征.同时该模型引入了注意力机制,将这2种特征进行动态融合.模型根据不同特征重要性,分配差异化权重,聚焦关键情感信息.结果表明,该方法在情感分析任务中展现出显著优势.

Abstract

Sentiment analysis is a core task in natural language processing, involving the assessment of emotions or sentiment expressed within texts. In the current research on sentiment analysis, most models rely on bidirectional encoder representations from transformers (BERT) as a feature extractor, focusing mainly on relatively simple binary or ternary tasks. To address fine - grained sentiment classification, the paper introduces a new hybrid dual-channel gated recurrent unit and convolutional neural network (GRU - CNN) sentiment analysis model(GGC). This model uses generative pre-trained transformer (GPT) as a feature extractor, capturing the deeper meanings in the text more precisely. Based on this, the text features extracted are fed into multi - channel GRU and CNN, capturing both global and local features respectively. The model also incorporates an attention mechanism, which dynamically fuses these two types of features. This mechanism allows the model to allocate different weights to different parts according to their importance, thus capturing key emotional information in the text more accurately. Experimental results show that this method achieves excellent performance in sentiment analysis tasks.

关键词

情感分析 / 自然语言处理 / GPT / 特征融合 / 注意力机制

Key words

sentiment analysis / natural language processing / GPT / feature fusion / attention mechanisms

中图分类号

TP391.1

引用本文

导出引用
梁一鸣 , 范菁. 融合多通道GRU和CNN的情感分析模型研究. 云南民族大学学报(自然科学版). 2025, 34(03): 330-341 https://doi.org/10.3969/j.issn.1672-8513.2025.03.011
LIANG Yi-ming, FAN Jing. Research on sentiment analysis model integrating multi-channel GRU and CNN[J]. Journal of Yunnan University of Nationalities(Natural Sciences Edition). 2025, 34(03): 330-341 https://doi.org/10.3969/j.issn.1672-8513.2025.03.011

参考文献

1
方澄,李贝,韩萍,吴琼.基于语法依存图的中文微博细粒度情感分类[J].计算机应用202343(4):1056 - 1061.
2
PANG B LEE L VAITHYANATHAN S. Thumbs up?‍Sentiment classification using machine learning techniques[J]. Computing Research Repository2002:79 - 86.
3
AGARWAL B MITTAL N BANSAL P, et al. Sentiment analysis using common-sense and context information[J]. Computational Intelligence and Neuroscience20152015:1 - 9.
4
DEVLIN J CHANG M W KENTON L, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]// North American Chapter of the Association for Computational Linguistics, 2019:4171 - 4186.
5
SHARMA A K CHAURASIA S SRIVASTAVA D K. Sentimental short sentences classification by using CNN deep learning model with fine tuned word2Vec[J].Procedia Computer Science2020167:1139 - 1147.
6
XU G X ZHANG Z X ZHANG T, et al. Aspect - level sentiment classification based on attention - bilstm model and transfer learning[J].Knowledge - based Systems2022245:108586.
7
AYETIRAN E F. Attention - based aspect sentiment classification using enhanced learning through cnn - bilstm networks[J]. Knowledge - based Systems2022252:109409.
8
HSIEH Y H ZENG X P. Sentiment analysis: an ERNIE - BiLSTM approach to bullet screen comments[J]. Sensors202222(14):5223.
9
LIU B. Text sentiment analysis based on CBOW model and deep learning in big data environment[J]. Journal of ambient Intelligence and Humanized Computing202011:451 - 458.
10
DONG L WEI F TAN C, et al. Adaptive recursive neural network for target - dependent Twitter sentiment classification[C]// Proceedings of the Annual Meeting of the Association for Computational Linguistics.201452(2): 49 - 54.
11
ZHAO L LIU Y ZHANG M, et al. Modeling label - wise syntax for fine - grained sentiment analysis of reviews via memory - based neural model[J]. Information Processing & Management202158(5):102641.
12
SEBASTIANI F ESULI A. Sentiwordnet: a publicly available lexical resource for opinion mining[C]//Proceedings of the 5th International Conference on Language Resources And Evaluation. European Language Resources Association (ELRA) Genoa, Italy, 2006:417 - 422.
13
CAMBRIA E PORIA S HAZARIKA D, et al. SenticNet 5: discovering conceptual primitives for sentiment analysis by means of context embeddings[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 201832(1): 1795 - 1802.
14
ALJUAID H IFTIKHAR R AHMAD S, et al. Important citation identification using sentiment analysis of In - text citations[J]. Telematics and Informatics202156:101492.
15
RAHAB H ZITOUNI A DJOUDI M. SANA: sentiment analysis on newspapers comments in algeria[J].Journal of King Saud University - Computer and Information Sciences201933(7): 899 - 907.
16
NASFI R BOUGUILA N. Sentiment analysis from user reviews using a hybrid generative - giscriminative HMM - SVM approach.[J]. Lecture Notes in Computer Science2022:74 - 83.
17
HUANG B, OU Y, CARLEY K M, et al. Aspect level sentiment classification with attention - over - attention neural networks[C]//Social, Cultural, and Behavioral Modeling: 11th International Conference, SBP - BRiMS 2018, Washington, DC, USA, July 10 - 13, 2018, Proceedings 11. Springer International Publishing, 2018:197 - 206.
18
LU X ZHANG H.Sentiment analysis method of network text based on improved AT - BiGRU model[J].Scientific Programming2021, 2021(12):1 - 11.
19
LIU B. Text sentiment analysis based on CBOW model and deep learning in big data environment[J]. Journal of Ambient Intelligence and Humanized Computing202011: 451 - 458.
20
LIU Y LU J YANG J, et al. Sentiment analysis for e - commerce product reviews by deep learning model of Bert - BiGRU - Softmax[J]. Mathematical Biosciences and Engineering202017(6):7819 - 7837.
21
赵宏,傅兆阳,赵凡,等.基于BERT和层次化Attention的微博情感分析研究[J].计算机工程与应用202258(05):156 - 162.
22
JIANG X C SONG C XU Y C, et al. Research on sentiment classification for netizens based on the BERT - BiLSTM - TextCNN model[J].PeerJ Computer Science20228:e1005.
23
WEI G L. Research on internet text sentiment classification based on BERT and CNN - BiGRU[J]. 2022 11th International Conference on Communications, Circuits and Systems (ICCCAS)2022: 285 - 289.
24
DONG J C HE F J GUO Y C, et al. A commodity review sentiment analysis based on BERT - CNN model[C]//International Conference on Cloud Computing and Security, 2020:143 - 147.
25
ZHOU P SHI W TIAN J, et al. Attention - based bidirectional long short - term memory networks for relation classification[C]// Annual Meeting of the Association for Computational Linguistics, 2016:207 - 212.
26
ZHANG B L ZHOU W. Transformer - Encoder - GRU (T - E - GRU) for Chinese sentiment analysis on chinese comment Text[J]. Neural Processing Letters202255(2):1847 - 1867.
27
KAMYAB M LIU G H RASOOL A, et al. ACR - SA: attention - based deep model through two-channel CNN and Bi - RNN for sentiment analysis[J].Peer J Computer Science20228: e877.

基金

国家自然科学基金(61540063)

评论

PDF(2137 KB)

Accesses

Citation

Detail

段落导航
相关文章

/