Research on sentiment analysis model integrating multi-channel GRU and CNN

LIANG Yi-ming, FAN Jing

PDF(2137 KB)
PDF(2137 KB)
Journal of Yunnan University of Nationalities(Natural Sciences Edition) ›› 2025, Vol. 34 ›› Issue (03) : 330-341. DOI: 10.3969/j.issn.1672-8513.2025.03.011

Research on sentiment analysis model integrating multi-channel GRU and CNN

Author information +
History +

Abstract

Sentiment analysis is a core task in natural language processing, involving the assessment of emotions or sentiment expressed within texts. In the current research on sentiment analysis, most models rely on bidirectional encoder representations from transformers (BERT) as a feature extractor, focusing mainly on relatively simple binary or ternary tasks. To address fine - grained sentiment classification, the paper introduces a new hybrid dual-channel gated recurrent unit and convolutional neural network (GRU - CNN) sentiment analysis model(GGC). This model uses generative pre-trained transformer (GPT) as a feature extractor, capturing the deeper meanings in the text more precisely. Based on this, the text features extracted are fed into multi - channel GRU and CNN, capturing both global and local features respectively. The model also incorporates an attention mechanism, which dynamically fuses these two types of features. This mechanism allows the model to allocate different weights to different parts according to their importance, thus capturing key emotional information in the text more accurately. Experimental results show that this method achieves excellent performance in sentiment analysis tasks.

Key words

sentiment analysis / natural language processing / GPT / feature fusion / attention mechanisms

Cite this article

Download Citations
LIANG Yi-ming , FAN Jing. Research on sentiment analysis model integrating multi-channel GRU and CNN. Journal of Yunnan University of Nationalities(Natural Sciences Edition). 2025, 34(03): 330-341 https://doi.org/10.3969/j.issn.1672-8513.2025.03.011

References

1
方澄,李贝,韩萍,吴琼.基于语法依存图的中文微博细粒度情感分类[J].计算机应用202343(4):1056 - 1061.
2
PANG B LEE L VAITHYANATHAN S. Thumbs up?‍Sentiment classification using machine learning techniques[J]. Computing Research Repository2002:79 - 86.
3
AGARWAL B MITTAL N BANSAL P, et al. Sentiment analysis using common-sense and context information[J]. Computational Intelligence and Neuroscience20152015:1 - 9.
4
DEVLIN J CHANG M W KENTON L, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]// North American Chapter of the Association for Computational Linguistics, 2019:4171 - 4186.
5
SHARMA A K CHAURASIA S SRIVASTAVA D K. Sentimental short sentences classification by using CNN deep learning model with fine tuned word2Vec[J].Procedia Computer Science2020167:1139 - 1147.
6
XU G X ZHANG Z X ZHANG T, et al. Aspect - level sentiment classification based on attention - bilstm model and transfer learning[J].Knowledge - based Systems2022245:108586.
7
AYETIRAN E F. Attention - based aspect sentiment classification using enhanced learning through cnn - bilstm networks[J]. Knowledge - based Systems2022252:109409.
8
HSIEH Y H ZENG X P. Sentiment analysis: an ERNIE - BiLSTM approach to bullet screen comments[J]. Sensors202222(14):5223.
9
LIU B. Text sentiment analysis based on CBOW model and deep learning in big data environment[J]. Journal of ambient Intelligence and Humanized Computing202011:451 - 458.
10
DONG L WEI F TAN C, et al. Adaptive recursive neural network for target - dependent Twitter sentiment classification[C]// Proceedings of the Annual Meeting of the Association for Computational Linguistics.201452(2): 49 - 54.
11
ZHAO L LIU Y ZHANG M, et al. Modeling label - wise syntax for fine - grained sentiment analysis of reviews via memory - based neural model[J]. Information Processing & Management202158(5):102641.
12
SEBASTIANI F ESULI A. Sentiwordnet: a publicly available lexical resource for opinion mining[C]//Proceedings of the 5th International Conference on Language Resources And Evaluation. European Language Resources Association (ELRA) Genoa, Italy, 2006:417 - 422.
13
CAMBRIA E PORIA S HAZARIKA D, et al. SenticNet 5: discovering conceptual primitives for sentiment analysis by means of context embeddings[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 201832(1): 1795 - 1802.
14
ALJUAID H IFTIKHAR R AHMAD S, et al. Important citation identification using sentiment analysis of In - text citations[J]. Telematics and Informatics202156:101492.
15
RAHAB H ZITOUNI A DJOUDI M. SANA: sentiment analysis on newspapers comments in algeria[J].Journal of King Saud University - Computer and Information Sciences201933(7): 899 - 907.
16
NASFI R BOUGUILA N. Sentiment analysis from user reviews using a hybrid generative - giscriminative HMM - SVM approach.[J]. Lecture Notes in Computer Science2022:74 - 83.
17
HUANG B, OU Y, CARLEY K M, et al. Aspect level sentiment classification with attention - over - attention neural networks[C]//Social, Cultural, and Behavioral Modeling: 11th International Conference, SBP - BRiMS 2018, Washington, DC, USA, July 10 - 13, 2018, Proceedings 11. Springer International Publishing, 2018:197 - 206.
18
LU X ZHANG H.Sentiment analysis method of network text based on improved AT - BiGRU model[J].Scientific Programming2021, 2021(12):1 - 11.
19
LIU B. Text sentiment analysis based on CBOW model and deep learning in big data environment[J]. Journal of Ambient Intelligence and Humanized Computing202011: 451 - 458.
20
LIU Y LU J YANG J, et al. Sentiment analysis for e - commerce product reviews by deep learning model of Bert - BiGRU - Softmax[J]. Mathematical Biosciences and Engineering202017(6):7819 - 7837.
21
赵宏,傅兆阳,赵凡,等.基于BERT和层次化Attention的微博情感分析研究[J].计算机工程与应用202258(05):156 - 162.
22
JIANG X C SONG C XU Y C, et al. Research on sentiment classification for netizens based on the BERT - BiLSTM - TextCNN model[J].PeerJ Computer Science20228:e1005.
23
WEI G L. Research on internet text sentiment classification based on BERT and CNN - BiGRU[J]. 2022 11th International Conference on Communications, Circuits and Systems (ICCCAS)2022: 285 - 289.
24
DONG J C HE F J GUO Y C, et al. A commodity review sentiment analysis based on BERT - CNN model[C]//International Conference on Cloud Computing and Security, 2020:143 - 147.
25
ZHOU P SHI W TIAN J, et al. Attention - based bidirectional long short - term memory networks for relation classification[C]// Annual Meeting of the Association for Computational Linguistics, 2016:207 - 212.
26
ZHANG B L ZHOU W. Transformer - Encoder - GRU (T - E - GRU) for Chinese sentiment analysis on chinese comment Text[J]. Neural Processing Letters202255(2):1847 - 1867.
27
KAMYAB M LIU G H RASOOL A, et al. ACR - SA: attention - based deep model through two-channel CNN and Bi - RNN for sentiment analysis[J].Peer J Computer Science20228: e877.

Comments

PDF(2137 KB)

Accesses

Citation

Detail

Sections
Recommended

/