# Deep Learning for Chinese Language Sentiment Extraction and Analysis

Authors: Zhu Zhu
Journal: Mathematical Problems in Engineering
 (2022)

---

## Abstract

In recent years, vocabulary emotion processing has become immensely popular and the requirements for language emotion analysis mining and processing have become significantly abundant. The sentiment extraction and analysis work has always been very challenging; especially, the Chinese word segmentation operation is difficult to deal with effectively, the multiple combinations of implicit and explicit words make the task of sentiment analysis mining more difficult, and, in particular, the efficiency of machine analysis of language sentiment is feeble. We use some expressions and sentiment vocabulary dictionaries combined with hybrid structures and use information synergy methods to get in touch with sentiment analysis methods. We use the relevant sentiment to evaluate the explicit or implicit emotional association of the emotional connection of the vocabulary and add the unique emotional word matrix to analyze the related clustering results of the emotional words to continuously optimize and upgrade the performance, so that our sentiment analysis results are systematic in terms of efficiency and significantly improved.


---

## Body

## 1. Introduction

In recent years, the processing of language vocabulary sentiment has gradually increased and sentiment analysis mining processing is an important source of reviewing the author’s opinion and attitude. We focus on the study of the time span and causal connection of emotion. Combining the dual connection of time and causality, a corresponding data model can be established and emotional data analysis can be performed on it to predict related events. Using deep learning series algorithms to analyze data units such as image networks, statistical results are obtained. The algorithm operation of the convolutional network has become the preferred method in the application of analytical images. Metrics tuning of deep learning performance has huge benefits, enabling the perfect combination of flexibility and uniformity. We use POS (part of speech) tagging and maximum entropy (ME) modeling to develop text-based sentiment detection models to explore mutual sentimental connections between words and objective transactions and perform multiple analyses of word sentiment data.


## 2. Introduction to the CLSTM Model

The application of the LSTM model has the following advantages: (1) It is convenient for sequential modeling work. (2) The memory function of the model is relatively powerful, and it can carry out long-term memory. (3) The model implementation scheme is relatively simple. (4) It solves some problems of long sequences, such as gradient disappearing and exploding. The CLSTM model is a neural network prediction model based on deep learning. On the model’s attention mechanism, it can quickly distinguish between regular words and analysis words with emotional tendencies and compare with the traditional LSTM model. Its advantages are used in time. It is more obvious, and the classification and analysis efficiency of vocabulary is greatly improved. The CLSTM model is constructed to realize the language emotion analysis of deep learning, improve the accuracy of emotion extraction and analysis, optimize the processing and analysis results, and then realize the function of language emotion analysis [1]. The CLSTM model is shown in Figure 1.Figure 1
CLSTM model with attention mechanism.


### 2.1. Calculation of the Model

To realize the specific classification mechanism of the CLSTM algorithm, the specific implementation formula of the related algorithm is as follows:(1)T=t1,t2,…,tn,(2)it=σwi⋅ht−1,xt+bi,(3)ft=σwf⋅ht−1,xt+bf,(4)Ot=σW0⋅ht−1,Xt+b0,(5)c˜t=tanhwc⋅ht−1,xt+bc,(6)Ct=ft⋅Ct−1+it⋅Ct˜,(7)ht=ot⋅tanhct,(8)ut=tanhwsht+bs,(9)at=softmaxutT,us,(10)v=Σtatht,(11)y=softmaxv.


### 2.2. Final Output of the Model

The CLSTM model combines the advantages of CNN and LSTM. CNN effectively extracts the n-gram features of the text, and LSTM has the ability to effectively capture contextual information. The CLSTM model combines these two advantages and derives its own unique advantages and uses the unique neural network data elements to effectively distinguish text data [2].Among them, in the convolution layer, feature maps have different color information; if feature maps have the same color, it means that the convolution kernel has selected a unified operation value, and the same color will be automatically spliced to form a new vector. At this time, we can get the matrix formula as(12)w=C1;C2;…;Cn.“Semicolon” represents vector splicing, that is, a value obtained by the convolution behavior of different convolution kernels in the feature map, and the dotted line part represents the generation of a new vector. A filterf∈Rm⋅k with a step size of 1 can completely get w∈Rn−m+1⋅n; then, we should apply the new vector and gradually input it into the LSTM, and finally, the softmax layer can output the classification probability.In the training set, the preprocessing operation is performed, the text is vectorized, and feature extraction is performed. Finally, through the system display of the model training, a suitable model is obtained for sentiment analysis of related language texts [3]. The left-path process is the preprocessing training work. We conduct research on the training model just because we need to test the optimal results of the algorithm, so we use the optimal algorithm model to output the formula. After the left-path training model is gradually formed, we can get the right-hand training set of the standard model. Therefore, the left-hand training model must be used to determine the best model, and then the right-hand process must be carried out. The operation process is shown in Figure 2.Figure 2
Text recognition sentiment analysis model process.As mentioned earlier, CNN can be combined with LSTM to form a new CLSTM model. Here, we also call it a CLSTM model that introduces residual connections. In the past, we may have encountered a series of problems, such as loss of network parameter update data or disappearance of vocabulary gradients, not to mention that better analytical work can be achieved after concatenating the residuals. The residual connection of the CLSTM model is shown in Figure3.Figure 3
CLSTM model with residual connections.W1 is the text representation word vector, and the output-related features of the language can be expressed as Ci=C1i⋅C2i,…,Cni; after the residual connection makes –wi−1 and ci as the module input, the output is hi=h1i⋅h2i,…,hni, and the calculation formula is as follows:(13)hji=Cji+wji−1,j=1,2,3,…,n.


## 2.1. Calculation of the Model

To realize the specific classification mechanism of the CLSTM algorithm, the specific implementation formula of the related algorithm is as follows:(1)T=t1,t2,…,tn,(2)it=σwi⋅ht−1,xt+bi,(3)ft=σwf⋅ht−1,xt+bf,(4)Ot=σW0⋅ht−1,Xt+b0,(5)c˜t=tanhwc⋅ht−1,xt+bc,(6)Ct=ft⋅Ct−1+it⋅Ct˜,(7)ht=ot⋅tanhct,(8)ut=tanhwsht+bs,(9)at=softmaxutT,us,(10)v=Σtatht,(11)y=softmaxv.


## 2.2. Final Output of the Model

The CLSTM model combines the advantages of CNN and LSTM. CNN effectively extracts the n-gram features of the text, and LSTM has the ability to effectively capture contextual information. The CLSTM model combines these two advantages and derives its own unique advantages and uses the unique neural network data elements to effectively distinguish text data [2].Among them, in the convolution layer, feature maps have different color information; if feature maps have the same color, it means that the convolution kernel has selected a unified operation value, and the same color will be automatically spliced to form a new vector. At this time, we can get the matrix formula as(12)w=C1;C2;…;Cn.“Semicolon” represents vector splicing, that is, a value obtained by the convolution behavior of different convolution kernels in the feature map, and the dotted line part represents the generation of a new vector. A filterf∈Rm⋅k with a step size of 1 can completely get w∈Rn−m+1⋅n; then, we should apply the new vector and gradually input it into the LSTM, and finally, the softmax layer can output the classification probability.In the training set, the preprocessing operation is performed, the text is vectorized, and feature extraction is performed. Finally, through the system display of the model training, a suitable model is obtained for sentiment analysis of related language texts [3]. The left-path process is the preprocessing training work. We conduct research on the training model just because we need to test the optimal results of the algorithm, so we use the optimal algorithm model to output the formula. After the left-path training model is gradually formed, we can get the right-hand training set of the standard model. Therefore, the left-hand training model must be used to determine the best model, and then the right-hand process must be carried out. The operation process is shown in Figure 2.Figure 2
Text recognition sentiment analysis model process.As mentioned earlier, CNN can be combined with LSTM to form a new CLSTM model. Here, we also call it a CLSTM model that introduces residual connections. In the past, we may have encountered a series of problems, such as loss of network parameter update data or disappearance of vocabulary gradients, not to mention that better analytical work can be achieved after concatenating the residuals. The residual connection of the CLSTM model is shown in Figure3.Figure 3
CLSTM model with residual connections.W1 is the text representation word vector, and the output-related features of the language can be expressed as Ci=C1i⋅C2i,…,Cni; after the residual connection makes –wi−1 and ci as the module input, the output is hi=h1i⋅h2i,…,hni, and the calculation formula is as follows:(13)hji=Cji+wji−1,j=1,2,3,…,n.


## 3. Improvement of the CLSTM Model

The specific implementation of the superimposed application of this model is shown in Figure4.Figure 4
Superposition application of the CLSTM model algorithm.The superposition of the algorithm is used not to randomly perform mixed operations, but to find the comprehensive performance advantages of the superposition algorithm through specific applications. In Figure4, what we need to add is the specific operation of the hybrid operation of the CLSTM algorithm and PML and experimental steps need to be added to reflect the effectiveness and superiority of its superposition algorithm.


### 3.1. The PMI Model Algorithm Design

Here, we add a reference to the degree of language lexical association and use the SO-PMI algorithm to calculate the emotional trend weighted value of language vocabularies, record the language emotion comparison differences of related vocabularies, and calculate whether the emotional correlation and the degree of connection are close [4]. The formula for calculating the similarity of language vocabulary is as follows:(14)PMIw1,w2=log2Pw1&w2Pw1Pw2.Here,Pw1&w2 represents the probability of w1andw2 appearing at the same time and Pw1Pw2 represents the probability of w1andw2 appearing alone. In fact, PMIw1,w2=log2M·dfw1&w2/dfw1dfw2 in the article is composed of the basic formula PMIw1,w2=log2pw1&w2/pw1pw2, combined with pword=dfword/M. In this formula, pw1&w2 represents the probability of word 1 and word 2 appearing together and pw1 and pw2 represent the probability of each word appearing alone. The basic idea is to use statistical methods to calculate the common probability of two words appearing in a text, and the size of the probability reflects the degree of association between the two words.After performing the SO-PMI algorithm, we can get the emotional tendency of the language emotion of words, which can be roughly divided into neutral words, positive words, and negative words. We then add and subtract weights to determine neutral words as 0, positive words as 1, and negative words as −1 [5]. In general, if the final calculation result of the weight value is positive, the sentence can be judged to be a positive sentence; if the final calculation result of the weight value is negative, it can be judged that the sentence is a negative sentence. The algorithm can make sentiment analysis results more accurate than before in the application of word linking [6]. The implementation process is roughly as shown in Figure 5.Figure 5
Flowchart of Chinese language emotion classification.


### 3.2. Introduction of the Auxiliary Algorithm Formula

#### 3.2.1. Gradient Descent Algorithm

In this paper, the gradient descent algorithm is used simply to solve the problem of the optimal solution of the vocabulary in the current gradient, and the algorithm will explore the optimal solution of the vocabulary along the negative direction of this gradient. With the deepening of the training of the deep learning model, the difficulty level and complexity of the vocabulary will gradually deepen. Therefore, we use the negative direction to explore, so that the loss function decreases the fastest. The Taylor calculation formula of the relevantf (x) is as follows:(15)fx+ad=fxk+agkTd+oa,a>0.Here, the unit vector isd⟶ and θ is the angle between d⟶ and −gk⟶; then,(16)gkT⟶d⟶=−gk⟶cosθ.Whenθ = 0, gkT⟶d⟶ will reach the minimum value and the speed of f (x) will reach the maximum value.The descent algorithm is shown in Figure6.Figure 6
The detailed process of the gradient descent algorithm.


#### 3.2.2. Sentiment Word Feature Formula Application

A piece of text is composed of many words, so we say that words are the basis of text composition [7]. In particular, the emotional vocabulary that appears in the text will greatly affect the language emotional tendency of the entire sentence. The amount of emotional vocabulary has a great effect on the appeal of the language. We supplement the emotional dictionary here, which can make the emotional attribute f_sentimentsi look like the following formula:(17)fsentimentsi=∑k=1mestimatewordi,km.Here, word represents vocabulary,wordi,k is the kth word in the si sentence, and m represents the number of words. When estimatewordi,k=0, the word is not an emotional word, and when estimatewordi,k=1, the word is an emotional word. When using the relevant sentiment calculation formula, we can still add some auxiliary formulas, so on the basis of it, we have added the scoring formula calculation associated with it.(18)fkeywordsi=∑j=1nkeywordwij,keywordwij=1;wijakeyword,0;wijnotakeyword.Here,wij represents the jth word in the sentence si; we traverse it, and if it is a keyword, the feature score can be +1.Of course, the analysis of all languages is inseparable from the huge language storage database. Under the relevant operations of deep learning, we use relevant equipment to remove language redundancy and extract relevant information [8]. After a series of word segmentation operations, the language is carried out. Sentiment classification, combined with the weighted value operation of the previous technology, can make a better judgment, so as to realize the extraction of the text language [9].wc is the central reference vocabulary of the model application, which can effectively discriminate the context content wo and make probabilistic analysis. The relevant formulas applied by the model are as follows:(19)pw0|wc=expuoTvc∑i∈vexpuiTvc.vc is the center word vector, and ui is the background word vector. We can make the corresponding flow chart, as shown in Figure 7.Figure 7
De-redundancy exclusion operation of machine learning.Extracting and analyzing common vocabulary and selecting this formula can restore the emotional data of the original text to the greatest extent.(20)pxi=Zxit+1×tZxi=tZxi′+tZxi.xi represents the original vocabulary, Zxi represents the probability that the sampled vocabulary is extracted from the entire data set, and t is the threshold of the sampled vocabulary, which is 0.001 by default. The larger the value unit, the greater the difference in the sampling probability. For the same vocabulary, the larger the t value, the greater the probability of the sampled value being deleted [10].


### 3.3. Actual SO-PMI Algorithm Operation

We can introduce relevant calculation algorithms of the probability theory. Assuming that the total number of text data isM, what we need to count is the specific number of text words, that is to say, the frequency problem in the text data set [11]. We can set it as dfword, which has the corresponding probability calculation formula of(21)pword=dfwordM.Then, we can convert the SO-PMI algorithm to the formula, and the new word similarity calculation formula can be obtained as(22)PMIw1,w2=log2M·dfw1&w2dfw1dfw2.In this calculation, we use the base 2 logarithmic formula, so that the statistical result is always between 0 and 1, so the similarity of words can be easily expressed. If the PMI value is greater than 0, it can indicate that the words have a correlation; if the PMI value is equal to 0, the words are independent of each other; if the PMI value is less than 0, the words have no correlation [12].We now continue the introduction of the formula, and we get the calculation formula of emotional tendency. At the beginning, we need to select words with clear emotions as reference objects and calculate the PMI difference, so as to judge the difference of language emotional tendency [13]. The relevant calculation formula is as follows:(23)SO−PMIw=∑i=1kPMIkey−pi,w−∑i=1kPMIkey−ni,w.Here,key−pi represents the ith positive word in the vocabulary statistics and key−ni represents the ith derogatory word in the vocabulary statistics.The following three judgment results for judging the Chinese language vocabulary are given as follows:If the value obtained by SO-PMI is greater than 0, the sentiment tendency of the wordw is positive.If the value obtained by SO-PMI is equal to 0, the emotional tendency of the wordw is neutral.If the value obtained by SO-PMI is less than 0, the sentiment tendency of the wordw is negative.At the beginning of this algorithm, the first thing to do is the preprocessing of the text.At this time, we need to extract candidate words according to the emotional language vocabulary database and judge whether the words in the text are emotional words [14]. If it has become an emotional vocabulary, the operation process can be directly skipped. If the text contains words that are not emotional words, the formula is used for calculation and evaluation.The SO-PMI value between the word and the benchmark word is calculated. If the result is greater than zero, it can be judged as a positive value and then added to the analysis operation; if the result is less than zero, it is judged as a derogatory word and added to the analysis. After all the judgment operation steps are finished, the algorithm can be judged to be finished. Due to the diversity and complexity of the Chinese language vocabulary, we can synonymously divide the selected positive and derogatory words in consideration of the benchmark value.Please note the following: when the target algorithm starts to execute, the corpus must be preprocessed and analyzed, then the part-of-speech judgment criteria are added after the word division and classification work, and finally, the regions are allocated [15]. This is based on the difficulty of the Chinese language. The Chinese phrase system is too large, and it is inevitable that there will be some omissions in the emotional thesaurus. Moreover, in today’s society in the Internet age, the number of emotional vocabulary updates is far greater than the number of thesauri stored. Therefore, we need to design an algorithm to judge the emotion of words. The SO-PMI algorithm in the figure is one of them. The specific implementation of the SO-PMI algorithm is shown in Figure 8.Figure 8
SO-PMI algorithm implementation.


## 3.1. The PMI Model Algorithm Design

Here, we add a reference to the degree of language lexical association and use the SO-PMI algorithm to calculate the emotional trend weighted value of language vocabularies, record the language emotion comparison differences of related vocabularies, and calculate whether the emotional correlation and the degree of connection are close [4]. The formula for calculating the similarity of language vocabulary is as follows:(14)PMIw1,w2=log2Pw1&w2Pw1Pw2.Here,Pw1&w2 represents the probability of w1andw2 appearing at the same time and Pw1Pw2 represents the probability of w1andw2 appearing alone. In fact, PMIw1,w2=log2M·dfw1&w2/dfw1dfw2 in the article is composed of the basic formula PMIw1,w2=log2pw1&w2/pw1pw2, combined with pword=dfword/M. In this formula, pw1&w2 represents the probability of word 1 and word 2 appearing together and pw1 and pw2 represent the probability of each word appearing alone. The basic idea is to use statistical methods to calculate the common probability of two words appearing in a text, and the size of the probability reflects the degree of association between the two words.After performing the SO-PMI algorithm, we can get the emotional tendency of the language emotion of words, which can be roughly divided into neutral words, positive words, and negative words. We then add and subtract weights to determine neutral words as 0, positive words as 1, and negative words as −1 [5]. In general, if the final calculation result of the weight value is positive, the sentence can be judged to be a positive sentence; if the final calculation result of the weight value is negative, it can be judged that the sentence is a negative sentence. The algorithm can make sentiment analysis results more accurate than before in the application of word linking [6]. The implementation process is roughly as shown in Figure 5.Figure 5
Flowchart of Chinese language emotion classification.


## 3.2. Introduction of the Auxiliary Algorithm Formula

### 3.2.1. Gradient Descent Algorithm

In this paper, the gradient descent algorithm is used simply to solve the problem of the optimal solution of the vocabulary in the current gradient, and the algorithm will explore the optimal solution of the vocabulary along the negative direction of this gradient. With the deepening of the training of the deep learning model, the difficulty level and complexity of the vocabulary will gradually deepen. Therefore, we use the negative direction to explore, so that the loss function decreases the fastest. The Taylor calculation formula of the relevantf (x) is as follows:(15)fx+ad=fxk+agkTd+oa,a>0.Here, the unit vector isd⟶ and θ is the angle between d⟶ and −gk⟶; then,(16)gkT⟶d⟶=−gk⟶cosθ.Whenθ = 0, gkT⟶d⟶ will reach the minimum value and the speed of f (x) will reach the maximum value.The descent algorithm is shown in Figure6.Figure 6
The detailed process of the gradient descent algorithm.


### 3.2.2. Sentiment Word Feature Formula Application

A piece of text is composed of many words, so we say that words are the basis of text composition [7]. In particular, the emotional vocabulary that appears in the text will greatly affect the language emotional tendency of the entire sentence. The amount of emotional vocabulary has a great effect on the appeal of the language. We supplement the emotional dictionary here, which can make the emotional attribute f_sentimentsi look like the following formula:(17)fsentimentsi=∑k=1mestimatewordi,km.Here, word represents vocabulary,wordi,k is the kth word in the si sentence, and m represents the number of words. When estimatewordi,k=0, the word is not an emotional word, and when estimatewordi,k=1, the word is an emotional word. When using the relevant sentiment calculation formula, we can still add some auxiliary formulas, so on the basis of it, we have added the scoring formula calculation associated with it.(18)fkeywordsi=∑j=1nkeywordwij,keywordwij=1;wijakeyword,0;wijnotakeyword.Here,wij represents the jth word in the sentence si; we traverse it, and if it is a keyword, the feature score can be +1.Of course, the analysis of all languages is inseparable from the huge language storage database. Under the relevant operations of deep learning, we use relevant equipment to remove language redundancy and extract relevant information [8]. After a series of word segmentation operations, the language is carried out. Sentiment classification, combined with the weighted value operation of the previous technology, can make a better judgment, so as to realize the extraction of the text language [9].wc is the central reference vocabulary of the model application, which can effectively discriminate the context content wo and make probabilistic analysis. The relevant formulas applied by the model are as follows:(19)pw0|wc=expuoTvc∑i∈vexpuiTvc.vc is the center word vector, and ui is the background word vector. We can make the corresponding flow chart, as shown in Figure 7.Figure 7
De-redundancy exclusion operation of machine learning.Extracting and analyzing common vocabulary and selecting this formula can restore the emotional data of the original text to the greatest extent.(20)pxi=Zxit+1×tZxi=tZxi′+tZxi.xi represents the original vocabulary, Zxi represents the probability that the sampled vocabulary is extracted from the entire data set, and t is the threshold of the sampled vocabulary, which is 0.001 by default. The larger the value unit, the greater the difference in the sampling probability. For the same vocabulary, the larger the t value, the greater the probability of the sampled value being deleted [10].


## 3.2.1. Gradient Descent Algorithm

In this paper, the gradient descent algorithm is used simply to solve the problem of the optimal solution of the vocabulary in the current gradient, and the algorithm will explore the optimal solution of the vocabulary along the negative direction of this gradient. With the deepening of the training of the deep learning model, the difficulty level and complexity of the vocabulary will gradually deepen. Therefore, we use the negative direction to explore, so that the loss function decreases the fastest. The Taylor calculation formula of the relevantf (x) is as follows:(15)fx+ad=fxk+agkTd+oa,a>0.Here, the unit vector isd⟶ and θ is the angle between d⟶ and −gk⟶; then,(16)gkT⟶d⟶=−gk⟶cosθ.Whenθ = 0, gkT⟶d⟶ will reach the minimum value and the speed of f (x) will reach the maximum value.The descent algorithm is shown in Figure6.Figure 6
The detailed process of the gradient descent algorithm.


## 3.2.2. Sentiment Word Feature Formula Application

A piece of text is composed of many words, so we say that words are the basis of text composition [7]. In particular, the emotional vocabulary that appears in the text will greatly affect the language emotional tendency of the entire sentence. The amount of emotional vocabulary has a great effect on the appeal of the language. We supplement the emotional dictionary here, which can make the emotional attribute f_sentimentsi look like the following formula:(17)fsentimentsi=∑k=1mestimatewordi,km.Here, word represents vocabulary,wordi,k is the kth word in the si sentence, and m represents the number of words. When estimatewordi,k=0, the word is not an emotional word, and when estimatewordi,k=1, the word is an emotional word. When using the relevant sentiment calculation formula, we can still add some auxiliary formulas, so on the basis of it, we have added the scoring formula calculation associated with it.(18)fkeywordsi=∑j=1nkeywordwij,keywordwij=1;wijakeyword,0;wijnotakeyword.Here,wij represents the jth word in the sentence si; we traverse it, and if it is a keyword, the feature score can be +1.Of course, the analysis of all languages is inseparable from the huge language storage database. Under the relevant operations of deep learning, we use relevant equipment to remove language redundancy and extract relevant information [8]. After a series of word segmentation operations, the language is carried out. Sentiment classification, combined with the weighted value operation of the previous technology, can make a better judgment, so as to realize the extraction of the text language [9].wc is the central reference vocabulary of the model application, which can effectively discriminate the context content wo and make probabilistic analysis. The relevant formulas applied by the model are as follows:(19)pw0|wc=expuoTvc∑i∈vexpuiTvc.vc is the center word vector, and ui is the background word vector. We can make the corresponding flow chart, as shown in Figure 7.Figure 7
De-redundancy exclusion operation of machine learning.Extracting and analyzing common vocabulary and selecting this formula can restore the emotional data of the original text to the greatest extent.(20)pxi=Zxit+1×tZxi=tZxi′+tZxi.xi represents the original vocabulary, Zxi represents the probability that the sampled vocabulary is extracted from the entire data set, and t is the threshold of the sampled vocabulary, which is 0.001 by default. The larger the value unit, the greater the difference in the sampling probability. For the same vocabulary, the larger the t value, the greater the probability of the sampled value being deleted [10].


## 3.3. Actual SO-PMI Algorithm Operation

We can introduce relevant calculation algorithms of the probability theory. Assuming that the total number of text data isM, what we need to count is the specific number of text words, that is to say, the frequency problem in the text data set [11]. We can set it as dfword, which has the corresponding probability calculation formula of(21)pword=dfwordM.Then, we can convert the SO-PMI algorithm to the formula, and the new word similarity calculation formula can be obtained as(22)PMIw1,w2=log2M·dfw1&w2dfw1dfw2.In this calculation, we use the base 2 logarithmic formula, so that the statistical result is always between 0 and 1, so the similarity of words can be easily expressed. If the PMI value is greater than 0, it can indicate that the words have a correlation; if the PMI value is equal to 0, the words are independent of each other; if the PMI value is less than 0, the words have no correlation [12].We now continue the introduction of the formula, and we get the calculation formula of emotional tendency. At the beginning, we need to select words with clear emotions as reference objects and calculate the PMI difference, so as to judge the difference of language emotional tendency [13]. The relevant calculation formula is as follows:(23)SO−PMIw=∑i=1kPMIkey−pi,w−∑i=1kPMIkey−ni,w.Here,key−pi represents the ith positive word in the vocabulary statistics and key−ni represents the ith derogatory word in the vocabulary statistics.The following three judgment results for judging the Chinese language vocabulary are given as follows:If the value obtained by SO-PMI is greater than 0, the sentiment tendency of the wordw is positive.If the value obtained by SO-PMI is equal to 0, the emotional tendency of the wordw is neutral.If the value obtained by SO-PMI is less than 0, the sentiment tendency of the wordw is negative.At the beginning of this algorithm, the first thing to do is the preprocessing of the text.At this time, we need to extract candidate words according to the emotional language vocabulary database and judge whether the words in the text are emotional words [14]. If it has become an emotional vocabulary, the operation process can be directly skipped. If the text contains words that are not emotional words, the formula is used for calculation and evaluation.The SO-PMI value between the word and the benchmark word is calculated. If the result is greater than zero, it can be judged as a positive value and then added to the analysis operation; if the result is less than zero, it is judged as a derogatory word and added to the analysis. After all the judgment operation steps are finished, the algorithm can be judged to be finished. Due to the diversity and complexity of the Chinese language vocabulary, we can synonymously divide the selected positive and derogatory words in consideration of the benchmark value.Please note the following: when the target algorithm starts to execute, the corpus must be preprocessed and analyzed, then the part-of-speech judgment criteria are added after the word division and classification work, and finally, the regions are allocated [15]. This is based on the difficulty of the Chinese language. The Chinese phrase system is too large, and it is inevitable that there will be some omissions in the emotional thesaurus. Moreover, in today’s society in the Internet age, the number of emotional vocabulary updates is far greater than the number of thesauri stored. Therefore, we need to design an algorithm to judge the emotion of words. The SO-PMI algorithm in the figure is one of them. The specific implementation of the SO-PMI algorithm is shown in Figure 8.Figure 8
SO-PMI algorithm implementation.


## 4. Simulation Experiments

### 4.1. Data Budget Processing

In order to realize the superiority of related operation analysis of superimposed applications, we perform superimposition processing on the SO-PML algorithm, taking 5000+ Chinese language emotion data as an example, using the following methods to deeply analyze language emotion [16]. The specific experimental methods are as follows:Option 1: we model and cite the CLSTM model separately to analyze Chinese lexical sentimentOption 2: the CLSTM model uses the auxiliary gradient descent algorithm to calculate the optimal solution for the Chinese vocabularyOption 3: combined application of the CLSTM model in the auxiliary gradient descent algorithm and the emotional vocabulary formula is performedOption 4: The comprehensive application of the CLSTM model superimposed on the SO-PMI algorithm, the auxiliary gradient algorithm, and the emotional vocabulary formula calculation is done at the same time


### 4.2. Comparison Results of Experimental Algorithms

In the above scheme, we carried out data comparison operations, respectively, and obtained the comparison results of the Chinese language sentiment analysis, as shown in Tables1–4. Comparing the data in the table, we can clearly see that the data in scheme 1 is significantly lower than that of the other three schemes. We analyzed about 3000 words, but the algorithm’s sentiment extraction and analysis efficiency is only 50.7%, which is far lower than other algorithms [17]. Scheme 2 adds an auxiliary gradient descent algorithm to the CLSTM model to process the optimal solution of the vocabulary, and the rate and accuracy of analyzing vocabulary sentiment are slightly improved, but the overall change is not large and there are still major problems. Scheme 3 then analyzes the changes brought by the emotion formula to the CLSTM model. It can be seen that there are obvious changes compared to Scheme 1, but the analysis of the emotional state after too many words is still unsatisfactory. After all the tests, we finally designed the fourth scheme and it was successfully selected. It has its uniqueness in addition to the advantages of other algorithms, which greatly improves the efficiency of sentiment analysis. Therefore, this scheme has obvious advantages compared with other schemes, and its computing speed and the accuracy of the language sentiment analysis make its comprehensive level the best [18].Table 1
Chinese language sentiment extraction and analysis in scheme 1.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.570.85003.065.4150010.159.6300021.750.7Table 2
Chinese language sentiment extraction and analysis in scheme 2.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.478.95002.870.515008.564.9300016.460.5Table 3
Chinese language sentiment extraction and analysis in scheme 3.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.2581.25001.574.315006.065.9300014.861.7Table 4
Chinese language sentiment extraction and analysis in scheme 4.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.1198.85000.689.315003.582.730008.177.6We compared the line graphs of the analysis times for scenarios 1–4. The number of words from left to right in the figure is 100, 500, 1500, and 3000, respectively. We can clearly see the overall superiority of this scheme. When the number of vocabulary is larger, the more obvious the advantage is [19]. In this line chart, the larger the change of the line, the more obvious the distinction between the pros and cons of the model. We can clearly see from Figure 9 that when 100 text data is used as the standard, the line is basically a horizontal line with little change. When 3000 text data is used as the standard, the variation of schemes 1–4 is huge, which better verifies the superior performance of our selected algorithm.Figure 9
Comprehensive comparison of 4 algorithms on 3000 language vocabulary benchmarks.The comparison effect is shown in Figure10.Figure 10
Overall comparison of sentiment analysis time for schemes 1–4.Here, we take the 3000 language vocabulary benchmarks as an example and list the line chart to compare the data of schemes 1–4 in detail. It can be clearly seen that the comprehensive performance of scheme 4 is significantly better than the other schemes [20]. The effect is shown in Figure 9.


### 4.3. Analysis of the SO-PMI Algorithm Model for Superposition Application

In the above case analysis, using this algorithm, when the number of the Chinese language vocabulary is about 2000, it can make the language sentiment analysis efficiency and language sentiment analysis accuracy achieve the best comprehensive performance.Based on the comprehensive application of the CLSTM model superimposed on the SO-PMI algorithm proposed by the verification, that is, in the case of scheme 4, the number of 2000 Chinese language vocabulary is cited as the benchmark and the deep learning analyzes the emotional distribution of the vocabulary, conducts a comprehensive performance analysis on it, and shows the superior performance of the algorithm [21].When the number of Chinese language vocabulary is 2000, its comprehensive performance index is shown in Figure11.Figure 11
Comprehensive performance analysis of the 2000-word-based algorithm.When the number of words reaches 2000, it can meet the role of general article language sentiment analysis. The speed of language sentiment analysis is significantly improved compared with the previous algorithm. Based on 2000 words, the application waits about 4.5 minutes to meet people’s general needs, which is the time to wait [22].Text length is an important indicator of language sentiment analysis. If the text length is too short, it is difficult to reflect the superior performance of each algorithm. If the text is too long, it will increase the burden of the algorithm model.Therefore, we counted the distribution of language text length in general life, and Figure12 is a graphic representation of its distribution. We control most of the text within a reasonable range (this article uses 3000 as the range), so the algorithm can effectively perform related sentiment analysis work [23]. The distribution of language texts in daily life is shown in Figure 12.Figure 12
Statistical distribution display of language text length.Similarly, we analyze the actual emotional needs in this field. The language emotion function can be applied to emotion retrieval, emotion summary, emotion question answering, and many places such as movie reviews, product evaluations, microblogs, and news. It can be seen that its application field is broad, and the information given above shows that the comprehensive performance of the algorithm is superior and it is easy to meet the needs of language sentiment analysis in people’s daily life [24]. The overall block diagram of the language statistics is shown in Figure 13.Figure 13
The main adaptation map of language emotion.We need to transform traditional algorithmic sentiment analysis methods, improve the extraction and analysis of key words, and expand the coverage of key sentences to improve their representativeness. At the same time, emoji is also a major direction of its sentiment analysis. We also need to increase the related construction tasks of the symbol dictionary and combine it with text language analysis, expand the sentiment dictionary on the SO-PMI algorithm, and formulate a corresponding set of sentiment rules calculation.


## 4.1. Data Budget Processing

In order to realize the superiority of related operation analysis of superimposed applications, we perform superimposition processing on the SO-PML algorithm, taking 5000+ Chinese language emotion data as an example, using the following methods to deeply analyze language emotion [16]. The specific experimental methods are as follows:Option 1: we model and cite the CLSTM model separately to analyze Chinese lexical sentimentOption 2: the CLSTM model uses the auxiliary gradient descent algorithm to calculate the optimal solution for the Chinese vocabularyOption 3: combined application of the CLSTM model in the auxiliary gradient descent algorithm and the emotional vocabulary formula is performedOption 4: The comprehensive application of the CLSTM model superimposed on the SO-PMI algorithm, the auxiliary gradient algorithm, and the emotional vocabulary formula calculation is done at the same time


## 4.2. Comparison Results of Experimental Algorithms

In the above scheme, we carried out data comparison operations, respectively, and obtained the comparison results of the Chinese language sentiment analysis, as shown in Tables1–4. Comparing the data in the table, we can clearly see that the data in scheme 1 is significantly lower than that of the other three schemes. We analyzed about 3000 words, but the algorithm’s sentiment extraction and analysis efficiency is only 50.7%, which is far lower than other algorithms [17]. Scheme 2 adds an auxiliary gradient descent algorithm to the CLSTM model to process the optimal solution of the vocabulary, and the rate and accuracy of analyzing vocabulary sentiment are slightly improved, but the overall change is not large and there are still major problems. Scheme 3 then analyzes the changes brought by the emotion formula to the CLSTM model. It can be seen that there are obvious changes compared to Scheme 1, but the analysis of the emotional state after too many words is still unsatisfactory. After all the tests, we finally designed the fourth scheme and it was successfully selected. It has its uniqueness in addition to the advantages of other algorithms, which greatly improves the efficiency of sentiment analysis. Therefore, this scheme has obvious advantages compared with other schemes, and its computing speed and the accuracy of the language sentiment analysis make its comprehensive level the best [18].Table 1
Chinese language sentiment extraction and analysis in scheme 1.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.570.85003.065.4150010.159.6300021.750.7Table 2
Chinese language sentiment extraction and analysis in scheme 2.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.478.95002.870.515008.564.9300016.460.5Table 3
Chinese language sentiment extraction and analysis in scheme 3.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.2581.25001.574.315006.065.9300014.861.7Table 4
Chinese language sentiment extraction and analysis in scheme 4.
The number of emotion words extractedSentiment analysis rate (min)Language sentiment analysis accuracy (%)1000.1198.85000.689.315003.582.730008.177.6We compared the line graphs of the analysis times for scenarios 1–4. The number of words from left to right in the figure is 100, 500, 1500, and 3000, respectively. We can clearly see the overall superiority of this scheme. When the number of vocabulary is larger, the more obvious the advantage is [19]. In this line chart, the larger the change of the line, the more obvious the distinction between the pros and cons of the model. We can clearly see from Figure 9 that when 100 text data is used as the standard, the line is basically a horizontal line with little change. When 3000 text data is used as the standard, the variation of schemes 1–4 is huge, which better verifies the superior performance of our selected algorithm.Figure 9
Comprehensive comparison of 4 algorithms on 3000 language vocabulary benchmarks.The comparison effect is shown in Figure10.Figure 10
Overall comparison of sentiment analysis time for schemes 1–4.Here, we take the 3000 language vocabulary benchmarks as an example and list the line chart to compare the data of schemes 1–4 in detail. It can be clearly seen that the comprehensive performance of scheme 4 is significantly better than the other schemes [20]. The effect is shown in Figure 9.


## 4.3. Analysis of the SO-PMI Algorithm Model for Superposition Application

In the above case analysis, using this algorithm, when the number of the Chinese language vocabulary is about 2000, it can make the language sentiment analysis efficiency and language sentiment analysis accuracy achieve the best comprehensive performance.Based on the comprehensive application of the CLSTM model superimposed on the SO-PMI algorithm proposed by the verification, that is, in the case of scheme 4, the number of 2000 Chinese language vocabulary is cited as the benchmark and the deep learning analyzes the emotional distribution of the vocabulary, conducts a comprehensive performance analysis on it, and shows the superior performance of the algorithm [21].When the number of Chinese language vocabulary is 2000, its comprehensive performance index is shown in Figure11.Figure 11
Comprehensive performance analysis of the 2000-word-based algorithm.When the number of words reaches 2000, it can meet the role of general article language sentiment analysis. The speed of language sentiment analysis is significantly improved compared with the previous algorithm. Based on 2000 words, the application waits about 4.5 minutes to meet people’s general needs, which is the time to wait [22].Text length is an important indicator of language sentiment analysis. If the text length is too short, it is difficult to reflect the superior performance of each algorithm. If the text is too long, it will increase the burden of the algorithm model.Therefore, we counted the distribution of language text length in general life, and Figure12 is a graphic representation of its distribution. We control most of the text within a reasonable range (this article uses 3000 as the range), so the algorithm can effectively perform related sentiment analysis work [23]. The distribution of language texts in daily life is shown in Figure 12.Figure 12
Statistical distribution display of language text length.Similarly, we analyze the actual emotional needs in this field. The language emotion function can be applied to emotion retrieval, emotion summary, emotion question answering, and many places such as movie reviews, product evaluations, microblogs, and news. It can be seen that its application field is broad, and the information given above shows that the comprehensive performance of the algorithm is superior and it is easy to meet the needs of language sentiment analysis in people’s daily life [24]. The overall block diagram of the language statistics is shown in Figure 13.Figure 13
The main adaptation map of language emotion.We need to transform traditional algorithmic sentiment analysis methods, improve the extraction and analysis of key words, and expand the coverage of key sentences to improve their representativeness. At the same time, emoji is also a major direction of its sentiment analysis. We also need to increase the related construction tasks of the symbol dictionary and combine it with text language analysis, expand the sentiment dictionary on the SO-PMI algorithm, and formulate a corresponding set of sentiment rules calculation.


## 5. Conclusion

As mentioned above, the deep learning of this research is used for Chinese language sentiment extraction and analysis, through the reference of the original CLSTM model, plus the calculation of the auxiliary gradient algorithm and the emotional vocabulary formulaf_sentimentsi and the synthesis of the SO-PMI algorithm model. The application can substantially improve the efficiency and accuracy of language emotion extraction and analysis. The algorithm we propose performs de-redundancy operations on some unnecessary neutral words and can extract and analyze language sentiment after a series of word segmentation operations. Compared with other single algorithms, the comprehensive performance of this algorithm is the best, which significantly improves the efficiency and accuracy of sentiment analysis. Under the premise of 2000-word vocabulary, the algorithm fully meets the needs of daily life. In the traditional language sentiment analysis work, we add the new text extraction opinion vocabulary to explore the mutual emotional connection between vocabulary and objective affairs [25]. Combined with the extraction of opinion relations in the application of tree kernels, a new kernel reference is developed, multiple analyses is performed on the emotional vocabulary data model, and finally, the overall performance improvement of the efficiency of language sentiment analysis is achieved. The algorithm also has imperfections. Our emotional vocabulary is imperfect, and the Chinese text language is extremely difficult to analyze. In addition, there are some special sentence structure analyses, such as antonyms. We still need to increase the extraction of key sentence patterns and explore more advantageous algorithms to make the extraction of text information more representative.



---

*Source: 8145445-2022-06-02.xml*