# The Application of Artificial Intelligence in the Dissemination of Local Culture in Hainan Province: Taking the Dissemination of Bai Yuchan’s Thoughts as an Example

Authors: Yuxiu Yu; Honghai Wang
Journal: Advances in Multimedia
 (2022)

---

## Abstract

Bai Yuchan’s Taoist thought is an important part of Taoist health-preserving thought. Excavating, sorting out, and translating Bai Yuchan’s Taoist thought will not only help increase cultural self-confidence and protect traditional culture but also become an important medium for foreign exchanges. With the advent of the digital age, artificial intelligence has helped the dissemination of excellent traditional Chinese culture with its unique technological advantages, improving the effectiveness, intensity, and breadth of cultural dissemination. In domain machine translation, whether domain terms can be correctly translated plays a decisive role in the translation quality. It is of practical significance to effectively integrate domain terms into neural machine translation models and improve the translation quality of domain terms. This paper proposes a method of incorporating new Bai Yuchan’s thought term information as prior knowledge into neural machine translation. Using the term dictionary constructed from Bai Yuchan’s thought bilingual terminology knowledge base as a medium, two different knowledge integration methods are proposed and compared: (1) term replacement, which means using the target term to replace the source term on the source language side, and (2) term addition, which means splicing the source term and the target term on the source language side and both the source language side and the target language side. Use identifiers as special external knowledge to identify the beginning and end of the target term. Based on the Chinese-English bilingual alignment corpus of New Bai Yuchan’s thoughts and the constructed Chinese-English alignment termbase, the experiments are carried out. The results show that on the test set, the BLEU value of the proposed method is 6.38 and 6.38 higher than the baseline experiments, respectively, which proves that the proposed method can effectively incorporate domain terminology knowledge into the translation model and improve the translation quality of domain terminology.


---

## Body

## 1. Introduction

Culture is the soul of a country and a nation. President Xi pointed out that to carry forward the excellent traditional Chinese culture, we must properly handle the relationship between inheritance and creative development and focus on creative transformation and innovative development [1]. Driven by new theories and new technologies, the rapid development of artificial intelligence technology has promoted the innovative dissemination of Chinese excellent traditional culture [2]. How to apply artificial intelligence, perfectly integrate core value content and technical elements, and promote the inheritance and innovation of Chinese excellent traditional culture and how to give Chinese excellent traditional culture a precise expression, accurately display Chinese culture to the world, and spread Chinese voices are urgently needed solutions in the new era [3]. Artificial intelligence technology integrates core value content and modern aesthetic elements, giving Chinese traditional culture strong vitality [4]. With the development of high technology, artificial intelligence has subtly integrated Chinese traditional culture into people’s daily life in various forms of expression, improving the effectiveness of communication .There are two ways to translate and introduce Bai Yuchan’s Taoist health-preserving thoughts: one is to translate his works, and the translation method should be selected according to the characteristics of the text. The other is official and nongovernmental communication, the main body of communication should be expanded, and the power of new media should be used. Artificial intelligence can easily use the languages and dialects of different countries to communicate with audiences through translation technology and speech recognition technology, breaking the barriers of cross-language, cross-regional, and cross-cultural communication and promoting Chinese excellent traditional culture to the world [5]. Taking Dunhuang as an example, the artificial intelligence guide “Dunhuang Xiaobing” has thoroughly familiarized the thousands of pages of “Dunhuang Dictionary of Learning” by heart and uses different languages to chat to tourists about Dunhuang culture, history, geography, and other knowledge. In the digital age, technologies represented by artificial intelligence play a pivotal role in the dissemination process [6]. As a rational and objective representative, although artificial intelligence robots have knowledge reserves beyond the human brain, they cannot truly simulate human emotions and cannot resonate with the audience [7, 8]. Due to the constraints of technical factors such as coding, although the communication efficiency of robots is high, it cannot spread the cultural content with real warmth, emotion, and depth. The connotation interpretation is not deep enough, and the communication effect is not ideal. In some occasions that require complex human-computer interaction, artificial intelligence robots generally have the phenomenon of delay, unresponsiveness, and answers that are not asked [9, 10]. The overly stereotyped communication method has not really aroused the audience’s interest in traditional culture but also reduced the aesthetic charm of traditional culture itself, losing its due temperature and vitality. Therefore, how to avoid the patterned dissemination of artificial intelligence and inject the temperature, depth, and height of traditional culture into artificial intelligence technology is an urgent problem to be solved [11].Machine translation refers to the process of translating source language sentences into semantically equivalent target language sentences through computers. It is an important research direction in the field of natural language processing. “Deep learning technology” refers to using the learning ability of artificial intelligence to automatically recognize text, images, and sound data, so that machines can learn by themselves. In the process of translation, the terminology information of a specific domain is incorporated into the neural machine translation model as prior knowledge, and improving the translation effect of domain terms has always been a hot issue in neural machine translation research. In recent years, with the development of multiculturalism, some young people believe that traditional culture “can’t keep up with the trend,” and there is a misunderstanding of traditional culture, which leads to a narrow audience of traditional culture and affects innovation and development to a certain extent [12]. To this end, we urgently need to use artificial intelligence technology represented by “deep learning technology” to continuously inject elements of the times into traditional culture and use the songs and dances, film, and television works that young people like to interpret the profound connotation of traditional culture and provide traditional culture. The deep inner core is wrapped in the coat of the era [13, 14]. This can not only stimulate the interest of contemporary young people to deeply explore traditional culture and promote the integration and development of traditional culture and modern society but also realize the inheritance and innovation of traditional culture [15].Inner alchemy is relatively esoteric and difficult to understand, and it is very difficult to practice. Within Taoism, there are not many people who have truly cultivated the Dao. For overseas people, it is even more difficult to practice when they overcome language and cultural barriers. The translation and introduction of Bai Yuchan’s Taoist health-preserving thoughts is an important part of the promotion of Chinese culture, mainly through the following two ways: first, the translation of Bai Yuchan’s works, and second, the official and private dissemination of Bai Yuchan’s thoughts and deeds. In addition to following the general principles of Taoist translation, the translation of Bai Yuchan’s works should also choose appropriate translation methods according to its own text characteristics. In addition to the instructive expositions on cultivation, his writings also contain more than a thousand poems, with themes related to the beautiful scenery of the wind and moon, cultivation insights, and singing of immortal ancestors. When translating the instructive discourse on cultivation practice, because the Taoist vocabulary used by Bai Yuchan has the characteristics of metaphor and nonspecificity, and most of the vocabulary corresponding to the cultural connotation cannot be found in American culture, the literal translation plus annotation method, transliteration plus annotation method, can be used. Taking the sixth jue “Slow Fire” of “Dan Fa Shen Tong 19 Jue” as an example, the word itself has the meaning of decoction, small fire, and slow simmering when stewing soup, which is used as a metaphor for “no mind during the training process.” When continuous gentle breathing is used in meditation, Bai Yuchan said that his state is “warm and warm, and it is continuous.” Therefore, it can be translated as follows: simmering fire, which refers to soft, slow, and continuous breath during meditation without the guidance of mind. When translating poems, different translation methods should be adopted according to different categories to fully convey their aesthetic connotations.


## 2. The Research Background and Technical Solutions

### 2.1. The Introduction of Bai Yuchan and His Thought

Bai Yuchan is one of the five patriarchs of the Southern Sect, and his Taoist health-preserving thought is based on the full integration and sublimation of the three schools of thought, Confucianism, Buddhism, and Taoism. The quintessence of Bai Yuchan’s Taoist health-preserving thought is mainly reflected in three aspects, namely, inner alchemy health-preserving, elegant interest health-preserving, and diet health-preserving.Bai Yuchan’s Taoist health-preserving thought is an important part of Chinese Taoist health-preserving thought. It is a sublimation on the basis of inheriting Confucianism and Taoism’s health-preserving thought and can meet the needs of modern medical development, government health care work, and personal health preservation. Therefore, it is necessary to carry out the translation and introduction of Bai Yuchan’s Taoist health care thought. Modern medicine inherits the wisdom of the ancients and puts health in the first place. “Practicing work to treat illnesses, medicine will focus on health care, so that everyone’s life will be more pleasant, comfortable and unrestrained.” Compared with the translation and introduction of the thoughts of nourishing the heart and diet, the difficulties in the translation and introduction of the thoughts of Bai Yuchan’s Nei Dan are mainly manifested in the following aspects. Firstly, the inner alchemy technique is relatively esoteric and difficult to understand, and it is very difficult to practice. There are not many people who have truly cultivated the Dao. Second, Taoists are indifferent to fame and fortune and advocate quietness and inaction. Taoists who have cultivated the Dao are less devoted to explaining the profound and difficult theories and cultivation methods of inner alchemy in simple language or explaining the practice of inner alchemy in simple language. Nowadays, the most widely circulated overseas are Taijiquan, Wuqinxi, and Baduanjin, which are highly practical and relatively simple health-preserving exercises. Some scholars believe that “so far, no individual or organization has been engaged in the promotion of Taoist Neidan health care.”Bai Yuchan’s Taoist health-preserving thought is an important part of Taoist health-preserving thought. Excavating, sorting out, and translating Bai Yuchan’s Taoist health-preserving thought will not only help increase cultural self-confidence and protect traditional culture but also become an important medium for foreign exchanges. Translators shoulder the heavy responsibility of cultural promotion and require high professional quality. They must not only be influenced by Chinese culture but also familiar with the context of Western culture and become a bridge between Chinese and Western cultures. In the process of translation, the translator needs to have a high degree of retention of the cultural information of Bai Yuchan’s thoughts and do a lot of textual research work. It is impossible without a professional, scientific, and realistic research spirit. In addition, translators need strong basic language skills and the accumulation of traditional Chinese culture. They need multiple background knowledge such as linguistics, history, sociology, and philosophy and can better express Bai Yuchan’s thought and the text information and culture in his works. To present the whole picture of Bai Yuchan’s thought and his works as much as possible, so that the target language readers can deeply understand the traditional cultural essence of Chinese Taoism, health preservation thought, philosophy, and aesthetics, so as to truly improve the acceptance of the translated work in the target language countries and regions. Make due contributions to the dissemination of Hainan local culture and traditional Chinese culture. They should not only have the accumulation of traditional Chinese culture, good foreign language literacy, and translation ability but also have the enthusiasm for translating and introducing Chinese cultural classics and disseminating Chinese culture. Understand Bai Yuchan’s works at a level and highlight the humanistic value and cultural heritage of philosophy, aesthetics, and Taoist health-preserving thoughts in his works. In the official and nongovernmental communication of Bai Yuchan’s thoughts and deeds, the main focus should be on expanding the subjects and objects of external communication, promoting the diversification of external communication channels, and adapting to the needs of external communication objects.In addition to following the general principles of Taoist translation, the translation of Bai Yuchan’s works should also choose appropriate translation methods according to its own text characteristics. In addition to the instructive expositions on cultivation, his writings also contain more than a thousand poems on topics such as the scenery of the wind and the moon, cultivation insights, and singing of immortal ancestors. When translating the instructive discourse on cultivation practice, the Taoist vocabulary used by Bai Yuchan has the characteristics of metaphor and nonspecificity, and most of the vocabulary corresponding to the cultural connotation cannot be found in American culture.


### 2.2. Neural Machine Translation System Based on Transformer

In terms of promoting the diversification of external communication channels, we should realize that the single paper media in the past has been far from meeting the needs. For example, Wechat international version official account, Weibo international version, Facebook, Tencent video and other software have expanded external communication channels. Transformer is a classic model based on attention mechanism proposed by Google team in 2017. This model abandons the sequential structure of traditional recurrent neural network, uses self-attention mechanism, and performs parallel training on the basis of global information. Best quality and translation speed. Therefore, this paper selects Transformer to conduct experiments on the translation model [16]. The Transformer model adopts a sequence-to-sequence model architecture, and the overall structure consists of two parts: an encoder and a decoder [17]. The encoder of the model encodes the source language and converts it into a vector representation, and the decoder receives the encoding information from the encoder and then decodes it to generate a translation. The overall structure of Transformer is shown in Figure 1.Figure 1
Transformer structure.In addition to following the general principles of Taoist translation, the translation of Bai Yuchan’s works should also choose appropriate translation methods according to its own text characteristics. In addition to the instructive expositions on cultivation, his works also contain more than a thousand poems on topics such as the beautiful scenery of the wind and the moon, cultivation insights, and singing of immortal ancestors. The encoder consists of 6 identical layer stacks, each of which contains a multihead attention sublayer and a feed-forward neural network sublayer, which are connected by residual connections and layers [18, 19]. Transformer uses positional encoding to save the position of words in the sequence to identify the order relationship in the language. The calculation formula of positional encoding PE is shown in
(1)PEpos,2i=sinpos100002i/d,PEpos,2i+1=cospos100002i/d,where pos represents the position of the word in the sentence, d represents the dimension of the position embedding, and i represents the dimension number of the word vector. For the input source sentence X, the vector representation of all words in the sentence is obtained by adding the word embedding vector and the position encoding, as shown in
(2)XEmbedding=WordEmbeddingX+PositionalEncodingX.The three linear transformation matrices WQ, WK, and WV in the attention sublayer, respectively, perform three linear transformations on the input vector representation and derive the query matrixQ, the key matrix K, and the value matrix V and further obtain the attention of X, which are shown in
(3)Q=LinearXEmbedding=XEmbedding⋅WQ,K=LinearXEmbedding=XEmbedding⋅WK,V=LinearXEmbedding=XEmbedding⋅WV,Xattention=AttentionQ,K,V=SoftmaxQKTdkV.The linear transformation matricesWQ,WK,WV in the self-attention layer are defined as multiple group, namely, W0Q,W0K,W0V and W1Q,W1k,W1V, multiple sets of attention vectors are obtained after calculation, and the multiple sets of attention vectors are spliced and input into the feedforward neural network after residual connection and layer normalization [20]. The specific calculation formulas are shown in
(4)Zi=headi=AttentionQWiQ,KWiK,WWiV,i=1,⋯,8,Z=MultiheadQ,K,V=ConcatZ1,Z2,⋯,Z8W0.The feedforward neural network consists of two fully connected network sublayers. The first layer uses the RELU function as the activation function, and the second layer is the linear activation function, as shown in(5)FFNZ=max0,ZW1+b1W2+b2,where b1, b2, W1, and W2 are model parameters.Similar to the encoder, the decoder also consists of a stack of 6 identical layers, and each layer of the decoder consists of two multihead attention sublayers and a feed-forward neural network sublayer. The first multihead attention sublayer adopts the masked operation, called masked multihead attention, which is used to hide the information of the next order when translating the current order [21]. The K and V matrices of the second multihead attention sublayer come from the encoded information matrix of the encoder, while the Q matrix uses the output of the previous multihead attention layer in the decoder. Residual connections and layer normalization are performed at each sublayer.


## 2.1. The Introduction of Bai Yuchan and His Thought

Bai Yuchan is one of the five patriarchs of the Southern Sect, and his Taoist health-preserving thought is based on the full integration and sublimation of the three schools of thought, Confucianism, Buddhism, and Taoism. The quintessence of Bai Yuchan’s Taoist health-preserving thought is mainly reflected in three aspects, namely, inner alchemy health-preserving, elegant interest health-preserving, and diet health-preserving.Bai Yuchan’s Taoist health-preserving thought is an important part of Chinese Taoist health-preserving thought. It is a sublimation on the basis of inheriting Confucianism and Taoism’s health-preserving thought and can meet the needs of modern medical development, government health care work, and personal health preservation. Therefore, it is necessary to carry out the translation and introduction of Bai Yuchan’s Taoist health care thought. Modern medicine inherits the wisdom of the ancients and puts health in the first place. “Practicing work to treat illnesses, medicine will focus on health care, so that everyone’s life will be more pleasant, comfortable and unrestrained.” Compared with the translation and introduction of the thoughts of nourishing the heart and diet, the difficulties in the translation and introduction of the thoughts of Bai Yuchan’s Nei Dan are mainly manifested in the following aspects. Firstly, the inner alchemy technique is relatively esoteric and difficult to understand, and it is very difficult to practice. There are not many people who have truly cultivated the Dao. Second, Taoists are indifferent to fame and fortune and advocate quietness and inaction. Taoists who have cultivated the Dao are less devoted to explaining the profound and difficult theories and cultivation methods of inner alchemy in simple language or explaining the practice of inner alchemy in simple language. Nowadays, the most widely circulated overseas are Taijiquan, Wuqinxi, and Baduanjin, which are highly practical and relatively simple health-preserving exercises. Some scholars believe that “so far, no individual or organization has been engaged in the promotion of Taoist Neidan health care.”Bai Yuchan’s Taoist health-preserving thought is an important part of Taoist health-preserving thought. Excavating, sorting out, and translating Bai Yuchan’s Taoist health-preserving thought will not only help increase cultural self-confidence and protect traditional culture but also become an important medium for foreign exchanges. Translators shoulder the heavy responsibility of cultural promotion and require high professional quality. They must not only be influenced by Chinese culture but also familiar with the context of Western culture and become a bridge between Chinese and Western cultures. In the process of translation, the translator needs to have a high degree of retention of the cultural information of Bai Yuchan’s thoughts and do a lot of textual research work. It is impossible without a professional, scientific, and realistic research spirit. In addition, translators need strong basic language skills and the accumulation of traditional Chinese culture. They need multiple background knowledge such as linguistics, history, sociology, and philosophy and can better express Bai Yuchan’s thought and the text information and culture in his works. To present the whole picture of Bai Yuchan’s thought and his works as much as possible, so that the target language readers can deeply understand the traditional cultural essence of Chinese Taoism, health preservation thought, philosophy, and aesthetics, so as to truly improve the acceptance of the translated work in the target language countries and regions. Make due contributions to the dissemination of Hainan local culture and traditional Chinese culture. They should not only have the accumulation of traditional Chinese culture, good foreign language literacy, and translation ability but also have the enthusiasm for translating and introducing Chinese cultural classics and disseminating Chinese culture. Understand Bai Yuchan’s works at a level and highlight the humanistic value and cultural heritage of philosophy, aesthetics, and Taoist health-preserving thoughts in his works. In the official and nongovernmental communication of Bai Yuchan’s thoughts and deeds, the main focus should be on expanding the subjects and objects of external communication, promoting the diversification of external communication channels, and adapting to the needs of external communication objects.In addition to following the general principles of Taoist translation, the translation of Bai Yuchan’s works should also choose appropriate translation methods according to its own text characteristics. In addition to the instructive expositions on cultivation, his writings also contain more than a thousand poems on topics such as the scenery of the wind and the moon, cultivation insights, and singing of immortal ancestors. When translating the instructive discourse on cultivation practice, the Taoist vocabulary used by Bai Yuchan has the characteristics of metaphor and nonspecificity, and most of the vocabulary corresponding to the cultural connotation cannot be found in American culture.


## 2.2. Neural Machine Translation System Based on Transformer

In terms of promoting the diversification of external communication channels, we should realize that the single paper media in the past has been far from meeting the needs. For example, Wechat international version official account, Weibo international version, Facebook, Tencent video and other software have expanded external communication channels. Transformer is a classic model based on attention mechanism proposed by Google team in 2017. This model abandons the sequential structure of traditional recurrent neural network, uses self-attention mechanism, and performs parallel training on the basis of global information. Best quality and translation speed. Therefore, this paper selects Transformer to conduct experiments on the translation model [16]. The Transformer model adopts a sequence-to-sequence model architecture, and the overall structure consists of two parts: an encoder and a decoder [17]. The encoder of the model encodes the source language and converts it into a vector representation, and the decoder receives the encoding information from the encoder and then decodes it to generate a translation. The overall structure of Transformer is shown in Figure 1.Figure 1
Transformer structure.In addition to following the general principles of Taoist translation, the translation of Bai Yuchan’s works should also choose appropriate translation methods according to its own text characteristics. In addition to the instructive expositions on cultivation, his works also contain more than a thousand poems on topics such as the beautiful scenery of the wind and the moon, cultivation insights, and singing of immortal ancestors. The encoder consists of 6 identical layer stacks, each of which contains a multihead attention sublayer and a feed-forward neural network sublayer, which are connected by residual connections and layers [18, 19]. Transformer uses positional encoding to save the position of words in the sequence to identify the order relationship in the language. The calculation formula of positional encoding PE is shown in
(1)PEpos,2i=sinpos100002i/d,PEpos,2i+1=cospos100002i/d,where pos represents the position of the word in the sentence, d represents the dimension of the position embedding, and i represents the dimension number of the word vector. For the input source sentence X, the vector representation of all words in the sentence is obtained by adding the word embedding vector and the position encoding, as shown in
(2)XEmbedding=WordEmbeddingX+PositionalEncodingX.The three linear transformation matrices WQ, WK, and WV in the attention sublayer, respectively, perform three linear transformations on the input vector representation and derive the query matrixQ, the key matrix K, and the value matrix V and further obtain the attention of X, which are shown in
(3)Q=LinearXEmbedding=XEmbedding⋅WQ,K=LinearXEmbedding=XEmbedding⋅WK,V=LinearXEmbedding=XEmbedding⋅WV,Xattention=AttentionQ,K,V=SoftmaxQKTdkV.The linear transformation matricesWQ,WK,WV in the self-attention layer are defined as multiple group, namely, W0Q,W0K,W0V and W1Q,W1k,W1V, multiple sets of attention vectors are obtained after calculation, and the multiple sets of attention vectors are spliced and input into the feedforward neural network after residual connection and layer normalization [20]. The specific calculation formulas are shown in
(4)Zi=headi=AttentionQWiQ,KWiK,WWiV,i=1,⋯,8,Z=MultiheadQ,K,V=ConcatZ1,Z2,⋯,Z8W0.The feedforward neural network consists of two fully connected network sublayers. The first layer uses the RELU function as the activation function, and the second layer is the linear activation function, as shown in(5)FFNZ=max0,ZW1+b1W2+b2,where b1, b2, W1, and W2 are model parameters.Similar to the encoder, the decoder also consists of a stack of 6 identical layers, and each layer of the decoder consists of two multihead attention sublayers and a feed-forward neural network sublayer. The first multihead attention sublayer adopts the masked operation, called masked multihead attention, which is used to hide the information of the next order when translating the current order [21]. The K and V matrices of the second multihead attention sublayer come from the encoded information matrix of the encoder, while the Q matrix uses the output of the previous multihead attention layer in the decoder. Residual connections and layer normalization are performed at each sublayer.


## 3. Domain Machine Translation Incorporating Terminology Knowledge

### 3.1. Experimental Data

This paper studies domain machine translation based on the bilingual alignment corpus of the new Bai Yuchan thought and the constructed bilingual terminology knowledge base. The bilingual aligned corpus Pat_Corpus is constructed from the actionable patent website, a patent data search engine. The size of the Chinese corpus is 17.5 MB, and the size of the English corpus is 26.1 MB. The two corpora contain a total of 116,095 pairs of Chinese-English bilingual alignment sentences. Table1 lists examples of Chinese and English patent sentence pairs of Bai Yuchan’s thought.Table 1
Examples of Chinese and English sentences.
ChineseEnglishYi xi chun shui yang bi han, liu chu hong tao ji pian hong.Above the emerald spring brook, chills rise; along with the water, peach blossom petals float.Ri gao wu zhang shang han mian, xin xia wu chou bu guan tian.When it is almost noon, I am in my dreamland lingering, whatever matters in this world is of no concern to me.Zhen qian zhen gong cai ru shou, pian shi fu hu you qin long.Once the true lead and mercury in your body are found, immediately the tiger and dragon are captured.The term knowledge base uses deep learning technology to build a neural network to extract terms from Chinese patent texts and translates Chinese terms through WIPO to obtain corresponding English terms. Each corpus contains a total of 39,861 pairs of Chinese and English terms. Table2 lists examples of Chinese and English patent term pairs in Bai Yuchan’s thought.Table 2
Examples of Chinese and English sentences.
ChineseEnglishZuo wang lunTreatise on sitting forgettingDan yang zhen ren yu luSaying of Taoist master DanyangZhi shang yu huang dai xi jingThe Taoist method of opening the Dan TianThe Pat_Corpus is divided into training set, validation set, and test set according to the ratio of 8 : 1 : 1.


### 3.2. Experimental Procedure

In this experiment, Chinese data is used as the source language, and English data is used as the target language. For Chinese data, terminology information is incorporated into neural machine translation as prior knowledge using two different methods: terminology replacement and terminology addition. Using jieba word segmentation tool and with the help of Chinese patent terminology database to guide word segmentation, the term information in Chinese patent data is effectively preserved [22]. It avoids the loss of term information caused by inaccurate word segmentation, which affects the translation effect of the term, and provides basic data for term replacement and term addition.
(1)
Term replacement: use the target term to replace the source term on the source language side, and use the symbols “<S>” and “<E>” to identify the target term. In this paper, this method is denoted as SE-Replace(2)
Terminology addition: add the target term after the source term in the source language, and use the symbols “<S>” and “<E>” to identify the target term. In this paper, this method is denoted as SE-AppendFor English data, the NLTK word segmentation tool is used for word segmentation, the terms in it are also identified, and the English data after word segmentation is standardized [23]. Source represents the source language, Segmentation represents the result of the term dictionary instructing word segmentation, SE-Replace represents the term replacement method proposed in this paper, and SE-Append represents the term addition method proposed in this paper. The domain term information is incorporated into neural machine translation as prior knowledge through term replacement and term addition, and the symbols “<S>” and “<E>” are used to identify the replacement and addition of target-side terms in the source language, respectively. The method of using term replacement enables the translation model to learn the semantic relationship between the target-side term and the source sentence during training [24, 25]. The method of term addition enables the model to learn more fully the correspondence between the source terminology and the target terminology during training, so as to further improve the accuracy of term translation results [26]. Taking a translation instance incorporating prior terminology knowledge in the new energy field as an example, the training process of the translation model is shown in Figure 2.Figure 2
Model training process.In order to verify the effectiveness of the proposed method, the following comparative experiments are designed in this paper.(1)
Baseline: the source language does not carry any terminology information as prior knowledge, and the data that has only been guided by terminology segmentation in the new energy field is used as the baseline experimental data(2)
Replace: replace only, use the target term to replace the source term. The source language carries the target term knowledge information and does not use any identifier to identify the source language component(3)
Append: add only, splicing the destination term after the source term. The source language carries the knowledge information of the source terminology and the target terminology, and no identifier is used to identify the language components in the source language(4)
Sub-Replace: use the target term to replace the source term, the source language carries the knowledge information of the target term, learn from the ideas of Dinu and others, and use the identifier to identify the source language component, where the subscript 0 identifies the source language part, subscript 1 identifies the source term, and subscript 2 identifies the destination term(5)
Sub-Append: concatenate the target term after the source term. The source language carries the knowledge information of the source terminology and the target terminology and uses the identifier to identify the components in the source language. The subscript 0 identifies the source language part, the subscript 1 identifies the source term, and the subscript 2 identifies the target term(6)
SE-Replace: the term replacement method is proposed in this paper. On the source language side, use the target-side term to replace the source-side term, and use the symbols “<S>” and “<E>” to identify the target-side term(7)
SE-Append: the term adding method is proposed in this paper. Add the target-side term after the source-language side and the source-side term, and use the symbols “<S>” and “<E>” to identify the target-side term


## 3.1. Experimental Data

This paper studies domain machine translation based on the bilingual alignment corpus of the new Bai Yuchan thought and the constructed bilingual terminology knowledge base. The bilingual aligned corpus Pat_Corpus is constructed from the actionable patent website, a patent data search engine. The size of the Chinese corpus is 17.5 MB, and the size of the English corpus is 26.1 MB. The two corpora contain a total of 116,095 pairs of Chinese-English bilingual alignment sentences. Table1 lists examples of Chinese and English patent sentence pairs of Bai Yuchan’s thought.Table 1
Examples of Chinese and English sentences.
ChineseEnglishYi xi chun shui yang bi han, liu chu hong tao ji pian hong.Above the emerald spring brook, chills rise; along with the water, peach blossom petals float.Ri gao wu zhang shang han mian, xin xia wu chou bu guan tian.When it is almost noon, I am in my dreamland lingering, whatever matters in this world is of no concern to me.Zhen qian zhen gong cai ru shou, pian shi fu hu you qin long.Once the true lead and mercury in your body are found, immediately the tiger and dragon are captured.The term knowledge base uses deep learning technology to build a neural network to extract terms from Chinese patent texts and translates Chinese terms through WIPO to obtain corresponding English terms. Each corpus contains a total of 39,861 pairs of Chinese and English terms. Table2 lists examples of Chinese and English patent term pairs in Bai Yuchan’s thought.Table 2
Examples of Chinese and English sentences.
ChineseEnglishZuo wang lunTreatise on sitting forgettingDan yang zhen ren yu luSaying of Taoist master DanyangZhi shang yu huang dai xi jingThe Taoist method of opening the Dan TianThe Pat_Corpus is divided into training set, validation set, and test set according to the ratio of 8 : 1 : 1.


## 3.2. Experimental Procedure

In this experiment, Chinese data is used as the source language, and English data is used as the target language. For Chinese data, terminology information is incorporated into neural machine translation as prior knowledge using two different methods: terminology replacement and terminology addition. Using jieba word segmentation tool and with the help of Chinese patent terminology database to guide word segmentation, the term information in Chinese patent data is effectively preserved [22]. It avoids the loss of term information caused by inaccurate word segmentation, which affects the translation effect of the term, and provides basic data for term replacement and term addition.
(1)
Term replacement: use the target term to replace the source term on the source language side, and use the symbols “<S>” and “<E>” to identify the target term. In this paper, this method is denoted as SE-Replace(2)
Terminology addition: add the target term after the source term in the source language, and use the symbols “<S>” and “<E>” to identify the target term. In this paper, this method is denoted as SE-AppendFor English data, the NLTK word segmentation tool is used for word segmentation, the terms in it are also identified, and the English data after word segmentation is standardized [23]. Source represents the source language, Segmentation represents the result of the term dictionary instructing word segmentation, SE-Replace represents the term replacement method proposed in this paper, and SE-Append represents the term addition method proposed in this paper. The domain term information is incorporated into neural machine translation as prior knowledge through term replacement and term addition, and the symbols “<S>” and “<E>” are used to identify the replacement and addition of target-side terms in the source language, respectively. The method of using term replacement enables the translation model to learn the semantic relationship between the target-side term and the source sentence during training [24, 25]. The method of term addition enables the model to learn more fully the correspondence between the source terminology and the target terminology during training, so as to further improve the accuracy of term translation results [26]. Taking a translation instance incorporating prior terminology knowledge in the new energy field as an example, the training process of the translation model is shown in Figure 2.Figure 2
Model training process.In order to verify the effectiveness of the proposed method, the following comparative experiments are designed in this paper.(1)
Baseline: the source language does not carry any terminology information as prior knowledge, and the data that has only been guided by terminology segmentation in the new energy field is used as the baseline experimental data(2)
Replace: replace only, use the target term to replace the source term. The source language carries the target term knowledge information and does not use any identifier to identify the source language component(3)
Append: add only, splicing the destination term after the source term. The source language carries the knowledge information of the source terminology and the target terminology, and no identifier is used to identify the language components in the source language(4)
Sub-Replace: use the target term to replace the source term, the source language carries the knowledge information of the target term, learn from the ideas of Dinu and others, and use the identifier to identify the source language component, where the subscript 0 identifies the source language part, subscript 1 identifies the source term, and subscript 2 identifies the destination term(5)
Sub-Append: concatenate the target term after the source term. The source language carries the knowledge information of the source terminology and the target terminology and uses the identifier to identify the components in the source language. The subscript 0 identifies the source language part, the subscript 1 identifies the source term, and the subscript 2 identifies the target term(6)
SE-Replace: the term replacement method is proposed in this paper. On the source language side, use the target-side term to replace the source-side term, and use the symbols “<S>” and “<E>” to identify the target-side term(7)
SE-Append: the term adding method is proposed in this paper. Add the target-side term after the source-language side and the source-side term, and use the symbols “<S>” and “<E>” to identify the target-side term


## 4. Result Analysis and Discussion

In order to better reflect the effectiveness of the proposed method, different random seeds are set when dividing the training set, the validation set, and the test set, and experiments are carried out multiple times according to the division ratio. The training rounds are set to 160, and the model training was taken the same hyperparameter settings; record the BLEU scores on the validation set and test set for each experiment, calculate the average, and use it as the final score.In order to more intuitively show the performance of different methods, Figures3 and 4 use the BLEU value as the ordinate to show the BLEU value and change trend of different methods on the validation set and test set.Figure 3
Validation set translation performance.Figure 4
Test set translation performance.The experimental results show that, compared with Baseline, the methods of Replace and Append, which carry prior terminology knowledge, both improve the translation performance. The mean value of using Replace’s method after 3 experiments obtains an improvement of 1.87 and 0.76 BLEU points on the validation set and the test set, respectively. After three experiments using the Append method, the mean value of the validation set and the test set was improved by 2.92 and 1.76 BLEU points, respectively. The Replace and Append methods verify the effectiveness of incorporating prior knowledge in neural machine translation, and incorporating prior terminology knowledge into the source can effectively improve the translation effect of neural machine translation.Compared with the Replace and Append methods, the Sub-Replace and Sub-Append methods have further improved the translation performance. Compared with Replace, Sub-Replace improves by 1.09 and 1.33 BLEU points on validation set and test set, respectively. Compared with Append, Sub-Append improves by 1.5 and 1.41 BLEU points on validation set and test set, respectively. The Sub-Replace and Sub-Append methods verify the effectiveness of using identifiers to identify sentence components in the source language to distinguish source terms from target terms based on incorporating term information as prior knowledge into neural machine translation.The method in this paper directly replaces the source term with the target term, splices the target term information behind the source term, and uses the identifiers “<S>” and “<E>” to identify the beginning and end of the target term, respectively. This incorporates terminology information as prior knowledge and identifiers as additional information into neural machine translation models. In order to further compare the differences between term replacement and term addition at the source end, we carried out experimental analysis on Baseline, Append, Replace, Sub-Replace, Sub-Append, and the methods SE-Replace and SE-Append proposed in this paper. Figures5 and 6, respectively, show the number of model iterations in the training process and the line graph after averaging BLEU for methods such as whether to incorporate terminology knowledge in the source language and how to identify it after incorporating terminology knowledge.Figure 5
Epoch-BLEU change chart 1.Figure 6
Epoch-BLEU change chart 2.SE-Append has leveled off after 110 epochs of training. The reason may be that the target term is added after the source term, and more term knowledge is incorporated into the source language. As shown in Figures5 and 6, the Transformer model tends to converge gradually during iterative training. Baseline, which has only been processed by common word segmentation, converges faster and becomes stable after 80 rounds of training. The reason may be the fixed expression of Bai Yuchan’s thoughts in Chinese and English patent texts and the strong learning ability of the Transformer model. The Transformer model learns the corresponding expressions of Chinese and English patent texts in a short period of time and thus tends to be stable in a relatively short period of time. From the experimental results, since there is no term information input as prior knowledge in the source language, the translation model cannot fully learn the correspondence between the source terminology and the target terminology during training and can only translate simple terms correctly. It is the difference between Chinese and English expressions and the use of multiple digital subscripts to identify sentence components in the source language, which causes knowledge confusion, increases the difficulty of learning translation models, and makes it difficult for neural networks to learn.The addition of terms can retain the complete information and expression habits expressed in Chinese, enrich the expression information of the source terminology, and only identify the target terminology by identifiers in the source language and the target language, avoiding the confusion of knowledge caused by excessive identifiers. In order to visually show the effect of adding data of different scales on the Pearson correlation coefficient, this paper generates two sets of line graphs for comparison of the experimental results. Figure7 shows the training of the feature extraction model using the synthetic corpus with the addition of mono-zh and syn-vi, and Figure 8 shows the training of the feature extraction model with the synthetic corpus with the addition of syn-zh and mono-vi. The experimental results show that the addition of synthetic corpora produces favorable results for the training of the translation quality estimation model, and the Pearson correlation coefficients in the Chinese-English direction are better than those in the English-Chinese direction.Figure 7
Add synthetic (mono-zh) corpus experimental results.Figure 8
Add (syn-zh) synthetic corpus experimental results.


## 5. Conclusions

For domain-oriented machine translation tasks, this paper takes Bai Yuchan’s thought as an example to carry out domain machine translation research and proposes a new energy domain term information as a priori knowledge into neural machine translation through term replacement. The identifiers “<S>” and “<E>” are used to identify the target-side terms, and the target-side terms are separated from the sentence components of the source language and target language. The identifiers “<S>” and “<E>” are input as additional knowledge to guide the translation process. Experiments show that using target-side terms to replace source-side terms and splicing target-side terms to source-side terms can effectively incorporate domain terms as prior knowledge into neural machine translation, improving term translation effects. As special external knowledge, identifiers will give the neural network additional learning guidance. When the neural machine translation model learns the correspondence between the source language and the target language, it will focus on the target-side terms identified by special symbols, thereby improving translation quality of tagged terms and improving overall translation quality while ensuring that domain terms are correctly translated.Bai Yuchan’s Taoist health-preserving thought is an important part of Chinese Taoist health-preserving thought. It is a sublimation on the basis of inheriting the Confucian and Taoist health-preserving ideas and can meet the needs of medical development, government health care work, and personal health preservation. Therefore, it is necessary to carry out white jade The Translation and Introduction of Toad Taoism’s Health-keeping Thought. The main change of the method in this paper is at the data level. Compared with the model modification, the method in this paper is simple, practical, and easy to implement and has achieved obvious results in the experiment. In addition, the method in this paper has generality in improving the translation quality of domain terminology under the premise of ensuring domain-aligned corpus and domain terminology knowledge base. In the next step, we will explore how to use multiple encoders in domain machine translation to model external prior knowledge such as terminology dictionaries and syntactic information and integrate domain features into neural machine translation models at the model level, incorporating semantic roles as prior knowledge into neural machine translation, using additional semantic role information in the source-side horizontal encoder and vertical encoder to improve traditional neural machine translation models, and solving problems such as semantic missing translation and discontinuous translation.In the next step, we will explore how to use multiple encoders in domain machine translation to model external prior knowledge such as terminology dictionaries and syntactic information and integrate domain features into neural machine translation models at the model level.



---

*Source: 7255853-2022-10-07.xml*