# Analysis of the Impact of the Traditional Literature Environment Based on Big Data Technology on Overseas Literature

Authors: Qing Ding
Journal: Journal of Environmental and Public Health
 (2022)

---

## Abstract

To study the influence of conventional literature on foreign literature driven by big data, this essay begins with surveys and interviews. Chinese big data-driven corpora are distinct from other Chinese corpora, as is widely known. Its main objective is to categorize professional corpora that are unknown and fall within the category of professional corpora. In order to provide a straightforward and useful domain partitioning model for corpus texts, this research makes use of text clustering and big data-driven methodologies. We can easily determine the domain of the aligned text, making it easier to do machine translation research in the future. The research findings demonstrate that the accuracy rate of the approach suggested in this article is essentially above 89.79%, demonstrating the viability of the way of automatically building a corpus suggested in this paper in the experiment.


---

## Body

## 1. Introduction

It has been more than two thousand years since Confucius founded Confucianism. In these long years, Confucianism has left a deep impression not only in China but also in Korea, Japan, and Southeast Asian countries. In the middle and late Ming Dynasty, “Neo Confucianism” gradually became rigid and declined, and “yangmingism” was highly praised as a new theory. “Yangmingism,” represented by Wang Yangming’s philosophical thought, inherits and develops Lu Jiuyuan’s psychological thought on the basis of criticizing “Neo Confucianism.” “Yangmingism” has not only been widely spread in China but also spread to Japan across the sea, forming a unique Japanese “Yangmingism.” Finally, “Yangmingism” broke through the suppression of “neo-Confucianism” of official learning, became the spiritual power to promote the Meiji Restoration in Japan, and opened the way for Japan’s modernization [1]. “Chuanxilu” is an ancient philosophical work in China, compiled by Wang Yangming’s disciples sorting out his quotations and letters. The book not only comprehensively expounds Wang Yangming’s thoughts but also reflects his dialectical teaching methods, as well as his language art which is good at using metaphors and often takes sarcasm. Under the background of globalization today, by absorbing foreign excellent ideology and culture, it not only provides a more comprehensive perspective and diverse methods in the process of cultivating socialist core values but also provides richer experience for the ideological and moral construction and the development of ideological and cultural undertakings in our country in the new era.The formation and development of Japanese “Yangmingism” concept of loyalty and filial piety were carried out by Japan’s absorption and reference of Chinese Confucianism. Japan’s “Yangmingism” is formed on the basis of creative inheritance and development of China’s “Yangmingism,” so Wang Yangming’s thought is also an important ideological source of Japan’s “Yangmingism” concept of loyalty and filial piety. After the Meiji Restoration, “Yangmingism” became one of the weapons that Japanese philosophers tried to correct western money worship and liberalism. It was not only widely used by Japanese philosophers in daily production activities such as education, commerce, and trade but also applied the idea of “Yangmingism” to post-war literature in the middle and late Ming Dynasty [2]. “Yangmingism” and “Chuanxilu” should have taken the same path, but the neo-Confucianism faction of the opposing camp beat the others and imported anti-Yangmingism publications into Japan. Although the “Yangmingism” in Japan and South Korea originated from China, they are not just a simple paraphrase and inheritance of Chinese “Yangmingism” [3]. All along, the cultural exchanges among the three East Asian countries have been multi-directional. Meritorious sect, as the mainstream of Japanese “Yangmingism,” is characterized by its courage to explore in practice and devote itself to the society, instead of making subtle comments in theory.In terms of its philosophical principles, Wang Yangming’s theory of mind is a very idealistic theoretical paradigm that emphasizes the spiritual experience of existence and the belief that there is nothing outside of the mind. Since its inception, Japan’s “Yangmingism” has always been in opposition, signifying the ability of Japanese society to demand reform and combat injustice. Although it does not go beyond Wang Yangming’s ideological purview in theory, its latter era behavior pattern of rejecting the established system and emphasizing action has had a big impact on Japan’s social revolution [4]. Confucian culture, which is an integral component of Chinese traditional culture, must be taken into consideration and promoted as part of the reform and opening-up process. The development and spread of ancient Confucian cultural values are greatly aided by “Yangmingism,” a significant component of neo-Confucianism of the Song and Ming dynasties.To gain a deeper understanding of Japanese people, Japanese culture, and Japanese history, and to encourage further communication and exchange between China and Japan in the ideological and cultural spheres, big data analysis, research on the influence of Confucianism in the Song and Ming Dynasties on foreign literature, and internal relationships and functions between “Yangmingism” and Japanese post-war literature are all important. The innovation of this paper is as follows: (1) By studying and sorting out the spread and development of “Yangmingism” in Japan, and grasping the influence of “Yangmingism” on national consciousness in different stages, it is believed that “Yangmingism” had a certain influence on the goal, content, and means of modern Japanese post-war literature, and some of its ideas were also used by modern militarists and became one of the sources of militarism. (2) Traditional corpus collection is manual or obtained from official documents, bilingual news websites, and other specific sources. For corpus texts, we use the strategies of text clustering and big data driving for reference and establish a simple and usable domain division model. For an aligned text, we can quickly judge its field, which provides convenience for the follow-up research of machine translation.


## 2. Related Work

### 2.1. Research on “Yangmingism” in Japan

By analyzing the thoughts of the representative figures of “Yangmingism,” this paper probes into the positive and reasonable factors contained in the Japanese “Yangmingism” thought, such as respecting heaven and loving others, despising authority, paying attention to performing meritorious deeds, being self-respecting and fearless, and teaching people to aspire [5]. Waks discussed the development of Japanese Confucianism under the freedom and civil rights movement in the early Meiji period, and concluded that modern Japanese thinkers tried to reinterpret the traditional Confucianism, and generally applied “Yangmingism” thought to political reform, education, and cultivation [6]. D’Ambrosio analyzed the role of Confucianism in Japan’s modernization process, criticized the remarks that Confucianism only hindered the development of modernization and gave birth to militarism, and demonstrated that Confucianism had certain positive role and significance in cultivating post-war literature, shaping the national modernization thought and establishing the political view of modernization [7].Defoort believes that compared with “neo-Confucianism,” Japanese temperament is suitable for straightforward Yangming’s mind [8]. Tsui believes that filial piety is the “original heart” that everyone has, and it is the fundamental reason why people are human. Filial piety is the principle of the creation of the universe [9].


### 2.2. Parallel Corpus Correlation Research

Sentence alignment is an important step in processing corpus, and it is also the only way to transform Internet texts into machine translation which can directly use corpus. The quality of bilingual aligned texts on the Internet is uneven. Some of them are translated by experts with good translation level, others are translated by ordinary netizens with certain translation level, and even some are pure machine translation. Therefore, redundant information and uneven text quality will seriously affect the effect of sentence alignment.Mohamed puts forward an attempt to mix various methods and calculate the length and word meaning at the same time, which can greatly improve the accuracy [10]. However, with more and more sentence features, the computational efficiency will decrease. Onyenwe et al. put forward a method of obtaining translation results by online translation. This method has some loss to the accuracy of evaluation, but it greatly improves the feasibility and speed of translation quality evaluation [11]. Burkhardt et al. put forward an error-driven method based on conversion to replace the manual formulation of language rules, so that the system can automatically obtain conversion rules from the training corpus [12]. Xue et al. use mathematical knowledge to obtain language information through statistics in the training corpus, which can calculate the probability that a word has a certain part of speech according to the context information of the word [13].Wang et al. constructed a large-scale bilingual corpus of emotional metaphors to meet the urgent need of emotional computing for language resources construction [14]. Ma designed a tagging framework based on the combination of weak supervised metaphor recognition program and crowdsourcing platform, and the obtained corpus is very reliable [15]; Othman et al.’ s theoretical research results obtained through statistical analysis are convincing, which is a detailed and in-depth theoretical research of Chinese word-formation based on semantics at present, and will effectively solve the problems of polysemy and recognition of unknown words in the field of Chinese information processing [16]. Laurinciukaite et al. analyzed the existing processing algorithms, adopted a method that can be well combined with statistical models, and implemented it. Through experiments, we compare the tagging accuracy of the system before and after adding the new word processing algorithm [17].


## 2.1. Research on “Yangmingism” in Japan

By analyzing the thoughts of the representative figures of “Yangmingism,” this paper probes into the positive and reasonable factors contained in the Japanese “Yangmingism” thought, such as respecting heaven and loving others, despising authority, paying attention to performing meritorious deeds, being self-respecting and fearless, and teaching people to aspire [5]. Waks discussed the development of Japanese Confucianism under the freedom and civil rights movement in the early Meiji period, and concluded that modern Japanese thinkers tried to reinterpret the traditional Confucianism, and generally applied “Yangmingism” thought to political reform, education, and cultivation [6]. D’Ambrosio analyzed the role of Confucianism in Japan’s modernization process, criticized the remarks that Confucianism only hindered the development of modernization and gave birth to militarism, and demonstrated that Confucianism had certain positive role and significance in cultivating post-war literature, shaping the national modernization thought and establishing the political view of modernization [7].Defoort believes that compared with “neo-Confucianism,” Japanese temperament is suitable for straightforward Yangming’s mind [8]. Tsui believes that filial piety is the “original heart” that everyone has, and it is the fundamental reason why people are human. Filial piety is the principle of the creation of the universe [9].


## 2.2. Parallel Corpus Correlation Research

Sentence alignment is an important step in processing corpus, and it is also the only way to transform Internet texts into machine translation which can directly use corpus. The quality of bilingual aligned texts on the Internet is uneven. Some of them are translated by experts with good translation level, others are translated by ordinary netizens with certain translation level, and even some are pure machine translation. Therefore, redundant information and uneven text quality will seriously affect the effect of sentence alignment.Mohamed puts forward an attempt to mix various methods and calculate the length and word meaning at the same time, which can greatly improve the accuracy [10]. However, with more and more sentence features, the computational efficiency will decrease. Onyenwe et al. put forward a method of obtaining translation results by online translation. This method has some loss to the accuracy of evaluation, but it greatly improves the feasibility and speed of translation quality evaluation [11]. Burkhardt et al. put forward an error-driven method based on conversion to replace the manual formulation of language rules, so that the system can automatically obtain conversion rules from the training corpus [12]. Xue et al. use mathematical knowledge to obtain language information through statistics in the training corpus, which can calculate the probability that a word has a certain part of speech according to the context information of the word [13].Wang et al. constructed a large-scale bilingual corpus of emotional metaphors to meet the urgent need of emotional computing for language resources construction [14]. Ma designed a tagging framework based on the combination of weak supervised metaphor recognition program and crowdsourcing platform, and the obtained corpus is very reliable [15]; Othman et al.’ s theoretical research results obtained through statistical analysis are convincing, which is a detailed and in-depth theoretical research of Chinese word-formation based on semantics at present, and will effectively solve the problems of polysemy and recognition of unknown words in the field of Chinese information processing [16]. Laurinciukaite et al. analyzed the existing processing algorithms, adopted a method that can be well combined with statistical models, and implemented it. Through experiments, we compare the tagging accuracy of the system before and after adding the new word processing algorithm [17].


## 3. Methodology

### 3.1. The Spread and Influence of “Yangmingism” in Japan

The evolution of “Yangmingism” thought had already taken place in Wang Yangming’s later years. The theoretical forms adopted by “Yangmingism” are often not strict, which cannot prevent the latecomers from expanding these forms and accommodating the contents that Yangming himself does not advocate. As far as the social ideological trend in the middle and late Ming Dynasty is concerned, the social ideological movement in a certain historical period, which is comprehensively determined by social, economic, political, and cultural factors, must be developed with the help of the existing ideological system and materials, and the existing ideological materials cannot determine the development direction of this ideological trend.Chinese “Yangmingism” not only embodies the concern of human nature but also contains traditional Confucianism. After Toju Nakae, Japanese “Yangmingism” is divided into two factions: one is the German Sect, which pays attention to spiritual cultivation and has a strong introspective character, and the other is the Meritorious sect, which takes the transformation of the world as its responsibility and pays attention to practice and action. When “Yangmingism” was spread to the east, it was the centralized rule period of Tokugawa clan system in Japan, and Confucianism was in the official position at that time. However, Tokugawa clan did not really recognize Confucianism politically, but only for political purposes. No matter who you are, you should respect your destiny, cultivate your vocation, and work hard, which is tantamount to denying the hierarchical social hierarchy. It also inspires people to do their duty and fulfill their destiny. The greatest contribution to the cultivation of Japan’s moral values is that of “sincerity, diligence, graduation, and concession” as a job ethics and “moral economic monism” as an economic ethics.Before the Meiji Restoration, Japan was deeply influenced by China’s “physiocracy” thinking. Even though businessmen had a lot of wealth, their social status could not be compared with that of samurai. Japan’s bushido spirit is the foundation of being a man, but if there is no business talent, that is, specific execution ability, it will also lead to self-destruction economically. On the issue of the concept of justice and benefit, Seze thinks that the two are not inherently contradictory as the traditional concept thinks. Japanese “Yangmingism” puts “heart” in the supreme position, and its essence is a kind of respect and care for people’s self-worth. This is sublimated into a “people-oriented” business philosophy in Japanese management philosophy. The “Yangmingism” emphasizes that learning by things is a process of self-cultivation, and the integration of knowledge and practice, kung fu and ontology are the same. To achieve this goal, we must go through a hard process.Toju Nakae’s subjective idealism philosophy system, the so-called “total filial piety method,” is based on Wang Yangming’s philosophy system, but its logical structure has its own characteristics. The most important representative of “Yangmingism” in the first half of the Tokugawa shogunate period is Kumazawa-san. Starting from the absoluteness of “heart,” this paper leads to the affirmation of people’s value and holds that there are people in heaven and earth, such as people with heart, who are full of praise for people’s spirituality and confidence in their creativity. The existence of human desire hinders the integration of “conscience,” and only by removing desire can we get “emptiness.” However, he believes that he cannot stick to his own heart purely and should try his best to show the truth of his heart and put it into practice. This is the so-called “unity of knowing and doing.”With the development of Japan’s social economy, people’s high sense of dependence on society has led to the prevalence of “profit-only theory,” “money worship,” and “liberalism” in society, and the embodiment of personal value in social work has become smaller and weaker, while “to conscience” provides a new way for confused people to examine their position and value in society. To conscience prompted the Japanese to return to their original heart. Under the background of strengthening national strength and neglecting traditional Japanese ideology and culture, this paper studies Wang Yangming’s theory of “to conscience” and re-examines the value of Confucian culture in society. Wang Yangming believes that to treat conscience, first, to keep one’s inherent heart in society, free from outside interference and influence; second, through their own practice of “conscience,” they can form a correct value evaluation standard, so that the subject can gradually realize the “conscience.” The harmonious unity of “conscience” between individuals and society not only makes people have a deeper understanding of the reform measures of Meiji Restoration and traditional Japanese ideology and culture. Modern Japanese “Yangmingism” scholars analyzed Wang Yangming’s thoughts from many aspects, combined with Japan’s reality, learned from Japan’s practical experience in the backstabbing movement, integrated “Yangmingism” thoughts into the post-war literature, and improved the chaotic situation of social thoughts at that time from three aspects: society, state, and individual.Toju Nakae, as a “Yangmingism,” has made his own unique contribution to the transformation of Bushido. On the basis of criticizing and reflecting on the traditional Bushido, he put forward a new samurai Taoist concept that takes into account “all filial piety” and “loyalty and courage,” which has profound significance for the formation and later development of Bushido in Edo period. Undeniably, even today, Bushido still has an extraordinary significance and influence on the whole country of Japan, and it has become the most important part of its national spirit and national character. Since modern times, many of these ideas have been promoted and publicized by the Japanese government, prompting people to combine the filial piety advocated by the whole people with the content of “loyalty and filial piety as a whole,” thus serving the post-war literature view centered on the emperor in modern Japan. Linking people’s behavior with the national and imperial movements, educating people to become patriotic and loyal subjects and outstanding citizens who have dedicated themselves to the country, and turning the reverence for the emperor into an obligation that subjects must fulfill.As a kind of spiritual undercurrent of Japanese society, Japanese “Yangmingism” showed a strong rebellious spirit. On the one hand, it was because the shogunate at that time was on the verge of collapse, and “Yangmingism” could easily be used by the rebellious class. Japan’s “Yangmingism” is based on China’s “Yangmingism” and developed with its own characteristics. There are both connections and differences between them. From the academic system, Japanese “Yangmingism” is closer to the left, and some people even think that Japanese “Yangmingism” is a branch of the left. The Japanese shogunate “Yangmingism” did not reject western science and culture; on the contrary, they adopted a positive attitude of absorbing foreign studies as foreigners. They used “Yangmingism” as a weapon to emancipate their minds, breaking the bad habit of “neo-conformism” sticking neo-Confucianism and opening the door for Japan to absorb western science and culture. Ito hirobumi and Saigo Takamori, the founding fathers of Meiji, who were deeply influenced by “Yangmingism,” directly advocated civil rights, democracy, and the abolition of vassal counties, which laid the foundation for the realization of capitalism in Japan.


### 3.2. Domain Partition of Corpus Based on Big Data

Of course, the beginning of “Yangmingism” communication did not begin today. Since the inter-ethnic communication, the communication and influence of literature have also appeared. As a branch of ancient human civilization, Chinese culture and literature also have a profound influence on the world. Therefore, we should get enlightenment from this and know how “Yangmingism” should establish itself in today’s world pattern, which is the cultural destiny of a nation and the basic paradigm of the relationship between universal culture and civilization. In a sense, it can also be said that since the trendy literature dominated the artistic and ideological flow of Chinese Confucianism in Song and Ming Dynasties, Chinese Confucianism in Song and Ming Dynasties had the “basic qualification” to communicate with the world literature. Before that, our literature, whether it was “national” or “human,” was insufficient.In the past century, the overseas literature dissemination, influence, and research of “Yangmingism” have gone through a process from paying attention to the translation and introduction of “Chuanxilu” to the comparison of literary influence, from the comparison of literary concepts to the multi-dimensional and multi-level research of literary texts and literary history based on the Chinese context. Over the past decade, foreign research achievements of “Yangmingism” have attracted the attention of domestic academic circles, and a number of works representing the frontier of foreign research have been translated and published in China one after another. Originally, Japanese literature is more pure and aesthetic than “Yangmingism.” No matter Matsuo Bashō, a famous poet in Edo period, or Yasunari Kawabata, a modern new sensation writer, his works all reveal the feeling of a single subject and the faint beauty of sadness. As a Japanese, Ji Chuan is naturally influenced by the aesthetic orientation of the Japanese nation. A country’s ancient literature can be recognized and accepted by others in translation, introduction, and dissemination, and its inherent humanistic spirit can maintain lasting vitality in inheritance and dissemination and be transformed from national literary classics to world literary classics.To be able to be processed by the classifier, the text cannot be directly presented as characters, but must be transformed into a special representation. If a text is to be recognized by a classifier and classified according to different feature values, it needs a structured feature set. Chinese big data-driven corpus is different from other Chinese corpora, and its main purpose is to classify unknown corpora, which belongs to the category of professional corpora. Classified corpus is mainly used as the basis of natural language processing. The rapid development of modern Chinese, the emergence of various network terms, and the emergence of new academic terms all lead to the continuous updating of classified corpus. For example, by combining predicate-centered sentence pattern analysis with corpus statistics, Chinese sentence patterns are automatically analyzed, and a “Chinese sentence pattern frequency table” is proposed to automatically mark the boundaries between sentence elements and sentence patterns in Chinese texts, and search for sentence examples in the corpus according to the specified sentence patterns, and so on.A language model is a model produced by using mathematical methods to describe the laws of natural language phenomena. The purpose is to establish a distribution that can describe the probability of the occurrence of a given word sequence in a language. It makes full and effective use of the statistical information of the corpus and only uses the non-zero in the co-occurrence matrix for training, while Skip-gram does not make effective use of some statistical information in the corpus. Finish the downstream tasks quickly through fine-tuning methods. Therefore, there are few parameters to start learning again, which speeds up the learning speed. Metaphor is not a language problem, but a thinking problem. Metaphor is a way of thinking and cognitive means. At the same time, after fully studying the psychological and cognitive significance of metaphor, this paper puts forward a cognitive model of metaphor, as shown in Figure1:Figure 1
Metaphorical cognitive model.Domain is equivalent to “metaphor,” which refers to the scope of mapping, which is generally the common feature of two conceptual attributes. As a cognitive metaphor, besides “similarity” or “contrast,” it also has a more complicated internal relationship, which is “mapping.” “Mapping” is understood as a transfer here, which means that metaphor transfers the structure of the source concept to the target concept [18, 19]. The purpose of tagging is achieved by constructing the mapping relationship between the source domain and the target domain, and the tagged words only focus on verbs. Then, a weak supervised metaphor recognition system is used to tag the data to get weak metaphor data, which is filtered to get normative data, and manually tagged and verified on crowdsourcing platform.The common method to calculate the feature weightw is TFIDF, where TFi,d is the number of times that the word i appears in d, and IDFi divides the total number of all texts N by the number of texts containing the word i and makes decimal logarithm. The formula of TFIDF is:
(1)TFIDFi=TFi,d×logNIDFi.Given the training corpus, the word sequence and the corresponding part-of-speech marker sequence are all definite, so the word sequence can be regarded as the observation sequence in HMM (Hidden Markov model) [20], and the part-of-speech sequence as the hidden state sequence in the model. Therefore, the available model parameter A,B,Π is:
(2)aij=cij∑k=1Ncik1≤i,j≤N.cij is the sum of the times from state si to state sj in all training corpora.∑k=1Ncik is the total number of transitions from state si to all other possible states in all training corpora.Entropy is a term used in information theory to indicate how uncertain occurrences are. Information entropy measures the overall information source’s average level of uncertainty and indicates the statistical properties of the entire information source. Let the random variableξ contain A1,A2,⋯,An with n possible states, and the probability of each state is p1,p2,⋯,pn, then the degree of uncertainty, that is, the information entropy, is:
(3)Hξ=−∑i=1npilogpi.Under the action of no external force, things always develop in the most chaotic direction, and the increase of entropy means that disorder is strengthened. Therefore, under known constraints, the thing with the highest entropy is most likely to approach its true state.Therefore, the probability that we can get an observation data is:(4)pyi=piyi1−pi1−yi.Because we assume that the observations are independent of each other, we can use the product of the marginal distributions to represent the joint distribution of the observations:(5)Lθ=∏piyi1−pi1−yi.The likelihood function is the likelihood function ofn observations. Generally, it is the parameter value estimated by the maximum likelihood estimation method by making the natural logarithmic transformation formula of likelihood number, that is, the value of parameter β1,β2,⋯,βk when lnLθ takes the maximum value.Rule-based algorithm is a traditional method, which mainly depends on the grammatical structure of a sentence, decomposes the sentence structure through a grammatical tree, then designs metaphor recognition features, and calculates similarity reasoning according to the features to determine whether verbs in a sentence have metaphorical expressions.For metaphor recognition in this study, certain conventional methods will be combined with word vectors and similarity calculation techniques. This approach is far more straightforward than the conventional regular approaches, requires less manpower, and just requires the early marking of some data sets for testing and verification. The rule-based algorithm framework created in this paper is represented by the flow chart of the algorithm illustrated in Figure2.Figure 2
Flow chart of algorithm framework.Regularize the text data, preliminarily clean up the original text, and clean up irrelevant characters (non-Chinese characters); according to the collected latest thesaurus and Chinese Wikipedia data, construct verb lexicon; reasoning metaphorical similarity to determine whether a sentence is a metaphorical sentence; manual annotation by crowdsourcing platform; it is mainly constructed from the latest synonym forest and Chinese Wikipedia, which can guarantee to cover most common verbs; auxiliary feature extraction is to construct a feature set to help metaphor recognition according to the characteristics of verb metaphors, so as to ensure that some weak metaphors can also be recognized.In the second stage, theAttention value can be obtained by weighted summation mainly according to the scores generated in the first stage, as shown in the following formula (6):
(6)AttentionQ,a=∑i=1nai⋅vi.Qrepresents the weight matrix generated by different fully connected layers in the attention mechanism.The distribution of low-order models is constructed by its maximum likelihood distribution, and only when a phenomenon in high-order models rarely or not appears, the low-order models have greater significance in mixed models. Therefore, the best effect of low-order model can only be obtained under such conditions.The probabilitypwi of a word wi should be proportional to the number of its different forward adjacent words, rather than the frequency cwi of its occurrence, that is:
(7)pkn=wi=N1+⋅wiN1+⋅⋅.The formula “.“is a symbol of location, which represents any word after the word string wi−n+1i−1 in the training corpus.We need to know the total numberN of texts, the number n1 of texts containing words iand belonging to class C, the number n2 of texts containing words i and not belonging to class C, and the number n3 of texts not containing words i and belonging to class C, so that the mutual information between words i and class C is:
(8)MIi,C=logn1×Nn1+n3×n1+n2.In the case of probabilityp, the expected value of the feature should be equal to the empirical value of the feature obtained from the sample data. That is:
(9)∑xpxfix=∑xpx^fix.Among them, forpa1Cj,pa2Cj,⋯,panCj⋯j=1,2,⋯,m, it can be obtained by statistical calculation from one training sample, and the training sample data is a discrete value. Use the formula:
(10)pakCi=siksi.In the formula,sik is the number of samples with characteristic attribute value of ak and class Ci, where Si is the total number of samples with class Ci.


## 3.1. The Spread and Influence of “Yangmingism” in Japan

The evolution of “Yangmingism” thought had already taken place in Wang Yangming’s later years. The theoretical forms adopted by “Yangmingism” are often not strict, which cannot prevent the latecomers from expanding these forms and accommodating the contents that Yangming himself does not advocate. As far as the social ideological trend in the middle and late Ming Dynasty is concerned, the social ideological movement in a certain historical period, which is comprehensively determined by social, economic, political, and cultural factors, must be developed with the help of the existing ideological system and materials, and the existing ideological materials cannot determine the development direction of this ideological trend.Chinese “Yangmingism” not only embodies the concern of human nature but also contains traditional Confucianism. After Toju Nakae, Japanese “Yangmingism” is divided into two factions: one is the German Sect, which pays attention to spiritual cultivation and has a strong introspective character, and the other is the Meritorious sect, which takes the transformation of the world as its responsibility and pays attention to practice and action. When “Yangmingism” was spread to the east, it was the centralized rule period of Tokugawa clan system in Japan, and Confucianism was in the official position at that time. However, Tokugawa clan did not really recognize Confucianism politically, but only for political purposes. No matter who you are, you should respect your destiny, cultivate your vocation, and work hard, which is tantamount to denying the hierarchical social hierarchy. It also inspires people to do their duty and fulfill their destiny. The greatest contribution to the cultivation of Japan’s moral values is that of “sincerity, diligence, graduation, and concession” as a job ethics and “moral economic monism” as an economic ethics.Before the Meiji Restoration, Japan was deeply influenced by China’s “physiocracy” thinking. Even though businessmen had a lot of wealth, their social status could not be compared with that of samurai. Japan’s bushido spirit is the foundation of being a man, but if there is no business talent, that is, specific execution ability, it will also lead to self-destruction economically. On the issue of the concept of justice and benefit, Seze thinks that the two are not inherently contradictory as the traditional concept thinks. Japanese “Yangmingism” puts “heart” in the supreme position, and its essence is a kind of respect and care for people’s self-worth. This is sublimated into a “people-oriented” business philosophy in Japanese management philosophy. The “Yangmingism” emphasizes that learning by things is a process of self-cultivation, and the integration of knowledge and practice, kung fu and ontology are the same. To achieve this goal, we must go through a hard process.Toju Nakae’s subjective idealism philosophy system, the so-called “total filial piety method,” is based on Wang Yangming’s philosophy system, but its logical structure has its own characteristics. The most important representative of “Yangmingism” in the first half of the Tokugawa shogunate period is Kumazawa-san. Starting from the absoluteness of “heart,” this paper leads to the affirmation of people’s value and holds that there are people in heaven and earth, such as people with heart, who are full of praise for people’s spirituality and confidence in their creativity. The existence of human desire hinders the integration of “conscience,” and only by removing desire can we get “emptiness.” However, he believes that he cannot stick to his own heart purely and should try his best to show the truth of his heart and put it into practice. This is the so-called “unity of knowing and doing.”With the development of Japan’s social economy, people’s high sense of dependence on society has led to the prevalence of “profit-only theory,” “money worship,” and “liberalism” in society, and the embodiment of personal value in social work has become smaller and weaker, while “to conscience” provides a new way for confused people to examine their position and value in society. To conscience prompted the Japanese to return to their original heart. Under the background of strengthening national strength and neglecting traditional Japanese ideology and culture, this paper studies Wang Yangming’s theory of “to conscience” and re-examines the value of Confucian culture in society. Wang Yangming believes that to treat conscience, first, to keep one’s inherent heart in society, free from outside interference and influence; second, through their own practice of “conscience,” they can form a correct value evaluation standard, so that the subject can gradually realize the “conscience.” The harmonious unity of “conscience” between individuals and society not only makes people have a deeper understanding of the reform measures of Meiji Restoration and traditional Japanese ideology and culture. Modern Japanese “Yangmingism” scholars analyzed Wang Yangming’s thoughts from many aspects, combined with Japan’s reality, learned from Japan’s practical experience in the backstabbing movement, integrated “Yangmingism” thoughts into the post-war literature, and improved the chaotic situation of social thoughts at that time from three aspects: society, state, and individual.Toju Nakae, as a “Yangmingism,” has made his own unique contribution to the transformation of Bushido. On the basis of criticizing and reflecting on the traditional Bushido, he put forward a new samurai Taoist concept that takes into account “all filial piety” and “loyalty and courage,” which has profound significance for the formation and later development of Bushido in Edo period. Undeniably, even today, Bushido still has an extraordinary significance and influence on the whole country of Japan, and it has become the most important part of its national spirit and national character. Since modern times, many of these ideas have been promoted and publicized by the Japanese government, prompting people to combine the filial piety advocated by the whole people with the content of “loyalty and filial piety as a whole,” thus serving the post-war literature view centered on the emperor in modern Japan. Linking people’s behavior with the national and imperial movements, educating people to become patriotic and loyal subjects and outstanding citizens who have dedicated themselves to the country, and turning the reverence for the emperor into an obligation that subjects must fulfill.As a kind of spiritual undercurrent of Japanese society, Japanese “Yangmingism” showed a strong rebellious spirit. On the one hand, it was because the shogunate at that time was on the verge of collapse, and “Yangmingism” could easily be used by the rebellious class. Japan’s “Yangmingism” is based on China’s “Yangmingism” and developed with its own characteristics. There are both connections and differences between them. From the academic system, Japanese “Yangmingism” is closer to the left, and some people even think that Japanese “Yangmingism” is a branch of the left. The Japanese shogunate “Yangmingism” did not reject western science and culture; on the contrary, they adopted a positive attitude of absorbing foreign studies as foreigners. They used “Yangmingism” as a weapon to emancipate their minds, breaking the bad habit of “neo-conformism” sticking neo-Confucianism and opening the door for Japan to absorb western science and culture. Ito hirobumi and Saigo Takamori, the founding fathers of Meiji, who were deeply influenced by “Yangmingism,” directly advocated civil rights, democracy, and the abolition of vassal counties, which laid the foundation for the realization of capitalism in Japan.


## 3.2. Domain Partition of Corpus Based on Big Data

Of course, the beginning of “Yangmingism” communication did not begin today. Since the inter-ethnic communication, the communication and influence of literature have also appeared. As a branch of ancient human civilization, Chinese culture and literature also have a profound influence on the world. Therefore, we should get enlightenment from this and know how “Yangmingism” should establish itself in today’s world pattern, which is the cultural destiny of a nation and the basic paradigm of the relationship between universal culture and civilization. In a sense, it can also be said that since the trendy literature dominated the artistic and ideological flow of Chinese Confucianism in Song and Ming Dynasties, Chinese Confucianism in Song and Ming Dynasties had the “basic qualification” to communicate with the world literature. Before that, our literature, whether it was “national” or “human,” was insufficient.In the past century, the overseas literature dissemination, influence, and research of “Yangmingism” have gone through a process from paying attention to the translation and introduction of “Chuanxilu” to the comparison of literary influence, from the comparison of literary concepts to the multi-dimensional and multi-level research of literary texts and literary history based on the Chinese context. Over the past decade, foreign research achievements of “Yangmingism” have attracted the attention of domestic academic circles, and a number of works representing the frontier of foreign research have been translated and published in China one after another. Originally, Japanese literature is more pure and aesthetic than “Yangmingism.” No matter Matsuo Bashō, a famous poet in Edo period, or Yasunari Kawabata, a modern new sensation writer, his works all reveal the feeling of a single subject and the faint beauty of sadness. As a Japanese, Ji Chuan is naturally influenced by the aesthetic orientation of the Japanese nation. A country’s ancient literature can be recognized and accepted by others in translation, introduction, and dissemination, and its inherent humanistic spirit can maintain lasting vitality in inheritance and dissemination and be transformed from national literary classics to world literary classics.To be able to be processed by the classifier, the text cannot be directly presented as characters, but must be transformed into a special representation. If a text is to be recognized by a classifier and classified according to different feature values, it needs a structured feature set. Chinese big data-driven corpus is different from other Chinese corpora, and its main purpose is to classify unknown corpora, which belongs to the category of professional corpora. Classified corpus is mainly used as the basis of natural language processing. The rapid development of modern Chinese, the emergence of various network terms, and the emergence of new academic terms all lead to the continuous updating of classified corpus. For example, by combining predicate-centered sentence pattern analysis with corpus statistics, Chinese sentence patterns are automatically analyzed, and a “Chinese sentence pattern frequency table” is proposed to automatically mark the boundaries between sentence elements and sentence patterns in Chinese texts, and search for sentence examples in the corpus according to the specified sentence patterns, and so on.A language model is a model produced by using mathematical methods to describe the laws of natural language phenomena. The purpose is to establish a distribution that can describe the probability of the occurrence of a given word sequence in a language. It makes full and effective use of the statistical information of the corpus and only uses the non-zero in the co-occurrence matrix for training, while Skip-gram does not make effective use of some statistical information in the corpus. Finish the downstream tasks quickly through fine-tuning methods. Therefore, there are few parameters to start learning again, which speeds up the learning speed. Metaphor is not a language problem, but a thinking problem. Metaphor is a way of thinking and cognitive means. At the same time, after fully studying the psychological and cognitive significance of metaphor, this paper puts forward a cognitive model of metaphor, as shown in Figure1:Figure 1
Metaphorical cognitive model.Domain is equivalent to “metaphor,” which refers to the scope of mapping, which is generally the common feature of two conceptual attributes. As a cognitive metaphor, besides “similarity” or “contrast,” it also has a more complicated internal relationship, which is “mapping.” “Mapping” is understood as a transfer here, which means that metaphor transfers the structure of the source concept to the target concept [18, 19]. The purpose of tagging is achieved by constructing the mapping relationship between the source domain and the target domain, and the tagged words only focus on verbs. Then, a weak supervised metaphor recognition system is used to tag the data to get weak metaphor data, which is filtered to get normative data, and manually tagged and verified on crowdsourcing platform.The common method to calculate the feature weightw is TFIDF, where TFi,d is the number of times that the word i appears in d, and IDFi divides the total number of all texts N by the number of texts containing the word i and makes decimal logarithm. The formula of TFIDF is:
(1)TFIDFi=TFi,d×logNIDFi.Given the training corpus, the word sequence and the corresponding part-of-speech marker sequence are all definite, so the word sequence can be regarded as the observation sequence in HMM (Hidden Markov model) [20], and the part-of-speech sequence as the hidden state sequence in the model. Therefore, the available model parameter A,B,Π is:
(2)aij=cij∑k=1Ncik1≤i,j≤N.cij is the sum of the times from state si to state sj in all training corpora.∑k=1Ncik is the total number of transitions from state si to all other possible states in all training corpora.Entropy is a term used in information theory to indicate how uncertain occurrences are. Information entropy measures the overall information source’s average level of uncertainty and indicates the statistical properties of the entire information source. Let the random variableξ contain A1,A2,⋯,An with n possible states, and the probability of each state is p1,p2,⋯,pn, then the degree of uncertainty, that is, the information entropy, is:
(3)Hξ=−∑i=1npilogpi.Under the action of no external force, things always develop in the most chaotic direction, and the increase of entropy means that disorder is strengthened. Therefore, under known constraints, the thing with the highest entropy is most likely to approach its true state.Therefore, the probability that we can get an observation data is:(4)pyi=piyi1−pi1−yi.Because we assume that the observations are independent of each other, we can use the product of the marginal distributions to represent the joint distribution of the observations:(5)Lθ=∏piyi1−pi1−yi.The likelihood function is the likelihood function ofn observations. Generally, it is the parameter value estimated by the maximum likelihood estimation method by making the natural logarithmic transformation formula of likelihood number, that is, the value of parameter β1,β2,⋯,βk when lnLθ takes the maximum value.Rule-based algorithm is a traditional method, which mainly depends on the grammatical structure of a sentence, decomposes the sentence structure through a grammatical tree, then designs metaphor recognition features, and calculates similarity reasoning according to the features to determine whether verbs in a sentence have metaphorical expressions.For metaphor recognition in this study, certain conventional methods will be combined with word vectors and similarity calculation techniques. This approach is far more straightforward than the conventional regular approaches, requires less manpower, and just requires the early marking of some data sets for testing and verification. The rule-based algorithm framework created in this paper is represented by the flow chart of the algorithm illustrated in Figure2.Figure 2
Flow chart of algorithm framework.Regularize the text data, preliminarily clean up the original text, and clean up irrelevant characters (non-Chinese characters); according to the collected latest thesaurus and Chinese Wikipedia data, construct verb lexicon; reasoning metaphorical similarity to determine whether a sentence is a metaphorical sentence; manual annotation by crowdsourcing platform; it is mainly constructed from the latest synonym forest and Chinese Wikipedia, which can guarantee to cover most common verbs; auxiliary feature extraction is to construct a feature set to help metaphor recognition according to the characteristics of verb metaphors, so as to ensure that some weak metaphors can also be recognized.In the second stage, theAttention value can be obtained by weighted summation mainly according to the scores generated in the first stage, as shown in the following formula (6):
(6)AttentionQ,a=∑i=1nai⋅vi.Qrepresents the weight matrix generated by different fully connected layers in the attention mechanism.The distribution of low-order models is constructed by its maximum likelihood distribution, and only when a phenomenon in high-order models rarely or not appears, the low-order models have greater significance in mixed models. Therefore, the best effect of low-order model can only be obtained under such conditions.The probabilitypwi of a word wi should be proportional to the number of its different forward adjacent words, rather than the frequency cwi of its occurrence, that is:
(7)pkn=wi=N1+⋅wiN1+⋅⋅.The formula “.“is a symbol of location, which represents any word after the word string wi−n+1i−1 in the training corpus.We need to know the total numberN of texts, the number n1 of texts containing words iand belonging to class C, the number n2 of texts containing words i and not belonging to class C, and the number n3 of texts not containing words i and belonging to class C, so that the mutual information between words i and class C is:
(8)MIi,C=logn1×Nn1+n3×n1+n2.In the case of probabilityp, the expected value of the feature should be equal to the empirical value of the feature obtained from the sample data. That is:
(9)∑xpxfix=∑xpx^fix.Among them, forpa1Cj,pa2Cj,⋯,panCj⋯j=1,2,⋯,m, it can be obtained by statistical calculation from one training sample, and the training sample data is a discrete value. Use the formula:
(10)pakCi=siksi.In the formula,sik is the number of samples with characteristic attribute value of ak and class Ci, where Si is the total number of samples with class Ci.


## 4. Experiment and Results

To realize the task of part-of-speech tagging, we must first select an appropriate part-of-speech tagging set. It is an indispensable part of the part-of-speech tagging system, and it is a collection of reasonable classification of words. The maximum entropy algorithm model is used to train and test the materials, and the labeling results show that the labeling of part-class words is more prone to errors than ordinary words. Therefore, if the accuracy of labeling of part-class words can be improved, it will play a great role in improving the overall labeling effect of the system. When big data is driven, verbs and nouns are the main topics related, and these two words play a far greater role in documents than other words. Therefore, in this experiment, we also follow this principle, keeping only nouns and verbs while segmenting Chinese words. These words often reflect the characteristics and functions of categories in more detail than category names, and in this case, they can better represent category names as the characteristics of categories. Words that meet these characteristics can be called category characteristic words.Get the original web pages by their class names. Among them, odd-numbered corpus is used as the test corpus, and even-numbered corpus is used as the actual corpus. Then, through unified coding conversion, standardization, webpage text extraction, Chinese word segmentation, core word acquisition algorithm, and sorting algorithm. In the process of verification, three classifiers and two test corpora are used to evaluate the corpus, and the accuracy and recall are shown in Tables1 and 2. The accurate visualization results obtained from the corpus test are shown in Figures 3 and 4., respectively.Table 1
Results obtained from the first test corpus.
Category nameRef [10]Ref [12]OurAccurate/%Recall/%Accurate/%Recall/%Accurate/%Recall/%1. Parallel computing77.62478.32382.02884.27991.54293.9992. Data mining78.01978.61682.10882.01889.7994.5263. Artificial intelligence80.23175.62179.7982.19492.10792.9044. Computer network78.00777.46182.91781.11391.69193.3435. Data structure78.68875.86482.05181.31989.51894.0026. Cultural dissemination81.14778.36181.91381.18492.19792.2857. Big data drive80.09879.07479.93883.26292.16194.63Table 2
Results from the second test corpus.
Category nameRef [10]Ref [12]OurAccurate/%Recall/%Accurate/%Recall/%Accurate/%Recall/%1. Parallel computing77.34379.91781.62884.21692.0291.9182. Data mining79.2579.75979.13283.34591.63592.6283. Artificial intelligence76.9479.01381.24382.22890.691.4054. Computer network77.90679.22279.19284.41491.96193.1385. Data structure77.17979.46482.03981.9794.16391.2556. Cultural dissemination78.79577.77582.13383.28793.76692.627. Big data drive79.01479.86779.1384.99693.44991.185Figure 3
Accurate visualization results of the first test corpus.Figure 4
Accurate visualization results of the first test corpus.It can be found that the accuracy rate is basically above 89.79%, which shows that the method of automatically building corpus proposed in this paper is feasible in the experiment. At the same time, it is also noted that computer network and computer composition principle have the worst effects, mainly because the search results of search engines are not ideal, which also shows that the quality of search engines has a great influence on this method.Spearman’s correlation makes a linear correlation analysis by using the rank of two variables, arranges the sample values of two features in order of size, and then synthesizes the order of these sample values to make statistics. The correlation coefficient obtained is Spearman’s correlation coefficient. Before the correlation test, we first drew the results of manual evaluation and online evaluation into scatterplots and observed linear models, as shown in Figures5 and 6.Figure 5
Manual evaluation’s detrended logistic P-P diagram.Figure 6
Online evaluation’s detrended logistic P-P diagram.As can be observed, the value ranges between -0.02 and 0.05. The ordinate position reflects the result value acquired by the online assessment method, and the value ranges between 0 and 1. A sentence bead is symbolized by each point in the diagram. You can observe that most phrase beads have a linear trend in which the ordinate grows with the abscissa and tends to be greater. The two types of semantic word-formation patterns in the test sample data set are predicted, and the semantic word-formation pattern of a word is determined based on the likelihood that the word would appear in that language’s word-formation pattern. This study uses the K-S (Kolmogorov-Smimov) test to determine the cumulative probability distribution curves of the two semantic word-formation patterns using either a logistic regression model or a naive Bayes model. The maximum absolute difference between the cumulative probability distributions of the two semantic word-formation patterns is then calculated to determine how well each model can distinguish the two semantic word-formation patterns. The calculation method and idea of K-S test on Matlab tools are the same as logistic regression model. The results of K-S inspection chart are shown in Figure7:Figure 7
K-S test of the naive Bayesian model.The statistical value of K-S test of naive Bayes model based on sample data set is about 0.7365. The Naive Bayes model has a good ability to distinguish the first and second semantic word-formation patterns, but it is not as strong as logistic regression model constructed under the same sample data set.


## 5. Conclusion

The overseas literature dissemination and research of “Yangmingism” will also lead to various misunderstandings among different cultures due to the differences in cultural contexts. The formation and development of Japanese “Yangmingism” concept of loyalty and filial piety were carried out by Japan’s absorption and reference of Chinese Confucianism. Japan’s “Yangmingism” is formed on the basis of creative inheritance and development of China’s “Yangmingism,” so Wang Yangming’s thought is also an important ideological source of Japan’s “Yangmingism” concept of loyalty and filial piety. As an inseparable part of Chinese traditional culture, Confucianism is also a part that must be paid attention to and developed in the process of reform and opening up, and “Yangmingism” is an important part of “neo-confounding of the song and Ming dynasties.” Driven by big data, language model is a model that uses mathematical methods to describe the laws of natural language phenomena. The purpose is to establish a distribution that can describe the probability of the occurrence of a given word sequence in a language. For metaphor recognition in this study, certain conventional techniques, word vectors, and similarity calculation techniques will be applied. This procedure is significantly easier than conventional regular methods. The research findings indicate that the method of automatically building corpus described in this paper has an accuracy rate that is fundamentally above 89.79%, demonstrating that the method is practicable in the experiment.



---

*Source: 2834363-2022-09-30.xml*