# Event Scene Method of Legal Domain Knowledge Map Based on Neural Network Hybrid Model

Authors: Lu Zhou
Journal: Applied Bionics and Biomechanics
 (2022)

---

## Abstract

Event extraction technology is one of the important researches in the field of information extraction, which helps people accurately retrieve, find, classify, and summarize effective information from a large amount of information streams. This paper uses the neural network hybrid model to identify the trigger words and event categories of the legal domain knowledge graph events, extracts the events of interest from a large amount of free text, and displays them in a structured format. First, the original text is preprocessed, and then, the distributed semantic word vector is combined with the dependent syntactic structure and location attributes to create a semantic representation in the form of a vector. The combined deep learning model is used to extract activated words, the long-term memory loop neural network uses temporal semantics to extract deep features, and the convergent neural network completes the extraction of activated words and event categories. Finally, the experimental results show that the accuracy of event extraction of the neural network hybrid model designed in this paper has reached 77.1%, and the recall rate has reached 76.8%, which is greatly improved compared with the traditional model.


---

## Body

## 1. Introduction

In recent years, artificial intelligence, as a field of computer development, has gradually matured into technology and media. Since Google introduced the concept of “knowledge graph” in 2012, the scope of knowledge graph has now covered dozens of vertical fields such as law, finance, military, education, medical care, and technology, and it is expanding rapidly with a clear development trend. Extracting facts from the knowledge map of the legal field is the research focus of extracting legal information. Due to the high data integration capabilities of the knowledge graph, the information extraction methods, reasoning mechanism, and knowledge visualization research in the knowledge graph are difficult and easy to study in various vertical operating environments. In the legal industry, the knowledge graph can be displayed in two formats: graph and spectrum. Through the clarification and reasoning of related entities, link prediction can be realized; infer the knowledge points possessed or understood by the entity, compare the weight of the knowledge points and the difficulty of the knowledge points, and infer the degree and importance, weight ratio, and feedback control status.The knowledge graph refers to a collection of entities, concepts, and relationships between entities. Knowledge graph can be applied to various natural language processing technologies, and fact extraction technology plays a very important role in the construction of knowledge graph. For example, the loss of connection event news text of Malaysia Airlines MH370 uses event export technology to automatically export members and roles related to events such as show time, victims, and location. The rise of the knowledge graph is accompanied by the related concepts of machine learning technology in the field of artificial intelligence. The key is to collect a large amount of structured or unstructured data, analyze and model the data based on domain knowledge, and find the law from it through machine calculation. Machines can recognize and learn patterns. Create calculation rules for related data after formation. Nowadays, many integrated event extraction mechanisms have achieved good results on the problem of knowledge graph event extraction in the legal field. However, compared with other areas, compliance and recall rates are generally low, and there are still major problems and room for improvement. The domain scalability and portability of event extraction systems are not ideal. Most of the current studies are based on MUC or ACE and only focus on a specific field or a few types of events. The application of the system is limited by the field, and it cannot be easily and quickly transplanted or extended with the change of the field.The wavelet and neural network hybrid model (WNN model) shows better performance than the ANN model. In addition, the WNN model has been developed to predict the wave height of a single location where past wave height data can be obtained. In response to these problems, Oh and Suh combined empirical orthogonal function analysis and wavelet analysis with neural networks to develop a hybrid model (referred to as EOFWNN model). Past wave height data of multiple locations and past and future weather data of the surrounding area including the wave station are used as input data. However, their accuracy decreases as the lead time increases because they do not consider the relationship between wave height and meteorological variables [1]. Lei et al. proposed a hierarchical framework combining convolutional neural network (CNN) and hidden Markov model (HMM). The CNN-HMM model is trained using the embedded Viterbi algorithm, and the data used to train the CNN is forced to align. Make an annotation. However, the time used by the model to extract features is not much different from that of a single model, but it requires more training time, which is of little significance [2]. The hybrid forecasting method can significantly improve the accuracy of wind power forecasting. Dong et al. developed a new integration strategy to process the data set and select the appropriate input set structure. The traditional local linear neurofuzzy model is optimized by searcher optimization algorithm. The research results prove that the hybrid model is better than the traditional method. However, the performance of the designed neural network hybrid model is not explained, and the actual performance of the model cannot be understood [3]. Cavalcanti et al. introduced the analysis of a hybrid, error-correction-based neural network model for predicting path loss in the suburbs of 800 MHz and 2600 MHz. The model combines empirical propagation models, ECC-33, Ericsson 9999, Okumura Hata, and 3GPP’s TR 36.942, with feedforward artificial neural network (ANN). The performance of the mixed model is compared with the conventional version of the empirical model and a simple neural network that uses input parameters commonly used in related work. The results were compared with data obtained from measurements conducted near the Federal University of Rio Grande do Norte (UFRN) in Natal, Brazil. Finally, the hybrid neural network obtained the lowest RMSE index. In addition to almost equalizing the distribution of simulation and experimental data, it also verified the effectiveness of the research. However, their research is too complicated, and the calculation is prone to errors, and it is difficult to be applied in reality [4]. Yazdani et al. proposed a fast and novel nonlinear filtering method called relative energy (Rel-En) to extract robust short-term events from biomedical signals. The short-term and long-term energy in the signal can be extracted, and a coefficient vector can be provided to multiply the signal to enhance the event of interest. The algorithm has been thoroughly evaluated on three benchmark data sets in different biomedical applications, namely, ECG QRS composite detection, EEG K composite detection, and imaging photoplethysmic pulse wave (iPPG) peak detection. Rel-En successfully identified the events in these settings. Compared with the prior art, QRS complex wave and K complex wave detection obtain better or comparable results. For iPPG peak detection, the proposed method is used as the preprocessing step of the fixed threshold algorithm, which significantly improves the overall result. Although the designed event extraction method is easy to define and calculate, the intelligent extraction of short-term events cannot be done for long-term events [5]. Traditional event extraction is achieved through two methods: pipeline and joint extraction method. The pipeline method uses trigger word recognition to determine events and further realizes event extraction, which is prone to error cascade. The joint extraction method applies deep learning to achieve the completion of the task of classification of trigger words and argument roles. The research of joint extraction method mostly adopts CNN or RNN network structure. However, in the case of event extraction, a deeper understanding of the complex context is required. Existing research does not make full use of syntactic relations. Yu et al. proposed a new event extraction model, which is based on the Tree-LSTM network and Bi-GRU network with syntactic-related information. This method uses both Tree-LSTM and Bi-GRU to obtain the representation of candidate event sentences and identify event types, which helps active learning to more accurately select training data with more information, and ultimately improves the experimental performance of time extraction. However, their research has limitations, limited to the use of paraphrase text discovery technology to identify different text carriers of the same type of event [6].The innovation of this work realizes the complete process from initial data set to activation word extraction, checking and replacing original samples, and creating rule descriptions at the proposal level. The body performs preliminary feature extraction to obtain a vector matrix that the model can train. Using the cyclic neural network model of long-term memory and short-term memory, the time characteristics of sentences are trained from the positive and negative aspects of the output. Finally, the convergent neural network model is used to train the previously derived deep features to complete the classification, that is, to extract the activation words and event categories. In addition, this research uses a mixture of various neural network algorithms to make the research proceed successfully.


## 2. Design of the Method for Extracting Events from the Knowledge Map of the Legal Domain Based on the Neural Network Hybrid Model

### 2.1. Knowledge Graph in the Legal Field

The knowledge graph is a complex semantic network with many entities, which graphically displays the entities, the related attributes contained in the entities, and the relationships between the entities [7, 8]. The role is to use the directional reasoning of the relationship between entities to improve the user’s retrieval quality, and it plays a significant role in data structure exchange, knowledge calculation, and knowledge reasoning [9, 10].The knowledge map in the legal field is quite different from the knowledge maps in other fields due to its unique nature [11, 12]. In the legal knowledge graph, there are many professional terms for related entities, the Chinese and English concepts are mixed, and the close correlation between knowledge points makes it necessary to define the ontology framework, optimize the entity and attribute extraction methods, and establish a new update supplement during the construction of the legal knowledge graph. The whole algorithm, although the scope of the knowledge graph is large, and the entity relationships are complex and diverse, but based on the scalability of knowledge, the knowledge graph needs to be continuously updated and maintained [13, 14].Modern information technology is promoting a major transformation of the judicial system. The “smart court building” focusing on artificial intelligence court applications, electronic litigation, and court big data is paralleled with judicial system reform. Artificial intelligence intelligently advances cases, predicts judgment results, and automatically generates judgments. This can be applied in the essay. The basic fact-based theories of court judgments are essentially compatible with the laws of artificial intelligence generation and can be used as the basis for deep neural network learning, word segmentation, and knowledge graph design, and front-end theories are added. The specific application path is the continuous implementation of hierarchical deconstruction based on essential facts, the deconstruction of the application of case knowledge at all levels of data, and the gradual implementation of the hierarchical implementation of legal experts. This provides machine learning to form a large-scale-labeled legal knowledge map.


### 2.2. Neural Network Hybrid Model

#### 2.2.1. Definition of Neural Network

Artificial neural network is a technical copy of biological neural network in a specific simplified sense. The corresponding learning algorithm simulates certain intelligent activities of the human brain and is technically copied to solve practical problems [15, 16]. Artificial neural network is composed of many basic neurons in processing equipment. The output of the neuron layer is always connected to the input of the N+1 layer of the neuron until the final output. The structure of artificial neural network is mainly composed of three elements: neurons, network topology, and network learning algorithm.Set the input data asa1,a2⋯ax, the connection weight is b1,b2⋯bx, and the calculation formula of the neuron is
(1)R=∑i=1saibi+cfa.R represents the current state of the neuron, a represents the output data, and c represents the bias.The functionf is called the activation function, which can transform the output into a specified interval. It is a widely used nonlinear function, also known as the sigmoid function, which is defined as
(2)fa=11+d−ca+aibi.The function is strictly monotonously increasing and continuously differentiable, with a value between 0 and 1.


#### 2.2.2. Neural Network Training

The input layer and the hidden layer are fully connected. The hidden layer hasm nodes, which are connected to the hidden layer at the previous moment. The weight matrix connecting the hidden layer uses random data to prepare the hidden layer [17, 18].The forward propagation process of the input signal, inputRn at the nth node of the hidden layer, then:
(3)Rn=Xij∑m=1itijsi+γi.Among them,Xij is the activation function of the hidden layer, and tij is the bias vector of the hidden unit.OutputEn at the nth node of the hidden layer:
(4)En=γRn=γXij∑m=1itijsi+γi.Among them is thesi activation function, and γi is the bias vector of the output layer.EnterRn at the mth node of the output layer:
(5)Rm=∑m=1itnjEn+cn=∑m=1itnjγ∑m=1itijsi+γi+cn.OutputKm at the mth node in the output layer:
(6)Km=ϕRn=ϕ∑m=1itnjEn+cn=ϕ∑m=1itnjγ∑n=1jtnjsi+γi+cn.First, calculate the difference between the output value and the expected value from the output level, which is also called input error [19, 20], calculate the error of each layer, and get the sum of the error weights, so that the output of the neural network is as close to the expected value as possible [21, 22].The quadratic error criterion functionEh for each sample h is
(7)Eh=12∑t=1mTs−Km2.The total error functionE of the system for H training samples is
(8)E=12∑T=1H∑H=1TTSP−KmP.According to the error step reduction method, the weight and offset compensation of each layer in the network are calculated in turn, and then, the weights and offsets of each neuron in the network are updated until the error is reduced to a certain extent or the maximum number of training times is reached.


### 2.3. Model Design

#### 2.3.1. Convolutional Neural Network

Convolutional neural network is a kind of feedforward neural network that includes convolutional computation and has deep structure and is one of the representative algorithms of deep learning. Convolutional neural network is a creative research result produced by referring to the structural principles of biological visual nervous system and improving artificial neural network. Compared with the multilayer feedforward neural network, the convolutional neural network has the advantages of fewer model parameters, simultaneous feature learning and classification, global optimization, and strong generalization ability. Now, it has become the current research hotspot in the field of computational neuroscience. The operation of the convolutional neural network can be regarded as the product operation of the convolution kernel and the input matrix. The convolution kernel moves on the input matrix to obtain the characteristic matrix sequence of the input vector. If multiple convolution kernels are selected, the input matrix can be obtained [23, 24].The convolutional neural network is used to select the important part of the feature information learned by the convolutional layer. Convolutional neural networks will have hundreds of millions of neuron connections, resulting in a huge amount of parameters. However, convolutional neural networks operate on local areas and share weights, which mean that the same weights will be applied to all inputs, which greatly reduce the parameters and increase the computing speed. The traditional feature engineering method is too much manual feature design. Convolutional neural networks rely less on the prior knowledge of the domain, and unlike traditional algorithms, they need to manually design complex features.


#### 2.3.2. Recurrent Neural Network

Different from the convolutional neural network, the cyclic neural network uses the sentence sequence as the input to model the serialization of the sentence [25]. Recurrent neural networks are memorized, parameter-sharing, and Turing-complete. When determining the event type of each word to be tested, not only the information of the current word to be tested but also the information of the words between the words to be tested will be used [26]. In this paper, after extracting the basic semantic features to generate the input vector, first use the recurrent neural network to further extract the time sequence features of the sentence, and then, use the obtained deep features as the input of the convolutional neural network.


#### 2.3.3. Neural Network Hybrid Model

The recurrent neural network here uses a long- and short-term memory (LSTM) structure. The system is composed of two opposite cycles paralleled by the network, and then, the outputs of the two networks are spliced to obtain the deep features of the final sentence. Such a loop mechanism makes it possible for each node to get all the semantic features from the first word of the sentence to the current word, but such features are not sufficient for the judgment of event trigger words and event elements. To obtain a complete context features, it is also necessary to know that the words after the current word have an impact on the semantics of the current word [27, 28]. In order to solve this problem, it is necessary to train a second recurrent neural network to obtain the semantic information after the current word. This recurrent neural network has the same structure as the first recurrent neural network, except that the reverse training starts from the last word of each sentence until the end of the first word of the sentence, and the hidden features can be obtained. Finally, there is a connection layer, which connects the hidden layers trained in the two networks to get the deep features that are really needed. The structure of the neural network hybrid model is shown in Figure 1.Figure 1
Neural network complex model structure diagram.The network topology is composed of many basic neurons in the processing unit. These neurons are connected in a specific way to form a network structure, which is called a neural network topology. It usually consists of an input layer, a hidden layer, and an output layer. At present, there are mainly the following two network topological structures: the first is the forward network. The connections between neurons in this structure are simply from in to out. The structural connection of the feedback network is more complicated, and it can receive input or send to it. Other neurons output, so there is feedback.After the above steps, the deep features of the sentence are obtained. Each sentence in the corpus corresponds to a deep feature, and each word still corresponds to a feature vector, and the vector corresponds to a word. In the phase of trigger word extraction, the problem of trigger word recognition is regarded as a multiclassification task. There are nine event categories, plus a total of ten categories of nonevents, so the classification result has ten labels. The candidate trigger word dictionary of the language has been obtained above. The trigger word extraction process is to traverse each candidate trigger word of each sentence and then judge whether the current candidate word is the trigger word of the sentence. The training is based on the sentence, and the deep featureH and the position j of the previous candidate word are used as the input vector of the model. After the convolution and pooling of the model, a pair of context features is extracted, and finally, the softmax classifier is used for multiple classifications. If the classification result is a nonpiece label, the current candidate word is not a trigger word. The training process of the convolutional neural network includes convolution, pooling, and classification. Pooling, also known as downsampling, is essentially a reduction of the data. How to extract features from an array of pixels is actually what the convolutional neural network does [29, 30].


### 2.4. Event Extraction

#### 2.4.1. Dependent Syntactic Structure Features

When using a machine learning model for event extraction-related issues, the event features are usually extracted first. These features will help the model understand the text to a certain extent, but they are limited to the part of the sentence and cannot make full use of the syntax of the text. Structure, lack of grasp of the overall structure was sentence. Dependent syntactic structure analysis is a key task in natural language processing. It can identify and analyze the subject, predicate, object, definite, adverbial, and complement structures in a sentence and find the dependency of each component in the sentence. A dependency relationship corresponds to two words, a keyword and a dependent word. Only one part of each sentence is independent, and other words depend on another component, and each component is dominant and interdependent. Make the semantic association of the sentence get rid of the interference of the actual word position, and it is easier to be extracted. Therefore, the dependency syntactic structure is of great significance for the model to understand the semantics of the text and grasp the overall structure of the sentence.On top of this, there is the combination of two modes, as well as the addition of various derivative methods such as statistical methods and machine learning methods. There are also a large number of excellent systems for different fields. Different systems have their own preferences due to different concerns. Therefore, different syntax analyzers will also affect the extraction performance to a certain extent.


#### 2.4.2. Word Vector

A word vector refers to assigning a word to a space vector, using the vector to represent the word, and performing subsequent model calculations. The spatial distance of the word vector (such as Euclidean distance and cosine distance) can be used to judge whether the semantics of two words are close. The smaller the spatial distance corresponding to the word vector, the closer the semantics of the two words are. For each word to be tested, first summarize the corresponding word vector from the word vector table, and enter the input layer. The convolutional layer can capture the meaning of the birth level and compress it into the feature map.


#### 2.4.3. Event Element Identification

Trigger word extraction determines the number of events in the sentence, as well as the trigger word and event category of each event, and the event element extraction is based on the known trigger word, and the participating elements of each event and its corresponding role are carried out. Identify and constitute a complete biomedical event. This chapter completes the extraction of event elements, regards the detection of event elements as a relationship extraction problem, sequentially determines the relationship between the trigger word and each entity in the sentence and the trigger word, and determines whether the current word is an event element according to the corresponding relationship category and the role corresponding to the event element.


#### 2.4.4. The Element Type Corresponding to the Event Type

In the element recognition stage, this article does not distinguish between event types. The candidate vocabulary of each sentence contains entities and trigger words at the same time. The candidate vocabulary is traversed, and the relationship with known trigger words is judged one by one. For simple events, there are only two types of subject relationship and no relationship, and the relationship pair can only be trigger word-entity; for complex events, there are subject relationship, target relationship, and no relationship, and the relationship pair may be trigger word-entity and words-trigger words. After identifying all the relationship pairs, according to the type and number of the relationship pairs of each trigger word, do not sort them into simple events, bound events, and complex events. Eventually, all types of events are merged to form a collection of events. In the process of element extraction, it is necessary to use the trigger word annotations obtained in the previous chapter and the layer features representing the original corpus and use the dynamic multipooling convolutional neural network model to extract the relationship pairs. The convolutional neural network model is the same as the structure used in the previous chapter, including the process of convolution, pooling, and classification, and the classification here is to determine the relationship between the trigger word that has been identified in the previous sentence and each word, and there are coexisting topics. There are three categories of relationship, target relationship, and irrelevance.


## 2.1. Knowledge Graph in the Legal Field

The knowledge graph is a complex semantic network with many entities, which graphically displays the entities, the related attributes contained in the entities, and the relationships between the entities [7, 8]. The role is to use the directional reasoning of the relationship between entities to improve the user’s retrieval quality, and it plays a significant role in data structure exchange, knowledge calculation, and knowledge reasoning [9, 10].The knowledge map in the legal field is quite different from the knowledge maps in other fields due to its unique nature [11, 12]. In the legal knowledge graph, there are many professional terms for related entities, the Chinese and English concepts are mixed, and the close correlation between knowledge points makes it necessary to define the ontology framework, optimize the entity and attribute extraction methods, and establish a new update supplement during the construction of the legal knowledge graph. The whole algorithm, although the scope of the knowledge graph is large, and the entity relationships are complex and diverse, but based on the scalability of knowledge, the knowledge graph needs to be continuously updated and maintained [13, 14].Modern information technology is promoting a major transformation of the judicial system. The “smart court building” focusing on artificial intelligence court applications, electronic litigation, and court big data is paralleled with judicial system reform. Artificial intelligence intelligently advances cases, predicts judgment results, and automatically generates judgments. This can be applied in the essay. The basic fact-based theories of court judgments are essentially compatible with the laws of artificial intelligence generation and can be used as the basis for deep neural network learning, word segmentation, and knowledge graph design, and front-end theories are added. The specific application path is the continuous implementation of hierarchical deconstruction based on essential facts, the deconstruction of the application of case knowledge at all levels of data, and the gradual implementation of the hierarchical implementation of legal experts. This provides machine learning to form a large-scale-labeled legal knowledge map.


## 2.2. Neural Network Hybrid Model

### 2.2.1. Definition of Neural Network

Artificial neural network is a technical copy of biological neural network in a specific simplified sense. The corresponding learning algorithm simulates certain intelligent activities of the human brain and is technically copied to solve practical problems [15, 16]. Artificial neural network is composed of many basic neurons in processing equipment. The output of the neuron layer is always connected to the input of the N+1 layer of the neuron until the final output. The structure of artificial neural network is mainly composed of three elements: neurons, network topology, and network learning algorithm.Set the input data asa1,a2⋯ax, the connection weight is b1,b2⋯bx, and the calculation formula of the neuron is
(1)R=∑i=1saibi+cfa.R represents the current state of the neuron, a represents the output data, and c represents the bias.The functionf is called the activation function, which can transform the output into a specified interval. It is a widely used nonlinear function, also known as the sigmoid function, which is defined as
(2)fa=11+d−ca+aibi.The function is strictly monotonously increasing and continuously differentiable, with a value between 0 and 1.


### 2.2.2. Neural Network Training

The input layer and the hidden layer are fully connected. The hidden layer hasm nodes, which are connected to the hidden layer at the previous moment. The weight matrix connecting the hidden layer uses random data to prepare the hidden layer [17, 18].The forward propagation process of the input signal, inputRn at the nth node of the hidden layer, then:
(3)Rn=Xij∑m=1itijsi+γi.Among them,Xij is the activation function of the hidden layer, and tij is the bias vector of the hidden unit.OutputEn at the nth node of the hidden layer:
(4)En=γRn=γXij∑m=1itijsi+γi.Among them is thesi activation function, and γi is the bias vector of the output layer.EnterRn at the mth node of the output layer:
(5)Rm=∑m=1itnjEn+cn=∑m=1itnjγ∑m=1itijsi+γi+cn.OutputKm at the mth node in the output layer:
(6)Km=ϕRn=ϕ∑m=1itnjEn+cn=ϕ∑m=1itnjγ∑n=1jtnjsi+γi+cn.First, calculate the difference between the output value and the expected value from the output level, which is also called input error [19, 20], calculate the error of each layer, and get the sum of the error weights, so that the output of the neural network is as close to the expected value as possible [21, 22].The quadratic error criterion functionEh for each sample h is
(7)Eh=12∑t=1mTs−Km2.The total error functionE of the system for H training samples is
(8)E=12∑T=1H∑H=1TTSP−KmP.According to the error step reduction method, the weight and offset compensation of each layer in the network are calculated in turn, and then, the weights and offsets of each neuron in the network are updated until the error is reduced to a certain extent or the maximum number of training times is reached.


## 2.2.1. Definition of Neural Network

Artificial neural network is a technical copy of biological neural network in a specific simplified sense. The corresponding learning algorithm simulates certain intelligent activities of the human brain and is technically copied to solve practical problems [15, 16]. Artificial neural network is composed of many basic neurons in processing equipment. The output of the neuron layer is always connected to the input of the N+1 layer of the neuron until the final output. The structure of artificial neural network is mainly composed of three elements: neurons, network topology, and network learning algorithm.Set the input data asa1,a2⋯ax, the connection weight is b1,b2⋯bx, and the calculation formula of the neuron is
(1)R=∑i=1saibi+cfa.R represents the current state of the neuron, a represents the output data, and c represents the bias.The functionf is called the activation function, which can transform the output into a specified interval. It is a widely used nonlinear function, also known as the sigmoid function, which is defined as
(2)fa=11+d−ca+aibi.The function is strictly monotonously increasing and continuously differentiable, with a value between 0 and 1.


## 2.2.2. Neural Network Training

The input layer and the hidden layer are fully connected. The hidden layer hasm nodes, which are connected to the hidden layer at the previous moment. The weight matrix connecting the hidden layer uses random data to prepare the hidden layer [17, 18].The forward propagation process of the input signal, inputRn at the nth node of the hidden layer, then:
(3)Rn=Xij∑m=1itijsi+γi.Among them,Xij is the activation function of the hidden layer, and tij is the bias vector of the hidden unit.OutputEn at the nth node of the hidden layer:
(4)En=γRn=γXij∑m=1itijsi+γi.Among them is thesi activation function, and γi is the bias vector of the output layer.EnterRn at the mth node of the output layer:
(5)Rm=∑m=1itnjEn+cn=∑m=1itnjγ∑m=1itijsi+γi+cn.OutputKm at the mth node in the output layer:
(6)Km=ϕRn=ϕ∑m=1itnjEn+cn=ϕ∑m=1itnjγ∑n=1jtnjsi+γi+cn.First, calculate the difference between the output value and the expected value from the output level, which is also called input error [19, 20], calculate the error of each layer, and get the sum of the error weights, so that the output of the neural network is as close to the expected value as possible [21, 22].The quadratic error criterion functionEh for each sample h is
(7)Eh=12∑t=1mTs−Km2.The total error functionE of the system for H training samples is
(8)E=12∑T=1H∑H=1TTSP−KmP.According to the error step reduction method, the weight and offset compensation of each layer in the network are calculated in turn, and then, the weights and offsets of each neuron in the network are updated until the error is reduced to a certain extent or the maximum number of training times is reached.


## 2.3. Model Design

### 2.3.1. Convolutional Neural Network

Convolutional neural network is a kind of feedforward neural network that includes convolutional computation and has deep structure and is one of the representative algorithms of deep learning. Convolutional neural network is a creative research result produced by referring to the structural principles of biological visual nervous system and improving artificial neural network. Compared with the multilayer feedforward neural network, the convolutional neural network has the advantages of fewer model parameters, simultaneous feature learning and classification, global optimization, and strong generalization ability. Now, it has become the current research hotspot in the field of computational neuroscience. The operation of the convolutional neural network can be regarded as the product operation of the convolution kernel and the input matrix. The convolution kernel moves on the input matrix to obtain the characteristic matrix sequence of the input vector. If multiple convolution kernels are selected, the input matrix can be obtained [23, 24].The convolutional neural network is used to select the important part of the feature information learned by the convolutional layer. Convolutional neural networks will have hundreds of millions of neuron connections, resulting in a huge amount of parameters. However, convolutional neural networks operate on local areas and share weights, which mean that the same weights will be applied to all inputs, which greatly reduce the parameters and increase the computing speed. The traditional feature engineering method is too much manual feature design. Convolutional neural networks rely less on the prior knowledge of the domain, and unlike traditional algorithms, they need to manually design complex features.


### 2.3.2. Recurrent Neural Network

Different from the convolutional neural network, the cyclic neural network uses the sentence sequence as the input to model the serialization of the sentence [25]. Recurrent neural networks are memorized, parameter-sharing, and Turing-complete. When determining the event type of each word to be tested, not only the information of the current word to be tested but also the information of the words between the words to be tested will be used [26]. In this paper, after extracting the basic semantic features to generate the input vector, first use the recurrent neural network to further extract the time sequence features of the sentence, and then, use the obtained deep features as the input of the convolutional neural network.


### 2.3.3. Neural Network Hybrid Model

The recurrent neural network here uses a long- and short-term memory (LSTM) structure. The system is composed of two opposite cycles paralleled by the network, and then, the outputs of the two networks are spliced to obtain the deep features of the final sentence. Such a loop mechanism makes it possible for each node to get all the semantic features from the first word of the sentence to the current word, but such features are not sufficient for the judgment of event trigger words and event elements. To obtain a complete context features, it is also necessary to know that the words after the current word have an impact on the semantics of the current word [27, 28]. In order to solve this problem, it is necessary to train a second recurrent neural network to obtain the semantic information after the current word. This recurrent neural network has the same structure as the first recurrent neural network, except that the reverse training starts from the last word of each sentence until the end of the first word of the sentence, and the hidden features can be obtained. Finally, there is a connection layer, which connects the hidden layers trained in the two networks to get the deep features that are really needed. The structure of the neural network hybrid model is shown in Figure 1.Figure 1
Neural network complex model structure diagram.The network topology is composed of many basic neurons in the processing unit. These neurons are connected in a specific way to form a network structure, which is called a neural network topology. It usually consists of an input layer, a hidden layer, and an output layer. At present, there are mainly the following two network topological structures: the first is the forward network. The connections between neurons in this structure are simply from in to out. The structural connection of the feedback network is more complicated, and it can receive input or send to it. Other neurons output, so there is feedback.After the above steps, the deep features of the sentence are obtained. Each sentence in the corpus corresponds to a deep feature, and each word still corresponds to a feature vector, and the vector corresponds to a word. In the phase of trigger word extraction, the problem of trigger word recognition is regarded as a multiclassification task. There are nine event categories, plus a total of ten categories of nonevents, so the classification result has ten labels. The candidate trigger word dictionary of the language has been obtained above. The trigger word extraction process is to traverse each candidate trigger word of each sentence and then judge whether the current candidate word is the trigger word of the sentence. The training is based on the sentence, and the deep featureH and the position j of the previous candidate word are used as the input vector of the model. After the convolution and pooling of the model, a pair of context features is extracted, and finally, the softmax classifier is used for multiple classifications. If the classification result is a nonpiece label, the current candidate word is not a trigger word. The training process of the convolutional neural network includes convolution, pooling, and classification. Pooling, also known as downsampling, is essentially a reduction of the data. How to extract features from an array of pixels is actually what the convolutional neural network does [29, 30].


## 2.3.1. Convolutional Neural Network

Convolutional neural network is a kind of feedforward neural network that includes convolutional computation and has deep structure and is one of the representative algorithms of deep learning. Convolutional neural network is a creative research result produced by referring to the structural principles of biological visual nervous system and improving artificial neural network. Compared with the multilayer feedforward neural network, the convolutional neural network has the advantages of fewer model parameters, simultaneous feature learning and classification, global optimization, and strong generalization ability. Now, it has become the current research hotspot in the field of computational neuroscience. The operation of the convolutional neural network can be regarded as the product operation of the convolution kernel and the input matrix. The convolution kernel moves on the input matrix to obtain the characteristic matrix sequence of the input vector. If multiple convolution kernels are selected, the input matrix can be obtained [23, 24].The convolutional neural network is used to select the important part of the feature information learned by the convolutional layer. Convolutional neural networks will have hundreds of millions of neuron connections, resulting in a huge amount of parameters. However, convolutional neural networks operate on local areas and share weights, which mean that the same weights will be applied to all inputs, which greatly reduce the parameters and increase the computing speed. The traditional feature engineering method is too much manual feature design. Convolutional neural networks rely less on the prior knowledge of the domain, and unlike traditional algorithms, they need to manually design complex features.


## 2.3.2. Recurrent Neural Network

Different from the convolutional neural network, the cyclic neural network uses the sentence sequence as the input to model the serialization of the sentence [25]. Recurrent neural networks are memorized, parameter-sharing, and Turing-complete. When determining the event type of each word to be tested, not only the information of the current word to be tested but also the information of the words between the words to be tested will be used [26]. In this paper, after extracting the basic semantic features to generate the input vector, first use the recurrent neural network to further extract the time sequence features of the sentence, and then, use the obtained deep features as the input of the convolutional neural network.


## 2.3.3. Neural Network Hybrid Model

The recurrent neural network here uses a long- and short-term memory (LSTM) structure. The system is composed of two opposite cycles paralleled by the network, and then, the outputs of the two networks are spliced to obtain the deep features of the final sentence. Such a loop mechanism makes it possible for each node to get all the semantic features from the first word of the sentence to the current word, but such features are not sufficient for the judgment of event trigger words and event elements. To obtain a complete context features, it is also necessary to know that the words after the current word have an impact on the semantics of the current word [27, 28]. In order to solve this problem, it is necessary to train a second recurrent neural network to obtain the semantic information after the current word. This recurrent neural network has the same structure as the first recurrent neural network, except that the reverse training starts from the last word of each sentence until the end of the first word of the sentence, and the hidden features can be obtained. Finally, there is a connection layer, which connects the hidden layers trained in the two networks to get the deep features that are really needed. The structure of the neural network hybrid model is shown in Figure 1.Figure 1
Neural network complex model structure diagram.The network topology is composed of many basic neurons in the processing unit. These neurons are connected in a specific way to form a network structure, which is called a neural network topology. It usually consists of an input layer, a hidden layer, and an output layer. At present, there are mainly the following two network topological structures: the first is the forward network. The connections between neurons in this structure are simply from in to out. The structural connection of the feedback network is more complicated, and it can receive input or send to it. Other neurons output, so there is feedback.After the above steps, the deep features of the sentence are obtained. Each sentence in the corpus corresponds to a deep feature, and each word still corresponds to a feature vector, and the vector corresponds to a word. In the phase of trigger word extraction, the problem of trigger word recognition is regarded as a multiclassification task. There are nine event categories, plus a total of ten categories of nonevents, so the classification result has ten labels. The candidate trigger word dictionary of the language has been obtained above. The trigger word extraction process is to traverse each candidate trigger word of each sentence and then judge whether the current candidate word is the trigger word of the sentence. The training is based on the sentence, and the deep featureH and the position j of the previous candidate word are used as the input vector of the model. After the convolution and pooling of the model, a pair of context features is extracted, and finally, the softmax classifier is used for multiple classifications. If the classification result is a nonpiece label, the current candidate word is not a trigger word. The training process of the convolutional neural network includes convolution, pooling, and classification. Pooling, also known as downsampling, is essentially a reduction of the data. How to extract features from an array of pixels is actually what the convolutional neural network does [29, 30].


## 2.4. Event Extraction

### 2.4.1. Dependent Syntactic Structure Features

When using a machine learning model for event extraction-related issues, the event features are usually extracted first. These features will help the model understand the text to a certain extent, but they are limited to the part of the sentence and cannot make full use of the syntax of the text. Structure, lack of grasp of the overall structure was sentence. Dependent syntactic structure analysis is a key task in natural language processing. It can identify and analyze the subject, predicate, object, definite, adverbial, and complement structures in a sentence and find the dependency of each component in the sentence. A dependency relationship corresponds to two words, a keyword and a dependent word. Only one part of each sentence is independent, and other words depend on another component, and each component is dominant and interdependent. Make the semantic association of the sentence get rid of the interference of the actual word position, and it is easier to be extracted. Therefore, the dependency syntactic structure is of great significance for the model to understand the semantics of the text and grasp the overall structure of the sentence.On top of this, there is the combination of two modes, as well as the addition of various derivative methods such as statistical methods and machine learning methods. There are also a large number of excellent systems for different fields. Different systems have their own preferences due to different concerns. Therefore, different syntax analyzers will also affect the extraction performance to a certain extent.


### 2.4.2. Word Vector

A word vector refers to assigning a word to a space vector, using the vector to represent the word, and performing subsequent model calculations. The spatial distance of the word vector (such as Euclidean distance and cosine distance) can be used to judge whether the semantics of two words are close. The smaller the spatial distance corresponding to the word vector, the closer the semantics of the two words are. For each word to be tested, first summarize the corresponding word vector from the word vector table, and enter the input layer. The convolutional layer can capture the meaning of the birth level and compress it into the feature map.


### 2.4.3. Event Element Identification

Trigger word extraction determines the number of events in the sentence, as well as the trigger word and event category of each event, and the event element extraction is based on the known trigger word, and the participating elements of each event and its corresponding role are carried out. Identify and constitute a complete biomedical event. This chapter completes the extraction of event elements, regards the detection of event elements as a relationship extraction problem, sequentially determines the relationship between the trigger word and each entity in the sentence and the trigger word, and determines whether the current word is an event element according to the corresponding relationship category and the role corresponding to the event element.


### 2.4.4. The Element Type Corresponding to the Event Type

In the element recognition stage, this article does not distinguish between event types. The candidate vocabulary of each sentence contains entities and trigger words at the same time. The candidate vocabulary is traversed, and the relationship with known trigger words is judged one by one. For simple events, there are only two types of subject relationship and no relationship, and the relationship pair can only be trigger word-entity; for complex events, there are subject relationship, target relationship, and no relationship, and the relationship pair may be trigger word-entity and words-trigger words. After identifying all the relationship pairs, according to the type and number of the relationship pairs of each trigger word, do not sort them into simple events, bound events, and complex events. Eventually, all types of events are merged to form a collection of events. In the process of element extraction, it is necessary to use the trigger word annotations obtained in the previous chapter and the layer features representing the original corpus and use the dynamic multipooling convolutional neural network model to extract the relationship pairs. The convolutional neural network model is the same as the structure used in the previous chapter, including the process of convolution, pooling, and classification, and the classification here is to determine the relationship between the trigger word that has been identified in the previous sentence and each word, and there are coexisting topics. There are three categories of relationship, target relationship, and irrelevance.


## 2.4.1. Dependent Syntactic Structure Features

When using a machine learning model for event extraction-related issues, the event features are usually extracted first. These features will help the model understand the text to a certain extent, but they are limited to the part of the sentence and cannot make full use of the syntax of the text. Structure, lack of grasp of the overall structure was sentence. Dependent syntactic structure analysis is a key task in natural language processing. It can identify and analyze the subject, predicate, object, definite, adverbial, and complement structures in a sentence and find the dependency of each component in the sentence. A dependency relationship corresponds to two words, a keyword and a dependent word. Only one part of each sentence is independent, and other words depend on another component, and each component is dominant and interdependent. Make the semantic association of the sentence get rid of the interference of the actual word position, and it is easier to be extracted. Therefore, the dependency syntactic structure is of great significance for the model to understand the semantics of the text and grasp the overall structure of the sentence.On top of this, there is the combination of two modes, as well as the addition of various derivative methods such as statistical methods and machine learning methods. There are also a large number of excellent systems for different fields. Different systems have their own preferences due to different concerns. Therefore, different syntax analyzers will also affect the extraction performance to a certain extent.


## 2.4.2. Word Vector

A word vector refers to assigning a word to a space vector, using the vector to represent the word, and performing subsequent model calculations. The spatial distance of the word vector (such as Euclidean distance and cosine distance) can be used to judge whether the semantics of two words are close. The smaller the spatial distance corresponding to the word vector, the closer the semantics of the two words are. For each word to be tested, first summarize the corresponding word vector from the word vector table, and enter the input layer. The convolutional layer can capture the meaning of the birth level and compress it into the feature map.


## 2.4.3. Event Element Identification

Trigger word extraction determines the number of events in the sentence, as well as the trigger word and event category of each event, and the event element extraction is based on the known trigger word, and the participating elements of each event and its corresponding role are carried out. Identify and constitute a complete biomedical event. This chapter completes the extraction of event elements, regards the detection of event elements as a relationship extraction problem, sequentially determines the relationship between the trigger word and each entity in the sentence and the trigger word, and determines whether the current word is an event element according to the corresponding relationship category and the role corresponding to the event element.


## 2.4.4. The Element Type Corresponding to the Event Type

In the element recognition stage, this article does not distinguish between event types. The candidate vocabulary of each sentence contains entities and trigger words at the same time. The candidate vocabulary is traversed, and the relationship with known trigger words is judged one by one. For simple events, there are only two types of subject relationship and no relationship, and the relationship pair can only be trigger word-entity; for complex events, there are subject relationship, target relationship, and no relationship, and the relationship pair may be trigger word-entity and words-trigger words. After identifying all the relationship pairs, according to the type and number of the relationship pairs of each trigger word, do not sort them into simple events, bound events, and complex events. Eventually, all types of events are merged to form a collection of events. In the process of element extraction, it is necessary to use the trigger word annotations obtained in the previous chapter and the layer features representing the original corpus and use the dynamic multipooling convolutional neural network model to extract the relationship pairs. The convolutional neural network model is the same as the structure used in the previous chapter, including the process of convolution, pooling, and classification, and the classification here is to determine the relationship between the trigger word that has been identified in the previous sentence and each word, and there are coexisting topics. There are three categories of relationship, target relationship, and irrelevance.


## 3. Event Extraction Experiment of Knowledge Graph in the Legal Domain Based on Neural Network Model

### 3.1. Judgment of the Event Type of the Legal Domain Knowledge Graph Based on the Neural Network Model

As an important task in the field of natural language process (NLP), event extraction task has high application value. The more mature maximum entropy and conditional random field methods in the field of event extraction are used for event extraction. By selecting the optimal features, the accuracy of recognition is improved as much as possible, and this part of the work is used as the two comparison standards (benchmark system) for deep learning. Because the commonly used features contain less semantic information and the generalization ability is poor, this chapter introduces deep semantic features that improve the event extraction capabilities of traditional methods.Due to the unbalanced data rate distribution, the traditional event extraction method has a poor recall rate. The reason is that the number of exported body samples is very small over time, and the distribution of event types is extremely unbalanced. Few examples of event types and unbalanced variance often lead to errors when training machine learning models. If the learning model is not fully trained, it will cause more types of learning bias. This type of deviation usually leads to recall problems.This paper proposes an event type recognition method based on affinity, which aims to spread event information in related documents in the tested document, so as to improve the event search rate of the tested document. The distribution of events is also likely to be consistent, especially in documents describing related issues. Based on this, the event information displayed in the relevant document is used to supplement the export result of the document to be tested. In many cases, part of the basic export unit can be obtained. Figure2 is the framework of the event extraction decision scheme of the neural network hybrid model.Figure 2
The framework of the event extraction decision scheme of the neural network hybrid model.


### 3.2. Experimental Parameters

The parameter is set to the word vector dimension of 400 dimensions, the sequence length of the cyclic neural network is 32, the batch size is 256, the number of iterations is 100,000, the convolution kernel window size of the convolutional Bible network is 5, and the number of convolution kernels is 200. Iterate 10,000 times. The parameter estimates of the activation function of the hidden layer and the output layer are shown in Table1.Table 1
Parameter estimation of neural network complex model.
Predictive valueHidden layer 1Output layerH(1 : 1)H(1 : 2)[group =0][group =1]Input layerDeviation0.3750.0150.1080.449EBI1.1010.8321.1310.362UL-0.1910.6940.3420.085PRE_1-1.7130.5300.0561.023Hidden layer 1Deviation0.1620.664-0.059-0.236H(1 : 1)0.3830.4321.021-1.144H(1 : 2)1.1210.5681.157-2.106Table1 shows that there is a significant difference between the error of the hidden layer of the neural network and the error of the output layer.


### 3.3. Experimental Data Set

This experiment uses the subsets WN11 and WN18 of Word Net. And Freebase’s subset FB13 and FB15K data sets are dedicated data and structure of the knowledge graph. The data set includes one-to-one, one-to-many, many-to-one, and many-to-many entity relationship types. There are a total of 11 and 18 relationships in WN11 and WN18. One-to-one, one-to-many, and many-to-one relationships do not exist. There are 11 and 18 N-N types of relationships, respectively. There are a total of 13 entity relationships in FB13, of which there is one type of N-1 relationship and 12 types of N-N relationship. FB15K has a total of 1345 entity relationships. The relationship categories in the data set are shown in Table2.Table 2
Number of relationship types in the data set.
WN11WN18FB13FB15KTotal number of relationships12161412471-10001691-N000158N-1100217N-N121614694For these two data sets, this paper traverses all training tuples through 500 cycles. In terms of data parameter selection, the optimization selection criteria of related experiments in trans E are used for reference.


## 3.1. Judgment of the Event Type of the Legal Domain Knowledge Graph Based on the Neural Network Model

As an important task in the field of natural language process (NLP), event extraction task has high application value. The more mature maximum entropy and conditional random field methods in the field of event extraction are used for event extraction. By selecting the optimal features, the accuracy of recognition is improved as much as possible, and this part of the work is used as the two comparison standards (benchmark system) for deep learning. Because the commonly used features contain less semantic information and the generalization ability is poor, this chapter introduces deep semantic features that improve the event extraction capabilities of traditional methods.Due to the unbalanced data rate distribution, the traditional event extraction method has a poor recall rate. The reason is that the number of exported body samples is very small over time, and the distribution of event types is extremely unbalanced. Few examples of event types and unbalanced variance often lead to errors when training machine learning models. If the learning model is not fully trained, it will cause more types of learning bias. This type of deviation usually leads to recall problems.This paper proposes an event type recognition method based on affinity, which aims to spread event information in related documents in the tested document, so as to improve the event search rate of the tested document. The distribution of events is also likely to be consistent, especially in documents describing related issues. Based on this, the event information displayed in the relevant document is used to supplement the export result of the document to be tested. In many cases, part of the basic export unit can be obtained. Figure2 is the framework of the event extraction decision scheme of the neural network hybrid model.Figure 2
The framework of the event extraction decision scheme of the neural network hybrid model.


## 3.2. Experimental Parameters

The parameter is set to the word vector dimension of 400 dimensions, the sequence length of the cyclic neural network is 32, the batch size is 256, the number of iterations is 100,000, the convolution kernel window size of the convolutional Bible network is 5, and the number of convolution kernels is 200. Iterate 10,000 times. The parameter estimates of the activation function of the hidden layer and the output layer are shown in Table1.Table 1
Parameter estimation of neural network complex model.
Predictive valueHidden layer 1Output layerH(1 : 1)H(1 : 2)[group =0][group =1]Input layerDeviation0.3750.0150.1080.449EBI1.1010.8321.1310.362UL-0.1910.6940.3420.085PRE_1-1.7130.5300.0561.023Hidden layer 1Deviation0.1620.664-0.059-0.236H(1 : 1)0.3830.4321.021-1.144H(1 : 2)1.1210.5681.157-2.106Table1 shows that there is a significant difference between the error of the hidden layer of the neural network and the error of the output layer.


## 3.3. Experimental Data Set

This experiment uses the subsets WN11 and WN18 of Word Net. And Freebase’s subset FB13 and FB15K data sets are dedicated data and structure of the knowledge graph. The data set includes one-to-one, one-to-many, many-to-one, and many-to-many entity relationship types. There are a total of 11 and 18 relationships in WN11 and WN18. One-to-one, one-to-many, and many-to-one relationships do not exist. There are 11 and 18 N-N types of relationships, respectively. There are a total of 13 entity relationships in FB13, of which there is one type of N-1 relationship and 12 types of N-N relationship. FB15K has a total of 1345 entity relationships. The relationship categories in the data set are shown in Table2.Table 2
Number of relationship types in the data set.
WN11WN18FB13FB15KTotal number of relationships12161412471-10001691-N000158N-1100217N-N121614694For these two data sets, this paper traverses all training tuples through 500 cycles. In terms of data parameter selection, the optimization selection criteria of related experiments in trans E are used for reference.


## 4. Extraction Results of the Legal Domain Knowledge Map Event Based on the Neural Network Hybrid Model

### 4.1. Network Performance Analysis of Neural Network Hybrid Model

Event extraction task is an important and challenging information extraction task, which aims to discover event trigger words and identify its event type. The existing traditional methods mostly use artificially designed feature sets, and these features are often extracted through text analysis and language knowledge. Generally speaking, features can be divided into two categories: lexical features and contextual features. Lexical features include part of speech and morphological features (for example, word itself and stem), which can capture the meaning and background knowledge of the word to be tested.The generalization ability of traditional feature engineering-based methods is not enough. In the case of insufficient training corpus, the model obtained by fully supervised learning is changed to other test sets, and the performance often drops significantly. Word embedding contains richer semantic information of words and has better generalization ability. The neural network model takes word vectors as input, does not require complicated process of feature engineering, and also reduces the problem of error transmission. The neural network model itself has a strong learning ability, and then using word vectors as input, the trained model will achieve better performance. The learning efficiency of the model and the accuracy of the output results are significantly improved.Randomly select 100 events as the training samples and test samples of the input and target vectors. The vector settings are shown in Table3.Table 3
Neural network complex model vector setting content.
Sample groupingVector categoryInput settingsMatrix structureTraining samplesInput vectorP_train2∗50 dimensionsInput vectorT_train1∗50 dimensionsTest sampleInput vectorP_test2∗50 dimensionsInput vectorT_test1∗50 dimensionsAfter many experiments, use existing network functions and training sample data to analyze the extraction results of sample events.The network performance test results of the neural network hybrid model are shown in Figure3.Figure 3
Neural network complex model network performance results.From the figure, we can see that the prediction accuracy percentage of the maintained sample reaches 100%, and the network performance is good. At the same time, the prediction accuracy percentage of the training sample and the test sample is also maintained at a high level, indicating that the model prediction accuracy rate is relatively high.


### 4.2. Event Extraction Results of the Knowledge Map of the Legal Domain Based on the Neural Network Hybrid Model

Figure4 shows the results of event trigger word recognition and event type classification of the neural network hybrid model. When the multilayer perceptron contains two hidden layers, the performance of event trigger word recognition and event type classification is optimal, with F1 values of 60.86% and 55.52%, respectively. When performing event recognition and classification, the performance of event recognition (F1 value) does not increase with the increase in the number of random layers. When the hidden layer increases from layer 1 to layer 2, the F1 value of the event type category increases, but when the hidden layer increases from layer 2, the F1 value becomes smaller and smaller. The reason for the analysis may be that when the number of hidden layers is small, the more the number of layers, the stronger the learning or representation performance of the neural network; but when the number of layers increases, on the one hand, the more layers, the more parameters need to be trained. On the other hand, it is difficult for the backpropagation algorithm to pass the residual error to the previous hidden layer, which may cause underfitting of the model.Figure 4
Neural network complex model event trigger word recognition and event type classification results.The trend line of model training accuracy is shown in Figure5.Figure 5
Neural network complex model training accuracy chart.Figure5 shows that the accuracy of the complex model of the neural network increases with the number of iterations.The neural network hybrid model designed in this paper recognizes the event type at the same time when triggering word recognition. The neural network hybrid model regards trigger word recognition as a classification task, including defined nine event types and nonevents, a total of ten types. Experiments of the accuracy rate, recall rate, andF value of the system are shown in Figure 6.Figure 6
Experimental results of the method in this paper.It can be seen that the system has a good recognition effect on the trigger word extraction of simple events. TheF value is basically around 80, but the recognition effect of mixed events is poor. Later, the characteristics of the mixed events will be summarized to improve the recognition effect.The results of comparison with traditional machine learning methods are shown in Figure7.Figure 7
Compared with traditional machine learning methods.Comparing the method in this paper with the traditional method, under the same environmental conditions, it can be clearly seen that the accuracy of the model used in this paper has reached 77.1%, and the recall rate has reached 76.8%, which is a great improvement over the traditional model.


## 4.1. Network Performance Analysis of Neural Network Hybrid Model

Event extraction task is an important and challenging information extraction task, which aims to discover event trigger words and identify its event type. The existing traditional methods mostly use artificially designed feature sets, and these features are often extracted through text analysis and language knowledge. Generally speaking, features can be divided into two categories: lexical features and contextual features. Lexical features include part of speech and morphological features (for example, word itself and stem), which can capture the meaning and background knowledge of the word to be tested.The generalization ability of traditional feature engineering-based methods is not enough. In the case of insufficient training corpus, the model obtained by fully supervised learning is changed to other test sets, and the performance often drops significantly. Word embedding contains richer semantic information of words and has better generalization ability. The neural network model takes word vectors as input, does not require complicated process of feature engineering, and also reduces the problem of error transmission. The neural network model itself has a strong learning ability, and then using word vectors as input, the trained model will achieve better performance. The learning efficiency of the model and the accuracy of the output results are significantly improved.Randomly select 100 events as the training samples and test samples of the input and target vectors. The vector settings are shown in Table3.Table 3
Neural network complex model vector setting content.
Sample groupingVector categoryInput settingsMatrix structureTraining samplesInput vectorP_train2∗50 dimensionsInput vectorT_train1∗50 dimensionsTest sampleInput vectorP_test2∗50 dimensionsInput vectorT_test1∗50 dimensionsAfter many experiments, use existing network functions and training sample data to analyze the extraction results of sample events.The network performance test results of the neural network hybrid model are shown in Figure3.Figure 3
Neural network complex model network performance results.From the figure, we can see that the prediction accuracy percentage of the maintained sample reaches 100%, and the network performance is good. At the same time, the prediction accuracy percentage of the training sample and the test sample is also maintained at a high level, indicating that the model prediction accuracy rate is relatively high.


## 4.2. Event Extraction Results of the Knowledge Map of the Legal Domain Based on the Neural Network Hybrid Model

Figure4 shows the results of event trigger word recognition and event type classification of the neural network hybrid model. When the multilayer perceptron contains two hidden layers, the performance of event trigger word recognition and event type classification is optimal, with F1 values of 60.86% and 55.52%, respectively. When performing event recognition and classification, the performance of event recognition (F1 value) does not increase with the increase in the number of random layers. When the hidden layer increases from layer 1 to layer 2, the F1 value of the event type category increases, but when the hidden layer increases from layer 2, the F1 value becomes smaller and smaller. The reason for the analysis may be that when the number of hidden layers is small, the more the number of layers, the stronger the learning or representation performance of the neural network; but when the number of layers increases, on the one hand, the more layers, the more parameters need to be trained. On the other hand, it is difficult for the backpropagation algorithm to pass the residual error to the previous hidden layer, which may cause underfitting of the model.Figure 4
Neural network complex model event trigger word recognition and event type classification results.The trend line of model training accuracy is shown in Figure5.Figure 5
Neural network complex model training accuracy chart.Figure5 shows that the accuracy of the complex model of the neural network increases with the number of iterations.The neural network hybrid model designed in this paper recognizes the event type at the same time when triggering word recognition. The neural network hybrid model regards trigger word recognition as a classification task, including defined nine event types and nonevents, a total of ten types. Experiments of the accuracy rate, recall rate, andF value of the system are shown in Figure 6.Figure 6
Experimental results of the method in this paper.It can be seen that the system has a good recognition effect on the trigger word extraction of simple events. TheF value is basically around 80, but the recognition effect of mixed events is poor. Later, the characteristics of the mixed events will be summarized to improve the recognition effect.The results of comparison with traditional machine learning methods are shown in Figure7.Figure 7
Compared with traditional machine learning methods.Comparing the method in this paper with the traditional method, under the same environmental conditions, it can be clearly seen that the accuracy of the model used in this paper has reached 77.1%, and the recall rate has reached 76.8%, which is a great improvement over the traditional model.


## 5. Conclusions

This paper proposes a neural network hybrid model to extract events in the knowledge map of the legal field, which has certain progress in the in-depth mining of features. At the same time, combining the characteristics was legal field, formulating reasonable rules, optimizing the identification method, and realizing a complete legal field event extraction mechanism. In addition, this topic combines the advantages of convergence and iterative neural networks to propose a model for extracting events for common convergence and bidirectional iterative neural networks. Experimental results show that, compared with traditional methods, the hybrid neural network model provides significant performance improvements. Event extraction is a challenging research direction. In the extraction process, no complex event processing results in poor final recognition of complex events; in the postrule processing link, although parts of the results of recognition errors are filtered out, some trigger words or parts of the event elements are correctly recognized, but the element recognition is incomplete. In the event recognition stage of this article, a neural network is used to extract the relationship between the trigger word and the candidate word, and all the relationship pairs are derived at the same time, and then, simple and complex event creation is done. According to the type of relationship, finally, different types of events are used. Event definitions are used to exclude noncompliant events. Traditional event extraction also removes a large number of correctly derived activation words, but the event data is exported for free, which reduces the recall rate. Therefore, in order to improve the recognition results, it is also necessary to design more accurate rules. The neural network hybrid model used in this paper fully extracts the time and environmental characteristics of the body and obtains highly recognizable results. However, it cannot be used for complex events. From the results, the results of simple event recognition are much better than complex events, whether it is activation word recognition or event data recognition. Therefore, how to design the function of complex events is a problem that needs further research. In the subsequent research, we will continue to research and improve these problems to further improve the extraction effect.



---

*Source: 5880595-2022-06-18.xml*