# Application of Multilevel Local Feature Coding in Music Genre Recognition

Authors: Yangxin Xiao; Qiang Zhang; Meng Wu; Dong Kailing
Journal: Mathematical Problems in Engineering
 (2022)

---

## Abstract

When the current method is used to recognize music genre style, the extracted features are not fused, which leads to poor recognition effectiveness. Therefore, the application research based on multilevel local feature coding in music genre recognition is proposed. Features of music are extracted from timbre, rhythm, and pitch, and the extracted features are fused based on D-S evidence theory. The fused music features are input into the improved deep learning network, and the storage system structure is determined from the advantages of cloud storage availability, manageability, and expansibility. It is divided into four modules: storage layer, management layer, structure layer, and access layer. The model of music genre style recognition is constructed to realize the application research based on multilevel local feature coding in music genre recognition. The experimental results show that the recognition accuracy of the proposed method is always at a high level, and the mean square error positively correlated with the number of beats. After segmentation, the waveform is denser, which has a good application effect.


---

## Body

## 1. Introduction

The music genre is one of the most mentioned music labels. With the increase of Internet music library capacity, retrieving music by genre has become the mainstream method of music information retrieval [1], and it is also an important basis for a music service platform to recommend music to users. Automatic and accurate music genre recognition can effectively reduce labor costs. Commonly used music genre recognition models generally include two stages: training and testing [2]. In the training stage, firstly, the mathematical model is established to describe the digital characteristics of music genres with discrimination [3, 4]; then the digital features of music files are extracted by preemphasis, Mel filter, and cepstrum lifting; Finally, the classifier is trained based on the digital characteristics and distribution characteristics of different schools. In the testing stage, the same way as the training stage is used for digital feature extraction. The classifier obtained in the training stage is used to calculate the extracted digital features and evaluate the genre. Multilevel local feature coding is of great significance for music genre recognition.In recent years, scholars try to use different methods to improve the application performance of music genre recognition, and constructing music genre recognition methods has gradually become a research hotspot. Jakubec andChmulik [5] proposed automatic music type recognition for in-car infotainment. Automatic music type recognition is a basic tool for music retrieval, recommendation, and personalization in the intelligent infotainment system and music streaming media services. Such systems may be particularly helpful for in-car audio because the driver’s interaction with such infotainment systems may be the main object of his/her distraction. In order to better classify genres, two important tasks need to be considered, namely, classifier and audio feature extraction. In this system, timbre texture and pitch content features are used for genre classification. Wood texture includes Mel frequency cepstrum coefficient and other spectral features. For pitch content, features extracted from Chroma are selected. The purpose of this work is to explore the possibility of classifying music types from audio signals and to create an automatic music type recognition system in a MATLAB programming environment. A music type recognition system is developed on a gtzan data set, including ten different music types, such as rock, pop, classical, and so on. Ng et al. [6] proposed multilevel local feature coding fusion for music type recognition. Music-type recognition plays a basic role in music indexing and retrieval. Different from images, music genres are composed of immediate features, which are highly diversified and have different levels of abstraction. However, most representation learning methods for Mgr focus on global features and make decisions from the same level of features. In order to make up for these defects, the convolutional neural network is combined with netvlad and self-attention to capture different levels of local information and learn their long-term correlation. The Meta classifier is used to learn from the high-level features aggregated in different local feature coding networks, so as to carry out the final Mgr. Experiments indicate that this strategy outperforms other advanced models in terms of accuracy. Although the above methods have made some progress, they are not ideal in the field of music genre recognition. Therefore, application research based on multilevel local feature coding in music genre recognition is proposed, which can identify the local delicate music genre features and frequency rhythm of the music.The research is organized as follows: The multilevel local music feature extraction and feature fusion are presented in Section2. Section 3 analyzes the music genre cloud storage characteristics and style recognition model. The experiment and its results are discussed in Section 4 of the study. Finally, the research job is completed in Section 5.


## 2. Multilevel Local Music Feature Extraction and Feature Fusion

### 2.1. Music Feature Extraction

The music genre recognition method based on multilevel local feature coding extracts music features from three aspects: timbre, rhythm, and pitch.


#### 2.1.1. Music Timbre Feature Extraction

Frequency usually affects the probability of musical timbre. The short-time Fourier transform method is used to calculate the characteristics of timbre. Letfm represent the time domain corresponding to the original audio signal, Fourier transform fm to obtain the timbre feature sequence Gg and the extracted timbre features are as follows:(1) Spectral Centroid. Assuming that Du represents the centroid of the music spectrum [7], it mainly describes the centroid of the spectrum, which can be calculated by the following formula:(1)Du=fm×Gg×Bt.In formula (1), Bt represents the center frequency corresponding to the t frequency band [8, 9]. Frequency is usually a random variable, and the normalized amplitude is the probability density of frequency:(2)Md=RrEs×Du.In formula (2), Rr represents the predicted probability item value, and Es represents the actual probability item value.(2) Spectral Diffusion. Spectral diffusion describes the diffusion degree of spectral centroid in the spectrum, which can be calculated by the following formula:(3)PKS=Md×Vth.In formula (3), Wth represents the diffusion velocity of the spectral centroid in the spectrum.(3) Spectral Skewness. Spectral skewness refers to the degree of data asymmetry, which belongs to a statistical concept. Spectral skewness describes the degree and direction of spectral amplitude skew, which can be calculated by the following formula:(4)FX=PKS×m3.In formula (4), m3 represents the third-order center distance corresponding to the frequency.(4) Spectral Kurtosis. Spectral kurtosis represents the flatness of frequency distribution near the center, and the spectral kurtosis is calculated by the following formula:(5)m4=∑FX−Du×PKS.In formula (5), m4 represents the fourth-order center distance corresponding to the frequency.(5) Spectral Flux. The change of frequency amplitude can be reflected by spectral flux:(6)Flux=Ytn−Wio×m4.In formula (6), Ytn represents the t frame sequence after Fourier transforms, and Wio represents the spectral flux eigenvalue. Music timbre feature extraction consists of five characteristic factors: spectral moment center, spectral diffusion, spectral skewness, spectral kurtosis, and spectral flux. The average amplitude difference function dynamic threshold strategy is used to segment the audio, the base audio rate is extracted through the autocorrelation function, and the audio segments are matched according to the pitch base frequency. After the weighted synthesis of the Euclidean distance algorithm and DTW (dynamic time warping) distance similarity matching algorithm [10, 11], the music feature recognition results can be obtained; the recognition results of the operation are shown in Figure 1.Figure 1
Structure diagram of acquiring music feature recognition.As can be seen from Figure1, the components are mainly input module, preprocessing module, feature extraction module, similarity matching module, and result output module. The relevant calculation steps in the system are described as follows:(1)
The algorithm of the preprocessing module includes noise reduction [12], weighting, and framing windowing to process the input audio signal;(2)
The feature extraction module calculates the fundamental frequency of each processed frame signal, divides the audio, and obtains the pitch information and fundamental frequency period of each note after calculation;(3)
In the similarity matching module, the music that best matches the pitch contour of the note of the audio segment is searched in the music database to obtain the music with the highest similarity.


#### 2.1.2. Music Rhythm Feature Extraction

Music genre style can be reflected by the strength and speed of rhythm, find the most significant periodicity in the music score signal and realize the extraction of music rhythm characteristics. Based on multilevel local feature coding, in music genre style recognition, combined with the low-frequency characteristics of beat, the beat of the music is obtained. The specific process is as follows:Wavelet coefficients are obtained by malat algorithm [13], and there are sampling processes and low-pass and high pass filtering in each layer:(7)xGn=∑k=0n2n−kgk,xDn=∑k=0n2n−kdk.In formula (7), gk represents a high pass filter and dk represents low-pass filter. High-frequency wavelet coefficients and low-frequency wavelet coefficients can be obtained by filtering. The filtered signal is decomposed by a wavelet. The signal decomposition process is shown in Figure 2.Figure 2
Wavelet decomposition process.The extraction of music rhythm features is divided into four steps: full-wave rectification, low-pass filtering, down sampling, and deaveraging. The corresponding expression is as follows:(8)yn=xkn,yn=1−αxn+αyn−1,yn=xkn,yn=xn−Exn.In formula (8), the function of parameters is to remove high-frequency noise and smooth the waveform of music rhythm characteristics, which is generally 0.99. When the peak passes, it will appear in the state with the same period and delay. The peak of the waveform after autocorrelation processing is monitored to obtain the beat histogram.


#### 2.1.3. Extraction of Music Pitch Features

Autocorrelation operation is performed on the basis of signal periodic features to detect the peak value of autocorrelation output and extract the pitch features of music, similar to the process of extracting rhythm features. The extraction process of pitch features is shown in Figure3.Figure 3
Pitch feature extraction process.


### 2.2. Fusion of Music Features

Music feature fusion based on multi-level local feature coding uses D-S evidence theory to fuse the above extracted features [14], The sample space a1,a2,⋯,an is used to describe the music features extracted in the above process, and the sample space a1,a2,⋯,an is processed through Qa to obtain the probability distribution function M1a1,M2a2,⋯,Mnan, which describes the music feature fusion texture feature.The target multivariate probability distribution function is fused by the following formula:通:(9)Qa=∑Mai,Qa^=∑1−Mai.In formula (9), Qa and Qa^ represent the probability distribution of target fusion proposition.LetPlA represents the fusion likelihood function and BlA represents the fusion trust function, and their expressions are as follows:(10)PlA=1−Bl−A×2D,BlA=∑MB.In formula (10), 2D indicates that it is composed of all subsets of D.The music features are judged through the maximum class probability functionfA to realize the fusion of music features:(11)SfA=BlA+COPlA−BlA.In formula (11), C and O describe the number of elements in C and O, respectively.


## 2.1. Music Feature Extraction

The music genre recognition method based on multilevel local feature coding extracts music features from three aspects: timbre, rhythm, and pitch.


### 2.1.1. Music Timbre Feature Extraction

Frequency usually affects the probability of musical timbre. The short-time Fourier transform method is used to calculate the characteristics of timbre. Letfm represent the time domain corresponding to the original audio signal, Fourier transform fm to obtain the timbre feature sequence Gg and the extracted timbre features are as follows:(1) Spectral Centroid. Assuming that Du represents the centroid of the music spectrum [7], it mainly describes the centroid of the spectrum, which can be calculated by the following formula:(1)Du=fm×Gg×Bt.In formula (1), Bt represents the center frequency corresponding to the t frequency band [8, 9]. Frequency is usually a random variable, and the normalized amplitude is the probability density of frequency:(2)Md=RrEs×Du.In formula (2), Rr represents the predicted probability item value, and Es represents the actual probability item value.(2) Spectral Diffusion. Spectral diffusion describes the diffusion degree of spectral centroid in the spectrum, which can be calculated by the following formula:(3)PKS=Md×Vth.In formula (3), Wth represents the diffusion velocity of the spectral centroid in the spectrum.(3) Spectral Skewness. Spectral skewness refers to the degree of data asymmetry, which belongs to a statistical concept. Spectral skewness describes the degree and direction of spectral amplitude skew, which can be calculated by the following formula:(4)FX=PKS×m3.In formula (4), m3 represents the third-order center distance corresponding to the frequency.(4) Spectral Kurtosis. Spectral kurtosis represents the flatness of frequency distribution near the center, and the spectral kurtosis is calculated by the following formula:(5)m4=∑FX−Du×PKS.In formula (5), m4 represents the fourth-order center distance corresponding to the frequency.(5) Spectral Flux. The change of frequency amplitude can be reflected by spectral flux:(6)Flux=Ytn−Wio×m4.In formula (6), Ytn represents the t frame sequence after Fourier transforms, and Wio represents the spectral flux eigenvalue. Music timbre feature extraction consists of five characteristic factors: spectral moment center, spectral diffusion, spectral skewness, spectral kurtosis, and spectral flux. The average amplitude difference function dynamic threshold strategy is used to segment the audio, the base audio rate is extracted through the autocorrelation function, and the audio segments are matched according to the pitch base frequency. After the weighted synthesis of the Euclidean distance algorithm and DTW (dynamic time warping) distance similarity matching algorithm [10, 11], the music feature recognition results can be obtained; the recognition results of the operation are shown in Figure 1.Figure 1
Structure diagram of acquiring music feature recognition.As can be seen from Figure1, the components are mainly input module, preprocessing module, feature extraction module, similarity matching module, and result output module. The relevant calculation steps in the system are described as follows:(1)
The algorithm of the preprocessing module includes noise reduction [12], weighting, and framing windowing to process the input audio signal;(2)
The feature extraction module calculates the fundamental frequency of each processed frame signal, divides the audio, and obtains the pitch information and fundamental frequency period of each note after calculation;(3)
In the similarity matching module, the music that best matches the pitch contour of the note of the audio segment is searched in the music database to obtain the music with the highest similarity.


### 2.1.2. Music Rhythm Feature Extraction

Music genre style can be reflected by the strength and speed of rhythm, find the most significant periodicity in the music score signal and realize the extraction of music rhythm characteristics. Based on multilevel local feature coding, in music genre style recognition, combined with the low-frequency characteristics of beat, the beat of the music is obtained. The specific process is as follows:Wavelet coefficients are obtained by malat algorithm [13], and there are sampling processes and low-pass and high pass filtering in each layer:(7)xGn=∑k=0n2n−kgk,xDn=∑k=0n2n−kdk.In formula (7), gk represents a high pass filter and dk represents low-pass filter. High-frequency wavelet coefficients and low-frequency wavelet coefficients can be obtained by filtering. The filtered signal is decomposed by a wavelet. The signal decomposition process is shown in Figure 2.Figure 2
Wavelet decomposition process.The extraction of music rhythm features is divided into four steps: full-wave rectification, low-pass filtering, down sampling, and deaveraging. The corresponding expression is as follows:(8)yn=xkn,yn=1−αxn+αyn−1,yn=xkn,yn=xn−Exn.In formula (8), the function of parameters is to remove high-frequency noise and smooth the waveform of music rhythm characteristics, which is generally 0.99. When the peak passes, it will appear in the state with the same period and delay. The peak of the waveform after autocorrelation processing is monitored to obtain the beat histogram.


### 2.1.3. Extraction of Music Pitch Features

Autocorrelation operation is performed on the basis of signal periodic features to detect the peak value of autocorrelation output and extract the pitch features of music, similar to the process of extracting rhythm features. The extraction process of pitch features is shown in Figure3.Figure 3
Pitch feature extraction process.


## 2.1.1. Music Timbre Feature Extraction

Frequency usually affects the probability of musical timbre. The short-time Fourier transform method is used to calculate the characteristics of timbre. Letfm represent the time domain corresponding to the original audio signal, Fourier transform fm to obtain the timbre feature sequence Gg and the extracted timbre features are as follows:(1) Spectral Centroid. Assuming that Du represents the centroid of the music spectrum [7], it mainly describes the centroid of the spectrum, which can be calculated by the following formula:(1)Du=fm×Gg×Bt.In formula (1), Bt represents the center frequency corresponding to the t frequency band [8, 9]. Frequency is usually a random variable, and the normalized amplitude is the probability density of frequency:(2)Md=RrEs×Du.In formula (2), Rr represents the predicted probability item value, and Es represents the actual probability item value.(2) Spectral Diffusion. Spectral diffusion describes the diffusion degree of spectral centroid in the spectrum, which can be calculated by the following formula:(3)PKS=Md×Vth.In formula (3), Wth represents the diffusion velocity of the spectral centroid in the spectrum.(3) Spectral Skewness. Spectral skewness refers to the degree of data asymmetry, which belongs to a statistical concept. Spectral skewness describes the degree and direction of spectral amplitude skew, which can be calculated by the following formula:(4)FX=PKS×m3.In formula (4), m3 represents the third-order center distance corresponding to the frequency.(4) Spectral Kurtosis. Spectral kurtosis represents the flatness of frequency distribution near the center, and the spectral kurtosis is calculated by the following formula:(5)m4=∑FX−Du×PKS.In formula (5), m4 represents the fourth-order center distance corresponding to the frequency.(5) Spectral Flux. The change of frequency amplitude can be reflected by spectral flux:(6)Flux=Ytn−Wio×m4.In formula (6), Ytn represents the t frame sequence after Fourier transforms, and Wio represents the spectral flux eigenvalue. Music timbre feature extraction consists of five characteristic factors: spectral moment center, spectral diffusion, spectral skewness, spectral kurtosis, and spectral flux. The average amplitude difference function dynamic threshold strategy is used to segment the audio, the base audio rate is extracted through the autocorrelation function, and the audio segments are matched according to the pitch base frequency. After the weighted synthesis of the Euclidean distance algorithm and DTW (dynamic time warping) distance similarity matching algorithm [10, 11], the music feature recognition results can be obtained; the recognition results of the operation are shown in Figure 1.Figure 1
Structure diagram of acquiring music feature recognition.As can be seen from Figure1, the components are mainly input module, preprocessing module, feature extraction module, similarity matching module, and result output module. The relevant calculation steps in the system are described as follows:(1)
The algorithm of the preprocessing module includes noise reduction [12], weighting, and framing windowing to process the input audio signal;(2)
The feature extraction module calculates the fundamental frequency of each processed frame signal, divides the audio, and obtains the pitch information and fundamental frequency period of each note after calculation;(3)
In the similarity matching module, the music that best matches the pitch contour of the note of the audio segment is searched in the music database to obtain the music with the highest similarity.


## 2.1.2. Music Rhythm Feature Extraction

Music genre style can be reflected by the strength and speed of rhythm, find the most significant periodicity in the music score signal and realize the extraction of music rhythm characteristics. Based on multilevel local feature coding, in music genre style recognition, combined with the low-frequency characteristics of beat, the beat of the music is obtained. The specific process is as follows:Wavelet coefficients are obtained by malat algorithm [13], and there are sampling processes and low-pass and high pass filtering in each layer:(7)xGn=∑k=0n2n−kgk,xDn=∑k=0n2n−kdk.In formula (7), gk represents a high pass filter and dk represents low-pass filter. High-frequency wavelet coefficients and low-frequency wavelet coefficients can be obtained by filtering. The filtered signal is decomposed by a wavelet. The signal decomposition process is shown in Figure 2.Figure 2
Wavelet decomposition process.The extraction of music rhythm features is divided into four steps: full-wave rectification, low-pass filtering, down sampling, and deaveraging. The corresponding expression is as follows:(8)yn=xkn,yn=1−αxn+αyn−1,yn=xkn,yn=xn−Exn.In formula (8), the function of parameters is to remove high-frequency noise and smooth the waveform of music rhythm characteristics, which is generally 0.99. When the peak passes, it will appear in the state with the same period and delay. The peak of the waveform after autocorrelation processing is monitored to obtain the beat histogram.


## 2.1.3. Extraction of Music Pitch Features

Autocorrelation operation is performed on the basis of signal periodic features to detect the peak value of autocorrelation output and extract the pitch features of music, similar to the process of extracting rhythm features. The extraction process of pitch features is shown in Figure3.Figure 3
Pitch feature extraction process.


## 2.2. Fusion of Music Features

Music feature fusion based on multi-level local feature coding uses D-S evidence theory to fuse the above extracted features [14], The sample space a1,a2,⋯,an is used to describe the music features extracted in the above process, and the sample space a1,a2,⋯,an is processed through Qa to obtain the probability distribution function M1a1,M2a2,⋯,Mnan, which describes the music feature fusion texture feature.The target multivariate probability distribution function is fused by the following formula:通:(9)Qa=∑Mai,Qa^=∑1−Mai.In formula (9), Qa and Qa^ represent the probability distribution of target fusion proposition.LetPlA represents the fusion likelihood function and BlA represents the fusion trust function, and their expressions are as follows:(10)PlA=1−Bl−A×2D,BlA=∑MB.In formula (10), 2D indicates that it is composed of all subsets of D.The music features are judged through the maximum class probability functionfA to realize the fusion of music features:(11)SfA=BlA+COPlA−BlA.In formula (11), C and O describe the number of elements in C and O, respectively.


## 3. Music Genre Cloud Storage Characteristics and Style Recognition Model

### 3.1. Research on Cloud Storage Characteristics and System Structure of Music Genres

Music genre cloud storage is the product of the development of cloud computing, and cloud storage further promotes the development of cloud computing, and the two promote each other. Cloud storage integrates cluster applications and distributed file systems. It is a technology that uses the network to provide data storage and access. Its characteristics are shown in Table1:Table 1
Cloud storage characteristics of music genres.
CharacteristicDescription of music genre characteristicsData availabilityAvailability is judged according to the fault-free running time of the system. Music genre cloud storage must provide users with continuous data storage services, not only to ensure data security and avoid data damage but also to ensure network stabilityManageabilityThis feature can be expressed using the effective management ability at the same resource cost. For storage hosts distributed in different areas, comprehensive management is carried out to avoid system failureStorage efficiencyThis feature indicates how to efficiently use the original storage, which is an important feature of music genre cloud storage. Compress and format convert the data to reduce the data storage space. In addition, you can find and delete duplicate data to improve storage efficiencyAccess modeThat is, the protocol used by music genre cloud storage service, and the method used by users to access the stored content. At this stage, most methods are based on web servicesExpansibilityExpanding storage capacity can further meet the diversified needs of users and improve service qualityMusic genre cloud storage should not only have the traditional storage function but also analyze the actual application needs of users. We should not only make reasonable planning for software and hardware resources but also respond to users’ requests for resource storage in real time. This makes the music genre cloud storage system not only have internal storage management performance but also include application service performance. The cloud storage structure model of the music genre is shown in Figure4.Figure 4
Structural model of music genre cloud storage system.The functions of music genre cloud storage structure are divided into the following four levels:


#### 3.1.1. Storage Layer

It is mainly responsible for providing storage data, which is composed of physical storage and device management system, and belongs to the lowest part of music genre cloud storage system. Storage devices are generally connected by massive remote storage systems using networks. The main work of the equipment management system is to manage the physical storage equipment, including state detection, redundancy management, and the like, to ensure the barrier-free operation of the underlying equipment.


#### 3.1.2. Management

The main work of this level is to schedule and manage storage operations, which is the most critical link. In order to provide integrated services for storage systems distributed in different regions, the management must use cluster and distributed technology. In addition, the management also needs to have data backup and disaster recovery technology to ensure the security of traditional music storage and provide users with more secure storage services.


#### 3.1.3. Interface Layer

It is an interface designed for applications and a bridge connecting the management layer and the access layer. Music genre cloud storage services can design the application interface in combination with the actual business types.


#### 3.1.4. Access Layer

The access layer is the interface between users and storage services. Authorized users can log in to the system through the specified public interface and enjoy specific storage services. The access mode is generally browser or cloud desktop.


### 3.2. Construction of Music Genre Style Recognition Model

In order to improve the accuracy of music genre recognition and personalized recognition, a music genre style recognition model is constructed. A matrix is used to describe the user’s scoring data, and the matrix is used as the input of the music genre style recognition model. The selection relationship between users and resources can reflect the interesting trend among users, and the relationship between resource nodes and user nodes in the network is displayed by the dual-mode network in the system. For a specific user group, when users are associated with multiple network activities, multidimensional connections will be generated among users in the group, forming a multimode network of selection relationship between users and resources.Based on the application of multilevel local feature coding in music genre recognition, the fused music features are input into the improved deep learning network, and the music genre style recognition model is constructed to realize music genre recognition. The specific steps are as follows.Step 1: Input the fused music genre features into the network, initialize the weight matrix of the deep learning network, and initialize the offsetsa and b of the hidden layer and the visible layer to 0.Step 2: Assign a value to the visible layer neural unit, forward transmit the input music features, and obtain the corresponding activation probability of forward propagation in the deep learning network.Step 3: The activation probability valueph|v corresponding to the neuron in the hidden layer is usually a real number, and it is binarized.Step 4: Back propagate the probability value corresponding to the hidden layer unit in the deep learning network to obtain the reconstruction valuev′ of the neural unit in the visible layer. Let pv′|h represent the activation probability of neural unit v′ in the visible layer, and its calculation formula is as follows:(12)pv′|h=∏i=1mpvj|h,Step 5: In the improved deep learning network, thev′ reconstructed by forward propagation is obtained, and the activation probability and back propagation probability corresponding to the neural unit h′ in the hidden layer are obtained in the above way.Step 6: Obtain the increment of the offsetb in the visible layer by reconstructing the activation probability of the visible layer v′ and the activation probability corresponding to the original visible layer v. Similarly, the increment corresponding to the offset a in the hidden layer h is obtained by the activation probability corresponding to the hidden layers h′ and h. The increment of weight matrix W can be obtained by calculating the back propagation probability and forward propagation probability [15]. During each iteration, bias and weights are updated with the learning rate ε:(13)Wt=Wt−1+εvph|v−v′ph′|v′,bt=bt−1+εpv|h−pv′|h′,at=at−1+εph|v−ph′|v′.Step 7: Set the termination conditions and output the music genre style recognition results. The model has the following advantages:


#### 3.2.1. Fast Recognition Speed

This feature is manifested in three aspects: fast data generation, large-scale expansion of massive data, and fast data disappearance. Digitization brings about the mobility of life. Therefore, it is necessary to strengthen the timeliness of information processing;


#### 3.2.2. Recognition Immediacy

Compared with traditional protection methods, recognition models usually have a special relationship with users’ immediate actions. Intangible cultural heritage is dependent on the existence of “inheritors,” which is the same as that of big data;


#### 3.2.3. Integration of Personalization and Socialization

The music genre style recognition model is the product of the combination of personalization and socialization. In essence, it is the extension and development of personalization, which also symbolizes new changes. Music genre style recognition model is closely related to human and social activities. The data can no longer be distributed according to the physical structure but needs to be reorganized in combination with the relationship between individual and society; thus, the application of multilevel local feature coding in music genre recognition is completed.


## 3.1. Research on Cloud Storage Characteristics and System Structure of Music Genres

Music genre cloud storage is the product of the development of cloud computing, and cloud storage further promotes the development of cloud computing, and the two promote each other. Cloud storage integrates cluster applications and distributed file systems. It is a technology that uses the network to provide data storage and access. Its characteristics are shown in Table1:Table 1
Cloud storage characteristics of music genres.
CharacteristicDescription of music genre characteristicsData availabilityAvailability is judged according to the fault-free running time of the system. Music genre cloud storage must provide users with continuous data storage services, not only to ensure data security and avoid data damage but also to ensure network stabilityManageabilityThis feature can be expressed using the effective management ability at the same resource cost. For storage hosts distributed in different areas, comprehensive management is carried out to avoid system failureStorage efficiencyThis feature indicates how to efficiently use the original storage, which is an important feature of music genre cloud storage. Compress and format convert the data to reduce the data storage space. In addition, you can find and delete duplicate data to improve storage efficiencyAccess modeThat is, the protocol used by music genre cloud storage service, and the method used by users to access the stored content. At this stage, most methods are based on web servicesExpansibilityExpanding storage capacity can further meet the diversified needs of users and improve service qualityMusic genre cloud storage should not only have the traditional storage function but also analyze the actual application needs of users. We should not only make reasonable planning for software and hardware resources but also respond to users’ requests for resource storage in real time. This makes the music genre cloud storage system not only have internal storage management performance but also include application service performance. The cloud storage structure model of the music genre is shown in Figure4.Figure 4
Structural model of music genre cloud storage system.The functions of music genre cloud storage structure are divided into the following four levels:


### 3.1.1. Storage Layer

It is mainly responsible for providing storage data, which is composed of physical storage and device management system, and belongs to the lowest part of music genre cloud storage system. Storage devices are generally connected by massive remote storage systems using networks. The main work of the equipment management system is to manage the physical storage equipment, including state detection, redundancy management, and the like, to ensure the barrier-free operation of the underlying equipment.


### 3.1.2. Management

The main work of this level is to schedule and manage storage operations, which is the most critical link. In order to provide integrated services for storage systems distributed in different regions, the management must use cluster and distributed technology. In addition, the management also needs to have data backup and disaster recovery technology to ensure the security of traditional music storage and provide users with more secure storage services.


### 3.1.3. Interface Layer

It is an interface designed for applications and a bridge connecting the management layer and the access layer. Music genre cloud storage services can design the application interface in combination with the actual business types.


### 3.1.4. Access Layer

The access layer is the interface between users and storage services. Authorized users can log in to the system through the specified public interface and enjoy specific storage services. The access mode is generally browser or cloud desktop.


## 3.1.1. Storage Layer

It is mainly responsible for providing storage data, which is composed of physical storage and device management system, and belongs to the lowest part of music genre cloud storage system. Storage devices are generally connected by massive remote storage systems using networks. The main work of the equipment management system is to manage the physical storage equipment, including state detection, redundancy management, and the like, to ensure the barrier-free operation of the underlying equipment.


## 3.1.2. Management

The main work of this level is to schedule and manage storage operations, which is the most critical link. In order to provide integrated services for storage systems distributed in different regions, the management must use cluster and distributed technology. In addition, the management also needs to have data backup and disaster recovery technology to ensure the security of traditional music storage and provide users with more secure storage services.


## 3.1.3. Interface Layer

It is an interface designed for applications and a bridge connecting the management layer and the access layer. Music genre cloud storage services can design the application interface in combination with the actual business types.


## 3.1.4. Access Layer

The access layer is the interface between users and storage services. Authorized users can log in to the system through the specified public interface and enjoy specific storage services. The access mode is generally browser or cloud desktop.


## 3.2. Construction of Music Genre Style Recognition Model

In order to improve the accuracy of music genre recognition and personalized recognition, a music genre style recognition model is constructed. A matrix is used to describe the user’s scoring data, and the matrix is used as the input of the music genre style recognition model. The selection relationship between users and resources can reflect the interesting trend among users, and the relationship between resource nodes and user nodes in the network is displayed by the dual-mode network in the system. For a specific user group, when users are associated with multiple network activities, multidimensional connections will be generated among users in the group, forming a multimode network of selection relationship between users and resources.Based on the application of multilevel local feature coding in music genre recognition, the fused music features are input into the improved deep learning network, and the music genre style recognition model is constructed to realize music genre recognition. The specific steps are as follows.Step 1: Input the fused music genre features into the network, initialize the weight matrix of the deep learning network, and initialize the offsetsa and b of the hidden layer and the visible layer to 0.Step 2: Assign a value to the visible layer neural unit, forward transmit the input music features, and obtain the corresponding activation probability of forward propagation in the deep learning network.Step 3: The activation probability valueph|v corresponding to the neuron in the hidden layer is usually a real number, and it is binarized.Step 4: Back propagate the probability value corresponding to the hidden layer unit in the deep learning network to obtain the reconstruction valuev′ of the neural unit in the visible layer. Let pv′|h represent the activation probability of neural unit v′ in the visible layer, and its calculation formula is as follows:(12)pv′|h=∏i=1mpvj|h,Step 5: In the improved deep learning network, thev′ reconstructed by forward propagation is obtained, and the activation probability and back propagation probability corresponding to the neural unit h′ in the hidden layer are obtained in the above way.Step 6: Obtain the increment of the offsetb in the visible layer by reconstructing the activation probability of the visible layer v′ and the activation probability corresponding to the original visible layer v. Similarly, the increment corresponding to the offset a in the hidden layer h is obtained by the activation probability corresponding to the hidden layers h′ and h. The increment of weight matrix W can be obtained by calculating the back propagation probability and forward propagation probability [15]. During each iteration, bias and weights are updated with the learning rate ε:(13)Wt=Wt−1+εvph|v−v′ph′|v′,bt=bt−1+εpv|h−pv′|h′,at=at−1+εph|v−ph′|v′.Step 7: Set the termination conditions and output the music genre style recognition results. The model has the following advantages:


### 3.2.1. Fast Recognition Speed

This feature is manifested in three aspects: fast data generation, large-scale expansion of massive data, and fast data disappearance. Digitization brings about the mobility of life. Therefore, it is necessary to strengthen the timeliness of information processing;


### 3.2.2. Recognition Immediacy

Compared with traditional protection methods, recognition models usually have a special relationship with users’ immediate actions. Intangible cultural heritage is dependent on the existence of “inheritors,” which is the same as that of big data;


### 3.2.3. Integration of Personalization and Socialization

The music genre style recognition model is the product of the combination of personalization and socialization. In essence, it is the extension and development of personalization, which also symbolizes new changes. Music genre style recognition model is closely related to human and social activities. The data can no longer be distributed according to the physical structure but needs to be reorganized in combination with the relationship between individual and society; thus, the application of multilevel local feature coding in music genre recognition is completed.


## 3.2.1. Fast Recognition Speed

This feature is manifested in three aspects: fast data generation, large-scale expansion of massive data, and fast data disappearance. Digitization brings about the mobility of life. Therefore, it is necessary to strengthen the timeliness of information processing;


## 3.2.2. Recognition Immediacy

Compared with traditional protection methods, recognition models usually have a special relationship with users’ immediate actions. Intangible cultural heritage is dependent on the existence of “inheritors,” which is the same as that of big data;


## 3.2.3. Integration of Personalization and Socialization

The music genre style recognition model is the product of the combination of personalization and socialization. In essence, it is the extension and development of personalization, which also symbolizes new changes. Music genre style recognition model is closely related to human and social activities. The data can no longer be distributed according to the physical structure but needs to be reorganized in combination with the relationship between individual and society; thus, the application of multilevel local feature coding in music genre recognition is completed.


## 4. Experimental Analysis

Through the above research on the application of multilevel local feature coding in music genre recognition, in order to verify this method and its effect on music genre recognition, an experiment is designed to verify it. Set the experimental parameters as shown in Table2:Table 2
Experimental parameters.
ProjectParameterProcessorInter core i3 M 350@2.27 GHzOperating systemWindows10Sound cardHigh fidelity audio sound cardSoftware toolMATLAB 7.0 2018MicrophoneDicsong stereo headphonesHard disk160 GIn order to ensure the rationality and scientificity of this experiment, the same music melody is recognized according to the method in this article. During the operation, the background computer will record the notes of notes. The staff will record the recognition speed and accuracy of the three methods and balance the intelligent recognition effect of the three methods as the final experimental result.Based on the application of multilevel local feature coding in music genre recognition, four different styles of electronic music resources are identified, and the recognition speed and accuracy of each resource as shown in Figure5 are obtained through recording and calculation. Automatic recognition performance of different electronic music signals is shown in Figure 5.Figure 5
Automatic recognition performance of different electronic music signals.In Figure5, the cylindrical recognition speed shows that the recognition method greatly speeds up the recognition speed of music signals, and the recognition speed decreases slightly with the increase of music duration. From the curve trend of mean square error value, it can be seen that the recognition accuracy of this method is always at a high level for different styles of electronic music signals, and the mean square error value positively correlated with the number of beats. The reason is that this method uses the Gaussian activation function with good analytical performance to replace the commonly used sigmoid activation function, so that the network complexity does not increase with the increase in input variables and has good smoothness and radial symmetry; Based on Windows platform, the automatic recognition process of C + + language architecture is adopted to realize the automatic recognition of target electronic music signals through preemphasis, windowing, and framing.In order to verify the effectiveness of the application in music genre recognition constructed in this article, evaluation factors need to be constructed because evaluation factors can affect the general set of various factors. After investigation, the evaluation level indicators are as follows: very good, good, general, poor, and very poor. The corresponding level indicators and scoring data are shown in Table3:Table 3
Corresponding analysis of scoring indicators and data.
Scoring indexVery niceGoodCommonlyPoorVery bad100∼8080∼6060∼4040∼2020∼0After constructing the hierarchical fuzzy subset, it is necessary to quantify the evaluated things from each factoruii=1,2,3,4,5, that is, confirm to observe the membership of the evaluated things to the fuzzy subset of each level from a single factor, so as to obtain the fuzzy relationship matrix J. The specific formula is as follows:(14)J=J1J2J3J4J5=j11j12⋯j1nj21j22⋯j2nj31j32⋯j3nj41j42⋯j4nj51j52⋯j5n.In formula (14), the element of row i and column j in matrix J indicates that by observing the factor ui of an evaluated player, it is the fuzzy subset membership of vj level..In the evaluation system of live music competition scoring, the primary indicators are singing skills and arrangement skills, and the secondary indicators are note sequence, pitch period, note segmentation, and pitch sequence. According to formula (14), the results are 0.34, 0.15, 0.21, and 0.30, respectively. Pitch period and pitch sequence describe music pitch; note sequence and note segmentation describe music melody.Three contestants a, B, and C were selected as experimental personnel. Among them, a had received professional training in music and sang some music on the stage; B is an amateur, loves music, and will practice at rest; C has no interest in music and seldom sings. When singing the same song, the time is set to the time of the whole song. Then, select five professional judges to score the three experimental personnel. In order to ensure the effectiveness of the data, the on-site environment should remain unchanged from the beginning to the end and then compare the scoring data of the judges with the scoring data of the system to observe the effect of the constructed system. The specific results are shown in Tables4–6:Table 4
Comparison of scoring data of experimenter A.
ExperimenterPlayer ARaterPitchMelodyAverageJudge 1919693.5Judge 2968691Judge 3919191Judge 4869188.5Judge 5819588Paper method84.885.285Table 5
Comparison of scoring data of experimenter B.
ExperimenterPlayer BRaterPitchMelodyAverageJudge 1767676Judge 2817678.5Judge 3618171Judge 4667671Judge 5666163.5Paper method656364Table 6
Comparison of scoring data of experimenter C.
ExperimenterPlayer CRaterPitchMelodyAverageJudge 1465148.5Judge 2615156Judge 3564148.5Judge 4556057.5Judge 5505050Paper method485049By observing Tables4–6, it can be seen that the average score of experimenter A is 85, and the singing level is excellent. The average score of experimenter B was 64, and his singing level was good. The average score of experimenter C is 49, indicating that the singing level is poor. In this article, the application method of multilevel local feature coding in music genre recognition is very close to the scoring data of the judges, which can meet the real scoring needs, meet people’s subjective feelings, and have stronger objectivity.The length of sound is the concrete embodiment of the duration of music, which can most mobilize the perception of the human body. In the recognition of music genres, the segmentation length is the first step of music note segmentation recognition, which is used to improve the segmentation accuracy of music notes. The original waveform of music is shown in Figure6:Figure 6
Original waveform of music.Rhythm is the relationship between all notes in the music field and the absolute height between each note. From this point of view, rhythm is constantly changed and improved with the development of society. The ultimate purpose of change is to make the connection between each note closer and present better music effect. At present, the rhythm is mainly divided into three categories: pure rhythm, five-degree phase law, and twelve average law. Each rhythm represents different forms of music singing, of which the twelve average law is the most commonly used. It mainly divides the notes into twelve semitones according to the frequency ratio, and each semitone represents the average law of a rhythm. The performance of notes is accurate to a certain extent, which lays a foundation for the segmentation and recognition of notes. The waveform after segmentation is shown in Figure7:Figure 7
Waveform after segmentation.It can be seen from Figure7 that the original waveform is sparse and the waveform after segmentation is dense. We understand the physical characteristics of music notes. By extracting the characteristics of music notes, we lay the foundation for intelligent segmentation and recognition of notes. Based on the theory of pitch and sound level, the pitch represents the frequency doubling degree of a note, and the sound level represents the treble level of a note, The pitch and scale of a note form a tone. The core of the feature extraction method is to analyze the music note structure and then further classify the note features according to the harmonic information represented by the notes to complete the refinement. The key of the feature extraction method is the sound-level mapping of the notes. This mapping process not only reduces the energy of the notes but also simplifies the note data frame to retain the key information of the notes, Eliminate the redundant information, which will not change the training of notes.In conclusion, the application of multilevel local feature coding in music genre recognition has good performance.


## 5. Conclusions and Prospects

### 5.1. Conclusion

For different styles of electronic music signals, the recognition accuracy of this method is always at a high level, and the mean square error is positively correlated with the number of beats.In this article, the application method of multilevel local feature coding in music genre recognition is very close to the scoring data of the judges, which can meet the real scoring needs, meet people’s subjective feelings, and have stronger objectivity. The original waveform is sparse, and the segmented waveform is dense. The note data frame is simplified, the key information of the note is retained, and the redundant information is eliminated. This process will not change the note training.


### 5.2. Prospects

There are still some deficiencies with this article’s research material. In future research, I intend to improve the following three points:(1)
The future research focus can be on learning the local features of different abstract levels and their long-term dependence. It shows excellent application prospects in the task of music genre recognition. We can try to provide better performance by optimizing the aggregation network of local features and global features at the same time and train the architecture in the way of multitask learning.(2)
Learn local features at different levels of abstraction, but how these local features are. Future research work can study different filter visualization techniques to interpret filters and extend the proposed method to other tasks, such as audio event classification, emotion prediction, and music tagging.(3)
In the future, we need to further explore the performance of the proposed method on larger data sets. In the future, we plan to add large data sets to the experiment of this article in order to obtain a more complete verification of the proposed music genre style recognition model.


## 5.1. Conclusion

For different styles of electronic music signals, the recognition accuracy of this method is always at a high level, and the mean square error is positively correlated with the number of beats.In this article, the application method of multilevel local feature coding in music genre recognition is very close to the scoring data of the judges, which can meet the real scoring needs, meet people’s subjective feelings, and have stronger objectivity. The original waveform is sparse, and the segmented waveform is dense. The note data frame is simplified, the key information of the note is retained, and the redundant information is eliminated. This process will not change the note training.


## 5.2. Prospects

There are still some deficiencies with this article’s research material. In future research, I intend to improve the following three points:(1)
The future research focus can be on learning the local features of different abstract levels and their long-term dependence. It shows excellent application prospects in the task of music genre recognition. We can try to provide better performance by optimizing the aggregation network of local features and global features at the same time and train the architecture in the way of multitask learning.(2)
Learn local features at different levels of abstraction, but how these local features are. Future research work can study different filter visualization techniques to interpret filters and extend the proposed method to other tasks, such as audio event classification, emotion prediction, and music tagging.(3)
In the future, we need to further explore the performance of the proposed method on larger data sets. In the future, we plan to add large data sets to the experiment of this article in order to obtain a more complete verification of the proposed music genre style recognition model.



---

*Source: 3627831-2022-03-22.xml*