# Deep Learning Dual Neural Networks in the Construction of Learning Models for Online Courses in Piano Education

Authors: Shijun Lei; Huiming Liu
Journal: Computational Intelligence and Neuroscience
 (2022)

---

## Abstract

The use of deep learning (DL) and artificial intelligence (AI) in teaching children piano lessons promotes modern piano instruction and enhances the overall quality of education. To begin, a more thorough explanation of the teaching environment and the intelligent piano’s features is provided. Then, a method for detecting the onset of a piano note using a Dual Neural Network (DNN) is proposed. By transforming the original time-domain waveform of the piano music signal into a frequency distribution that changes with time, the network can analyze the input signal’s time-frequency. Finally, the intelligent piano teaching method combines deep learning with artificial intelligence (AI) to produce the best possible results for students learning the piano instrument. For children and their parents alike, it is a favorite, and it significantly impacts their interests. The proposed model has a 94% overall accuracy rate.


---

## Body

## 1. Introduction

As society progresses, the need of providing children with a high-quality education becomes increasingly apparent. Music education can help students enhance their emotional, physical, and cerebral growth, as well as their ability to persevere in difficult situations. The use of emotional music in preschool training has been shown to boost children’s cultural achievements as well as their overall quality of life [1]. Because of this, piano instruction can be incorporated into the curriculum of a top-notch public school. As a result, children who begin learning to play the piano at a young age are more prone to become disenchanted in the time-consuming activities that accompany their lessons as they mature. Therefore, teachers should design scientific techniques for teaching piano to children that are based on the kids’ ages, appropriate pedagogical materials, and educational psychology, among other considerations [2]. Deep learning (DL) technology is being used by pianists to allow them to focus on the individual needs of each youngster and tailor their lessons to meet those needs. It is possible to make piano training for children more cerebral by using the DL algorithm to develop a musical instrument recognition system that incorporates the DL algorithm. Scholars from both local and international institutions have conducted substantial research on piano education [3]. A piano note identification algorithm was developed with the help of an artificial network and tested in a classroom setting in order to better understand piano instruction. The transcription, evaluation, and annotation of certain piano audio recordings were performed in order to construct a linear annotation recognition model. Among the conclusions of this study are a comparison and analysis of numerous Chinese and foreign piano training methodologies that make use of augmented reality (AR) technology, as well as case studies and real-world experience in piano education using AR technology. The results of the survey revealed an inverse link between the findings and children’s pleasant emotional responses to music, demonstrating the effectiveness of the AR-based piano education method in particular [4]. The trial participants’ emotional intelligence (EQ) growth, academic achievement, and social abilities all improved as a result of their exposure to music. Deep learning (DL)-based instrument identification technology can be used in conjunction with children’s piano lessons to increase kids’ interest in piano studies while also improving the outcomes of their learning. First and foremost, an assessment of the current situation of piano education for youngsters was conducted. Children can learn to play the piano using instrument recognition technology, which was developed in partnership with educational psychology. Music recognition software was created using DL and then tested using a questionnaire (QS) to examine the influence of different teaching techniques on young pianists’ ability to learn [5]. DL is a revolutionary teaching tool that helps students become more engaged in their piano studies by guiding them through the identification of their own musical compositions through a custom-built DL learning system. It also guides and adjusts their own piano performances in real time as they progress through the levels of the programme.In a traditional classroom setting, a single piano teacher can teach up to ten students at the same time. As a result, it is nearly impossible to keep track of everything that is going on at any given moment. When possible, the number of students in each class should be maintained to a bare minimum in order to maintain a high student-teacher ratio [6]. The teacher’s attention was traditionally focused on the course material, while students’ attention was diverted to absorbing and digesting what they were taught. Students who are bogged down in theory and technique have a difficult time recognising the core of a pianist’s performance on the piano. The lack of interest on their part may prevent them from being interested in learning how to play the game at all [7]. Therefore, piano education for youngsters must be updated, and teachers must come up with novel techniques to engage their students in studying and performing the piano. A number of people also believe that pupils benefit from positive classroom environments and those performance abilities should not be simply based on repetition exercises. There can not be enough emphasis placed on the significance of parental involvement in their children’s piano practise, considering the fragile nature of children’s self-control and willpower. The collaboration of parents and teachers is essential while providing piano lessons for young pupils to guarantee that the courses are tailored to each child’s individual learning style [8]. Cognitive tasks, such as learning to play the piano, should be examined through the prism of knowledge acquisition, which is the process through which people gain knowledge. Children’s educational mental health can serve as a foundation for improving instructional techniques, according to educational psychology. Depending on where they are in their growth and development at the time of the classification, infants, young children, preschoolers, primary schoolers, and teenagers can all be classified into age groups. The term “preschooler” refers to youngsters who are younger than seven years old. The majority of research initiatives are geared on children between the ages of 4 and 6. Children as young as three are considered to be among the brightest people on the planet, according to popular thinking. Therefore, preschool education has the ability to assist youngsters in the development and enhancement of their innate intellectual capabilities [9]. Music can assist young children (between the ages of four and six) improve their ability to express themselves creatively and to perform onstage. Children’s insatiable need to create and play may be a valuable asset in the music industry, as they can breathe fresh life and vitality into existing works (Woody, 2020). Piano teachers who want to adequately prepare their pupils for theatrical performances must keep up with the most recent developments in the field of instruction.China’s educational system would be inadequate if it did not include art instruction. Because artificial intelligence (AI) has infiltrated the art school system, it is necessary to change piano training in this country [10]. Despite their widespread appeal, piano lessons are prohibitively expensive and have a small student base, making it hard to make piano lessons more widely available to the general public. If artificial intelligence (AI) is used in conjunction with a wireless network, online piano instruction may acquire more acceptance. It is possible for piano online training to attain a higher level of public acceptance and societal influence if it makes use of artificial intelligence and network technology to modify and expand the structure of the original instrument [11]. However, earlier research has employed multiple linear regression and stepwise regressive techniques in order to simplify the relationship between the difficulty of teaching and normal performance. In addition, it is customary for the research approach to be explanatory in nature. An association between instructional difficulty and feature performance has been demonstrated under this discrete value, but research on the categorization relationship between these two variables has not been clearly explained, and the evidence for this has been restricted in its persuasiveness Several studies have used the clustering technique to determine the distribution of difficulty and performance, but they have failed to take into consideration the reference value of already available instructional challenges in their analyses of the data [12]. Each piano teaching component is evaluated using comparative trials and the Relief F weight technique, which is based on the expansion of differentiating factors and is based on the expansion of distinguishing characteristics [13]. The K-Nearest Neighbors (KNNs) in the Projected Feature Space (P-KNN) technique, which is based on metric learning theory, has been created to provide hierarchical recognition for various piano training features. It is necessary to use the Gaussian radial basis function (RBF) kernel algorithm in conjunction with the Metric Learning with Support Vector Machine (ML-SVM) classification strategy in order to discover the feature performance that has an impact on piano instruction. The development of a child’s personality is an important aspect of the process of teaching children piano. Many people believe that individualised piano instruction that is tailored to the needs and interests of each student can be extremely beneficial for them [14]. Musical sensitivity is the ability to recognise the emotional impact of piano music, and it is a skill that can be learned. Children should be taught about rhythm and tone through methods such as Solfeggio and ear training, according to some, and this is an excellent strategy to aid them in improving their musical talent. Working with children to build their sense of pitch and range through singing and playing is really beneficial. In order for young artists to improve their ear skills, they should carefully listen to prerecorded melody tracks and correct any flaws they detect.Instrument recognition technology can be used to classify, remark on, and detect musical emotions through the usage of musical instruments [15]. For transcription and visualisation reasons, instrument names and melodies can also be obtained and annotated. It is possible to create a completely new digital music evaluation model based on the tones produced by the instrument. It is necessary to be able to discern between the varied tones produced by different instruments in order to recognise them as musical instruments. Because of developments in computer technology, it is simpler to discern between distinct instrument tones (CT). When it comes to determining the effectiveness of an evaluation model, the tone analysis approach is applied. For CT instrument recognition to be successful, an accurate extraction of the instrument’s tone is required [16]. Instrumental music is distinguished from vocal music by the content of time and frequency, rather than the cepstrum [17]. Following multiscale visual modulation in the human brain, sound input is changed into an auditory spectrum, which reflects harmonic information after it has been transformed into a frequency spectrum [18]. On the basis of the auditory characteristics of human ears, it is hypothesised that there is a nonlinear relationship between frequency and the Mel spectrum. On the basis of this relationship, calculate the Mel Frequency Cepstrum Coefficient (MFCC) for feature extraction and dimension reduction purposes. Previous instrumental music identification algorithms have all relied on shallow structures to extract timbre information and optimise classifiers, and this is still true today [19]. Although these models are capable of coping with more complex circumstances, musical instruments such as percussion and symphonic instruments are typically excluded from consideration. There is no existing study related to the piano education online learning model. The study focused on the application of deep learning dual neural networks in the construction of the Piano Education online course learning model.


## 2. Materials and Methods

Getting into the virtual music teaching concept, more than one technology is being involved in its growth, which is artificial intelligence, and this will not be considered the first time a different technology has been merged with music teaching. By 1960, AI was being used in music systems but not in the way of learning. It helps through discovering musical instruments with different sounds. The deep learning neural network method needs to explain clearly. The deep neural network is a model with multiple hidden layers that involves multiple training processes to provide increased accuracy of any given application and for the given input. Using the methods of deep neural networks, the music managing systems would look for such a pattern in the scoring pages. And here, bars are used to indicate the upcoming track. Once the artificial intelligence is merged with the music system, it will be able to create a separate set of mathematical rules. Involving the mathematical concepts is to create the original composition of the soundtrack. For example, consider the harmony spaces, which would relate the human interfacing modules to the artificial intelligence idea of music. While introducing new technology to the world, the software or hardware should be user-friendly so that the user can be able to utilise the functions that are being represented in it. Everyone might have the feeling of understanding the music theme and the lyrics used in it.When the teaching methods are made online, it means the students or learners have a massive availability to access the notes given by the teaching personnel. If the classes are conducted in offline mode without any technology-based development in the class, then the students will not be able to go through their topics once they get out of the classes. In such a case, cloud storage makes the work more efficient for the students by allowing them to get back their testing and training work at any date and time. Normally, artificial intelligence is a kind of work in a separate world where, instead of human configuration, the technicians would create robots and assign tasks to the machines that benefit the humans who are living in the real world. The dual neural network is the deep learning algorithm that is one of the important concepts that stand behind music technology in all teaching fields. Creating an environment while at the same time making it understandable is mandatory. This research focuses on the working principle of these dual processes through the neural networking model. With the help of the deep learning concept, the dual neural network algorithm plays a major role.As a first step, teachers should be well versed in the teaching platform; only then will they be able to bring clarity to the student while delivering the concept. Even if the classes are made nonvirtual, it will be difficult for the students to grasp the concept if there is a lack of understanding with the teacher. According to the reaction, students would develop an interest in learning about the topic. Whatever the previous field has been shown in the learning platform, the Dual Neural Network (DNN) algorithm would bring massive growth to such a learning platform by increasing the efficiency and making analysis of the quality of music when it is delivered through wireless sensor networks. While hearing a tone on our mobile phones, the sound quality will differ when the same tone is being heard through an external speaker. So our prospect should be analysing the frequency and serving it at the right time with actual bandwidth to the user who is located in a different location. With the help of Figure1, the actual relations and the involvement of a student and the administrator will be analysed. About 200 hours of virtuoso piano performances have been compiled into a dataset called MAESTRO (MIDI & Audio Edited for Synchronous TRacks & Organization).Figure 1
Online teaching and training system.Using a dual neural network to build an intelligent piano teaching system, an analysis of the realisation approach is performed. Using a wireless network architecture, it also provides a way to measure piano performance in the context of device piano education. Because it does not entail conversation, gadget teaching is an effective means of transmitting the information. It also mimics the teacher’s function in leading pupils through the continued playing approach, which is critical in piano instruction.“Suppose there really areu training tests An,Sn as particularly for identifying for the wireless sensor nodes, where An is the device’s eigenvalue and Sn is the predicted data result. Assuming the aspects of the original signal is t, An=nn1,nn2,…,nnt has been used to d-demonstrate its training examples of the n samples. Sn=nn1,nn2,…,nnt is used to show the projected output sequence of the n sample. And, Qn=Qn1,Qn2,…,QntS is used to identify the n sample’s evaluated output variable. If the concentration between the i neurotransmitter and the adjacent j transmitter is EijthenEij=Eij, where j is the lower limit of the j neuron.”When a transmitter is utilised as an input unitQn=An, the changes in the surface region DNNnj of a j is transmitter can be defined as follows: (1)DNNnj=∑iEjiQni−θj.Here,Qni is the starting element’s i transmitter output, Qni is the present element’s j serotonin output, and fWSNnj is a Fourier transform. Equation (2) shows how to calculate Qni.(2)Qni=∑j=1nfDNNnj.Developing the technique of the skill could also be utilised to train itsQni system using a Dn is Sigmoid transfer function. The fundamental purpose of the training courses is to determine the nonlinear activation. (3)Dn=12∑j=1rlnj−Qni2,D=∑n=1uDn.The following equation (4) is utilised in each training procedure Δn, to lower the Eji error value is based on the gradient.(4)ΔnEji=∑j=1nŋδnjQnj+∑j=1rlnj−Qni2.In equation (5), ηδnj denotes the energy device.(5)δnj=∑j=1rlnj−Qni2−∑j=1nlnj−QnjQnj1−Qnj.OnceQnj represents an activation functions unit, the calculation would be performed as shown in the following equation:(6)δnj=∑j=1nQnj1−Anj∑jδnjEij.Throughout sensor network teachinghnj, it is prudent to employ AI mean standard errors, as shown in the following equation:(7)AI=1tu∑t=1u∑j=1th^nj−hnj2.In equations (8) and (9), n denotes the value that connects the jth hidden surface network to reduced weight matrices of a βj hidden node and the inputs nodes.(8)Qnj=∑j=1nβha+s+d1/2,(9)∑j=r+1nβjg+a+Aj+dc=hi.The rhythm sense is represented byganda inside the dataset. The music frequency time is specified by dc.The smart order is now on the lookout for a new areaAmax−Ai inside its visual range. If the region A might be changed any further within the viewable region and also the normal satisfies, h1>h2 random behaviour may be evaluated using the following equation:(10)Aj=Aj+randomVis−ifh1>h2,Ainex=Ai+randomstp∗Amax−Ai.TherandomVis specifies the visual range. It is comparable to the ∑q=1AqDq intensity of a piano music audio. This is a measure of a music signal’s tonality including its ∑q=1ADq spatial frequency elements. It is determined by using the following equation:(11)Centroid=∑q=1AqDq∑q=1ADq.Here,Dq appears to be the amplitude. The following formula is used to compute the sequence-v spectral bandwidth:(12)Bandwidth=∑qYqfq−fdv1/v.Here,Yq denotes the spatial magnitude. It is the piano music level below ∑msignalbo−signalbo−1gp−o which a significant portion of overall physical energy, 95%, can be discovered. It is calculated as in the following equations: (13)Ap=12∑msignalbo−signalbo−1gp−o,(14)singnalbp=1,Pp≥0,−1,Pp<0.The direction is defined bygf, the input time is described by bf, the input vector just at a specified frequency was given by bt, and the outside situation is represented by rt. The piano music transistor information can be written in the following equation:(15)ft=σgf.r.bt+bj.Theg symbol represents the matrix based on input entrance, and indeed the bi symbol represents the neurotic period based on input entrance. Equation (16) represents the throughput entry.(16)σt=σgo.rt−1,bt+b0.The heading corresponding to an unknown point for piano music is denoted bygo, while the paranoid idea is denoted by bo. The following is the corresponding equation (17) presentation of the calculation for the region dt˜.(17)dt˜=tanrgd.rt−1,bt+bc.Here,d˜t describes that current state of affairs on the inside. The dual network model model’s ultimate output targets are the piano music of a complex action of otanddt which may be illustrated as follows:(18)rt=∑t=1dottanr⊙dt.


## 3. Results and Discussion

When a transmitter is utilised as an input unitQn=An, the changes in the surface region WSNnj of a j is transmitter can be defined as in equation (1) based on this to retrieved in Figure 2. Deep learning algorithm using artificial intelligence in system analysis will stream various signal classifications, and there may be some signal lag.Figure 2
Performance of deep learning algorithm in the system analysis.In this defined framework, students are expected to use the signal for recording audio online as a structural converter. An audio discrepancy may be brought to the attention of a pupil and critiqued for improvement. Artificial intelligence (AI) will be used to let students pick and replay audio from various lecturers, according to the text. AI will make adjustments to the dataset’s algorithms. The analysis of results using a deep learning algorithm for standard score accuracy is (85%) or command and interpret accuracy overall (90%) in piano music memory overall accuracy (94%) (refer Table1).Table 1
Result analysis of deep learning algorithm in the system analysis.
ParameterSignal classification for deep learningStructure converterDatabaseAccuracy (%)Standard score18025947186Command and interpret19028146190Music memory19925058194n denotes the value that connects the jth hidden surface network to a provided reduced weight matrices of a βj hidden node and the inputs nodes as retrieved by Figure 3. A MIDI file is used instead of audio to send the video, which has been tested for frequency and mean, standard error, or global bit rate (GB) to create separate musical compositions. 45.1–47 kHz, 18-bit PCM stereo sampling frequency is necessary. All other sectors are scrambling to keep up with the rapid advancements in IT testing that have occurred in the contemporary technological age. Teachers and students at schools have shown a high level of technological proficiency compared to other organisations (refer Table 2).Figure 3
Performance analysis for frequency of use of prolog language.Table 2
Result analysis for frequency of use of prolog language.
MeanStandard deviationSize (GB)Testing2.5838076.9Frequency2.7026950.1Database2.1935660.7Prolog is a type that has a modelling process and the capacity to think intelligently. It is related to graphics with information technology understanding, and it includes propositions along with judgement comprehension scenarios. The phrase “Prolog programming” is commonly used in sets of data, ordinary mathematical results, completely credible, insufficient credibility, automatic recognition, and other fields. A new areaAmax−Ai inside its visual range. If the region A might be changed any further within the viewable region and also the normal satisfies, h1>h2 random behaviour may be evaluated using equation (10) retrieved from Figure 4 and Table 3. This is also widely used in music education and as a quantifier for mathematical expression vectors for piano performance.Figure 4
Deep learning model using analysis of frequency in the affective dimension of music.Table 3
Performance analysis of frequency of use of prolog language.
Language in prologAutomatic representationMathematical resultSuggestion1489282120Experienced professional1309251132Dataset1600240151Ordinary reliable2299241170Inadequate credibility2599433153Totally credible1589280161The World Piano-e-Competition organizers who created the raw data in this dataset are considered in this study. It uses MIDI capture and playback technology that are dependable and credible for each competition instalment, as well as concert-reliable and credible pianos. It is possible to assess the competition’s audition stage remotely by listening to the contestants’ performances on some other Prolog equipment through the Internet (see Table3).The majority of the total audio signal assessments use piano music to communicate communication signal properties. Nonqualitatively influenced, they categorise the distinctness of a rhythmic sensory input in the sequence or frequency field. It is comparable to the∑q=1AqDq intensity of a piece of piano music. This is a measure of a music signal’s tonality, including its ∑q=1ADq spatial frequency elements. Equation (11) is used to get the answer shown in Figure 5. Biological feature extraction or the corresponding musical frameworks are important in music because of the large range of variability.Figure 5
Performance analysis of teaching and training system’s effect evaluation using deep learning model.The parameters of an audio wave signal are made up of many characteristics of a piano sound signal. They are neither logically sound nor do they categorise the distinctness of a piano signal in the spatial-temporal or frequency domains. It is the piano music level below∑msignalbo−signalbo−1gp−o which a significant in Figure 6 portion of overall physical energy, 95%, can be discovered. Because music varies so much physiological feature extraction is done in brief intersecting skylights. It also describes that current state of affairs on the inside. Stringed instrument identification technology may increase the effect of piano teaching while also improving student enthusiasm in studying the instrument. In particular, the model’s performance in recognising musical instruments is enhanced in addition to the development and refinement of the model based on a neural network. The experimental results show that a multiple signal classification for deep learning dual neural network based instrument identifying model may meet the criteria of piano teaching while also improving students’ motivation in piano teaching.Figure 6
Frequency analysis of teaching and training system’s effect evaluation diagram.


## 4. Conclusions

Students can learn western classical music concepts and knowledge using AI and computer technology, such as chromatic scale, transfer, interval, and chord through piano lessons. Teaching the piano can benefit from its inclusion in the curriculum. A method for detecting the onset of a piano note based on DNN is proposed following an investigation of the intelligent piano’s functions and characteristics. According to the findings, children and their parents enjoy learning to play the intelligent piano, which is a good start for the future development of effective enlightenment education for young children. The results proved that the proposed model has provided an accuracy of 94% in the evaluation of quality learning. For future research, it is highly recommended to implement a hybrid neural network algorithm for identifying the performance of the piano online course model. [20]



---

*Source: 4408288-2022-07-13.xml*