Patent Publication Number: US-10776422-B2

Title: Dual sound source audio data processing method and apparatus

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
     This application is a continuation of International Patent Application No. PCT/CN2017/103106, filed on Sep. 25, 2017, which claims priority from Chinese Patent Application No. 201610852918.8, filed with the Chinese Patent Office on Sep. 27, 2016 and entitled “DUAL SOUND SOURCE AUDIO DATA PROCESSING METHOD AND APPARATUS”, the disclosures of which are incorporated by reference herein in their entirety. 
    
    
     BACKGROUND 
     1. Field 
     The present disclosure relates to the field of computer information processing technologies, and specifically to a dual sound source audio data processing method and apparatus. 
     2. Description of Related Art 
     People expect more fun from music with the popularity of multimedia devices. In addition to listening to single music, remixed music and medley songs are also popular. 
     SUMMARY 
     It is an aspect to provide a dual sound source audio data processing method and apparatus and a non-volatile computer readable storage medium that may make two songs having a same accompaniment but sung differently be automatically synthesized. 
     According to an aspect of one or more example embodiments, there is provided a method. The method includes obtaining audio data of a song pair including a first song and a second song, the first and second songs having a same accompaniment audio but different voice audio. The audio data is decoded to obtain first mono audio data corresponding to the first song and second mono audio data corresponding to the second song. The first and second mono audio data are combined to one piece of two-channel audio data including a left audio channel and a right audio channel. A play time of the two-channel audio data is divided into play periods, and energy suppression is selectively performed on the left audio channel and the right audio channel in different play periods 
     According to other aspects of one or more example embodiments, there is also provided an apparatus and computer readable medium consistent with the method. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       Example embodiments are described below with reference to the accompanying drawings, in which: 
         FIG. 1  is a schematic scenario diagram of a dual sound source audio data processing method according to an embodiment; 
         FIG. 2  is a schematic flowchart of a dual sound source audio data processing method according to an embodiment; 
         FIG. 3  is a schematic flowchart of a method of obtaining a same-origin song pair according to an embodiment; 
         FIG. 4  is a schematic flowchart of a method of filtering an accompaniment of an initially selected song pair according to an embodiment; 
         FIG. 5( a )  and  FIG. 5( b )  is a schematic diagram of a lyrics file of a same-origin song pair according to an embodiment; 
         FIG. 6  is a schematic diagram of an accompaniment file of a same-origin song pair according to an embodiment; 
         FIG. 7  is a schematic structural diagram of a dual sound source audio data processing apparatus according to an embodiment; 
         FIG. 8  is a schematic structural diagram of a dual sound source audio data processing apparatus according to an embodiment; 
         FIG. 9  is a schematic structural diagram of an obtaining module of an audio data processing apparatus according to an embodiment; and 
         FIG. 10  is a schematic diagram of hardware structure of a dual sound source audio data processing apparatus according to an embodiment. 
     
    
    
     DETAILED DESCRIPTION 
     The following further describes this application in detail with reference to the accompanying drawings and the embodiments. It may be understood that, the specific embodiments described herein are merely illustrative, but are not limited to the description herein. In addition, it should be noted that, for ease of description, the accompanying drawings only show parts relevant to the related exemplary embodiment. 
     In the following description, the specific embodiments are described with reference to steps and symbols of operations performed by one or more computers, unless otherwise stated. As such, it will be understood that such steps and operations, which are at times referred to as being computer-executed, include the manipulation by the processing unit of the computer of electrical signals representing data in a structured form. This manipulation converts the data or maintains the location of the data in a memory system of the computer, which can be reconfigured, or otherwise a person skilled in this art changes the way of operation of the computer in a well-known manner. The data structure maintained in the physical location of the data in the memory has specific properties defined by the data format. However, the principle of the present disclosure described in the foregoing text does not lead to a limitation. A person skilled in the art may understand that the various steps and operations described below may also be implemented in hardware. 
     A term “module” used in the specification may be regarded as a software object executed in the calculation system. Different components, modules, engines, and services described in the specification may be regarded as objects implemented in the calculation system. The apparatus and method described in the specification is preferably implemented in a form of software, and definitely can be implemented in a form of hardware, both of which fall within the protection scope of the present disclosure. 
     Embodiments provide a dual sound source audio data processing method and apparatus. 
     In the embodiments, two songs having a same accompaniment but sung differently are used as a same-origin song pair. Two pieces of mono audio data are obtained by decoding audio data of the same-origin song pair, the two pieces of mono audio data are combined to one piece of two-channel audio data, play time corresponding to the two-channel audio are divided to multiple play periods, and energy suppression are performed on a left audio channel or a right audio channel of the two-channel audio in different play periods, so that an effect that the two songs having a same accompaniment but sung differently are sung alternately is achieved. The embodiments provide a novelty solution that music is automatically synthesized, to provide a new function for a computer device. Both lyrics information and accompaniment information of the two songs used for synthesizing is the same. Therefore, an obtained audio is relatively gentle, no abrupt sense is generated thereof, and a comfortable listening effect is achieved. Moreover, regardless of the same-origin song pair is obtained or the audio data is processed, both are performed in background on a user terminal side. A user selects a synthesized audio on a user terminal to play, and does not need to manually select the same-origin song pair and process the audio data, so that an operation on the user terminal is simplified, and a processing resource of the user terminal is saved. In addition, compared with a manner that a music work is recorded by being sung live by a singer, the embodiments have advantages of low costs and high synthetic efficiency. 
     Referring to  FIG. 1 ,  FIG. 1  is a schematic scenario diagram of a dual sound source audio data processing method according to an embodiment. The scenario may include an audio data processing apparatus running in a server  200 , and the audio data processing apparatus is referred to as an audio processing apparatus  300  and mainly configured to obtain audio data of a same-origin song pair, where the same-origin song pair includes two songs having a same accompaniment but sung differently. Then, the audio data of the same-origin song pair are separately decoded, to obtain two pieces of mono audio data. Afterwards, the two pieces of mono audio data are combined to one piece of two-channel audio data. Finally, play time corresponding to the two-channel audio are divided to multiple play periods, and energy suppression is performed on a left audio channel or a right audio channel of the two-channel audio in different play periods, to obtain processed audio data. 
     In addition, the scenario may further include a song database  100 . The song database stores a large quantity of pieces of song information, where accompaniment files, lyrics files and audio data corresponding to songs are included. The audio processing apparatus  300 , according to lyrics files and accompaniment files of songs in the database  100 , filters out a same-origin song pair including two songs having a same accompaniment but sung differently. Certainly, the scenario may further include a user terminal  400  such as a mobile phone or a tablet computer. The user terminal includes an input apparatus (such as a keyboard or a mouse) and an output apparatus (such as a screen and a power amplifier). A user selects audio data processed by the audio processing apparatus  300  by activating the input apparatus, and plays the processed audio data by using an output apparatus. 
     Detailed descriptions are provided below separately. 
     In this embodiment, from points of view of the audio processing apparatus, the audio processing apparatus may specifically integrated on a network device such as a server or a gateway, to implement the dual sound source audio data processing method. The network device such as the server or the gateway may be a computer device. 
     This embodiment provides a dual sound source audio data processing method, including: obtaining audio data of a same-origin song pair, the same-origin song pair including two songs having a same accompaniment but sung in different manners; separately decoding the audio data of the same-origin song pair, to obtain two pieces of mono audio data; combining the two pieces of mono audio data to one piece of two-channel audio data; and dividing play time corresponding to a two-channel audio to multiple play periods, and performing the energy suppression on a left audio channel or a right audio channel of the two-channel audio in different play periods. 
     Referring to  FIG. 2 ,  FIG. 2  is a schematic flowchart of a dual sound source audio data processing method according to an embodiment. The method includes the following steps: 
     S 201 : Obtain audio data of a same-origin song pair. 
     The same-origin song pair includes two songs having a same accompaniment but sung differently. The sung differently means singers are different or singing languages are different. In this embodiment, a same-origin song pair may include two songs obtained after a same song is sung in different languages by a same singer, for example, “Red Rose” sung in Mandarin and “White Rose” sung in Cantonese by Eason Chan. The “Red Rose” and the “White Rose” sung in different singing languages but having a same accompaniment may be used as the same-origin song pair. In another embodiment, the same-origin song pair may also include two songs obtained after a song is sung by different singers. For example, Megan Nicole and Alex both have sung a song “Maps”, and the song “Maps” sung by Megan Nicole and the song “Maps” sung by Alex may be used as the same-origin song pair. In conclusion, two songs using a same accompaniment but sung differently in the song database are found to form a song pair. 
     S 202 : Separately decode the audio data of the same-origin song pair, to obtain two pieces of mono audio data. 
     S 203 : Combine the two pieces of mono audio data to one piece of two-channel audio data. 
     S 204 : Divide play time corresponding to a two-channel audio to multiple play periods, and perform energy suppression on a left audio channel or a right audio channel of the two-channel audio in different play periods. 
     Specifically, the play time corresponding to the two-channel audio includes time information of each sentence of lyrics. In this embodiment, the time information may be a start time and an end time of each sentence of lyrics. Alternatively, the time information may also be a start time and duration of each sentence of lyrics. Specifically, the play time may be divided to multiple play periods according to the time information of each sentence of lyrics, where a quantity of play periods are consistent with sentences included in the lyrics, so that an effect that a song is sung alternately by two types of sound is achieved. The lyrics may also be divided to multiple paragraphs, and the play periods are divided with reference to the paragraphs of the lyrics. That is, one or more lyrics sentences are used as a paragraph, a start time of each sentence of lyrics in the paragraph is used as a start time of the play period, and an end time corresponding to a last sentence of the lyrics in the paragraph is used as an end time of the play period, to implement an effect that a song is sung alternately by two types of sound. 
     Energy suppression is performed on the left audio channel and the right audio channel on the two-channel audio alternately in different play periods. In this embodiment, suppression may be performed alternately on the left audio channel and the right audio channel in different play periods; or energy suppression may be performed separately on the left audio channel or the right audio channel with reference to a preset rule. For example, a same audio channel is suppressed in continuous multiple play periods, or suppression is not performed on both of the left audio channel and the right audio channel in some play periods, or energy suppression is performed on the left audio channel or the right audio channel only in partial time of a play period. The energy suppression is performed on the left audio channel or the right audio channel only in partial time of a play period, so that it is achieved that a song part corresponding to a same play period is sung alternately by two types of sound. For example, sound A sings the former part of a lyrics sentence, sound B sings the latter part of the lyrics sentence. 
     A specific method of performing the energy suppression on an audio in any play period includes the following steps: 
     In a preset time period before a play period is entered, a fade-out effect is performed on an audio channel on which energy suppression is to be performed. In the play period, audio collection points of the audio channel on which energy suppression is to be performed are all set to be 0. In a preset time period after the play period is exited, the fade-out effect is performed on the audio channel. 
     Further, after step S 204  is performed, processed audio data may further be presented to a user, so that the user can listen to the audio. 
     Referring to  FIG. 3 ,  FIG. 3  is a schematic flowchart of a method of obtaining a same-origin song pair according to an embodiment. The method includes the following steps: 
     S 301 : Obtain song information of a candidate song pair, where the song information includes lyrics files and accompaniment files corresponding to two songs. 
     After song information of the candidate song pair is obtained, a song pair list may be established according to the song information of the candidate song pair. Specifically, the song information of the candidate song pair may be obtained by using the method in the following embodiment. 
     In an embodiment, all songs having a same song name but sung by singers having different names are searched in a song database, all the obtained songs are combined into pairs each having two songs, so that the candidate song pair is obtained, and the song information of the candidate song pair is extracted. 
     For example, all songs having a song name “Love” are searched in QQ Music library, and a search result includes “Love” sung by Little Tigers, “Love” sung by Karen Mok, and “Love” sung by TFBOYS. According to a rule of combining songs into pairs each having two songs, the “Love” sung by Little Tigers and the “Love” sung by Karen Mok may be used as a candidate song pair, the “Love” sung by Little Tigers and the “Love” sung by TFBOYS may be used as a candidate song pair, and the “Love” sung by Karen Mok and the “Love” sung by TFBOYS may be used as a candidate song pair. 
     In another embodiment, songs marked with a language label are searched in all songs of a same singer, where the language label includes a song name and a language version. One of the songs marked with the language label and another song corresponding to the song name in the language label are used as a candidate song pair, and song information of the candidate song pair is obtained. 
     For example, in a song list of a singer Eason Chan, a language label of a song “White Rose” is found to be “Red Rose” of a Cantonese version, so that the “White Rose” and the “Red Rose” corresponding to the language label may be used as a candidate song pair. 
     S 302 : Perform lyrics filtering on the candidate song pair, according to the lyrics files of the two songs in the candidate song pair, and if the lyrics files of the two songs in the candidate song pair are the same, determine that the candidate song pair is an initially selected song pair. 
     Specifically, lyrics of the candidate song pair may be filtered by using the following method. 
     First, the lyrics files of the two songs in the candidate song pair are parsed separately, to obtain a lyrics sentences quantity of each song and time information corresponding to each sentence of lyrics, where the time information may include a start time and an end time of each sentence of lyrics. Alternatively, the time information may also include a start time of each sentence of lyrics and duration that the lyrics being sung. Then, whether the lyrics sentences quantities in the two songs are the same are determined, and if not, a corresponding candidate song pair is abandoned, or if yes, lyrics sentences of the two songs are made to one by one, to determine whether the time information of the corresponding lyrics sentences in the two songs is the same, and if it is different, the corresponding candidate song pair is abandoned, or if it is the same, the candidate song pair is used as the initially selected song pair. 
     S 303 : Perform accompaniment filtering on the initially selected song pair, according to the accompaniment files of the two songs in the initially selected song pair, and if the accompaniment files of the two songs in the initially selected song pair are the same, determine that the initially selected song pair is the same-origin song pair. 
     Referring to  FIG. 4 , an accompaniment of the candidate song pair may be filtered by the following method. 
     S 401 : Separately extract accompaniment files of the two songs in the initially selected song pair, where the accompaniment file includes at least an accompaniment audio and accompaniment time corresponding to the accompaniment audio. 
     S 402 : Make accompaniment audios having same accompaniment time in the two songs one by one, to form at least one accompaniment pair. 
     S 403 : Separately process the two accompaniment audios of each accompaniment pair, to obtain two binary sequences having a same length and corresponding to the accompaniment pair, calculate a matching probability of the two binary sequences, determine whether the matching probability is greater than a preset value, and if yes, determine that the two accompaniment audios of the accompaniment pair are the same. 
     A specific method of determining whether the two accompaniment audios of the accompaniment pair are the same includes: separately performing Fourier transform on the two accompaniment audio data, to generate two spectrums; equally dividing the two spectrums to same quantities of frequency bands, separately calculating an average energy value of each frequency band in each spectrum, comparing sizes of each frequency band and a previous frequency band, and expressing a comparison result in a binary system, to obtain a binary sequence corresponding to the spectrum; calculating a matching probability of the two binary sequences, where the matching probability is 
               m   n     ,         
n represents a total quantity of digits in the binary sequences, and m represents a quantity of digit positions at which the two binary sequences have identical digits, determining whether the matching probability is greater than a preset value, and if yes, determining that the two accompaniment audios of the accompaniment pair are the same.
 
     S 404 : Determine whether the two accompaniment audios of each accompaniment pair are the same, and if yes, determine that the initially selected song pair is the same-origin song pair. 
     S 304 : Obtain audio data of the two songs corresponding to the same-origin song pair. 
     The audio data of the two songs forming the same-origin song pair is obtained from a song database. 
     The manner shown in  FIG. 3  is merely one of multiple methods of obtaining the same-origin song pair, and should not be understood as to limit the present disclosure. 
     According to the method described in a first embodiment, the following further provides detailed descriptions by using an example. 
     This embodiment divides the dual sound source audio data processing method to two main aspects, where one aspect is about filtering the same-origin song pair, and another aspect is about synthesizing the audio data of the same-origin song pair. The two aspects are separately described below with reference to an example. 
     The same-origin song pair is formed by two songs having a same accompaniment but sung differently. Filtering the same-origin song pair is that, two songs having a same accompaniment but sung differently are found and combined into pairs each having two songs. 
     In this embodiment, candidate song pairs may be found in a song database when the same-origin song pair is filtered, so that a song pair list is established. Searching for a candidate song in the song database may be performed by using the following methods. 
     A first method is to, in a song list of a same singer, check whether a song has a language label. For example, a language label of a song “White Rose” is “Red Rose” of a Cantonese version, so that the “White Rose” and the “Red Rose” may be used as a candidate song pair, and are separately recorded as a song x and a song y. 
     A second method is to search all songs having a same song name but sung by singers having different names in a song database, and combine all the obtained songs into pairs each having two songs. For example, “Love” sung by Little Tigers, “Love” sung by Karen Mok and “Love” sung by TFBOYS are combined into pairs each having two songs, to obtain three candidate song pairs, and two songs of each candidate song pair are separately recorded as a song x and a song y. 
     For all candidate song pairs found in the foregoing embodiment, it is uncertain that a same accompaniment is used. For example, “Love” sung by Little Tigers and “Love” sung by Karen Mok have a same title, but they are not a same song. Therefore, it is uncertain that a condition that the accompaniment is the same is met and accompaniments of the candidate song pairs are to be filtered. The following is a description of specific steps of filtering the accompaniments by using the “White Rose” and the “Red Rose” sung by Eason Chan as an example. 
     For songs x and y, corresponding lyrics files x 1  and y 1  are separately found in a song database, where a format of the lyrics files may specifically include lyrics corresponding to the songs, and time information corresponding to each sentence of lyrics. The time information may be a start time and an end time of each sentence of lyrics, and may be a start time and duration of each sentence of lyrics. As shown in  FIG. 5( a )  and  FIG. 5( b ) ,  FIG. 5( a )  and  FIG. 5( b )  separately shows lyrics files of the “White Rose” and the “Red Rose”. A format of the lyrics file is that, the start time is in the front of each line and corresponding lyrics are in the back of each line, and time information corresponding to each sentence of lyrics may be obtained by parsing the lyrics files. As shown in  FIG. 5 , except for a song name and information of a lyrics writer and a composer, a start time of a first sentence of the lyrics of the “Red Rose” and a first sentence of the lyrics of the “White Rose” is both [00:16.28], and an end time is both [00:18.65]. The first sentence of the lyrics of the “Red Rose” is represented by “aaaaaaaaa” and the first sentence of the lyrics of the “White Rose” is represented by “bbbbbbbbb”, and other lyrics sentences are represented by “xx . . . ”. By means of similarity matching, if lyrics sentences corresponding to the two songs are the same and both a start time and an end time of each sentence of lyrics are the same, it is determined that the songs x and y meet a lyrics filtering condition, and a candidate song pair including the songs x and y may be used as an initially selected song pair and enters accompaniment filtering of the next turn. On the contrary, the candidate song pair is deleted from the song pair list. 
     An accompaniment of the initially selected song pair is filtered. A common song has several relatively long parts having no lyrics and in which only an accompaniment is played, such as a prelude, an interval of two paragraphs and an end part, and a lyrics file of the accompaniment part only displays time information without lyrics, as content in a line box shown in  FIG. 6 . In the song “Red Rose”, there are four parts displaying only time but having no lyrics, and according to this feature, it can be directly parsed that the song only has an accompaniment in the part of [00:08.61]-[00:16.28]. It is assumed that the songs x and y use a same accompaniment, the two songs tend to be the same at the parts having no lyrics (because an amount of energy and encoding/decoding may both affect an accompaniment part, it has a relatively low probability that the accompaniment parts are totally the same). Based on this theory, comparison of audios of the songs x and y may be performed. In this embodiment, specific steps for comparing audios of the songs x and y is as follows: 
     selecting audios only having time information but having no lyrics in lyrics files corresponding to the songs x and y, for example, four accompaniment parts may be selected from the “Red Rose”, and the audios are respectively x i  i∈(1,4) and y i  i∈(1,4). Because lyrics filtering have been performed, it may be determined when i is determined, time of x i  and y i  is the same. Because a processing manner of each pair of x i  and y i  is the same, only x 1  and y 1  are used as an example subsequently; 
     separately decoding x 1  and y 1  to an 8k16 bit audio; 
     performing Fourier transform by using 1024 collection points as a frame length, and using 32 collection points as a frame shift, to obtain a spectrum; 
     equally dividing a 4k spectrum to 32 frequency bands, calculating an average value for each frequency band, and using the calculated average value as energy of the frequency band; 
     comparing a size relationship between each frequency band and a frequency band corresponding to a former frame, and if a size of a frequency band is larger than that of a former frame, the size relationship is represented by 1, or if smaller, the size relationship is represented by 0, to obtain 32 bit values representing each frame, and separately performing an operation on x 1  and y 1 , to obtain two binary sequences having a same length and corresponding to x 1  and y 1 ; 
     making binary sequences of x 1  and y 1  be in one-to-one comparison, calculating a matching probability of the two binary sequences, where the matching probability may be represented as 
               m   n     ,         
n represents a total quantity of digits in the binary sequences, and m represents a quantity of digit positions at which the two binary sequences have identical digits (if digit positions at which digits in the two binary sequences are both 0 or both 1 at the same time, it is determined that the digits are the same), comparing the matching probability with a preset value k, and if the matching probability is not less than the preset value k, matching is succeed, and accompaniments x 1  and y 1  tend to be the same. Theoretically, if accompaniments x 1  and y 1  are the same, the matching probability should be 1. Because an amount of energy and encoding/decoding may both affect an accompaniment part, a preset value k is set to determine similarity of accompaniments x 1  and y 1 , and a probability that accompaniments x 1  and y 1  are the same is becoming larger if the matching probability levels off to 1, such as k=0.9.
 
     If all x i  and y i  of two songs x and y of an initially selected song pair are successful matched, accompaniments of the two songs in the initially selected song pair are the same, and the initially selected is used as a same-origin song pair. On the contrary, the initially selected song pair is deleted from a song pair list. 
     By means of lyrics filtering and accompaniment filtering, left song pairs in the song pair list are all same-origin song pairs. To achieve an effect that each pair of same-origin songs are sung by two types of sound alternately, synthesizing processing is to be performed on audio data of the same-origin song pair. For ease of description, a synthesizing processing method of a same-origin song pair including two songs x and y is described below. 
     In this embodiment, synthesizing processing steps of the songs x and y are as follows: 
     decoding the audio data of the song x and the song y to a piece of 44k16 bit mono audio data; 
     combining two pieces of mono audio data of x and y to one piece of two-channel audio data, where left and right audio channels can be randomly allocated. In this way, when listening to music by wearing a headset or a speaker, a user may find that music heard by two ears of the user has a same accompaniment but is sung differently. 
     Music synthesized by the foregoing processing is listened to be noisy, to achieve an effect of being sung alternately, time of all lyrics sentences may be divided to n time period t i  i∈(1,n) according to time stamps of lyrics information, where n is a quantity of lyrics sentences (only sentences sung are included, and information of a lyrics writer and a composer and lines of an accompaniment are not included). As “Red Rose” shown in  FIG. 5 , t 1  is ([00:16.28]-[00:18.65]), t 2  is ([00:18.65]-[00:23.53]) . . . , energy suppression is performed on a left audio channel in a t i  (i is an odd number) time period, and energy suppression is performed on a right audio channel in a t i  (i is an even number) time period. In this way, an effect that different person voices sing on the left and right audio channels alternately is achieved. In this embodiment, suppression for a t i  time period includes three steps, and a specific method is as follows (using t 1  as an example): 
     In a first step, fade-out is performed: a fade-out effect is generated one second before t 1 , a specific time period is ([00:15.28]-[00:16.28]), and a sampling rate is 44100, so that an audio on the left audio channel has 44100 collection points, an energy value is k i  i∈(1,44100) in this second, and a new energy value after the fade-out is performed is 
     
       
         
           
             
               
                 p 
                 i 
               
               = 
               
                 
                   
                     k 
                     i 
                   
                   * 
                   
                     ( 
                     
                       44100 
                       - 
                       i 
                     
                     ) 
                   
                 
                 44100 
               
             
             ; 
           
         
       
     
     In a second step, all collection points in t 1  time period [00:16.28]-[00:18.65] are set to be 0; 
     In a third step, fade-in is performed: a fade-in effect is generated one second after k i  i∈(1,44100), a specific time period is ([00:18.65]-[00:19.65]), and a sampling rate is 44100, so that an audio on the left audio channel has 44100 collection points, an energy value is k i  i∈(1,44400) in this second, and a new energy value after the fade-in is performed is 
     
       
         
           
             
               
                 p 
                 i 
               
               = 
               
                 
                   
                     k 
                     i 
                   
                   * 
                   i 
                 
                 44100 
               
             
             ; 
           
         
       
     
     In an embodiment, two songs having a same accompaniment but sung differently are used as a same-origin song pair. Two pieces of mono audio data are obtained by decoding audio data of the same-origin song pair, and the two pieces of mono audio data are combined to one piece of two-channel audio data. Play time corresponding to the two-channel audio are divided into multiple play periods, and energy suppression are performed on a left audio channel or a right audio channel of the two-channel audio in different play periods, so that an effect that the two songs having a same accompaniment but sung differently are sung alternately is achieved. This embodiment provides a novelty solution that music is automatically synthesized, to provide a new function for a computer device, and the solution has advantages of low costs and high synthesizing efficiency. 
     To implement the dual sound source audio data processing method according to the embodiments, an embodiment further provides a dual sound source audio data processing apparatus. Nouns have meanings the same as that in the foregoing processing method of the audio data, and for specific implementation details, reference may be made to the description in the method embodiments. 
     Referring to  FIG. 7 ,  FIG. 7  is a schematic structural diagram of a dual sound source audio data processing apparatus according to an embodiment. The apparatus includes an obtaining module  500  and a processing module  600 . 
     The obtaining module  500  is configured to obtain audio data of a same-origin song pair. 
     The processing module  600  includes a decoding submodule  610 , a combination submodule  620  and a processing submodule  630 . The decoding submodule  610  is configured to separately decode the audio data of the same-origin song pair, to obtain two pieces of mono audio data; the combination submodule  620  is configured to combine the two pieces of mono audio data to one piece of two-channel audio data; and the processing submodule  630  is configured to divide play time corresponding to a two-channel audio to multiple play periods, and perform energy suppression on a left audio channel or a right audio channel of the two-channel audio in different play periods. 
     The same-origin song pair includes two songs having a same accompaniment but sung differently. In this embodiment, the same-origin song pair may include two songs obtained after a same song is sung by a same singer in different languages, or may include two songs obtained after a same song is sung by different singers. Referring to  FIG. 8 , the obtaining module  500  used to obtain the same-origin song pair specifically includes an obtaining submodule  510 , a lyrics filtering submodule  520  and an accompaniment filtering submodule  530 . The obtaining submodule  510  is configured to obtain song information of a candidate song pair, where the song information includes lyrics files and accompaniment files corresponding to the two songs; the lyrics filtering submodule  520  is configured to perform lyrics filtering on the candidate song pair, according to the lyrics files of the two songs in the candidate song pair, and if the lyrics files of the two songs in the candidate song pair are the same, determine that the candidate song pair is an initially selected song pair; and the accompaniment filtering submodule  530  is configured to perform accompaniment filtering on the initially selected song pair, according to the accompaniment files of the two songs in the initially selected song pair, and if the accompaniment files of the two songs in the initially selected song pair are the same, determine that the initially selected song pair is the same-origin song pair. 
     The lyrics file is lyrics sentences in a song and time information of each sentence of lyrics and the accompaniment file is the part including only music but having no lyrics and is not sung. 
     Referring to  FIG. 9 ,  FIG. 9  is a schematic structural diagram of an obtaining module  500  of an audio data processing apparatus according to an embodiment. 
     In a possible implementation, the obtaining submodule  510  may include a first obtaining unit  511  and a second obtaining unit  512 ; the first obtaining unit  511  is configured to search all songs having a same song name and sung by singers having different names in a song database, and combine all the obtained songs into pairs each having two songs, to obtain a candidate song pair; the second obtaining unit  512  is configured to search songs marked with a language label in songs of a same singer, where the language label includes a song name and a language version, and use one of the songs marked with the language label and another song corresponding to the song name in the language label as the candidate song pair. The lyrics filtering submodule  520  may include a parsing unit  521  and a lyrics filtering unit  522 , where the parsing unit is configured to separately parse lyrics files of the two songs in the candidate song pair, to obtain a quantity of lyrics sentences of each song and time information corresponding to each sentence of lyrics, where the time information includes a start time and an end time of each sentence of lyrics; and the lyrics filtering unit is configured to determine whether the quantities of lyrics sentences of the two songs in the candidate song pair are the same, and if yes, make the lyrics sentences of the two songs one by one, to determine whether the time information of the lyrics in a correspondence and in the two songs is the same, and if yes, use the candidate song pair as the initially selected song pair. The accompaniment filtering submodule  530  may include an extraction unit  531 , a mapping unit  532 , an accompaniment filtering unit  533  and a determining unit  534 . The extraction unit  531  is configured to separately extract the accompaniment files of the two songs in the initially selected song pair, where the accompaniment files includes at least an accompaniment audio and accompaniment time corresponding to the accompaniment audio; the mapping unit  532  is configured to make accompaniment audios having same accompaniment time in the two songs one by one, to form at least one accompaniment pair; the accompaniment filtering unit  533  is configured to separately process the two accompaniment audios of each accompaniment pair, to obtain two binary sequences having a same length and corresponding to the accompaniment pair, calculate the matching probability of the two binary sequences, determine whether the matching probability is greater than a preset value, and if yes, determine that the tow accompaniment audios of the accompaniment pair are the same; and the determining unit  534  is configured to determine whether the two accompaniment audios of each accompaniment pair are the same, and if yes, determine that the initially selected song pair is the same-origin song pair. 
     In a possible implementation, the accompaniment filtering unit  533  includes a decoding subunit  5331 , a spectrum generation subunit  5332 , a conversion subunit  5333  and a calculation subunit  5334 , where 
     the decoding subunit  5331  is configured to decode the two accompaniment audios of each accompaniment pair, to obtain two pieces of accompaniment audio data; the spectrum generation subunit  5332  is configured to separately perform Fourier transform on the two pieces of accompaniment audio data, to generate two spectrums; and the conversion subunit  5333  is configured to equally divide the two spectrums to same quantities of frequency bands, separately calculate an average energy value of each frequency band in each spectrum, compare sizes of each frequency band and a previous frequency band, and express a comparison result in a binary system, to obtain a binary sequence corresponding to the spectrum; 
     the calculation subunit  5334  is configured to calculate the matching probability of the two binary sequences, where the matching probability is 
               m   n     ,         
n represents a total quantity of digits in the binary sequences, and m represents a quantity of digit positions at which the two binary sequences have identical digits, determining whether the matching probability is greater than a preset value, and if yes, determine that the two accompaniment audios of the accompaniment pair are the same.
 
     Further, in a possible implementation, the processing submodule  630  includes a division unit  631  and a processing unit  632 , where the division unit  631  is configured to divide play time of a two-channel audio to multiple play periods according to time information of each sentence of lyrics in the two-channel audio, and a quantity of play periods is consistent with a quantity of lyrics sentences; and the processing unit  632  is configured to perform energy suppression on a left audio channel and a right audio channel on the two-channel audio alternately in different play periods. 
     After dual sound source audio data is processed, obtained audio data may further be transmitted to a user terminal, and displayed to the user. 
     The dual sound source audio data processing apparatus may specifically integrated on a network device such as a server or a gateway. 
     During specific implementation, the foregoing units may be implemented as independent entities, or may be combined arbitrarily, or may be implemented as a same entity or several entities. For specific implementation of the foregoing units, refer to the foregoing method embodiments. Details are not described herein again. 
     It can be learned from the above, the dual sound source audio data processing apparatus according to this embodiment first filters two songs having a same accompaniment but sung differently in a song database as a same-origin song pair, performs decoding and combining processing of audio data of the same-origin song pair, to obtain two-channel audio data, divides play time corresponding to a two-channel audio into multiple play periods, and performs energy suppression on a left audio channel or a right audio channel of the two-channel audio in different play periods, so that an effect that a song is sung by two voices alternately is achieved. This embodiment provides a novelty music synthesizing apparatus, to provide a new function for a computer device, and the solution has advantages of high synthesizing efficiency and low costs. 
     In the foregoing embodiments, the descriptions of the embodiments have respective focuses, for the part that is not described in detail in an embodiment, reference may be made to the foregoing detailed description of the dual sound source audio data processing method, and details are not described herein again. 
     In this embodiment, an audio data processing apparatus such as a computer, a tablet computer, and a mobile phone having a touch function is provided. The audio data processing apparatus and the audio data processing method in the foregoing embodiment belong to a same conception, and any method provided in the audio data processing method embodiment may be performed on the audio data processing apparatus. A specific implementation process thereof is shown in the audio data processing method embodiment, and details are not described herein again. 
       FIG. 10  is a schematic diagram of hardware structure of a dual sound source audio data processing apparatus according to an embodiment. As shown in  FIG. 10 , the apparatus may include: one or more (only one is shown in the figure) processors  1001 , a storage medium  1002 , a bus  1003  and an interface  1004 . 
     The storage medium  1002  may be used for storing one or more computer readable instructions, such as a software program and a module, and such as a program instruction/module corresponding to a dual sound source audio data processing method and apparatus in the embodiments. The processor  1001  is connected to the storage medium  1002  by the bus  1003  and operates the software program and the module stored in the storage medium  1002 , so that various function applications and data processing are executed. That is, the audio data processing method is implemented. The storage medium  1002  may include a high-speed random memory, and may also include a nonvolatile memory such as one or more magnetic storage devices, a flash memory, or another nonvolatile solid-state memory. In some instances, the storage medium  1002  may further include memories remotely disposed relative to the processor  1001 , and these remote memories may be connected to the terminal through a network. Instances of the network include but are not limited to, the Internet, an intranet, a local area network, a mobile communications network, and a combination thereof. The interface  1004  is connected to the processor  1001  by a bus, receives an instruction of the processor  1001 , and receives data of an external device or sends data to the external device according to the instruction. 
     It should be noted that, for the dual sound source audio data processing method described in the embodiments, a person of ordinary skill in the art may understand that, implementing all or parts of procedures of the audio data processing method described in the embodiments can be completed by controlling related hardware by using a computer program, where the computer program may be stored in a computer readable storage medium, for example, being stored in a memory of the server shown in  FIG. 1 , and is executed by at least one processor in the server. An execution process may include a procedure of the embodiment of the audio data processing method. The server may be a computer device. The foregoing storage medium may include a magnetic disk, an optical disc, a read-only memory (ROM, Read Only Memory), or a random access memory (RAM, Random Access Memory). 
     Therefore, an embodiment provides a non-volatile computer readable storage medium that stores a computer program. The computer program can cause a computer to execute the step of the dual sound source audio data processing method described in the foregoing embodiment. 
     For the audio data processing apparatus in the embodiments, the functional modules thereof may be integrated into one processing chip, or each of the modules may exist alone physically, or two or more modules may be integrated into one module. The integrated module may be implemented in a form of hardware, or may be implemented in a form of a software functional module. When being implemented in the form of a software functional module and sold or used as an independent product, the integrated module may be stored in a computer readable storage medium. The storage medium is, for example, an ROM, a magnetic disk, or an optical disc. 
     A dual sound source audio data processing method and apparatus provided in the embodiments are described in detail above. The principle and implementations of the present disclosure are described herein by using specific examples. The descriptions of the embodiments are merely used for helping understand the method and core ideas of the present disclosure. In addition, a person skilled in the art can make variations to the present disclosure in terms of the specific implementations and application scopes according to the ideas of the present disclosure. Therefore, the content of the specification shall not be construed as a limit to the present disclosure or the accompanying claims.