METHOD AND ARRANGEMENT FOR PROBABILISTIC PITCH MEASURING

Abstract: A method and an arrangement are described by means of which a pitch in a signal (s(t)) can be determined. In fact the probability density function (pdf) of the pitch is determined as a function of frequency. A pitch can then be derived from this probability density function. First a frequency spectrum A(f) is derived from a signal portion situated in a specific time interval T. Then, the probability contribution (K 1i , K 1j , ...) is determined for a number of frequency components (f i , f j , ...), stating the relative probability that a pitch at a frequency (f₁) is the result of a frequency component (f i , f j , ...). The probability contributions (K 1i , K 1j , ...) are multiplied by one another to obtain a probability density (K f1 ). This procedure is iterated for successive frequencies (f₂, ...) to obtain at least a second probability density. The probability densities K f1 , K f2 , ... are each a measure of the relative probability that a pitch occurs at the frequencies f₁, f₂, ..., respectively. The probability density function (pdf) from which one or more pitches can be derived can be determined from the computed probability densities (K f1 , K f2 ,...).

Description: The invention relates to a method of determining a pitch in a signal, deriving from the signal a probability density function of the pitch as a function of frequency and subsequently determining the pitch from the probability density function, as well as an arrangement for implementing the method. Such a method and arrangement are known from the publication "An optimum processor theory for the central formation of the pitch of complex tones" by J.L. Goldstein, J.A.S.A., Vol. 54, No. 6 (1973), pp. 1496-1516. It is a known fact that persons are able to recognise different pitches in a complex tone. Experiments have shown that pitch is a non-deterministic, subjective magnitude which is to be modelled stochastically. For a sine tone the probability density function of the experienced pitch is unimodal. This is to mean that no more than one maximum is found in the curve. This probability density function can be modelled as a Gaussian curve having a mean value corresponding with the frequency of the sine tone and a specific standard deviation σ. For a complex tone the situation is more complicated. Persons are able to perceive two kinds of pitches in a complex tone, depending on whether they perceive the sound as a whole (synthetic listening) or listen to the individual partial tones (analytic listening). In the case of synthetic listening we may hear pitches that correspond with frequencies that do not occur in the signal. These virtual pitches are described by a multimodal probability density function. If one takes, for example, a complex tone constituted by two sines having frequencies of 1200 Hz and 1400 Hz, one will not only perceive a pitch of 200 Hz (basic tone) but also pitches at 173 Hz and 236 Hz. In this case the probability density function is trimodal, thus has three maximums. This perceptive behaviour is described among other things by the model for pitch perception proposed by Goldstein in his aforementioned article. Goldstein's model is based on a stochastic formulation predicting the multimodal probability density function of the perceived virtual pitch. In his model each spectral component in the perceived signal is represented by a stochastic variable which has a Gaussian probability density function having a mean value corresponding with the frequency of the spectral component. The standard deviation of the probability density function is a free parameter of the model which function only depends on the spectral frequency. In Goldstein's model, when a complex tone is presented, a sample is determined from each Gaussian probability density function. With these samples a pattern recognizing means performs an estimate of the (lacking) basic tone. This process then results in a multimodal probability density function of the virtual pitch. Although the model can reasonably well be employed for describing the virtual pitch in signals, it does have several serious disadvantages. For example, the probability density function can only be computed for signals constituted by no more than two sines. For signals constituted by more than two sines the probability density function can be determined only by means of a Monte Carlo simulation. The model can further be used only for determining the probability density function if one knows in what octave the pitch is located. It is an object of the invention to provide a method as well as an arrangement which is able to compute the probability density function of the (virtual) pitch for compound signals and requires little computation time for determining this probability density function. One or more pitches of the signal together with their associated standard deviations can then be derived from the probability density function. For this purpose, the method is characterized in that: (a) from a signal portion located in a specific time interval a frequency spectrum is derived from the signal portion located in the time interval, which frequency spectrum is constructed from samples situated at essentially equidistant frequency values in a specific first frequency interval, (b) for a frequency value f₁ situated in a second frequency interval a probability contribution K 1i is determined, being a magnitude which is the result of the presence of a frequency component in the frequency spectrum at f i , (c) the step (b) is iterated at least once to obtain at least a second probability contribution K 1j , due to the presence of at least a second frequency component in the frequency spectrum at f j , (d) at least the two probability contributions K 1i , K 1j are multiplied by one another to obtain a probability density K f1 , (e) the steps (b), (c) and (d) are iterated to obtain at least a second probability density K f2 , in that the probability densities K f1 , K f2 , ... are each a measure of the relative probability that a pitch occurs at the frequency f₁, f₂, ..., respectively, and in that the probability contributions K 1i , K 1j , ... are each a measure of the relative probability that a pitch at the frequency f₁ is the result of a frequency component or the frequency component f i , f j , ... respectively, (f) from the thus obtained probability densities K f1 , K f2 , ... a probability density function of the pitch is derived as a function of frequency, from which probability density function a pitch is derived. The method may further be characterized in that for determining the probability contribution K 1i a probability density function G(f, f i , σ i ) is derived, having a mean value situated at frequency f i and a standard deviation σ i , this probability density function being a representation of the human perception of a tone having the frequency f i , in that from this probability density function G(f, f i , σ i ) a second probability density function G' n (f, f i /n, σ in ) is derived, having a mean value f i /n and a standard deviation σ in , n being an integer and selected such that f i /n is nearest to f₁, and in that K 1i is essentially taken to be equal to G n '(f₁, f i /n, σ in ). According to this method use is made of subharmonics of the spectral components in the signal, a stochastic representation for these subharmonics being used to obtain the probability contribution. The arrangement for implementing the method, comprising an input terminal for receiving the signal, is characterized in that the input terminal is coupled to an input of a frequency analysis unit arranged for obtaining a frequency spectrum of the signal portion situated in the time interval, in that an output of the frequency analysis unit is coupled to an input of a unit arranged for determining the probability contributions K 1i , K 1j , ..., K 2i , K 2j , ... and for transferring the probability contributions to an output coupled to an input of a multiplier unit, in that the multiplier unit is arranged for computing the probability densities K f1 , K f2 , ... from the respective probability contributions K 1i , K 1j , ... and K 2i , K 2j , ..., which probability densities K f1 , K f2 , ... are transferred to an output, in that this output is coupled to an input of a pitch determining means for determining a pitch from the probability density function pdf obtained from the probability densities K f1 , K f2 . The invention will be further explained with reference to the descriptions and on the basis of the following drawing Figures in which: Fig. 1 shows, plotted against time, the signal in the time interval, Fig. 2 shows the frequency spectrum of the signal, Fig. 3 shows the computation of the probability contribution K 1i , Fig. 4 shows two examples of the probability density function pdf of the pitch plotted against frequency, Fig. 5 shows a further example of the second probability density function, and Fig. 6 shows an arrangement for implementing the method. Fig. 1 shows a signal plotted against time. A speech signal may be concerned here. This is not necessary. The signal may also be, for example, a musical signal, because man can also have a pitch perception with musical signals. The signal situated in a specific time interval T is sampled and digitized and, subsequently, the sampled and digitized signal is subjected to a Fourier transform, for example, a digital Fourier transform or fast Fourier transform. Fig. 2 shows the frequency spectrum A(f) obtained from the Fourier transform. In fact, the frequency spectrum is not a continuous curve, but is constituted by frequency samples for frequency values m.Δf, where Δf = 1/T and m varies from 1 to M, M being equal to,for example, 512 or 1024. In fact, M depends on the rate f s at which the signal s(t) is sampled, that is: M = T/2 fs . Then, in Fig. 3a, a frequency value f₁ is taken to be situated in a second frequency zone TG. The frequency zone TG need not of necessity be situated in the frequency zone in which the frequency spectrum A(f) for the signal has been determined. Now the probability contribution K 1i is determined. The meaning of the concept of probability contribution will be explained hereinbelow. The probability contribution K 1i is a result of the presence of a frequency component at the frequency f i in the spectrum A(f). If f₁ were situated in the frequency range of the spectrum A(f), f₁ need not of necessity coincide with one of the frequency components m.Δf in the spectrum. The manner in which K 1i is determined will also be explained hereinbelow. Now the probability contribution K 1j will be determined for the same frequency f₁. This probability contribution is a result of the presence of a frequency component at the frequency f j in the spectrum A(f). This is represented in Fig. 3b. Determining K 1j is effected in the same manner as determining K 1i (cf. below). Determining the probability contribution for the frequency f₁ may be continued by taking into account a third and possibly even more frequency components f k , f l , ... (not shown) also situated in the frequency spectrum A(f). The significance of the probability contributions may be explained as follows. The probability contributions K 1i , K 1j ,... may be considered a measure of the relative probability that a pitch at the frequency f₁ is the result of a frequency component at the frequency f i , f j , ... respectively. Let us assume, by way of example, that no more than two probability contributions K 1i and K 1j have been determined and that K 1i = 0.2 and K 1j = 0.1. This implies that the probability that a pitch at the frequency f₁ is the result of the frequency component at f i is twice as large as the probability that the pitch at the frequency f₁ is the result of the frequency component at f j . The frequency components f i , f j need not of necessity be successive frequency components in the spectrum A(f). It is alternatively possible to include only those frequency components from the frequency spectrum that have a large amplitude, since it may be assumed that the frequency components that have a large amplitude will most affect the probability contributions for a pitch situated at the frequency f₁. The probability contributions K 1i and K 1j are multiplied by one another and, if more probability contributions K 1k , K 1l ... had been determined (or will yet be determined), also multiplied by K 1k , K 1l ... and so on. The obtained product K f1 is termed a probability density. The connotation of the concept of probability density will be explained hereinbelow. The procedure set out above will now be iterated for a second frequency f₂ situated in the second frequency zone TG. The probability contribution K 2i will be determined. The probability contribution K 2i is again the result of the presence of a frequency component at f i in the spectrum A(f). This is represented in Fig. 3c. A further explanation is to follow hereinbelow. No less than a second probability contribution K 2j and possibly even more probability contributions K 2k , K 2l , ... etc. will be determined. Now again the probability contributions are multiplied by one another to obtain the product (the probability density) K f2 . For determining the probability contributions for the frequency f₂, preferably the same frequencies f i , f j , ... etc. are taken as those used for determining the probability contributions for the frequency f₁. However, this is not strictly necessary. The procedure can be iterated for still further frequencies f₃, f₄, ... etc., situated in the interval TG in order to obtain the probability densities K f3 , K f4 . The significance of the probability densities may be explained as follows. The probability densities K f1 , Kf₂, ... may be considered a measure of the relative probability that a pitch occurs at the respective frequencies f₁, f₂. Let us assume, for example, that no more than two probability densities K f1 and K f2 have been determined and that K f1 = 0.02 and K f2 = 0.01. The meaning of this is that the probability that a pitch occurs at the frequency f₁ is twice as large as the probability that a pitch occurs at the frequency f₂. It should be observed in this context that the order of the steps set out hereinbefore may be changed when necessary. Alternatively, it is possible to carry out several steps more or less in parallel. For example, first all probability contributions K 1i , K 1j , ... K 2i , K 2j , .. etc. may be determined and subsequent to this the probability densities K f1 , K f2 etc. Needless to observe that it is equally possible to first compute the probability density K f1 after the probability contributions K 1i , K 1j have been determined, before proceesing to determine the probability contributions K 2i , K 2j , ... etc. All products K f1 , K f2 , K f3 , ... etc. can now be plotted against frequency in Fig. 4a. So doing, after normalizing the surface underneath the obtained curve to 1, one will obtain the probability density function pdf of the pitch as a function of frequency. The pitch can now be derived from this probability density function pdf. For example, the absolute maximum in the curve can be determined. The frequency at which this maximum occurs can then be considered the pitch f t of the signal. The surface referenced O₁ may also be considered the probability that the frequency f t is the pitch of the signal. A further possibility is to determine the surfaces O₁, O₂, O₃ (see Fig. 4a) underneath the pdf curve which are situated between each pair of adjacent relative minimums in the curve. The largest surface can then be determined. The frequency at which the maximum situated between the corresponding pair of minimums occurs may then be taken to be the pitch. The surface will then correspond with the probability that the frequency found is the pitch of the signal. Subsequently, a new signal may be included and the procedure described hereinbefore may be iterated in its entirety for this new signal. In this manner the pitch variation of the signal as a function of time may be determined. Fig. 4b shows a possibly different result for the probability density function pdf. In this Figure it is evident that there are two distinct peaks in the curve, situated at the frequencies f t1 and f t2 . This could mean that the signal has two pitches at these frequencies f t1 and f t2 . The determination of the probability contribution K 1i will now be further explained. In order to determine the probability contribution K 1i , see Fig. 3a, we assume a stochastic representation of the spectral component at the frequency f i . This is shown in Fig. 3a by means of the Gaussian curve G(f, f i , σ i ). These Gaussian curves are known from literature, see the publication by Goldstein mentioned previously. The mean value is situated at the frequency f i . The standard deviation σ i belonging to such Gaussian curves are extensively discussed in, i.a. the publication entitled "Frequency difference limens for short duration tones" by B.C.J. Moore in JASA 54 (1973), PP. 610-619. Based on the Gaussian curve G(f, f i , σ i ) the curve G n (f, f i /n, σ in ) is now determined. For this purpose the subharmonic of f i is determined which is closest to the frequency f₁. This is the frequency f i /n, n being an integer. A numerical example: assuming that f i = 1200 Hz and f₁ = 145 Hz. The subharmonic closest to 145 Hz has a frequency of 150 Hz. This means that n = 8, because 1200/8 is 150 Hz. The curve G n (f, f i /n, σ in ) is again a Gaussian curve having a mean value equal to the subharmonic frequency f i /n and a standard deviation σ in , which may be determined as follows: σ in = σ i /(n) α with α≦ 1, being a free parameter in the model as a result of which the model can be fitted to psychoacoustic data. The surface underneath Gaussian curve G n is equal to 1. The Gaussian curve G n is then scaled by a factor (β) n , where β ≦ 1 and is a free parameter or worded differently: G n '= (β) n .G n . The probability contribution K 1i can now be derived from the curve G n '(f, f i /n, σ in ). for that matter, K 1i is now equal to G n '(f₁, f i /n, σ in . The Gaussian curves G taken as a basis may be pre-scaled by an amplitude factor H(A(f i )). This amplitude factor then in fact indicates to what extent the probability contribution K 1i depends on the amplitude of the frequency component at f i . The further probability contributions may be derived in the same way. Fig. 5 shows a different possibility for the Gaussian curve G n '(f, f i /n, σ in ) referenced G n ''(f, f i /n, σ in ) here. For frequencies below f O and above f b the Gaussian curve is shown here by means of a broken line. the Gaussian curve is smaller than a specific threshold value D. In order to determine the probability contribution K 1i for these frequencies the Gaussian curve G n '' is assumed to be equal to the threshold D. Thus, if the position of f₁ is as shown in Fig. 5, K 1i will be equal to D. The threshold value is a free parameter in the model. Fig. 6 shows an arrangement for implementing the method. The signal s(t) of Fig. 1 is applied to an input terminal 1. This terminal is coupled to an input 2 of a unit 3. The unit 3 derives the samples from the signal portion s(t) situated in the time interval T. Through output 4 the samples are applied to input 5 of an analog-to-digital converter 6, where the samples are digitized. The digitized samples are applied through output 7 to the input 8 of a frequency analysis unit 9. The analysis unit 9 determines the frequency spectrum A(f), compare Fig. 2. Through the output 10 this frequency spectrum is applied to a second unit 12. In the unit 12 the probability contributions K 1i , K 1j , ... K 2i , K 2j , ...are determined, compare Fig. 3. Through the output 13 these probability contributions are applied to the input 14 of a multiplication unit 15 in which the probability contributions are multiplied by one another in order to obtain the probability density function pdf, compare Fig. 4. This probability density function pdf is applied through the output 16 to the input of a pitch determining means 18 where the pitch f t is derived from the probability density function pdf. Through the output 19 this pitch is applied to the output terminal 20 of this arrangement. By letting the arrangement process the signal in consecutive time intervals, at output terminal 20 the pitch of the signal will develop as a function of time. It should be observed that the invention is not restricted to that which has been described hereinbefore with reference to the drawing Figures. The invention likewise applies to the exemplary embodiments that differ from the embodiments discussed as regards items not relating to this invention.

Claims: Method of determining a pitch in a signal, deriving from the signal a probability density function of the pitch as a function of frequency and subsequently determining the pitch from the probability density function, characterized in that: (a) from a signal portion located in a specific time interval a frequency spectrum is derived from the signal portion located in the time interval, which frequency spectrum is constructed from samples situated at essentially equidistant frequency values in a specific first frequency interval, (b) for a frequency value f₁ situated in a second frequency interval a probability contribution K 1i is determined, being a magnitude which is the result of the presence of a frequency component in the frequency spectrum at f i , (c) the step (b) is iterated at least once to obtain at least a second probability contribution K 1j , due to the presence of at least a second frequency component in the frequency spectrum at f j , (d) at least the two probability contributions K 1i , K 1j are multiplied by one another to obtain a probability density K f1 , (e) the steps (b), (c) and (d) are iterated to obtain at least a second probability density K f2 , in that the probability densities K f1 , K f2 ... are each a measure of the relative probability that a pitch occurs at the frequency f₁, f₂, ..., respectively, and in that the probability contributions K 1i , K 1j , ... are each a measure of the relative probability that a pitch at the frequency f₁ is the result of a frequency component or the frequency component f i , f j , ... respectively, (f) from the thus obtained probability densities K f1 , K f2 , ... a probability density function of the pitch is derived as a function of frequency, from which probability density function a pitch is derived. Method as claimed in claim 1, characterized in that for determining the probability contribution K 1i probability density function G(f, f i , σ i ) is derived, having a mean value situated at frequency f i and a standard deviation σ i , this probability density function being a representation of the human perception of a tone having the frequency f i , in that from this probability density function G(f, f i , σ i ) a second probability density function G' n (f, f i /n, σ in ) is derived, having a mean value f i /n and a standard deviation σ in , n being an integer and selected such that f i /n is nearest to f₁, and in that K 1i is essentially taken to be equal to G' n (f₁, f i /n, σ in ). Method as claimed in Claim 2, characterized in that for those frequencies for which the second probability density function G n '(f, f i /n, σ in ) is smaller than a specific threshold value, the second probability density function G n ' is assumed to be equal to this threshold value. Method as claimed in Claims 1, 2 or 3, characterized in that each time the size of the surface underneath the probability density function of the pitch between pairs of frequency values for which the probability density function has (relative) minimums separated by a single maximum therebetween is determined and in that the frequency at this maximum for which the corresponding surface is largest is taken to be a pitch for the signal. Arrangement for implementing the method according to any one of the preceding Claims, comprising an input terminal for receiving the signal, characterized in that the input terminal being coupled to an input of a frequency analysis unit arranged for realising a frequency spectrum of the signal portion located in the time interval, the arrangement further comprises probability contribution determining means for determining the probability contributions K 1i , K 1j , ... K 2i , K 2j ,... and for applying the probability contributions to an output, the latter being coupled to an input of multiplication means in that the multiplication means is arranged for computing the probability densities K f1 , K f2 , ... from the probability contributions K 1i , K 1j and K 2i , K 2j respectively, which probability densities K f1 , K f2 are applied to an output, in that this output is coupled to an input of a pitch determining means for determining a pitch from the probability density function pdf obtained from the probability densities K f1 , K f2 . Arrangement as claimed in Claim 5 for implementing the method as claimed in Claim 2 or 3, characterized in that the second unit is arranged for deriving the probability density function G(f, f i , σ i ) and for deriving from this probability density function the second probability density function G n '(f, f i /n, σ in ) and is arranged for deriving K 1i being essentially equal to G n '(f₁, f i /n, σ in ).

Inventors: BEERENDS, JOHN GERARD, BEERENDS, JOHN GERARD, C/O INT. OCTROOIBUREAU B.V.
Applicants: N.V. PHILIPS' GLOEILAMPENFABRIEKEN
Application year: 1990
Main classification: G01H3
IPC codes: G01H3, G10L11