Methods and graphical user interfaces for displaying balance and correlation information of signals

The present invention relates to a method of displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal. According to the present invention, the method of displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal comprises the operations of obtaining a balance signal of the first channel signal and the second channel signal, obtaining a correlation signal of the first channel signal and the second channel signal, and displaying the balance signal and the correlation signal on a single scale. The present invention may be implemented in any number of ways including a method, a computer program product, a computer-readable medium containing a program code according to the method, a graphical user interface and a computer system.

FIELD OF THE INVENTION

This invention relates to the field of displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal. The invention relates more specifically to methods of displaying balance and correlation information, to computer program products configured to execute on a data processing device having a processor and a memory, said computer programs providing for a display of balance and correlation information of at least a pair of first channel signals and a second channel signal, graphical user interfaces for displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal and data processing systems including such graphical user interfaces.

BACKGROUND

When working with signals of at least a pair of a first channel and a second channel, in particular when working with audio signals with more than one channel, e.g. stereo, quadraphonic or surround signals, it is often important to track the correlation between the signals of the different channels. This is for example of importance when one has to check mono-compatibility of a stereo-audio signal that is intended for airplay. Another aspect that is of interest with stereo and/or multi-channel signals is the level balance between the signals of the different channels.

Existing applications for displaying audio data (e.g. computer software applications and dedicated hardware such as music synthesizers) provide numerous tools for displaying audio data. In particular, the display of the relation of energy of two signals of two different stereo-audio channels, i.e. the display of a balance of a first channel and a second channel signal, is well known.

However, there is a need for a method and apparatus for displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal in a way that an intended sonic impression can be judged only on the basis of such an advanced display.

SUMMARY OF THE DESCRIPTION

At least certain embodiments of the present invention provide for a method and an apparatus, a computer program product and a data processing system displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal according to a sensual impression that normally can only be achieved by e.g. listening to these signals in order to facilitate the judgment of the balance and correlation information of these signals.

The present invention thus relates to a method of displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal. The present invention may be implemented in any number of ways including a method, a computer program product, a computer-readable medium containing a program code according to the method, a graphical user interface and a data processing system.

Thus, the present invention in a first embodiment relates to a method of displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal, the method comprising:

obtaining a balance signal of the first channel signal and the second channel signal;

obtaining a correlation signal of the first channel signal and the second channel signal;

displaying the balance signal and the correlation signal on a single scale.

In a preferred embodiment, the scale is a normalized scale displayed within a single window or portion of the same window which can be moved or closed or minimized as a single window.

Preferably, a balance indicator is generated and displayed on the normalized scale corresponding to a value of the balance signal to be displayed.

It is further preferred, in at least certain embodiments, to generate and display a correlation range indicator on the normalized scale, the correlation range indicator being coupled to the balance indicator, the width of the correlation range indicator equals the length of the normalized scale x (1-value of correlation signal), wherein in case the width of the correlation range indicator exceeds the length of the normalized scale, the exceeding ends of the widths of the correlation range indicator are folded back at the ends of the normalized scale and wherein the width of the correlation range indicator covers the same percentage of the length of the normalized scale from the balance indicator to either end of the normalized scale. The folded back parts of the widths of the correlation range indicator are preferably displayed in a contrast or alarm color, e.g. in red.

Preferably, in at least certain embodiments, obtaining the balance signal comprises detecting a running average of the first channel signal, detecting a running average of the second channel signal, comparing the detected running average of one of the first and second signal with the running average of both first and second channel signals, and calculating the normalized balance signal on the basis of the comparison.

Preferably, in at least certain embodiments, obtaining the correlation signal comprises detecting a running average of the first channel signal, detecting a running average of the second channel signal, detecting a running average of the product of the first channel signal and the second channel signal, comparing the detected running averages, and calculating the normalized correlation signal on the basis of the comparison, whereby more recent parts of the detected running averages of the first and second channel signals get higher weightings while older parts get more and more reduced weightings.

Most preferably, in at least certain embodiments, the first channel signal and the second channel signal are audio signals.

Several pairs of first and second channel signals are preferably provided, in at least certain embodiments, defining a matrix corresponding to an arrangement of several channels according to surround audio format, whereby several balance and correlation signals are displayed on several scales corresponding to several pairs of first and second channel signals.

DETAILED DESCRIPTION

FIG. 1illustrates an example of the method of displaying balance and correlation information of at least a pair of a first channel signal and a second channel signal according to an embodiment of the invention.

At least certain embodiments of the present invention combine displaying a balance signal and a correlation signal in a single, compact and easy-to-understand scale.

In operation S1, a balance signal of the first channel signal and the second channel signal is obtained. In operation S2, a correlation signal of the first channel signal and the second channel signal is obtained. Finally, in operation S3, the balance signal and the correlation signal is displayed on a single display. This display is preferably carried out graphically on computer display means.

The balance signal and the correlation signal are obtained by using the following average-values floating in time:
A11=Avrg(s1*s1)
A22=Avrg(s1*s2)
A12=Avrg(s1*s2)
s1being the momentary amplitude of the first channel signal, s2being the momentary amplitude of the second channel signal and Avrg being an average floating in time.

The correlation signal with a range [−1; +1] is calculated as follows:
C=sqrt(C2) forC2≧0
or
C=−sqrt(−C2) forC2<0
with:
C2=A12*|A12|/(A11*A22)

The balance signal B01with a range [0; 1] is calculated as follows:
B01=A22/(A11+A22)
The value of B01being 0.0 if s1is active and s2is mute, the value of B01being 0.5 if the intensity of s1is the same as the intensity of s2, and the value of B01being 1.0 if s1is mute and s2is active.

For internal calculations, the balance signal B01with a range [0; 1] may be converted to a balance signal B with a range [−1; +1]:
B=−1.0+2.0*B01
The value of B being −1.0 if s1is active and s2is mute, the value of B being 0.0 if the intensity of s1is the same as the intensity of s2, and the value of B being +1.0 if s1is mute and s2is active.

According to the above, the values of A11, A22and A12are used for calculating the correlation signal as well as the balance signal.

FIG. 2illustrates an example of a method of obtaining the balance signal of operation S1in greater detail according to a preferred embodiment of the inventions.

In operation S1-1, a running average of a first channel signal is detected. In operation S1-2, a running average of the second channel signal is detected. The detections of operations S1-1and S1-2preferably take place simultaneously in one embodiment.

In operation S1-3, the detected running average of one of the first and second channel signals is compared with the running average of both first and second channel signals and a normalized balance signal is calculated on the basis of this comparison according to the equations above.

In the procedure according toFIGS. 1 and 2, the balance of the first channel signal and the second channel signal is determined and the balance signal is obtained based on the relation of the energy of the two signals. If the channels have the same energy, the balance is centered.

FIG. 3illustrates operation S2ofFIG. 1, i.e. obtaining a correlation signal, in greater detail according to a preferred embodiment of the invention.

In operation S2-1, the running average of the first channel signal is detected. In operation S2-2, the running average of the second channel signal is detected. In operation S2-3the running average of the product of the first channel signal and the second channel signal is detected.

The detection of operations S2-1, S2-2and S2-3can be conducted simultaneously, and in particular simultaneously with the detection of operations S1-1and S1-2(seeFIG. 2) in one embodiment.

In operation S2-4, the running average of the first channel signal is compared with the running average of the second channel signal and the running average of the product of the first channel signal and the second channel signal. Furthermore, the running averages of the first channel signal, the second channel signal and the running average of the product of the first channel signal and the second channel signal are rated, whereby more recent parts of the detected running averages get higher weights which are used in a weighted averaging process, while older parts get more and more reduced weights. Then, a normalized correlation signal is calculated on the basis of this comparison according to the equations above.

FIG. 4illustrates an example of a method of displaying the balance signal and the correlation signal according to operation S3inFIG. 1in greater detail according to a preferred embodiment of the invention.

According toFIG. 4, in operation S3-1a normalized balance signal is provided and forwarded in order to generate a balance indicator on the basis of the normalized balance signal in operation S3-2.

Parallel thereto, in operation S3-3, the normalized correlation signal is provided and forwarded in order to generate a correlation range indicator in operation S3-4.

In operation S3-5, the balance indicator and correlation range indicator are displayed on a single scale. The preferred simultaneous display is such that the same time axis is used for both indicators so that on any given point the balance and the correlation are shown juxtaposed.

The single scale is preferably a normalized scale with a length ranging from −1 to 1, −1 representing the balance signal being completely determined by the first channel signal, 1 representing the balance signal being completely determined by the second channel signal and 0 representing the balance signal being to the same extent determined by the first and second channel signals. The balance indicator is generated and displayed on this normalized scale corresponding to a value of the balance signal to be displayed.

The correlation range indicator is also generated and displayed on the same normalized scale and it is preferably coupled to the balance indicator.

The correlation range indicator preferably has a width that equals the length of the normalized scale x (1-value of correlation signal), wherein in case the width of the correlation range indicator exceeds the length of the normalized scale, the exceeding ends of the width of the correlation range indicator are folded back at the ends of the normalized scale, and wherein the width of the correlation range indicator covers the same percentage of the length of the normalized scale from the balance indicator to either end of the normalized scale. The folded back parts of the widths of the correlation range indicator are preferably displayed in a contrast or alarm color, e.g. in red. The value of the correlation signal is normalized with a range of −1 to 1, −1 representing equal shape of the first channel signal and the second channel signal, but different signs of the signals, 0 representing no similarity of the first channel signal and the second channel signal at all and 1 representing equal shape of the first channel signal and the second channel signal regardless of the levels of the signals.

FIG. 5illustrates a graphical user interface for displaying balance and correlation information according to an embodiment of the invention.

According toFIG. 5, the graphical user interface of the invention comprises means for obtaining a balance signal3of a first channel signal1and of a second channel signal2, means for obtaining a correlation signal4of the first channel signal1and the second channel signal2, and display means5with a single scale displaying the balance signal and the correlation signal on the single scale. These means may be either software based or hardware-only based structures.

FIG. 6illustrates the means for obtaining the balance signal3and means for obtaining the correlation signal4in greater detail according to a preferred embodiment of the invention. Preferably, the means for obtaining the balance signal3and the means for obtaining the correlation signal4can be realized in a single unit with the features as illustrated inFIG. 6.

According toFIG. 6, this unit comprises detection means61for detecting the running average of a first channel signal, detection means62for detecting the running average of the second channel signal and detection means63for detecting the running average of the product of the first channel signal and the second channel signal. Comparator and calculating means64are provided for comparing the detected running averages, and for comparing the detected running averages.

The comparator and calculating means64carry out these comparisons on the basis of the data inputted to the comparator and calculating means64from the detection means61, the detection means62and the detection means63, and calculate the normalized balance signal on the basis of the respective comparison and calculate the normalized correlation signal on the basis of the respective comparison, whereby more recent parts of the detected running averages of the first and second channel signal get higher weights while older parts get more and more reduced weights.

FIGS. 7ato7fshow a display of the balance signal and the correlation signal on a single scale according to an embodiment of the invention.

FIGS. 7ato7fdiffer from each other in the value of correlation (ranging from +0.9 inFIG. 7ato −1.0 inFIG. 7f).

The display ofFIG. 7ahas a single normalized scale70with a length running from −1 to 1, −1 representing the balance signal being completely determined by the first channel signal, 1 representing the balance signal being completely determined by the second channel signal and 0 representing the balance signal being to the same extent determined by the first and second channel signals.

This normalized scale70basically corresponds to a balance meter with its direct correspondence to the sound placement according to the balance signal, but it also incorporates the display of the correlation signal providing for a similar relationship to the sound location, i.e. strongly correlated signals on two channels (correlation close to +1) cause a sharply located virtual sound source between, for example, stereo speakers, while mostly uncorrelated signals (correlation close to 0) produce a blurred sonic impression. Therefore, the display ofFIG. 7ashows a correlation with a value of +1 as a sharp correlation range indicator, values close to 0 as a correlation range indicator with a “blurred area”. Negative correlations produce unnatural (but still blurred) sonic impressions and are therefore indicated as “blurred area” with a contrast-colored “problem indicator” in form of the folded back parts of the correlation signal/correlation range indicator.

InFIGS. 7ato7f, a balance indicator71is shown, generated and displayed on the normalized scale70corresponding to a value of the balance signal to be displayed. All the examples inFIGS. 7ato7fshow a scenario, where the first channel is louder than the second channel. Therefore, the balance marker is positioned closer to the first channel, i.e. closer to −1 on the normalized scale70.

In at least certain embodiments, a correlation range indicator72is generated and displayed on the normalized scale corresponding to a value of the correlation signal, and it is coupled to the balance indicator as shown inFIGS. 7athrough7f. The width of the correlation range indicator equals the length of the normalized scale x (1-value of correlation signal), wherein in case the width of the correlation range indicator exceeds the length of the normalized scale (which is the case in the examples ofFIGS. 7eandf), the exceeding ends of the width of the correlation range indicator73are folded back at the ends of the normalized scale70.

Furthermore, in all examples according toFIGS. 7ato7f, the width of the correlation range indicator72,73covers the same percentage of the length of the normalized scale70from the balance indicator71to either end of the normalized scale70.

The value of the correlation signal is represented by the width of the correlation range indicator72,73and in one embodiment is normalized with a range of −1 to 1, wherein the value of −1 represents equal shape of the first channel signal and the second channel signal, but different signs of the signals, and the value of 0 represents no similarity of the first channel signal and the second signal at all and the value of 1 represents equal shape of the first channel signal and the second channel signal regardless of the levels of the signals.

The width of the correlation range indicator represents the sonic impression. For example, in case the width of the correlation range indicator is rather small (for example inFIG. 7a), the sonic impression would be sharply located with a virtual sound source located between the first channel and the second channel. In case the width of the correlation range indicator grows with the correlation approaching 0 (seeFIGS. 7bto7d), this corresponds to an increasingly blurred sonic impression.

InFIGS. 7eand7f, the width of the correlation range indicator exceeds the length of the normalized scale70. This results in a display, where the ends of the correlation range indicator73are folded back at the ends of the normalized scale70. This is the case with correlation values smaller than 0.0. Since negative correlations are mostly undesired, these folded back parts of the correlation range indicator73can be displayed in a different color, for example they can be displayed as red areas.

As mentioned, the first channel signal and the second channel signal are preferably audio signals, such as audio stereo signals.

However, for multi-channel audio signals, a matrix of multiple pairs of first and second channel signals can be combined, so that multiples of scales corresponding to pairs of first and second channel signals are arranged according to the actual speaker positions. Several pairs of first and second channel signals are preferably provided, defining a matrix corresponding to an arrangement of several channels according to a surround audio format, whereby several balance and correlation signals are displayed on several scales corresponding to several pairs of first and second channel signals. A typical set-up with six pairs of first and second channel signals and six corresponding scales corresponding to an arrangement of six channels according to 5.1 surround audio format is shown inFIG. 8. Even though only six pairs of the five non-LFE channels in 5.1 are shown, it will be understood that embodiments of the invention are not to be restricted to six pairs and embodiments may incorporate and display more than these six pairs. E.g. with the channels L, R, C, Ls and Rs combinations could be L-C, R-C, L-R, L-Ls, R-Rs, Ls-Rs, L-Rs, Ls-R, Ls-C, Rs-C.

The small dark marks represent the balance indicator of each pair of channels, while the light grey areas represent the width of the correlation range indicators of each pair of channel signals. The spotlight-like highlighted area positioned slightly out of the center indicates the overall balance of the surround signal. Additionally (but not shown inFIG. 8), the brightness of each scale can be adapted according to the relative energy of the two channels of the respective scale compared to the overall energy, so that the balance/correlation of more important channel pairs gets displayed brighter, whilst the soft or even silent channel pairs are displayed darker.

FIG. 9illustrates a data processing system such as a computer system which may include a graphical user interface as discussed above. The computer system comprises a screen95on a display monitor94which is connected to a processing system91incorporating a processor and a memory such as a semiconductor memory (e.g. RAM) and/or a magnetic memory (e.g. a hard drive97). The computer system also includes a mouse93and a keyboard92, both connected electrically to the processing system.

On the screen95, the graphical user interface98according to the present invention is shown.

The processing system91includes, in one embodiment, system computer software for controlling the computer system. The software also includes control of the graphical user interface. The software may be downloaded from a server through a network or stored on an optical media, such as CD-ROM96.

A result of at least certain embodiments of the invention may be a data file, created through one of the methods described herein, which may be stored on a storage device of a data processing system. The data file may be an audio data file, in a digital format, which may be used to create sound by playing the data file on a system which is coupled to audio transducers, such as speakers.

One or more of the methods described herein may be implemented on a data processing system which is operable to execute those methods. The data processing system may be a general purpose or special purpose computing device, or a desktop computer, a laptop computer, a personal digital assistant, a mobile phone, an entertainment system, a music synthesizer, a multimedia device, an embedded device in a consumer electronic product, or other consumer electronic devices. In a typical embodiment, a data processing system includes one or more processors which are coupled to memory and to one or more buses. The processor(s) may also be coupled to one or more input and/or output devices through the one or more buses. Examples of data processing systems are shown and described in U.S. Pat. No. 6,222,549, which is hereby incorporated herein by reference.

The one or more methods described herein may also be implemented as a program storage medium which stores and contains executable program instructions for, when those instructions are executed on a data processing system, causing the data processing system to perform one of the methods. The program storage medium may be a hard disk drive or other magnetic storage media or a CD or other optical storage media or DRAM or flash memory or other semiconductor storage media or other storage devices.

The foregoing description has been given by way of example only and it will be appreciated by a person skilled in the art that modifications can be made without departing from the scope of the present invention.