Abstract:
The binaural hearing system comprises a first hearing device and a second hearing device, each comprising an output transducer for converting audio signals into signals to be perceived by a user of the hearing system; a communication link interconnecting said first and said second hearing device; and a sound generator comprised in said first hearing device for generating first audio signals; and said first hearing device is adapted to transmitting said first audio signals to said second hearing device via said communication link. Through the transmission of said generated first audio signals, it is possible to achieve a predictable latency for the perception of said first audio signals by the user&#39;s two ears.

Description:
TECHNICAL FIELD  
       [0001]     The invention relates to a binaural hearing system comprising two hearing devices, one for each ear of a user of the hearing system, and to a method of operating such a hearing system and a method of synchronization in such a hearing system. Such a hearing system is a linked pair of hearing devices. The hearing devices can be hearing aids, worn in or near the ear or implanted, headphones, earphones, hearing protection devices, communication devices or the like.  
       BACKGROUND OF THE INVENTION  
       [0002]     From EP 0 557 847 B1 a monaural hearing device is known, which comprises a signal emission device by means of which a user of the hearing device can be informed that a particular setting of the hearing device has been selected.  
         [0003]     From WO 01/30127 A2 a monaural hearing device is known, which allows to play user-defined sequences for acknowledging an action that has been carried out on the hearing device.  
         [0004]     From US 2002/0131613 A1 a binaural hearing system is known, in which audio signals obtained from digitizing output signals of a microphone of the hearing system are transmitted from one hearing device of the system to the other hearing device of the system via a communication link. Furthermore, control signals can be transmitted via said communication link. Such control signals can, e.g., be signals for controlling a signal processor of a hearing device, or signals by means of which a first of the two hearing devices acknowledges to the second hearing device that is has received a control signal that was transmitted from the second hearing device to the first hearing device. The two hearing device are synchronized by a controlled time-multiplexer unit, which is operated by a respective time control unit, wherein the two time control units are synchronized via said communication link.  
         [0005]     From DE 10 2004 035 046 A1 binaural hearing systems are known, which provide for “virtual sound sources” in the sense that system-generated sounds can be perceived by a user of the system as if they were generated in different locations near the user. Said DE 10 2004 035 046 A1 does not disclose, how to achieve the time synchronization (and timing accuracy) between the signals to be perceived by the user with his left and his right ear, respectively, which is necessary in order to predictably achieve such a virtual sound source effect.  
       SUMMARY OF THE INVENTION  
       [0006]     A goal of the invention is, to create a binaural hearing system and a method of operating a hearing system and a method of synchronization in a hearing system with enhanced possibilities for giving the user of the hearing system the impression that he perceives signals from a certain location or certain direction.  
         [0007]     One object of the invention is to provide for a binaural hearing system and a method of operating a hearing system and a method of synchronization in a hearing system with improved possibilities for synchronizing the perception of sound in the user&#39;s left and the right ear.  
         [0008]     Another object of the invention is to provide for a binaural hearing system and a method of operating a hearing system and a method of synchronization in a hearing system providing for a precisely predictable time difference between the user&#39;s perception of system-generated signals in the user&#39;s left and right ears.  
         [0009]     These objects are achieved by a binaural hearing system and by a method for operating a hearing system and by a method of synchronization in a hearing system according to the patent claims.  
         [0010]     The binaural hearing system comprises 
        a first hearing device and a second hearing device, each comprising an output transducer for converting audio signals into signals to be perceived by a user of the hearing system;     a communication link interconnecting said first and said second hearing device; and     a sound generator comprised in said first hearing device for generating first audio signals; 
 
 wherein first hearing device is adapted to transmitting said first audio signals to said second hearing device via said communication link. 
       
 
         [0014]     Through this, it is possible to achieve a rather precisely predictable time difference between the perception of signals obtained from said first audio signals in the user&#39;s left and right ears.  
         [0015]     Today, software-controlled digital hearing devices are widely used. Accordingly, commands of such a hearing device software are generated and executed along clocked threads with a certain tick period, which determines discrete points in time at which commands are executed. Such a tick period is typically of the order of 10 ms (some milliseconds to some ten milliseconds). In the case of a hearing system with two hearing devices, the threads in the two hearing devices are usually not in phase and do usually not even have a constant phase relation, and even the tick periods in the two hearing devices are usually somewhat different. This may be due to various reasons: the two hearing devices are switched on at different times; the booting of the hearing device controlling software does not take exactly the same amount of time in both hearing devices; the clock oscillators in the two hearing devices show (different) drift; the clock oscillators in the two hearing devices are (slightly) differently tuned.  
         [0016]     Accordingly, there will always be a jitter of the order of some or several milliseconds between “synchronized” commands in the two hearing devices, unless great effort is taken to create a stable phase relation between the threads of the control software of the two hearing devices. Note that such a jitter means a practically randomly occuring time difference between left and right hearing device.  
         [0017]     Thus, signals perceived by a user will, if such a jitter is present, randomly appear to arrive from random directions, to contain echo, or to stutter.  
         [0018]     In addition, particular tasks, like hearing-device-internal sound generation, may run along threads which are different from the thread of other parts of the hearing device software. The thread may even have a different tick period than the hearing device control software.  
         [0019]     All this makes it difficult or impossible to provide a hearing system user with signals (typically sound), so that these signals are perceived by the user as coming from a predictable direction. For achieving such an effect, an accuracy of some or some ten microseconds (μs) (at most maybe about 50 μs to 100 μs) is necessary, since the whole range spanning from signals being perceived as stemming from straight ahead or from the back to signals being perceived as stemming from the very left or very right of the user ranges, in terms of time delays between the left and the right side, from 0 μs to about 600 μs or 650 μs. A jitter of more than 0.5 ms or even more than 1 ms is therefore not acceptable.  
         [0020]     On the other hand, some types of processes within a hearing device are deterministic (within the desired timing accuracy), e.g., signal processing, conversion, amplification or transmission of data or signals from one hearing device to the other. The time required for such processes can be determined in advance; accordingly, they do not contribute to a (random) jitter.  
         [0021]     Accordingly, for signals, which shall be perceived by the user&#39;s ears with a minimal time jitter (of the order of magnitude of 10 μs) between left and right, only deterministic processes shall take place in each of the hearing devices after a highly synchronized origin of the signals (no jitter or below about 20 μs). Such an origin can be the generation of said signals in only one of the hearing devices.  
         [0022]     Only one stream of audio signals (acoustic sound message data) is generated (issued), by only one of the two hearing devices, and this stream is delivered, via said communication link, to the other hearing device, in which it may undergo amplification and other processing and finally presentation to the user with near-negligible latency with respect to the contralateral side. In both hearing devices, equal or similar processing of the audio signals may take place, and, if required, pre-determinable delays between the two sides may be accomplished for by introducing an according delay on the faster side.  
         [0023]     Thus, random delays from a lack of (precise) synchronization between the two sides are effectively avoided.  
         [0024]     An audio signal (or sound message) originating from a single source is presented to the user with a deterministic delay between the two sides.  
         [0025]     Typically, the invention can be used in conjunction with acknowledge signals (or other sound messages) as the signals to be perceived by the hearing device user.  
         [0026]     Acknowledge sounds, also called feedback sounds, are played to the user upon a change in the hearing device&#39;s function, e.g., when the user changes the loudness (volume) or another setting or program of one or both hearing devices, or when some other user&#39;s manipulation shall be acknowledged, or when the hearing device by itself takes an action, e.g., by making a change, e.g., if, in the case of a hearing aid, the hearing aid chooses, in dependence of the acoustical environment, a different hearing program (frequency-volume settings and the like), or when the hearing device user shall be informed that a hearing device&#39;s battery is low.  
         [0027]     Said signals to be perceived by the user are often acoustic signals (sound waves), but may be other signals as well, e.g., in the case of implanted hearing devices. The hearing devices&#39; output transducers can therefore be electro-to-mechanical converters (loudspeakers) or others, e.g., electrical-to-electrical converters.  
         [0028]     Said audio signals are usually electrical signals, analogue and/or digital.  
         [0029]     Said communication link may be wireless (typically electromagnetically; e.g., in the radio frequency range via frequency modulation, or Ultra-Wide-Band communication UWB), or wire-bound. Said communication link allows for communication at least from said first hearing device to said second hearing device, but usually allows for bidirectional communication.  
         [0030]     Said communication link may involve at least one transmitter comprised in said first hearing device and at least one receiver comprised in said second hearing device. It may, in addition, comprise at least one receiver comprised in said first hearing device and at least one transmitter comprised in said second hearing device.  
         [0031]     Said sound generator may be implemented in software or (partially) in form of hardware.  
         [0032]     Typically, said first and said second hearing devices each comprise an input transducer for receiving incoming signals and for converting said incoming signals into audio signals. Typically, such incoming signals are incoming sound, and said input transducers are mechanical-to-electrical converters (microphones), but converters receiving electromagnetical waves and converting these into audio signals are also possible (e.g., in case of a telephone coil or reception of a remote microphone signal via a frequency modulation -FM- receiver).  
         [0033]     Typically, at least one of said hearing devices, usually both (said first and said second hearing devices), each comprise a signal processor for processing audio signals.  
         [0034]     In one embodiment, the system comprises, comprised in said first hearing device, a first sound memory, which comprises a first set of data, which describe audio signals (in particular, first audio signals), and, comprised in said second hearing device, a second sound memory, which comprises a second set of data, which describe audio signals, wherein said first and second sets of data are substantially different from each other. This way, both hearing devices contain data describing (different) audio signals, and, accordingly, the required storage space in each hearing device can be (up to) halved (with respect to storing the same data in each hearing device). If, e.g., the user makes, at the second hearing device, a change, which is to be acknowledged (on both sides), and the appropriate acknowledge sound is stored in the second hearing device, and the data describing the corresponding audio signals can be transmitted to the first hearing device, the sound generator can produce the corresponding audio signal, which finally can be transmitted to the second hearing device and transduced into signals acknowledging said manipulation (on both sides). In the case that said data describe acknowledge sounds, the data sets can be considered first and second sets of acknowledge sound descriptions (or representations).  
         [0035]     In said data of said first and second sets, audio signals may be described, e.g., in a parametrized form (e.g., as a frequency to be played and a time for which it is to be played), or in a sampled form (e.g., compressed, like in MP3 format).  
         [0036]     In one embodiment, at least one of said first and said second hearing devices comprises a storage unit containing information on the contents of said first sound memory and/or of said second sound memory. By means of such a storage unit, it can be found out, without any communication between the first and the second hearing devices, whether data describing a desired sound are stored in the first or in the second hearing device. It is, e.g., possible to have in said storage unit a list of the contents of the first and of the second sound memory indicating where to find data of desired audio signals. And it is also possible to have in said storage unit a list of the contents of the sound memory of only one hearing device (which may be the hearing device containing said storage unit, or the other hearing device). In the latter case, the existence and not-existence in the list can indicate where (i.e., in which hearing device) data of the desired audio signals can be found.  
         [0037]     The storage unit may be a table or a look-up table.  
         [0038]     Accordingly, said storage unit may be considered to contain information on whether audio signals to be sent to said output transducers can be obtained from data contained in said first sound memory (i.e., in said first set of data) or from data contained in said second sound memory (i.e., in said second set of data).  
         [0039]     In one embodiment, the system furthermore comprises a second sound generator for generating second audio signals, which is comprised in said second hearing device, and wherein said second hearing device is adapted to transmitting said second audio signals to said first hearing device via said communication link. This way, both hearing devices comprise a sound generator, and sound generated in either sound generator may be transmitted to the other hearing device.  
         [0040]     Said first audio signals, and also said second audio signals, may comprise or be acknowledge sound signals. When only (sufficiently) deterministic processes are involved after the sound generation, the corresponding time delays in each hearing device can be calculated in advance, and corresponding delays may be used in order to let the user perceive the sounds in each ear with a well-defined time delay.  
         [0041]     The method for operating a hearing system comprising a first and a second hearing device and a communication link connecting the two hearing devices comprises the steps of 
        generating first audio signals in said first hearing device;     transmitting said first audio signals to said second hearing device via said communication link; and     converting, in each of the two hearing devices, said first audio signals into signals to be perceived by a user of the hearing system.        
 
         [0045]     The features of the method of synchronization in a hearing system corresponds to the features of the method for operating a hearing system. The method allows for a synchronized perception of signals to be perceived by the user in each ear.  
         [0046]     The method may furthermore comprise the steps of 
        generating second audio signals in said second hearing device; and     transmitting said second audio signals to said first hearing device via said communication link.        
 
         [0049]     In another method, wherein said first hearing device comprises a first sound memory, which comprises a first set of data, which describe audio signals (first and/or second audio signals), and said second hearing device comprises a second sound memory, which comprises a second set of data, which describe audio signals (first and/or second audio signals), and wherein said first and second sets of data are substantially different from each other, further comprises the step of 
        transmitting data from said second sound memory via said communication link to said first hearing device.        
 
         [0051]     This method, wherein at least one of said first and said second hearing devices comprises a storage unit containing information on the contents of said first sound memory and (or and/or) of said second sound memory, may further comprise the steps of 
        retrieving from said storage unit the information whether audio signals to be converted into signals to be perceived by a user of the hearing system are to be obtained from data contained in said first sound memory or from data contained in said second sound memory;     retrieving, from the appropriate sound memory, data describing the appropriate audio signals.        
 
         [0054]     If said sound memory data are contained in that one sound memory, which is located in that one hearing device, which does not comprise said storage unit, a command (control signal) can be transmitted (via said communication link) to the other hearing device (which comprises the sound memory comprising said data) in order to retrieve the desired sound memory data.  
         [0055]     The advantages of the methods correspond to the advantages of corresponding systems.  
         [0056]     Further preferred embodiments and advantages emerge from the dependent claims and the figures. 
     
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0057]     Below, the invention is described in more detail by means of examples and the included drawings. The figures show:  
         [0058]      FIG. 1 a  schematic diagram of a hearing system;  
         [0059]      FIG. 2 a  schematic diagram of a hearing system;  
         [0060]      FIG. 3 a  block diagram of a method of operating a hearing system. 
     
    
       [0061]     The reference symbols used in the figures and their meaning are summarized in the list of reference symbols. Generally, alike or alike-functioning parts are given the same or similar reference symbols. The described embodiments are meant as examples and shall not confine the invention.  
       DETAILED DESCRIPTION OF THE INVENTION  
       [0062]      FIGS. 1 and 2  show schematic diagrams of hearing systems  1 . A hearing system  1  comprises two hearing devices  10 L and  10 R, which may be similarly or identically structured. The hearing device  10 L of  FIGS. 1 and 2  may comprise some more elements, in particular such, which are only drawn in the first hearing device  10 R.  
         [0063]     In the  FIGS. 1 and 2 , audio signals (audio data streams) are drawn as solid arrows; control signals or data are represented by dashed arrows. Not all possible signal flows are indicated, but only some, which are required to explain the invention.  
         [0064]     The hearing devices  10 R, 10 L comprise controllers or control softwares  15 L, 15 R. For normal operation, the hearing devices  10 L, 10 R comprise input transducers  11 L, 11 R, typically microphones, which convert incoming sound  5  into audio signals (analogue and/or digital electrical signals). These audio signals may be processed in signal processors  13 L, 13 R, preferably digital signal processors (DSP), and are possibly amplified in amplifiers  14 L, 14 R before being converted into signals  7 , 8  to be perceived by a user of the hearing system  1  by output transducers  12 L, 12 R, typically loudspeakers.  
         [0065]     In  FIG. 1 , a user interface  16 R, a sound generator  17 R and a transmitter Tr of hearing device  10 R are drawn. Hearing device  10 L comprises a receiver Re.  
         [0066]     Although drawn as separate units, the DSP  13 R and the amplifier  14 R may be integrated within the same software or electrical unit. In addition, also the controller or control software  15 R may be integrally formed with DSP  13 R and/or amplifier  14 R. The hearing device controlling software  15 L, 15 R may be implemented in a separate processor, but does not have to. The same applies for the corresponding elements of the hearing device  10 L.  
         [0067]     In  FIG. 1 , it is sketched, how a concurrent or (practically) jitter-free perception by the user of an acknowledge sound, e.g. upon a volume change in hearing device  10 R, can be achieved.  
         [0068]     The user manipulates the user interface  16 R in order to change the volume (loudness) of signals  7 , 8  he perceives (typically the loudness in both hearing devices shall be changed). This generates a control signal, whereupon the sound generator  17 R is instructed by the controller  15 R to generate an appropriate sound message (acknowledge signal), which is referred to as first audio signals  30 . The first audio signals  30  are, on the one hand, fed to the output transducer  12 R (e.g., via DSP  13 R and amplifier  14 R, or directly, or in between the two) to be converted into signals  7  to be perceived by the user, and on the other hand, fed to the transmitter Tr of the hearing device  10 R. Instead of adding the first audio signals  30  to audio signals obtained from incoming sound  5 , they may as well replace those audio signals.  
         [0069]     By means of a communication link  20  involving the transmitter Tr of hearing device  10 R and the receiver Re of hearing device  10 L, the first audio signals  30  are made available in the hearing device  10 L, where they are, in analogy to the hearing device  10 R, converted into signals  8  to be perceived by the user.  
         [0070]     It is possible to foresee a delay unit in the signal path (at least in the hearing device  10 R), which allows for compensating and/or introducing time delays between the two hearing devices  10 L, 10 R. For example, if processing (and amplifying) steps are the same for the first audio signals  30  in both hearing devices  10 L, 10 R, the only step causing a time delay between the two hearing devices is the transmission of the first audio signals  30  via the communication link  20 . For encoding (in transmitter Tr), transmitting and decoding (in receiver Re), a pre-determinable delay of the order of, e.g., some milliseconds is introduced, which may have a jitter of the order of some microseconds to 10 μs or 30 μs. This delay can by compensated by such a delay unit. And additional delays between both sides (typically of the order of some 10 μs to some 100 μs) can be willingly introduced in order to simulate that the perceived signal  7 , 8  originates from a certain (predetermined) direction.  
         [0071]     Of course, in order to improve such a simulation (virtual sound source), the (first) audio signals may be processed using Head-Related Transfer Functions (HRTF) in the sense that not only interaural time differences (ITD) are applied as described above, but also interaural level differences (ILD), or, more generally speaking, frequency dependent interaural amplitude and phase differences.  
         [0072]      FIG. 2  shows, in the manner of  FIG. 1 , a schematic diagram of another hearing system  1 . The embodiment is similar to the one of  FIG. 1 , and mainly the additional or different features will be described.  
         [0073]     Both hearing devices  10 L, 10 R comprise a sound memory  18 L, 18 R, in each of which a set of data describing audio signals (e.g., acknowledge sounds and/or speech sounds) are contained. For example, the sound memory  18 R may contain (data describing) acknowledge sounds, which are to be played when the volume is increased, when the volume is decreased, or when the battery level is low, whereas in the sound memory  18 L, (data describing) acknowledge sounds may be stored, which acknowledge a change from one hearing program to another hearing program.  
         [0074]     Furthermore, both hearing devices  10 L, 10 R contain storage units  19 L, 19 R, by means of which the respective controller  15 L, 15 R can find out, whether a desired audio signal is stored in the sound memory  18 L of the hearing device  10 L or in the sound memory  18 R of hearing device  10 R.  
         [0075]     Both hearing devices comprise a transmitter Tr and a receiver Re each, thus enabling a bidirectional communication link  20 .  
         [0076]     In  FIG. 2 , it is sketched, how a concurrent or (practically) jitter-free perception by the user of an acknowledge sound, e.g. upon a volume change in hearing device  10 L, can be achieved.  
         [0077]     The user manipulates the second hearing device&#39;s user interface  16 L. This is noted by the controller  15 L. The controller checks the storage unit (table, LUT)  19 L and finds out, that the appropriate acknowledge sound (first audio signals  30 ) is not stored in the sound memory  18 L, but in the sound memory  18 R of the contralateral hearing device  10 R. Thereupon, a control signal is transmitted via the second hearing device&#39;s transmitter Tr and the first hearing device&#39;s receiver Re to the second hearing device&#39;s controller  15 R. The controller  15 R ensures that the requested data  40  representing (describing) the requested first audio signals  30  are loaded from the sound memory  18 R and that the requested audio signals  30  are generated. The requested audio signals  30  are fed towards the output transducer  12 R and, in addition, transmitted to the second hearing device  10 L via the communication link  20 , from where it is transmitted to the output transducer  12 L  
         [0078]     Of course, also the second hearing device  10 L may comprise a sound generator.  
         [0079]     In conjunction with one sound memory or with sound memories  18 L, 18 R, at least the following embodiments are possible: 
        only the first hearing device  10 R comprises a sound generator  17 R, and only the first hearing device  10 R comprises a sound memory  18 R;     only the first hearing device  10 R comprises a sound generator  17 R, and only the second hearing device  10 L comprises a sound memory  18 R (this requires always the transmission of data from hearing device  10 L to hearing device  10 R when a stored audio signal is to be played);     only the first hearing device  10 R comprises a sound generator  17 R, and both hearing devices  10 L, 10 R comprise a sound memory  18 L, 18 R;     both hearing devices  10 L, 10 R comprise a sound generator  17 L, 17 R, and only the first hearing device  10 R comprises a sound memory  18 R;     both hearing devices  10 L, 10 R comprise a sound generator  17 L, 17 R, and both hearing devices  10 L, 10 R comprise a sound memory  18 L, 18 R.        
 
         [0085]     Depending on where data are stored and where they are generated, data and/or audio signals have to be transmitted via the communication link  20 .  
         [0086]     It is possible to foresee a storage unit  19  in only one hearing device instead of in both.  
         [0087]      FIG. 3  shows a block diagram of a simple method of operating a hearing system  1 . The steps  100 - 300  are self-explaining.  
         [0088]     The invention enables for a deterministic (predictable) latency and negligible jitter for signals to be perceived by the user&#39;s two ears.  
         [0089]     The invention is particularly useful, when speech signals or more complex sounds are to be generated and presented to the user. The complexity of a sound may manifest in its (large) spectral content, its structure in time or rhythmic or percussive structure. Speech sounds may be used for guiding the user, informing the user and acknowledging events in the hearing system. Requirements for latency and jitter are less tough for simple sounds, like sine tones that fade in and fade out.  
         [0000]     List of Reference Symbols  
         [0090]     An appended “R” in a reference symbol indicates that the respective element is part of the first hearing device  10 R; an appended “L” in a reference symbol indicates that the respective element is part of the second hearing device  10 L. 
     1  hearing system, binaural hearing system      5  incoming sound, sound waves      7  signals to be perceived by a user of the hearing system (from the first hearing device  10 R)      8  signals to be perceived by a user of the hearing system (from the second hearing device  10 L)      10  hearing device      11  input transducer, microphone      12  output transducer, loudspeaker      13  signal processor, digital signal processor, DSP      14  amplifier      15  controller, control software, control part of hearing device software, hearing device controlling software      16  user interface      17  sound generator      18  sound memory      19  storage unit, table, lookup table      20  communication link      30  first audio signals      40  data describing first audio signals      100 , 200 , 300  steps     LUT lookup table     Tr transmitter     Re receiver