Abstract:
A system and method to detect and remediate unacceptable levels of speech intelligibility evaluates received test audio transmitted across and received in a space or region of interest. Intelligibility is improved by altering the rate, pitch, amplitude and frequency bands energy during presentation of the speech signal.

Description:
FIELD OF THE INVENTION  
       [0001]     The invention pertains to systems and methods of evaluating the quality of audio output provided by a system for individuals in region. More particularly, within a specific region the intelligibility of provided audio is evaluated and processed to improve intelligibility.  
       BACKGROUND OF THE INVENTION  
       [0002]     It has been recognized that speech or audio being projected or transmitted into a region by an audio announcement system is not necessarily intelligible merely because it is audible. In many instances, such as sports stadiums, airports, buildings and the like, speech delivered into a region may be loud enough to be heard but it may be unintelligible. Such considerations apply to audio announcement systems in general as well as those which are associated with fire safety, building or regional monitoring systems.  
         [0003]     The need to output speech messages into regions being monitored in accordance with performance-based intelligibility measurements has been set forth in one standard, namely, NFPA 72-2002. It has been recognized that while regions of interest, such as conference rooms or office areas may provide very acceptable acoustics, some spaces such as those noted above, exhibit acoustical characteristics which degrade the intelligibility of speech.  
         [0004]     It has also been recognized that regions being monitored may include spaces in one or more floors of a building, or buildings exhibiting dynamic acoustic characteristics. Building spaces are subject to change over time as surface treatments and finishes are changed, offices are rearranged, conference rooms are provided, auditoriums are incorporated and the like.  
         [0005]     One approach has been disclosed and claimed in U.S. patent application Ser. No. 10/740,200 filed Dec. 18, 2003, entitled “Intelligibility Measurement of Audio Announcement Systems” and assigned to the assignee hereof. The &#39;200 application is incorporated herein by reference.  
         [0006]     There is a continuing need to measure certain acoustic properties within a building space so that remediation of the speech messages could be undertaken Thus, there continues to be an ongoing need for improved, more efficient methods and systems of not only measuring speech intelligibility in regions of interest, but also in being able to carry out remediation of speech messages so as to improve such intelligibility. It would also be desirable to be able to incorporate some or all of such remediation capability in a way that takes advantage of ambient condition detectors which are intended to be distributed throughout a region being monitored. Preferably, such remediation of speech messages could be incorporated into the detectors being currently installed, and also be cost effectively incorporated as upgrades to detectors in existing systems as well as other types of modules. 
     
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0007]      FIG. 1  is a block diagram of a system in accordance with the invention;  
         [0008]      FIG. 1A  is a block diagram of an audio output unit in accordance with the invention;  
         [0009]      FIG. 1B  is an alternate audio output unit;  
         [0010]      FIG. 1C  is a block diagram of an exemplary common control unit usable in the system of  FIG. 1 ;  
         [0011]      FIG. 2A  is a block diagram of a detector of a type usable in the system of  FIG. 1 ;  
         [0012]      FIG. 2B  is a block diagram of a sensing and processing module usable in the system of  FIG. 1 ;  
         [0013]      FIGS. 3A , B taken together are a flow diagram of a method in accordance with the invention;  
         [0014]      FIG. 4  is a graph of state space illustrating where remediation may be possible.  
     
    
     DETAILED DESCRIPTION OF THE EMBODIMENTS  
       [0015]     While embodiments of this invention can take many different forms, specific embodiments thereof are shown in the drawings and will be described herein in detail with the understanding that the present disclosure is to be considered as an exemplification of the principles of the invention and is not intended to limit the invention to the specific embodiment illustrated.  
         [0016]     Systems and methods in accordance with the invention, sense and evaluate audio outputs from one or more transducers, such as loudspeakers, to measure certain acoustic properties of a building space or region being monitored. The results of the analysis can be used to determine the degree to which speech messages projected into the region would be degraded by the acoustic characteristics of the space and whether remediation of such speech messages is needed.  
         [0017]     In one aspect of the invention one or more acoustic sensors located throughout a region sense and quantify incoming predetermined audible test signals for a predetermined period of time. For example, the test signals can be injected into the region for a specified time interval. An analysis of received signals as well as residual ambient sound can include establishing spectral distribution and ambient noise level. The reverberation or decay time can be determined by analyzing the trailing agents of specific test signals.  
         [0018]     In another aspect of the invention, the characteristics of the speaker and amplifier chain introducing the audio into the region can be taken into account. Characteristics including maximum attainable sound pressure level (SPL) and frequency bands present in the sensed audio can be evaluated. A determination can be made as to whether the noise and reverberant characteristics of the space would degrade the intelligibility of the speech being projected to the extent that it cannot be compensated for. Results of the determination can be made available for system operators and can be used in manual and/or automatic methods of remediation.  
         [0019]     Systems and methods in accordance with the invention provide an adaptive approach to monitoring characteristics of a space or region over time. The performance of respective amplifier and output transducer combination(s) can then be evaluated to determine if the desired level of speech intelligibility is being provided in the respective space or region.  
         [0020]     In another aspect of the invention, systems and methods are provided to improve speech intelligibility in a space or region by slowing the rate of the speech and/or concentrating the energy of the amplified speech signal in frequency bands that are most important for human comprehension. This can include independent manipulation of pitch, tempo, frequency bands and sound pressure level.  
         [0021]     In another embodiment of the invention, the frequency band energy information extracted from incoming ambient noise can be evaluated to determine if energy levels in specific frequency bands important for speech intelligibility are undesirable. Such performance-based measurements provide real time feedback as to intelligibility characteristics over time and space that may vary. The energy levels in frequency bands of interest may be acceptable, such that no remediation is required within one space configuration. However, if the space is altered, the energy levels in those particular frequency bands may be unacceptable to ensure intelligible speech.  
         [0022]     In yet another aspect of the invention, if the reverberant characteristics of the space, as measured above, are long enough, the presentation of the audio speech injected into the region can be stretched temporally an amount suitable to improve intelligibility. Devices usable in systems in accordance with the invention can incorporate one or more digital signal processors and respective modules to shape the signals temporally and spectrally before providing them to the amplifier and output transducer chain. Analysis and remediation can be provided according to any allowable system partitioning.  
         [0023]     Further in accordance with the invention, stored frequency band energy data, previously acquired can be analyzed. The energy levels in predetermined frequency bands which are important for speech intelligibility can be evaluated. If acceptable for intelligible speech, an intelligibility acceptable determination can be forwarded to an associated monitoring system.  
         [0024]     If energy levels in the predetermined frequency bands are unacceptable for intelligible speech, the frequency spectra of the speech signals can be shaped prior to presentation, using a respective programmed processor or a digital signal processor to enhance frequency bands which are important to speech recognition to improve intelligibility  
         [0025]     Thus, systems and methods in accordance herewith can improve speech intelligibility by slowing the pace thereof, adjusting the pitch thereof, adjusting the frequency spectra thereof, and/or adjusting the sound pressure level (SPL) thereof. The variation of pace, pitch, frequency and SPL can be dynamically adjusted to suit the ambient acoustical circumstances in a specific region. For example, the voice output system may exhibit one set of characteristics in a normal office environment and a different set of characteristics, reflecting changes in ambient noise levels in the space, in a circumstance where individuals are attempting to evacuate the space.  
         [0026]     Further, the present systems and methods seek to dynamically determine the acoustic properties of a monitored space which are relevant to providing emergency speech announcement messages and which satisfy performance-based standards for speech intelligibility. Such monitoring will also provide feedback as to those spaces with acoustic properties that are marginal and may not comply with such standards without acoustic remediation of the speech message.  
         [0027]      FIG. 1  illustrates a system  10  which embodies the present invention. At least portions of the system  10  are located within a region R where speech intelligibility is to be evaluated. It will be understood that the region R could be a portion of or the entirety of a floor, or multiple floors, of a building. The type of building and/or size of the region or space R are not limitations of the present invention.  
         [0028]     The system  10  can incorporate a plurality of voice output units  12 - 1 ,  12 - 2  . . .  12 - n . Neither the number of voice units  12 - n  nor their location within the region R are limitations of the present invention.  
         [0029]     The voice units  12 - 1 ,  12 - 2  . . .  12 - n  can be in bidirectional communication via a wired or wireless medium  16  with a displaced control unit  20  for an audio output and a monitoring system. It will be understood that the unit  20  could be part of or incorporate a regional control and monitoring system which might include a speech annunciation system, fire detection system, a security system, and/or a building control system, all without limitation. It will be understood that the exact details of the unit  20  are not limitations of the present invention. It will also be understood that the voice output units  12 - 1 ,  12 - 2  . . .  12 - n  could be part of a speech annunciation system coupled to a fire detection system of a type noted above, which might be part of the monitoring system  20 .  
         [0030]     Additional audio output units can include loud speakers  14  coupled via cable  18  to unit  20 . Loud speakers  14  can also be used as a public address system.  
         [0031]     System  10  also can incorporate a plurality of audio sensing modules having members  22 - 1 ,  22 - 2  . . .  22 - m . The audio sensing modules or units  22 - 1  . . . - m  can also be in bidirectional communication via a wired or wireless medium  24  with the unit  20 .  
         [0032]     As described above and in more detail subsequently, the audio sensing modules  22 - i  respond to incoming audio from one or more of the voice output units, such as the units  12 - i ,  14 - i  and carry out, at least in part, processing thereof. Those of skill will understand that the below described processing could be completely carried out in some or all of the modules  22 - i . Alternately, the modules  22 - i  can carry out an initial portion of the processing and forward information, via medium  24  to the system  20  for further processing.  
         [0033]     The system  10  can also incorporate a plurality of ambient condition detectors  30 . The members of the plurality  30 , such as  30 - 1 , - 2  . . . - p  could be in bidirectional communication via a wired or wireless medium  32  with the unit  20 . It will be understood that the members of the plurality  22  and the members of the plurality  30  could communicate on a common medium all without limitation.  
         [0034]      FIG. 1A  is a block diagram of a representative member  12 - i  of the plurality of voice output units  12 . The unit  12 - i  incorporates input/output (I/O) interface circuitry  40  which is coupled to the wired or wireless medium  16  for bidirectional communications with monitoring unit  20 .  
         [0035]     The unit  12 - i  also incorporates control circuitry  42  which could include a programmable processor  42   a  and associated control software  42   b  as well as a digital signal processor  46   a . Storage unit  46   b  can be coupled thereto.  
         [0036]     Audio messages or communications to be injected into the region R are coupled via an amplifier  50  to an audio output transducer  52 . The audio output transducer  52  can be any one of a variety of loudspeakers or the like, all without limitation.  
         [0037]      FIG. 1B  illustrates details of a representative member  14 - i  of the plurality  14 . A member  14 - i  can include wiring termination element  80 , power level select jumpers  82  and audio output transducer  84 .  
         [0038]      FIG. 1C  is an exemplary block diagram of unit  20 . The unit  20  can incorporate input/output circuitry  93   a, b, c  and  96  for communicating with respective wired/wireless media  24 ,  32 ,  16  and  18 . The unit  20  can also incorporate control circuitry  92  which can be in communication with a nonvolatile memory unit  90 , a digital signal processor  94  as well as a programmable processor  98   a,b , an associated storage unit  98   b  as well as control software  98   c . It will be understood that the illustrated configuration of the unit  20  in  FIG. 1C  is an exemplary only and is not a limitation of the present invention.  
         [0039]      FIG. 2A  is a block diagram of a representative member  22 - i  of the plurality of audio sensing modules  22 . Each of the members of the plurality, such as  22 - i , includes a housing  60  which carries at least one audio input transducer  62 - 1  which could be implemented as a microphone. Additional, outboard, audio input transducers  62 - 2  and  62 - 3  could be coupled along with the transducer  62 - 1  to control circuitry  64 . The control circuitry  64  could include a programmable processor  64   a  and associated control software  64   b , as discussed below, to implement audio data acquisition processes as well as evaluation and analysis processes to determine if remediation is necessary relative to audio or voice message signals being received at the transducer  62 - 1 . The module  22 - i  is in bidirectional communications with interface circuitry  68  which in turn communicates via the wired or wireless medium  24  with system  20 .  
         [0040]      FIG. 2B  is a block diagram of a representative member  30 - i  of the plurality  30 . The member  30 - i  has a housing  70  which can carry an onboard audio input transducer  72 - 1  which could be implemented as a microphone. Additional audio input transducers  72 - 2  and  72 - 3  displaced from the housing  70  can be coupled, along with transducer  72 - 1  to control circuitry  74 .  
         [0041]     Control circuitry  74  could be implemented with and include a programmable processor  74   a  and associated control software  74   b . The detector  30 - i  also incorporates an ambient condition sensor  76  which could sense smoke, flame, temperature, gas all without limitation. The detector  30 - i  is in bidirectional communication with interface circuitry  78  which in turn communicates via wired or wireless medium  32  with monitoring system  20 .  
         [0042]     As discussed subsequently, processor  74   a  in combination with associated control software  74   b  can not only process signals from sensor  76  relative to the respective ambient condition but also process audio related signals from one or more transducers  72 - 1 , - 2  or - 3  all without limitation. Processing, as described subsequently, can carry out evaluation and a determination as to the nature and quality of audio being received and whether remediation is necessary and/or feasible.  
         [0043]      FIG. 3A , a flow diagram, illustrates steps of an evaluation process  100  in accordance with the invention. The process  100  can be carried out wholly or in part at one or more of the modules  22 - i  or detectors  30 - i  in response to received audio. It can also be carried out wholly or in part at unit  20 .  
         [0044]      FIG. 3B , illustrates steps of a remediation process  200  also in accordance with the invention. The process  200  can be carried out wholly or in part at one or more of the modules  12 - i  in response to processing commands and audio signals from unit  20 . It can also be carried out wholly or in part at unit  20 . The methods  100 ,  200  can be performed sequentially or independently without departing from the spirit and scope of the invention.  
         [0045]     In step  102 , the selected region is checked for previously applied audio remediation. If no remediation is being applied to audio presented by the system in the selected region, then a conventional method for quantitatively measuring the Common Intelligibility Scale (CIS) of the region may be performed, as would be understood by those of skill in the art. If remediation has been applied to the audio signals presented into the selected region, then a dynamically-modified method for measuring CIS is utilized in step  104 . The remediation is applied to all audio signals presented by the system into the selected region, including speech announcements, test audio signals, modulated noise signals and the like, all without limitation. The dynamically-modified method for measuring CIS adjusts the criteria used to evaluate intelligibility of a test audio signal to compensate for the currently applied remediation.  
         [0046]     For either CIS method, a predetermined sound sequence, as would be understood by those of skill in the art, can be generated by one or more of the voice output units  12 - 1 , - 2  . . . -n and/or  14 - 1 , - 2  . . . - n  or system  20 , all without limitation. Incident sound can be sensed for example, by a respective member of the plurality  22 , such as module  22 - i  or member of the plurality  30 , such as module  30 - i . For either CIS method, if the measured CIS value indicates the selected region does not degrade speech messages, then no further remediation is necessary.  
         [0047]     Those of skill will understand that the respective modules or detectors  22 - i ,  30 - i  sense incoming audio from the selected region, and such audio signals may result from either the ambient audio Sound Pressure Level (SPL) as in step  106 , without any audio output from voice output units  12 - 1 , - 2 , . . . ,  n  and/or  14 - 1 , - 2 , . . . - n , or an audio signal from one or more voice output units such as the units  12 - i ,  14 - i , as in step  108 . Sensed ambient SPL can be stored. Sensed audio is determined, at least in part, by the geographic arrangement, in the space or region R, of the modules and detectors  22 - i ,  30 - i  relative to the respective voice output units  12 - i ,  14 - i . The intelligibility of this incoming audio is affected, and possibly degraded, by the acoustics in the space or region which extends at least between a respective voice output unit, such as  12 - i ,  14 - i  the respective audio receiving module or detector such as  22 - i ,  30 - i.    
         [0048]     The respective sensor, such as  62 - 1  or  72 - 1 , couples the incoming audio to processors such as processor  64   a  or  74   a  where data, representative of the received audio, are analyzed. For example, the received sound from the selected region in response to a predetermined sound sequence, such as step  108 , can be analyzed for the maximum SPL resulting from the voice output units, such as  12 - i ,  14 - i , and analyzed for the presence of energy peaks in the frequency domain in step  112 . Sensed maximum SPL and peak frequency domain energy data of the incoming audio can be stored.  
         [0049]     The respective processor or processors can analyze the sensed sound for the presence of predetermined acoustical noise generated in step  108 . For example, and without limitation, the incoming predetermined noise can be 100 percent amplitude modulated noise of a predetermined character having a predefined length and periodicity. In steps  114  and  116  the respective space or region decay time can then be determined.  
         [0050]     The noise and reverberant characteristics can be determined based on characteristics of the respective amplifier and output transducer, such as  50 ,  52 , of the representative voice output unit  12 - i ,  14 - i  relative to maximum attainable sound pressure level and frequency bands energy. A determination, in step  120 , can then be made as to whether the intelligibility of the speech has been degraded but is still acceptable, unacceptable but compensatable, or unacceptable and not compensatable. The evaluation results can be communicated to monitoring system  20 .  
         [0051]     In accordance with the above, and as illustrated in  FIG. 3A , the state of a remediation flag is checked in step  102 . If set, the intelligibility test score can be determined for one or more of the members of the plurality  22 ,  30  in accordance with the U.S. patent application Ser. No. 10/740,200 previously incorporated by reference, using an appropriate Common Intelligibility Scale (CIS) method in step  104 . If the CIS score determined in step  104  indicates the speech messages in the selected region are intelligible, then the process  100  exits.  
         [0052]     In step  106 , the ambient sound pressure level associated with a measurement output from a selected one or more of the modules or detectors  22 ,  30  can be measured. Audio noise can be generated, for example one hundred percent amplitude modulated noise, from at least one of the voice output units  12 - i  or speakers  14 - i . In step  110  the maximum sound pressure level can be measured, relative to one or more selected sources. In step  112  the frequency domain characteristics of the incoming noise can be measured.  
         [0053]     In step  114  the noise signal is abruptly terminated. In step  116  the reverberation decay time of the previously abruptly terminated noise is measured. The noise and reverberant characteristics can be analyzed in step  118  as would be understood by those of skill in the art. A determination can be made in step  120  as to whether remediation is feasible. If not, the process can be terminated. In the event that remediation is feasible, a remediation flag can be set, step  122  and the remediation process  200 , see  FIG. 3B , can be carried out. It will be understood that the process  100  can be carried out by some or all of the members of the plurality  22  as well as some or all of the members of the plurality  30 . Additionally, a portion of the processing as desired can be carried out in monitoring unit  20  all without limitation. The method  100  provides an adaptive approach for monitoring characteristics of the space over a period of time so as to be able to determine that the coverage provided by the voice output units such as the unit  12 -,  14 - i , taking the characteristics of the space into account, provide intelligible speech to individuals in the region R.  
         [0054]      FIG. 3B  is a flow diagram of processing  200  which relates to carrying out remediation where feasible.  
         [0055]     In step  202 , an optimum remediation is determined. If the current and optimum remediation differ as determined in step  204 , then remediation can be carried out. In step  206  the determined optimum SPL remediation is set. In step  208  the determined optimum frequency equalization remediation can then be carried out. In step  210  the determined optimum pace remediation can also be set. In step  212  the determined optimum pitch remediation can also be set. The determined optimum remediation settings can be stored in step  214 . The process  200  can then be concluded step  216 .  
         [0056]     It will be understood that the processing of method  200  can be carried out at some or all of the modules  12  in response to incoming audio from system  20  or other audio input source without departing from the spirit or scope of the present invention. Further, that processing can also be carried out in alternate embodiments at monitoring unit  20 .  
         [0057]     Those of skill will understand that the commands or information to shape the output audio signals could be coupled to the respective voice output units such as the unit  12 - i , or unit  20  may shape an audio output signal to voice output units such as  14 - i . Those units would in turn provide the shaped speech signals to the respective amplifier and output transducer combination  50 ,  52 .  
         [0058]     As will be understood by those skilled in the art, remediation is possible within a selected region when the settable values which affect the intelligibility of speech announcements from voice output units  12 - i  or speakers  14 - i , can be set to values to cause improved intelligibility of speech announcements.  FIG. 4  depicts a representative state space within the set of parameters measured in process  100 , within which remediation may be possible. It will also be understood by those skilled in the art that the space depicted may vary for different regions selected for possible remediation. It will also be understood that processes  100  and  200  can be initiated and carried out automatically substantially without any human intervention.  
         [0059]     From the foregoing, it will be observed that numerous variations and modifications may be effected without departing from the spirit and scope of the invention. It is to be understood that no limitation with respect to the specific apparatus illustrated herein is intended or should be inferred. It is, of course, intended to cover by the appended claims all such modifications as fall within the scope of the claims.