Source: https://patents.google.com/patent/JP6206271B2/en
Timestamp: 2020-02-18 22:40:49
Document Index: 452964714

Matched Legal Cases: ['art 17', 'art 11', 'Application No. 2013', 'art 11', 'art 21', 'art 11', 'art 12', 'art 13', 'art 14', 'art 15', 'art 16', 'art 17', 'art 18']

JP6206271B2 - Noise reduction apparatus, noise reduction method, and noise reduction program - Google Patents
Noise reduction apparatus, noise reduction method, and noise reduction program Download PDF
JP6206271B2
JP6206271B2 JP2014053857A JP2014053857A JP6206271B2 JP 6206271 B2 JP6206271 B2 JP 6206271B2 JP 2014053857 A JP2014053857 A JP 2014053857A JP 2014053857 A JP2014053857 A JP 2014053857A JP 6206271 B2 JP6206271 B2 JP 6206271B2
JP2014053857A
JP2015177447A (en
敬介 小田
孝朗 山邊
2014-03-17 Application filed by 株式会社Ｊｖｃケンウッド filed Critical 株式会社Ｊｖｃケンウッド
2014-03-17 Priority to JP2014053857A priority Critical patent/JP6206271B2/en
2015-10-05 Publication of JP2015177447A publication Critical patent/JP2015177447A/en
2017-10-04 Publication of JP6206271B2 publication Critical patent/JP6206271B2/en
The present invention relates to a noise reduction device, a noise reduction method, and a noise reduction program, and more particularly to a noise reduction device, a noise reduction method, and a noise reduction program that suppress sudden sound in an environment in which sudden sound is periodically included in an audio signal.
When a mobile communication device is used in a noisy environment, noise reduction processing may be required to ensure speech clarity. Especially in devices that are often used in harsh environments, such as radios, for example, a continuous periodic sudden sound such as a ground compressor on a construction site or a vibration sound of an oxygen cylinder is exposed to voice. If this happens, there is a problem that prevents accurate transmission of voice. Therefore, Patent Documents 1 and 2 disclose techniques relating to noise reduction.
In Patent Document 1, the noise generated from the lens moving part of the camera-integrated VTR, the noise when the head contacts or separates from the magnetic tape, and the optical shutter in the camera-integrated VTR having a silver salt film camera function And a method of reducing sudden sound such as a head seek that occurs when recording on a rotary storage medium. Specifically, in Patent Document 1, a signal is cut off only in the sudden sound section, and information lacking the cut section is interpolated based on signal information in at least one of the front and rear.
In Patent Document 2, an envelope of a signal including sudden noise is calculated, a signal corresponding to the signal component of the sudden noise is extracted, and the sudden noise is calculated based on the extracted signal component of the sudden noise. The signal component is reduced.
JP 2002-251823 A JP 2011-205598 A
However, in the technologies disclosed in Patent Documents 1 and 2, for an input signal in which the target sound and the sudden sound to be suppressed are mixed, sudden sound is generated while ensuring the clarity of the sound. There was a problem that it was difficult to suppress.
The present invention is a sudden sound information storage unit for storing, as sudden sound information, an input signal including a sudden sound to be suppressed, which is equal to or lower than a preset threshold value among input signals input before the current input signal; A correlation value calculation unit that calculates a correlation value between the sudden sound information and the current input signal; and a phase difference between the sudden sound information and the sudden sound in the current input signal based on a maximum value of the correlation value. A phase difference calculation unit to calculate; an addition signal generation unit that shifts the phase of the sudden sound information based on the phase difference and inverts the sudden sound information to generate an addition signal; and the addition signal and the current signal There is provided a noise reduction device including a sudden sound suppression unit that adds an input signal to suppress sudden sound in the current input signal and outputs an output signal.
The present invention relates to a noise reduction method in a noise reduction device that outputs an output signal by suppressing sudden sound included in an input signal, and a threshold value in which a voice is set in advance among input signals input before the current input signal. And storing an input signal including a sudden sound to be suppressed as sudden sound information, calculating a correlation value between the sudden sound information and the current input signal, and based on the maximum value of the correlation value. Calculating a phase difference between the sound information and the sudden sound in the current input signal, shifting the phase of the sudden sound information based on the phase difference, and generating an addition signal by inverting the sudden sound information; There is provided a noise reduction method for outputting an output signal by suppressing the sudden sound in the current input signal by adding the addition signal and the current input signal.
The present invention relates to a noise reduction program that is executed by the arithmetic unit in a noise reduction apparatus that includes an arithmetic unit and a storage unit and outputs an output signal while suppressing sudden sound included in the input signal, and a current input signal A sudden sound information storage process for storing, as a sudden sound information, an input signal including a sudden sound to be suppressed, which is equal to or lower than a preset threshold value among the input signals input before the sudden sound information, A correlation value calculation process for calculating a correlation value between the current input signal and a phase difference calculation process for calculating a phase difference between the sudden sound information and the sudden sound in the current input signal based on a maximum value of the correlation value; Adding an addition signal generation process for generating an addition signal by shifting the phase of the sudden sound information based on the phase difference and inverting the sudden sound information; and adding the addition signal and the current input signal Crash in the current input signal Providing noise removal program executed a sudden sound suppression processing for outputting an output signal by suppressing the sound, a.
According to the present invention, a noise reduction device, a noise reduction method, and a noise reduction program that provide a high noise suppression effect regardless of the type of periodic noise are provided.
1 is a block diagram of a noise reduction device according to a first exemplary embodiment. 3 is a flowchart illustrating an operation of the noise reduction device according to the first exemplary embodiment; FIG. 3 is a diagram illustrating an example of an input signal input to the noise reduction device according to the first exemplary embodiment. It is a figure explaining the relationship between sudden sound information and correlation value in the noise reduction apparatus concerning Embodiment 1. FIG. It is a figure explaining the relationship between the sudden sound information of the noise reduction apparatus concerning Embodiment 1, and the addition signal which inverted sudden sound information. It is a figure explaining the range of the input signal memorize | stored as sudden sound information of the noise reduction apparatus concerning Embodiment 1. FIG. It is a figure explaining the update process of sudden sound information in the noise reduction apparatus concerning Embodiment 1. FIG. It is a figure explaining the input signal handled with the noise reduction apparatus 2 concerning Embodiment 2. FIG. It is a block diagram of the noise reduction apparatus concerning Embodiment 2. FIG. It is a figure explaining the relationship between an input signal and an analysis object frame in case a sudden sound exists over a flame | frame. It is a figure explaining the output signal at the time of performing a sudden sound suppression process about the input signal in which a sudden sound exists across a flame | frame. 6 is a flowchart illustrating an operation of the noise reduction device according to the second exemplary embodiment. 10 is a flowchart illustrating an operation of an inter-frame sudden sound suppression process of the noise reduction device according to the second exemplary embodiment; 10 is a flowchart showing an operation of a first half frame sudden sound suppression process of the noise reduction apparatus according to the second exemplary embodiment;
Embodiments of the present invention will be described below with reference to the drawings. The noise reduction apparatus 1 according to the first embodiment outputs an output signal in which periodic noise is suppressed from an input signal when sudden sound is periodically mixed in the input signal. Here, the sudden sound that is mixed periodically, for example, for an oxygen cylinder carried by a firefighter in the field of fire, warns the wearer when the tank capacity of the oxygen cylinder falls below a predetermined value. This is caused by the function of generating a sudden sound with a sustainability and periodicity, such as a warning vibration sound that operates. Moreover, periodic sudden sound is generated by a ground compressor at a construction site.
FIG. 1 shows a block diagram of a noise reduction apparatus 1 according to the first exemplary embodiment. As shown in FIG. 1, the noise reduction apparatus 1 according to the first exemplary embodiment includes a voice input unit 10, a frame configuration unit 11, a voice determination unit 12, a sudden sound detection unit 13, a sudden sound update determination unit 14, and sudden sound information. A storage unit 15, a correlation value calculation unit 16, a phase difference calculation unit 17, an addition signal generation unit 18, and a sudden sound suppression unit 19 are included.
In the noise reduction device 1, the voice input unit 10 and a storage unit that stores various information are configured by hardware. In the noise reduction apparatus 1, the frame configuration unit 11, the sound determination unit 12, the sudden sound detection unit 13, the sudden sound update determination unit 14, the correlation value calculation unit 16, the phase difference calculation unit 17, the addition signal generation unit 18, and the sudden The processing performed on the information or signal performed by the sound suppression unit 19 is realized by a program (for example, a noise reduction program) executed by a calculation unit such as a CPU (Central Processing Unit) or DSP (Digital Signal Processor). be able to. In this case, the noise reduction program can be stored using various types of non-transitory computer readable media and supplied to the computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory) CD-R, CD -R / W, including semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can be supplied to a computer including a CPU via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path. Each component realized by the program may be configured by hardware.
The voice input unit 10 is a sensor such as a microphone, for example, and acquires a voice signal from the outside. The input signal Ain acquired by the voice input unit 10 is an analog signal. The frame configuration unit 11 converts the input signal Ain into a digital value, and framing the input signal in units according to a preset number of samples, and outputs the input signal Din. Note that conversion from an analog signal to a digital value may be performed in any block of the audio input unit 10 and the frame configuration unit 11. The input signal Din output from the frame construction unit 11 is transmitted to the subsequent block, and sudden sound reduction processing is performed.
The sound determination unit 12 determines whether sound that is a component that is not a suppression target is included in the current input signal. The voice determination unit 12 enables the voice determination signal when it is determined that the voice component is not included in the current input signal.
The sudden sound detection unit 13 detects that the sudden sound to be suppressed is included in the current input signal. If the sudden sound detection unit 13 determines that the sudden sound is included in the current input signal, the sudden sound detection unit 13 enables the sudden sound detection signal.
The sudden sound information storage unit 15 stores, as sudden sound information, an input signal including a sudden sound to be suppressed and whose sound is equal to or lower than a preset threshold value among input signals input before the current input signal. This sudden sound information cancels the sudden sound of the input signal, and is stored as a reference signal. The sudden sound update determination unit 14 stores the sudden sound in the sudden sound information storage unit 15 in response to the fact that the sound is not included in the current input signal in the sound determination unit and the sudden sound is detected in the sudden sound detection unit 13. The stored sudden sound information is updated by the current input signal. Specifically, the sudden sound update determination unit 14 updates the sudden sound information stored in the sudden sound information storage unit 15 in response to both the voice determination signal and the sudden sound detection signal being enabled. Instruct. Here, when updating the sudden sound information, the sudden sound update determination unit 14 obtains sudden sound section information in which sudden sound exists from the sudden sound detection unit 13 and inputs the current input of the section according to the sudden sound section information. The sudden sound information storage unit 15 is instructed to use the signal as the sudden sound information after the update.
The sudden sound information storage unit 15 determines that the sudden sound update determination unit 14 includes the sudden sound and the audio signal in the current input signal, or does not include the sudden sound in the current input signal. If so, the stored sudden sound information is maintained.
The correlation value calculation unit 16 calculates a correlation value between the sudden sound information stored in the sudden sound information storage unit 15 and the current input signal. More specifically, when the sudden sound detection unit 13 determines that the current input signal includes sudden sound, the correlation value between the sudden sound information and the current input signal is calculated, and the calculated correlation value is calculated. It outputs to the phase difference calculation part 17.
Here, the correlation value is calculated based on, for example, equation (1).
In equation (1), m and n are natural numbers, and m represents a range (time width) in which an autocorrelation value is calculated from the input signal sequence, and the input signal included in the current input signal and the previous input signal , N is a constant and the maximum phase difference (search range), n is the number of samples of the input signal sequence for calculating the autocorrelation value, and x is the framed input signal Yes, A [m] is the autocorrelation value at the phase difference m.
The phase difference calculator 17 calculates the phase difference between the sudden sound information and the sudden sound in the current input signal based on the maximum correlation value calculated by the correlation value calculator 16. The phase difference calculation unit 17 outputs the calculated phase difference information to the addition signal generation unit 18.
The addition signal generation unit 18 generates a noise canceling signal by shifting the phase of the sudden sound information based on the phase difference information output from the addition signal generation unit 18. The addition signal generation unit 18 generates a signal obtained by inverting sudden sound information as the noise cancellation signal. Further, since the noise cancellation signal is treated as a signal added to the current input signal, it will be referred to as an addition signal in the following description.
The sudden sound suppression unit 19 adds the addition signal and the current input signal to suppress the sudden sound in the current input signal and outputs the output signal So. In the first embodiment, an adder is used as the sudden sound suppression unit 19.
Subsequently, the operation of the noise reduction device 1 according to the first exemplary embodiment will be described in detail. In the noise reduction apparatus 1 according to the first embodiment, the sudden sound suppression process and the sudden sound information update process are performed each time the input signal Din is input. In the sudden sound suppression process, sudden sound is suppressed using sudden sound information acquired based on input signals input in the past. In the sudden sound information update process, the sudden sound information is updated by an input signal inputted in a non-speech section in which a speech component that is not a suppression target is equal to or less than a threshold.
FIG. 2 is a flowchart showing the operation of the noise reduction apparatus 1 according to the first embodiment. In FIG. 2, steps S1 to S9 and S15 are sudden sound suppression processing, and steps S10 to S14 correspond to sudden sound information update processing. Here, in order to specifically describe the sudden sound suppression processing in the noise reduction apparatus 1 according to the first embodiment, FIG. 3 shows an example of an input signal input to the noise reduction apparatus according to the first embodiment. As shown in FIG. 3, in the noise reduction device 1 according to the first embodiment, an input signal Din is input. The input signal Din includes sudden sound. And in the noise reduction apparatus 1 concerning Embodiment 1, the sudden sound a contained in the past analysis frame is memorize | stored in the noise reduction apparatus 1 as sudden sound information, and the present analysis object frame is used using this sudden sound information. The sudden sound b is reduced.
As shown in FIG. 2, in the noise reduction apparatus 1 according to the first embodiment, when processing is started, first, an input signal Ain is acquired (step S1). And the noise reduction apparatus 1 makes the input signal Ain into a frame by the frame structure part 11, and produces | generates the input signal Din (step S2).
Here, the time of one frame in the framing process in step S2 will be described. In this embodiment, as an example of a sudden sound to be detected, a periodic impact sound generated when a mask (regulator) vibrates when the remaining amount of oxygen mounted in an oxygen cylinder used by a firefighter decreases is taken as an example. This percussive sudden sound has a time width of about 0.01 sec from rising to falling with the peak position having the highest sound pressure level as the apex. In order to detect the presence of this sudden sound, it is necessary to secure an acoustic signal analysis section that is not due to sudden sound before and after the sudden sound, and observe, for example, changes in the amplitude change amount and the energy change amount. Therefore, if there is a time width corresponding to several times 0.01 sec, for example, 0.03 to 0.05 sec, the presence of the sudden sound to be detected can be grasped. Therefore, these values are desirable for the analysis width defined as the time of one frame.
The section of the frame is not limited to the above numerical value, and may be changed according to the system. It is considered that the hitting sound generated when the object collides with each other is collected within a limited range determined by the colliding object and falls within a certain range. Therefore, the analysis width (number of samples in the frame) by short-term analysis may be secured several times the duration of sudden sound generated by a collision.
Subsequently, in the noise reduction device 1 according to the first embodiment, the sudden sound detection unit 13 determines whether or not the sudden sound is included in the input signal Din (step S3). Various methods can be used as the sudden sound detection method in the sudden sound detection process of step S3. However, it is described in Japanese Patent Application No. 2013-145548 by the present inventor who improved the sudden sound detection accuracy with periodicity. It is desirable to adopt a method of obtaining a correlation value between the current input signal and the past input signal for the peak position and peak duration of the signal amplitude in the frame.
In step S3, if the sudden sound is included in the input signal Din (Y branch in step S4), it is determined whether or not there is sudden sound information in the sudden sound information storage unit 15 (step S5). On the other hand, when it is determined in step S3 that the input signal Din has no sudden sound (N branch in step S4), the noise reduction apparatus 1 outputs the input signal Din as it is as the output signal So (step S15).
In step S5, when there is no sudden sound information in the sudden sound information storage unit 15 (N branch in step S5), the noise reduction apparatus 1 performs sudden sound information update processing. In addition, when there is no sudden sound information, since the addition signal necessary for suppression cannot be prepared, the noise reduction device 1 outputs the input signal Din as it is as the output signal So (step S15). On the other hand, if the sudden sound information is already stored in the sudden sound information storage unit 15 in step S5 (Y branch in step S5), the noise reduction apparatus 1 performs the processes in steps S6 to S9.
In step S6, the correlation value calculation unit 16 calculates a correlation value between the sudden sound information stored in the sudden sound information storage unit 15 and the input signal Din that is the current analysis target frame. This correlation value is calculated based on the above equation (1), for example.
In step S7, the phase difference between the sudden sound information stored in the sudden sound information storage unit 15 and the sudden sound in the current input signal Din is calculated based on the correlation value calculated in the correlation value calculation process in step S6. Generate phase difference information.
FIG. 4 is a diagram for explaining the relationship between the sudden sound information and the correlation value in the noise reduction apparatus according to the first embodiment, and the phase difference information will be described in more detail. In the noise reduction apparatus 1, first, the correlation value calculation unit 16 shifts the stored sudden sound information from the correlation value calculation start position to the correlation value calculation end position with respect to the analysis target frame (current input signal Din). To obtain the correlation value. At this time, when the sudden input is included in the current input signal Din, as shown in the correlation value calculation result of FIG. 4, the correlation value is large at the position where the sudden sound information and the sudden sound in the current input signal Din overlap. Become. In other words, when the sudden sound information is phase-difference shifted to the position where the peak position of the correlation value is the highest and then the sign is inverted and the addition process is performed, the signal component of the sudden sound can be suppressed most efficiently. Therefore, the phase difference calculation unit 17 calculates a distance (for example, the number of samples) to the peak of the correlation value, and outputs this to the addition signal generation unit 18 as phase difference information.
If the phase of the sudden sound and the sudden sound information of the analysis target frame is insufficient, the amplitude may increase and the noise level may increase or new noise may be added. Therefore, the accuracy of the phase difference information is greatly related to the sudden sound suppression capability.
Subsequently, in step S8, an addition signal generation process by the addition signal generation unit 18 is performed. An example of this addition signal generation process will be described in detail. First, reference is made to FIG. As shown in FIG. 4, in order to suppress the sudden sound in the current input signal Din most efficiently, it is necessary to shift the sudden sound information to a position shifted based on the phase difference information. Therefore, the addition signal generation unit 18 shifts the phase of the sudden sound information based on the equation (2).
In equation (2), B is an addition signal, x is stored sudden sound information, i is a sample number in one frame, s is phase difference information, and t is in sudden sound information. The total number of samples. That is, the addition signal generation unit 18 generates the addition signal by shifting the sudden sound information to a position indicated by the phase difference information and inverting the sudden sound information. FIG. 5 illustrates a relationship between the sudden sound information of the noise reduction apparatus according to the first embodiment and the addition signal obtained by inverting the sudden sound information. In FIG. 5, the sudden sound information is shown in the upper part, and the addition signal is shown in the lower part. As shown in FIG. 5, the sudden sound signal and the addition signal have a relationship of being inverted from each other.
The addition signal generation unit 18 adds the sign inversion signal of the stored sudden sound information, that is, the addition signal, to the corresponding portion of the input signal in the analysis target frame specified from the shift amount based on the phase difference information. May be.
In step S9, the sudden sound suppression unit 19 performs an addition process of the input signal and the addition signal, that is, a sudden sound suppression process. As a result, an output signal in which the sudden sound included in the current input signal Din is suppressed is generated. In the noise reduction apparatus 1, the process of updating the sudden sound information is performed following step S9.
In the sudden sound information update process, first, the voice segment determination process is performed by the voice determination unit 12 (step S10). Various methods can be used as the speech segment determination processing method in step S10, but speech based on the spectral components of the input signal described in Japanese Patent Application Laid-Open No. 2012-128411 already filed by the inventors. A signal component determination method or the like can be used. In step S10, if the current input signal Din includes voice, the voice determination unit 12 determines that it is a voice section and disables the voice determination signal (N branch in step S11). When the sound determination signal is in the disabled state, the sudden sound update determination unit 14 maintains the sudden sound information stored in the sudden sound information storage unit 15.
On the other hand, in step S10, if the current input signal Din does not include a voice having an amplitude greater than or equal to a preset threshold value, the voice determination unit 12 determines that it is a noise section and enables the voice determination signal (in step S11). Y branch). As a result, since both the voice determination signal and the sudden sound detection signal are enabled, the sudden sound update determination unit 14 determines to update the sudden sound in the sudden sound update determination process (Y branch in step S13). .
Here, information stored as sudden sound information will be described in detail. FIG. 6 is a diagram for explaining a range of input signals stored as sudden sound information of the noise reduction apparatus according to the first embodiment. The noise reduction apparatus 1 according to the first embodiment stores only the sudden sound reference storage section shown in FIG. 6 in order to reduce only sudden sound. As shown in FIG. 6, the sudden sound has a characteristic that the amplitude suddenly amplifies, attenuates with time, and returns to a normal signal level after the reference storage section. Therefore, the reference storage section may detect the peak position (maximum value) of the sudden sound, and set samples corresponding to the predetermined section of the sudden sound from several samples ahead and behind the peak position.
In the sudden sound update process, the sudden sound update determination unit 14 instructs the sudden sound information storage unit 15 to update the sudden sound information by the current input signal Din, and the sudden sound information storage unit 15 stores the sudden sound information. Is updated by the current input signal Din. Then, in response to the completion of the processing up to step S14, the noise reduction device 1 outputs the output signal So (step S15).
Here, a method for avoiding an erroneous determination in the sudden sound update determination process in step S12 will be described. Depending on the environment in which the acoustic signal is collected, various background noises are mixed in addition to voice and sudden sound. For this reason, there is a possibility that an erroneous determination is made that the sound is noise even though the sound is included in the sound section determination processing in step S10. If the reference signal is updated in a state where an erroneous determination has occurred, sound is mixed into the sudden sound information, which causes a harmful effect. In general, it is difficult to recognize the beginning part and the ending part of a speech signal by speech as speech, and there is a high possibility of erroneous determination. By generating the input signal Din by dividing it into frames having a predetermined analysis time, it is expected that the speech signal due to speech is frequently divided between frames. Therefore, a method for avoiding the influence of the erroneous determination of the speech segment as described above will be described.
A method of storing sudden sound information in the first embodiment will be described with reference to FIG. FIG. 7 is a diagram for explaining sudden sound information update processing in the noise reduction apparatus according to the first embodiment. The upper diagram of FIG. 7 is an acoustic signal including speech and sudden sound, and the lower diagram of FIG. 7 is a diagram displaying the speech segment determination result. As for the result of speech segment determination, 1 indicates a speech segment and 0 indicates a noise segment. In the first embodiment, in order to prevent voice from being mixed into the sudden sound information stored in the sudden sound information storage unit 15, the reference signal is updated when the noise (sudden sound) section continues for several frames. Since the noise interval a continues for a predetermined number of frames, the sudden sound information is updated. On the other hand, since the rising edge of the voice cannot be recognized as the voice in the voice section a, the voice may be mixed if the sudden sound immediately before the voice section a is stored. Therefore, the input signal Din before a predetermined frame, not immediately before the voice section a, is stored or updated as the sudden sound information a. Subsequently, since voice is mixed in the voice section a, storage or updating is not performed. In the noise interval b, since the noise interval is short and the reliability of only sudden sound is low, storage or updating is not performed. Since voice is mixed in the voice section b, storage or updating is not performed. In the noise section c, the noise (sudden sound) section continues for a predetermined number of frames, and therefore, the input signal Din several frames before the sound section c is stored as the sudden sound signal b. Since voice is mixed in the voice section c, it is not stored or updated.
As described above, in the first embodiment, as shown in FIG. 7, in order to prevent the voice from being mixed into the sudden sound information, when the noise period continues for a predetermined frame, the rising or falling portion of the voice signal is displayed. The sudden sound at the excluded position is stored as sudden sound information.
In the first embodiment, the sudden sound information stored in the sudden sound information storage unit 15 is updated as needed. If an old sudden sound compared to the analysis target frame is used as a reference signal, there is a concern that the correlation may not be sufficiently secured due to changes in the surrounding environment.For example, the peak position of the correlation value is detected and Even if the phase shift is absorbed, the generated addition signal for reducing sudden sound may not effectively suppress the sudden sound to be analyzed. Therefore, the sudden sound information is updated at any time when it is determined that the possibility that the audio signal is included is extremely low, and a new reference sound is secured in time.
From the above description, in the noise reduction apparatus 1 according to the first embodiment, out of the input signal input before the current input signal in the sudden sound information storage unit 15, the voice is equal to or lower than a preset threshold value, and the sudden occurrence of the suppression target An input signal including sound is stored as sudden sound information. And the noise reduction apparatus 1 suppresses sudden sound included in the present input signal Din based on this sudden sound information. Thereby, the noise reduction apparatus 1 concerning Embodiment 1 can suppress sudden sound generation, preventing deterioration of a sound.
More specifically, in the noise reduction apparatus 1 according to the first embodiment, sudden sound information is generated from an input signal that does not include speech among past input signals, and an addition signal obtained by inverting this sudden sound information is input as current input. The sudden sound is suppressed by adding to the signal Din. Therefore, the noise reduction apparatus 1 can suppress only a sudden sound while maintaining the intelligibility of the voice without suppressing the voice signal.
As a typical technique for noise reduction processing, adaptive noise reduction processing using an adaptive filter is widely known. Since this adaptive filter has the adaptability to change according to the environmental change while sequentially correcting the characteristics of the filter, it has a feature that the optimality according to the environment can always be maintained. In the noise reduction processing using the adaptive filter, the filter coefficient corresponding to the place is sequentially changed while operating the filter so as to cut only the noise component that changes depending on the place and the time using this feature. It can be adapted to reduce ambient noise. However, if the noise reduction process using the adaptive filter described above is performed when reducing periodic sudden sound, the adaptive signal processing circuit (adaptive filter circuit) is adapted to the adaptive noise reduction process even for periodic sudden noise. Are constantly operated, the number of taps of the adaptive signal processing circuit increases, and there is a problem that the circuit scale of the adaptive signal processing circuit increases.
On the other hand, in the noise reduction apparatus 1 according to the first embodiment, since only the sudden sound to be suppressed and the inverted signal of the sudden sound information close to this sudden sound are added, compared with the method using the adaptive filter. The circuit scale can be greatly reduced.
In the second embodiment, a noise reduction device 2 that is another form of the noise reduction device 1 according to the first embodiment will be described. First, the sudden sound handled by the noise reduction apparatus 2 according to the second embodiment will be described. FIG. 8 is a diagram for explaining an input signal handled by the noise reduction apparatus 2 according to the second embodiment. As shown in FIG. 8, in the noise reduction apparatus 2 according to the second embodiment, there is a sudden sound straddling the frame. In the noise reduction apparatus 2 according to the second embodiment, sudden sound that is located across frames as shown in FIG. 8 is suppressed. A block diagram of the noise reduction apparatus 2 according to the second embodiment is shown in FIG. In the description of the second embodiment, the same components as those described in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and the description thereof is omitted.
As illustrated in FIG. 9, the noise reduction device 2 according to the second embodiment adds a sudden sound position determination unit 20 to the noise reduction device 1 according to the first embodiment, and adds the sudden sound suppression unit 19 to the addition control unit 21. It has been replaced with. The addition control unit 21 corresponds to a sudden sound suppression unit.
The sudden sound position determination unit 20 determines whether or not the sudden sound is located between the previous input signal input in the processing cycle immediately before the current input signal. When the sudden sound position determination unit 20 detects that the sudden sound is located across the current input signal and the previous input signal, the addition control unit 21 adds the signal to the previous input signal and the current input signal. Is applied, and an output signal So corresponding to the previous input signal is output. Further, when the sudden sound position determination unit 20 detects that the sudden sound is located across the current input signal and the previous input signal, the addition control unit 21 indicates that the current input signal has been subjected to suppression processing. Is set to the valid state.
In addition, in the noise reduction apparatus 2 according to the second exemplary embodiment, the frame configuration unit 11 sets two frames moving back and forth in time as one piece of data in order to include suppression of sudden sound that exists between frames. Output as. FIG. 10 is a diagram for explaining the processing target frame handled in the second embodiment. In the frame configuration unit 11 according to the second embodiment, the frames 1 and 2 are output as one analysis target frame a, and then the frames 2 and 3 are set as one analysis target frame b in response to the generation of the frame 3. Output. The analysis target frame c following the analysis target frame b includes frames 3 and 4. Further, in the following description, when the analysis target frame a in FIG. 9 is taken as an example, the frame 1 (first half frame) input before in time is the previous input signal, and the frame 2 (after the frame 1 is input) The second half frame) is expressed as the current input signal.
The voice determination unit 12 determines the presence or absence of voice using the input two-frame signal. The sudden sound detection unit 13 detects sudden sound using the two input frames as one input signal.
The sudden sound update determination unit 14 determines whether or not the sudden sound information can be updated according to the sound determination signal of the first half frame of the input signal when the sudden sound exists across the frames. On the other hand, if the sudden sound exists across frames, the sudden sound update determination unit 14 suspends the update of the sudden sound information at the time of processing of the analysis target frame a, and the analysis target frame b is input. Accordingly, whether or not the sudden sound information can be updated is determined after the presence or absence of the audio signal of the second half frame of the analysis target frame a is determined. In other words, in the second embodiment, the sudden sound update determination unit 14 determines that the sudden sound exists between the current input signal and the previous input signal by the sudden sound position determination unit 20 and the current input When it is determined that neither the signal nor the previous input signal contains speech, the sudden sound information is updated with the current input signal and the previous input signal. On the other hand, the sudden sound update determination unit 14 determines that the sudden sound position determination unit 20 does not straddle between the current input signal and the previous input signal and that there is a sudden sound in the previous input signal. If it is determined that it is not included, the sudden sound information is updated by the previous input signal.
The correlation value calculation unit 16, the phase difference calculation unit 17, and the addition signal generation unit 18 have the sudden sound position determination unit 20 that the sudden sound is located across the current input signal and the previous input signal. If detected, an addition signal is generated using the current input signal and the previous input signal as one input signal.
Next, the operation of the noise reduction device 2 according to the second exemplary embodiment will be described. First, FIG. 11 is a diagram for explaining suppression processing for sudden sound, in which the noise reduction apparatus 2 according to the second embodiment is particularly effective. As illustrated in FIG. 11, the noise reduction device 2 according to the second exemplary embodiment effectively suppresses sudden sound that is located across frames. FIG. 12 is a flowchart showing the operation of the noise reduction apparatus according to the second embodiment to explain the processing for that purpose. In the second embodiment, the process shown in FIG. 12 is performed every time an analysis target frame is input. Further, in this frame chart, in order to clarify the explanation of the suppression processing method by the two-frame processing, it is described with the content that omits the processing of the voice determination unit corresponding to FIG. When audio is mixed, processing similar to the frame chart of FIG. 2 may be added to FIG.
As shown in FIG. 12, the noise reduction apparatus 2 according to the second embodiment first acquires an input signal Ain (step S20). And the noise reduction apparatus 2 makes the input signal Ain into a frame by the frame structure part 11, and produces | generates the input signal Din (step S21). In step S21, an input signal Din having a length including two frames is generated.
And the noise reduction apparatus 2 judges whether the suppression process completion flag of the addition control part 21 is valid or invalid (step S22). In this step S22, when it is determined that the suppression process completed flag is valid (N branch in step S22), the second half frame (currently) of the analysis target frame processed in the previous process stored in the addition control unit 22 Saved data corresponding to the first half frame in the analysis target frame is output (step S26). After step S26, there is no suppression processed frame, so the suppression processing flag is invalidated (step S27).
On the other hand, if it is determined in step S22 that the suppression process completed flag is invalid (Y branch in step S22), a sudden sound detection process is performed (step S23). In the process of step S23, sudden sound is detected for the entire analysis target frame. If it is determined in step S23 that there is no sudden sound in the first half frame (N branch in step S24), a previous input signal corresponding to the first half frame of the current analysis target frame is output (step S28). After step S28, since the sudden sound suppression process has not been completed for the second half frame (current input signal) of the processing target frame, the suppression process completed flag of the addition control unit 21 is invalidated (step S29).
If it is determined in step S23 that there is a sudden sound in the first half frame (Y branch in step S24), it is suddenly determined whether a sudden sound exists across the two frames included in the current analysis target frame. Determination is performed by the sound position determination unit 20 (step S25). In this step S25, it is determined whether or not it exists across the detected sudden sound peak position, the rising and falling sections before and after forming the sudden sound, and the frame length which is a unit of frame.
If it is determined in step S25 that a sudden sound exists across the frames (Y branch in step S25), an inter-frame sudden sound suppression process is performed (step S30). On the other hand, if it is determined in step S25 that there is no sudden sound that exists across frames (N branch in step S25), the first half frame sudden sound suppression processing is performed on the first half frame (previous input signal) of the analysis target frame. Is performed (step S31).
Here, the inter-frame sudden sound generation process in step S30 will be described in more detail. FIG. 13 is a flowchart showing the operation of the inter-frame sudden sound suppression process of the noise reduction apparatus according to the second embodiment.
As illustrated in FIG. 13, when starting the inter-frame sudden sound suppression process, the noise reduction device 2 first sets the suppression target processing block of the correlation value calculation unit 16 to 2 frames by the sudden sound position determination unit 20 ( Step S40). Subsequently, using two frames as one processing target frame, the correlation value calculation process (step S41), the phase difference calculation process (step S42), and the addition signal generation process (step S42) are performed as processes corresponding to steps S6 to S9 in FIG. Step S43) and sudden sound suppression processing (Step S44) are performed.
Subsequently, in the inter-frame sudden sound suppression process, since the sudden sound suppression process is completed for the second half frame (current input signal) of the processing target frame, the suppression process completed flag of the addition control unit 21 is validated (step S45). . Then, the noise reduction device 2 outputs the first half frame (previous input signal) of the processing target frame as the output signal So, and stores the second half frame (step S46).
Subsequently, the first half frame sudden sound generation process in step S31 will be described in more detail. FIG. 14 is a flowchart showing the operation of the first half frame sudden sound suppression processing of the noise reduction apparatus according to the second embodiment.
As shown in FIG. 14, when starting the first half frame sudden sound suppression process, the noise reduction device 2 first sets the suppression target processing block of the correlation value calculation unit 16 to the first half frame by the sudden sound position determination unit 20 ( Step S50). Subsequently, with the first half frame as one processing target frame, correlation value calculation processing (step S51), phase difference calculation processing (step S52), and addition signal generation corresponding to the processing corresponding to steps S6 to S9 in FIG. Processing (step S53) and sudden sound suppression processing (step S54) are performed.
Subsequently, in the first half frame sudden sound suppression process, since the sudden sound suppression process has not been completed for the second half frame (current input signal) of the processing target frame, the suppression processed flag of the addition control unit 21 is invalidated (Step S1). S55). Then, the noise reduction device 2 outputs the first half frame (previous input signal) of the processing target frame as the output signal So (step S56).
In addition, in order to add the influence of a voice component, when adding a voice determination unit, a voice section determination process is performed with an input signal that matches the frame length to be processed. Specifically, in the case of the inter-frame sudden sound suppression process of FIG. 13, the speech section determination for the first half frame and the second half frame is performed. Further, in the case of the first half frame sudden sound suppression processing of FIG. 14, the speech section determination for the first half frame is performed. As a result, it is possible to accurately select and update the sudden sound information to be used based on the presence or absence of the audio component in the analysis target frame.
From the above description, in the noise reduction apparatus 2 according to the second embodiment, even when there is a sudden sound straddling between frames, the two consecutive frames in time are used as the processing target frames. Sound suppression can be performed.
DESCRIPTION OF SYMBOLS 1 Noise reduction apparatus 2 Noise reduction apparatus 10 Voice input part 11 Frame structure part 12 Voice determination part 13 Sudden sound detection part 14 Sudden sound update determination part 15 Sudden sound information storage part 16 Correlation value calculation part 17 Phase difference calculation part 18 Additional signal Generation unit 19 Sudden sound suppression unit 20 Sudden sound position determination unit 21 Addition control unit
A voice input unit that uses data obtained by framing a voice signal in a predetermined cycle as a current input signal;
A sudden sound information storage unit for storing, as sudden sound information, an input signal including a sudden sound to be suppressed, which is equal to or lower than a preset threshold value among input signals input before the current input signal;
A correlation value calculation unit for calculating a correlation value between the sudden sound information and the current input signal;
A phase difference calculating unit that calculates a phase difference between the sudden sound information and the sudden sound in the current input signal based on the maximum value of the correlation value;
An addition signal generation unit that shifts the phase of the sudden sound information based on the phase difference and inverts the sudden sound information to generate an addition signal;
A sudden sound suppression unit that adds the added signal and the current input signal to suppress sudden sound in the current input signal and outputs an output signal;
A sudden sound detection unit for detecting that the current input signal includes a sudden sound to be suppressed; and
A voice determination unit that determines whether or not voice other than the suppression target is included in the current input signal based on a spectrum component of the current input signal;
The sudden sound information when the sound is not included in the current input signal in the sound determination unit and the number of frames in which the sudden sound is detected in the sudden sound detection unit continues for a predetermined number of frames. A sudden sound update determination unit for updating the current input signal,
A noise reduction device that performs the sudden sound suppression processing for each frame .
The sudden sound is anda sudden sound position determination unit determines whether located astride between the front input signals the input in the previous processing cycle of the current input signal,
The correlation value calculation unit, the phase difference calculation unit, and the addition signal generation unit detect that the sudden sound is located across the current input signal and the previous input signal by the sudden sound position determination unit. The sum signal is generated using the current input signal and the previous input signal as one input signal,
The sudden sound suppression unit, when the sudden sound position determination unit detects that the sudden sound is located across the current input signal and the previous input signal, the previous input signal and the current input A suppression process that indicates that the current input signal has been subjected to the suppression process is performed by applying the addition signal to the signal to perform a sudden sound suppression process and outputting the output signal corresponding to the previous input signal. A noise reduction device that activates a flag.
A sound determination unit that determines whether or not sound other than the suppression target is included in the current input signal;
The sudden sound update determination for updating the sudden sound information in response to the fact that the sound is not included in the current input signal in the sound determination unit and the sudden sound is detected in the sudden sound detection unit. And
The sudden sound update determination unit determines that the sudden sound exists between the current input signal and the previous input signal by the sudden sound position determination unit, and the current input signal and the previous sound signal When it is determined that none of the input signals includes the sound, the sudden sound information is updated by the current input signal and the previous input signal, and the sudden sound position determination unit The noise reduction device according to claim 2 , wherein when it is determined that the sudden sound exists in the previous input signal without straddling the previous input signal, the sudden sound information is updated by the previous input signal. .
A noise reduction method in a noise reduction device that outputs an output signal while suppressing sudden sound included in an input signal,
A voice signal obtained from the voice input unit is framed at a predetermined cycle to generate a current input signal, and a sudden sound suppression process is performed for each frame,
In the sudden sound suppression process,
The input signal that is input before the current input signal is lower than a preset threshold, and the input signal including the sudden sound to be suppressed is stored as sudden sound information,
Calculating a correlation value between the sudden sound information and the current input signal;
Calculate the phase difference between the sudden sound information and the sudden sound in the current input signal based on the maximum correlation value;
Shifting the phase of the sudden sound information based on the phase difference and inverting the sudden sound information to generate an addition signal,
Adding the added signal and the current input signal to suppress sudden sound in the current input signal and outputting an output signal ;
Detecting that the current input signal includes a sudden sound to be suppressed,
Determining whether or not speech other than the suppression target is included in the current input signal based on the spectral component of the current input signal;
A noise reduction method for updating the sudden sound information by the current input signal when the voice is not included in the current input signal and the frames in which the sudden sound is detected continue for a predetermined number of frames. .
Includes an operational unit and a storage unit, a pulp program being executed by the arithmetic unit in the noise reduction apparatus for outputting an output signal by suppressing the sudden sound included in the input signal,
The threshold below which the speech of the inputted input signal prior to the current input signal is preset, and the sudden sound information storing process of storing an input signal including a sudden sound suppression target as sudden sound information,
A correlation value calculation process for calculating a correlation value between the sudden sound information and the current input signal;
A phase difference calculation process for calculating a phase difference between the sudden sound information and the sudden sound in the current input signal based on the maximum correlation value;
An addition signal generation process for generating an addition signal by shifting the phase of the sudden sound information based on the phase difference and inverting the sudden sound information;
A sudden sound suppression process for adding the added signal and the current input signal to suppress sudden sound in the current input signal and outputting an output signal;
A sudden sound detection process for detecting that the current input signal includes a sudden sound to be suppressed; and
A sound determination process for determining whether or not sound other than the suppression target is included in the current input signal based on a spectral component of the current input signal;
The sudden sound information when the sound is not included in the current input signal in the sound determination process and the frame in which the sudden sound is detected in the sudden sound detection process continues for a predetermined number of frames. Help program to perform a sudden sound update determination processing of updating by the current input signal.
JP2014053857A 2014-03-17 2014-03-17 Noise reduction apparatus, noise reduction method, and noise reduction program Active JP6206271B2 (en)
JP2014053857A JP6206271B2 (en) 2014-03-17 2014-03-17 Noise reduction apparatus, noise reduction method, and noise reduction program
US14/461,311 US9691407B2 (en) 2014-03-17 2014-08-15 Noise reduction apparatus, noise reduction method, and noise reduction program
JP2015177447A JP2015177447A (en) 2015-10-05
JP6206271B2 true JP6206271B2 (en) 2017-10-04
ID=54069501
JP2014053857A Active JP6206271B2 (en) 2014-03-17 2014-03-17 Noise reduction apparatus, noise reduction method, and noise reduction program
US (1) US9691407B2 (en)
JP (1) JP6206271B2 (en)
US6636375B1 (en) * 1999-08-27 2003-10-21 Seagate Technology Llc Seek in a disc drive with nonlinear pivot friction
JP4373021B2 (en) * 2001-02-27 2009-11-25 株式会社日立グローバルストレージテクノロジーズ Information recording / reproducing device
JP2004192666A (en) * 2002-12-06 2004-07-08 Sony Corp Device and method for reducing noise
DE60333133D1 (en) * 2003-11-12 2010-08-05 Telecom Italia Spa Method and switching for estimating, associated filters, this user terminal and communication network, and computer program product therefor
JP4227529B2 (en) * 2004-01-06 2009-02-18 パナソニック株式会社 Periodic noise suppressor
JP4332789B2 (en) * 2004-01-14 2009-09-16 ソニー株式会社 Adaptive noise reduction method and adaptive noise reduction device
JP2006317671A (en) * 2005-05-12 2006-11-24 Sony Corp Signal processing circuit, signal processing method, imaging device, method for speech signal processing of imaging device, recording device and recording method, and reproduction device and reproduction method
JP2010249940A (en) * 2009-04-13 2010-11-04 Sony Corp Noise reducing device and noise reduction method
JP5504445B2 (en) 2010-03-26 2014-05-28 国立大学法人九州工業大学 Microphone device
2014-03-17 JP JP2014053857A patent/JP6206271B2/en active Active
2014-08-15 US US14/461,311 patent/US9691407B2/en active Active
US9691407B2 (en) 2017-06-27
JP2015177447A (en) 2015-10-05
US20150262576A1 (en) 2015-09-17
JP2016507086A (en) 2016-03-07 Ambient noise root mean square (RMS) detector
US8768692B2 (en) 2014-07-01 Speech recognition method, speech recognition apparatus and computer program
JP5100380B2 (en) 2012-12-19 Scalable decoding apparatus and lost data interpolation method
CN101122636A (en) 2008-02-13 Method of estimating sound arrival direction and apparatus of estimating sound arrival direction
DE102008027848A1 (en) 2009-01-08 Echo cancellers, echo cancellation and computer readable storage media
Ref document number: 6206271