Patent Description:
In the above technical field, patent literature <NUM> discloses a voice input/output apparatus that outputs a voice from a first loudspeaker and a second loudspeaker when a microphone unit is not used, and outputs a voice from the second loudspeaker while stopping the voice output from the first loudspeaker when the microphone unit is used. Patent literature <NUM> discloses a technique that improves the S/N of an utterance sound collected signal by suppressing the noise in an internal space by NC processing while ensuring the S/N of the utterance sound collected signal by the sound insulation capability of the housing of an attachment portion against environmental noise.

Prior art solutions are known from documents <CIT> and <CIT>.

However, in the technique described in the above patent literature <NUM>, it is unnecessary to perform echo cancellation since no echo is generated. In the technique described in the above patent literature <NUM>, it is unnecessary to cancel external noise in a voice signal input to an internal microphone since no environmental noise is input to the internal microphone. That is, it has not been conventionally conceived to cancel external noise in a voice signal captured by the internal microphone and cancel the echo in an output voice from the loudspeaker, so a high-quality main voice signal could not be generated.

The present invention enables to provide a technique of solving the above-described problem.

Aspects of the present invention are defined in the appended claims.

According to the present invention, it is possible to generate a high-quality main voice signal by performing both noise cancellation and echo cancellation.

Preferred example embodiments of the present invention will now be described in detail with reference to the drawings. It should be noted that the relative arrangement of the components, the numerical expressions and numerical values set forth in these example embodiments do not limit the scope of the present invention unless it is specifically stated otherwise. Further, in the drawings below, a unidirectional arrow simply indicates the flow direction of a given signal, and does not exclude bidirectionality. Note that the term "voice signal" in the following description refers to a direct electrical change which is generated in accordance with a voice or another sound and used to transmit the voice or the other sound, so this is not limited to a voice.

A voice input/output apparatus <NUM> according to the first example embodiment of the present invention will be described with reference to <FIG>.

As shown in <FIG>, the voice input/output apparatus <NUM> includes a main voice acquirer <NUM>, a noise acquirer <NUM>, a voice output unit <NUM>, a noise canceler <NUM>, and an echo canceler <NUM>. The noise acquirer <NUM> is arranged toward the outside of the body of a user <NUM>, and acquires (captures) external noise <NUM> arriving from the outside of the user <NUM>. The voice output unit <NUM> accepts an input of a voice signal <NUM>, and outputs a voice <NUM> to an ear canal <NUM> of the user <NUM>. The main voice acquirer <NUM> acquires (captures) a mixed voice, in which the external noise <NUM>, the output voice <NUM>, and a main voice <NUM> of the user <NUM> transmitted from the vocal cord of the user <NUM> through the ear canal are mixed, and outputs a mixed voice signal <NUM>. The noise canceler <NUM> processes the mixed voice signal <NUM> using a noise signal based on the external noise <NUM>. The echo canceler <NUM> processes the mixed voice signal <NUM> using the voice signal <NUM>.

According to this example embodiment, it is possible to generate a high-quality main voice signal by performing both the noise cancellation and the echo cancellation.

Next, a voice input/output apparatus according to the second example embodiment of the present invention will be described with reference to <FIG>. <FIG> is a view showing the arrangement of the voice input/output apparatus according to this example embodiment. A voice input/output apparatus <NUM> includes an internal microphone <NUM> serving as a main voice acquirer, an external microphone <NUM> serving as a noise acquirer, a loudspeaker <NUM> serving as a voice output unit, and a voice processor <NUM>. The voice processor <NUM> includes a noise canceler <NUM> and an echo canceler <NUM>. The voice input/output apparatus <NUM> may be an inner ear headphone, a canal headphone, a binaural headphone, a one-ear headphone, or a monaural headphone, but the present invention is not limited thereto. Further, the voice input/output apparatus <NUM> is not limited to the headphone, but may be an earphone or a headset.

The internal microphone <NUM> is an internal microphone arranged toward an ear canal <NUM> of a user <NUM>. A main voice <NUM> of the user <NUM> captured by the internal microphone <NUM> is transmitted to a predetermined transmission destination as a transmission signal <NUM>.

The internal microphone <NUM> captures a mixed voice, in which external noise <NUM>, an output voice <NUM>, and the main voice <NUM> are mixed, and outputs a mixed voice signal <NUM>. Even when the internal microphone <NUM> is arranged in the ear canal <NUM> as a confined space, if the external noise <NUM> is loud, the internal microphone <NUM> captures a part of the external noise <NUM> having passed through the head of the user <NUM> and propagated into the ear canal. Further, if the loudspeaker <NUM> is outputting a voice, the internal microphone <NUM> also captures the voice.

The external microphone <NUM> is arranged toward the outside of the body of the user <NUM>. The external microphone <NUM> captures the external noise <NUM> arriving from the outside of the user <NUM>. For example, the external microphone <NUM> is an external microphone that captures the external noise <NUM> around the user <NUM>. The external microphone <NUM> captures the external noise <NUM> and generates an external noise signal <NUM>.

A reception signal <NUM> received by a communication unit <NUM> is converted into an output voice signal <NUM> and input to the loudspeaker <NUM>. The loudspeaker <NUM> accepts an input of the output voice signal <NUM>, and outputs the output voice <NUM> to the ear canal <NUM> of the user <NUM>.

The noise canceler <NUM> processes, using a noise signal based on the external noise <NUM> captured by the external microphone <NUM>, the mixed voice signal <NUM> output from the mixed voice captured by the internal microphone <NUM>. The internal microphone <NUM> captures the mixed voice in which the main voice <NUM> of the user <NUM> and the external noise <NUM> are mixed.

The echo canceler <NUM> performs, using the output voice signal <NUM> input to the loudspeaker <NUM>, echo cancellation processing on the mixed voice signal <NUM> output by the internal microphone <NUM>.

The communication unit <NUM> receives the reception signal <NUM>, and sends the output voice signal <NUM> to the loudspeaker <NUM>. The communication unit <NUM> also receives a voice signal generated by the voice processor <NUM>, and transmits it to the outside as the transmission signal <NUM>.

<FIG> is a view showing the detailed arrangement of the voice processor of the voice input/output apparatus according to this example embodiment. The noise canceler <NUM> includes an adaptive filter <NUM> and an adder <NUM>. The external noise signal <NUM> generated by the external microphone <NUM> is input to the noise canceler <NUM>. The noise canceler <NUM> uses the external noise signal <NUM> based on the input external noise <NUM> to process the mixed voice signal <NUM>. The noise canceler <NUM> drives the adaptive filter <NUM> to generate a pseudo signal (pseudo noise signal <NUM>) of the noise signal included in the mixed voice signal. The adder <NUM> subtracts the pseudo noise signal <NUM> from the mixed voice signal <NUM> output by the internal microphone <NUM>, thereby suppressing the noise. A pseudo main voice signal <NUM> output from the adder <NUM> includes residual noise, and this is utilized to update the coefficient of the adaptive filter <NUM>.

The external noise signal <NUM> generated based on the external noise <NUM> captured by the external microphone <NUM> is also input to a controller <NUM>. Based on the input external noise signal <NUM>, the controller <NUM> controls the processing performed by the noise canceler <NUM>. The external noise signal <NUM>, the pseudo noise signal <NUM>, and the pseudo main voice signal <NUM> are input to the controller <NUM>. Based on these signals, the controller <NUM> generates a coefficient of the adaptive filter <NUM>, and controls the coefficient update timing.

The pseudo main voice signal <NUM> is input to the echo canceler <NUM>. The echo canceler <NUM> performs, using the output voice signal <NUM> input to the loudspeaker <NUM>, echo cancellation processing on the mixed voice signal <NUM> output by the internal microphone <NUM>. The echo canceler <NUM> includes an adaptive filter <NUM> and an adder <NUM>. The adaptive filter <NUM> generates a pseudo echo signal <NUM> using the output voice signal <NUM>. The adder <NUM> subtracts the pseudo echo signal <NUM> from the pseudo main voice signal <NUM> to generate a pseudo main voice signal <NUM>. The output voice signal <NUM> and the pseudo main voice signals <NUM> and <NUM> are input to the controller <NUM>. Based on these signals, the controller <NUM> generates a coefficient of the adaptive filter <NUM>, and controls the coefficient update timing.

In order to remove a part of the output voice signal <NUM> mixed in the mixed voice signal <NUM> captured by the internal microphone <NUM>, the echo canceler <NUM> performs the echo cancellation processing on the mixed voice signal <NUM> using the input voice signal.

In this manner, the echo canceler <NUM> performs the echo cancellation processing on the voice signal having undergone the noise cancellation processing. For example, even in a case in which the user utters a voice while the loudspeaker <NUM> is playing music, the echo canceler <NUM> can clearly extract the voice of the user from the mixed voice signal captured by the internal microphone <NUM>.

The communication unit <NUM> accepts the pseudo main voice signal <NUM> having undergone the processing by the noise canceler and the echo canceler, and transmits it to the outside as the transmission signal <NUM>.

<FIG> is a graph for explaining coefficient processing of the controller <NUM> of the voice input/output apparatus <NUM> according to this example embodiment. As has been described above, the noise canceler <NUM> performs the noise cancellation processing using the adaptive filter <NUM>, and the echo canceler <NUM> performs the echo cancellation processing using the adaptive filter <NUM>. In <FIG>, the ordinate represents the update amount (amount of leaning), and the abscissa represents the S/N (signal to noise ratio). A graph <NUM> indicates the update amount of the coefficient of the adaptive filter <NUM> of the noise canceler <NUM>. A graph <NUM> indicates the update amount of the coefficient of the adaptive filter <NUM> of the echo canceler <NUM>. As indicated by the graph <NUM> and the graph <NUM>, the controller <NUM> performs update processing of the adaptive filter <NUM>, and does not update the adaptive filter <NUM> until the update processing of the adaptive filter <NUM> converges. That is, the controller <NUM> performs update processing of the adaptive filter <NUM> after the update processing of the adaptive filter <NUM> has converged. That is, while the controller <NUM> is performing update processing of one of the adaptive filters, it does not perform update processing of the other adaptive filter, so both the adaptive filters <NUM> and <NUM> are never updated at the same time. Not the noise canceler <NUM> and the echo canceler <NUM> are turned on/off, but the updates (learning) of the adaptive filters <NUM> and <NUM> are turned on/off, so that the adaptive filters <NUM> and <NUM> are alternately updated. After the adaptive filters <NUM> and <NUM> are updated to some extent, each filter coefficient hardly changes. When reaching such a state, the filter coefficients of the adaptive filters <NUM> and <NUM> are determined, so the controller <NUM> does not reupdate the adaptive filters <NUM> and <NUM> in principle.

The controller <NUM> updates the adaptive filter <NUM> at a timing at which the internal microphone <NUM> does not capture the main voice <NUM> and the loudspeaker <NUM> is not outputting the output voice <NUM>. The controller <NUM> updates the adaptive filter <NUM> at a timing at which the loudspeaker <NUM> is outputting the output voice <NUM>.

At a timing at which the internal microphone <NUM> captures the main voice <NUM> and the loudspeaker <NUM> is outputting the output voice <NUM>, the controller <NUM> does not update the adaptive filters <NUM> and <NUM>.

According to this example embodiment, it is possible to transmit a high-quality main voice signal by performing both the noise cancellation and the echo cancellation. That is, it is possible to deliver the clear voice of the user to the partner. In addition, since the adaptive filters are updated, it is possible to cope with a change in external noise and a change in voice output from the loudspeaker. Further, also in a case in which, for example, the voice of the user is transmitted to a smartphone for voice recognition by an AI (Artificial Intelligence) assistant, the recognition accuracy is increased, so that misrecognition by the AI assistant can be reduced even outdoors with large external noise. Furthermore, it is possible to implement that the user makes a voice call or uses the AI assistant even while listening to music using a headphone.

Next, a voice input/output apparatus according to the third example embodiment of the present invention will be described with reference to <FIG> is a view showing the arrangement of the voice input/output apparatus according to this example embodiment. The voice input/output apparatus according to this example embodiment is different from that in the above-described second example embodiment in that the arrangement of a voice processor <NUM> is different from the arrangement of the voice processor <NUM>. The remaining components and operations are similar to those in the second example embodiment. Hence, the same reference numerals denote the similar components and operations, and a detailed description thereof will be omitted.

In addition to the arrangement of the voice processor <NUM> in the second example embodiment, the voice processor <NUM> includes a noise canceler <NUM>, an echo canceler <NUM>, and a controller <NUM>. The echo canceler <NUM> includes an adder <NUM> and an adaptive filter <NUM>. In the echo canceler <NUM>, the adder <NUM> subtracts, from an external noise signal <NUM> captured by an external microphone <NUM>, a pseudo output voice <NUM> generated by the adaptive filter <NUM> from an output voice signal <NUM> of a loudspeaker <NUM>. With this operation, sound leakage from the loudspeaker <NUM> is canceled, so that a high-quality pseudo external noise signal <NUM> can be obtained.

The external noise signal <NUM>, the external noise signal <NUM> having undergone the echo cancellation processing, and the output voice signal <NUM> are input to the controller <NUM>, and the controller <NUM> generates a coefficient of the adaptive filter <NUM> to control an update.

The noise canceler <NUM> includes an adder <NUM> and an adaptive filter <NUM>. In the noise canceler <NUM>, the adder <NUM> subtracts, from a voice signal <NUM> generated based on a reception signal <NUM>, the pseudo noise signal <NUM> generated from the pseudo external noise signal <NUM>.

According to this example embodiment, it is possible to transmit a high-quality main voice signal by performing both the noise cancellation and the echo cancellation. In addition, it is possible to remove the influence of the sound leakage output from the loudspeaker and mixed into the external microphone.

Next, a voice input/output apparatus according to the fourth example embodiment of the present invention will be described with reference to <FIG> is a view for explaining the arrangement of a voice input/output apparatus <NUM> according to this example embodiment. The voice input/output apparatus <NUM> according to this example embodiment is different from the voice input/output apparatus <NUM> according to the above-described third example embodiment in that there is no controller <NUM>. The remaining components and operations are similar to those in the second and third example embodiments. Hence, the same reference numerals denote the similar components and operations, and a detailed description thereof will be omitted.

An adaptive filter <NUM> generates a pseudo noise signal <NUM> from a pseudo external noise signal <NUM> having undergone echo cancellation, and an adder <NUM> subtracts the pseudo noise signal <NUM> from a voice signal <NUM> generated from a reception signal <NUM>.

An echo canceler <NUM> includes an adaptive filter <NUM> and an adder <NUM>. The adaptive filter <NUM> generates a pseudo output voice signal <NUM>. The adder <NUM> subtracts the pseudo output voice signal <NUM> from an external noise signal <NUM>.

According to this example embodiment, an effect similar to that in the third example embodiment can be obtained with the simpler arrangement.

Next, a hearing aid according to the fifth example embodiment of the present invention will be described with reference to <FIG> are views showing the arrangement of the hearing aid according to this example embodiment. The hearing aid according to this example embodiment is different from the voice input/output apparatus according to the above-described fourth example embodiment in that a hearing aid function and switches are added. The remaining components and operations are similar to those in the fourth and example embodiments. Hence, the same reference numerals denote the similar components and operations, and a detailed description thereof will be omitted.

<FIG> shows a case in which while listening to the voice of a partner, leakage of external noise is allowed. As shown in <FIG>, a hearing aid <NUM> includes an internal microphone <NUM>, an external microphone <NUM>, a loudspeaker <NUM>, a communication unit <NUM>, and a voice processor <NUM>. The voice processor <NUM> further includes an amplifier <NUM>, switches <NUM> and <NUM>, and an adder <NUM>. A voice signal <NUM> corresponding to a reception signal <NUM> input via the communication unit <NUM> is amplified by the amplifier <NUM>, input to the loudspeaker <NUM>, and output as an output voice. In the hearing aid <NUM>, since the output voice output from the loudspeaker <NUM> is loud, the mixing ratio of the output voice in the mixed voice is high. Therefore, the effect of performing cancelation on the output voice captured by the internal microphone <NUM> is large. In addition, since the amplified output voice easily leaks to the outside of the user from the hearing aid <NUM>, an echo canceler <NUM> is very important. The user can hear the voice of the call partner at a loud volume. Even the hearing aid <NUM> can capture a high-quality main voice. On the other hand, although the internal microphone <NUM> easily captures the amplified output voice, a high-quality pseudo main voice signal can be generated by the operation of the echo canceler <NUM>.

<FIG> shows a case in which while canceling the external noise, each of the self-voice and the voice of the partner is heard at a loud volume. In this case, the switch <NUM> is connected to the contact on the adaptive filter <NUM> side. In synchronization with the movement of the switch <NUM>, the switch <NUM> is closed. The adaptive filter <NUM> and the adder <NUM> operate as described with reference to <FIG>. With this operation, the user can hear the voice with the external noise canceled. In addition, since the switch <NUM> is closed, the adder <NUM> adds the pseudo main voice signal and the voice signal <NUM> generated from the reception signal <NUM>. With this operation, a user <NUM> can hear the self-generated voice, which is called sidetone.

<FIG> shows a case in which the user hears each of the external noise and the voice of the partner at a loud volume. In this case, the switch <NUM> is connected to a contact on the opposite side of the noise canceler <NUM>. Further, the switch <NUM> is opened in synchronization with the movement of the switch <NUM>. The echo canceler <NUM> cancels the influence of sound leakage. The adder <NUM> adds the clear external noise and the received voice of the partner. The amplifier <NUM> amplifies the voice signal added by the amplifier <NUM> to generate an output voice signal <NUM>. With this operation, the user can hear each of the external sound and the voice of the call partner at a loud volume.

Next, a voice input/output apparatus according to the sixth example embodiment of the present invention will be described with reference to <FIG> is a view showing the arrangement of the voice input/output apparatus according to this example embodiment. The voice input/output apparatus according to this example embodiment is different from that in the above-described second example embodiment in that an attachment and detachment detector <NUM> is provided. The remaining components and operations are similar to those in the second example embodiment. Hence, the same reference numerals denote the similar components and operations, and a detailed description thereof will be omitted.

The attachment and detachment detector <NUM> uses, for example, the blood flow sound or the heartbeat sound captured by an internal microphone <NUM> to detect attachment/detachment of a voice input/output apparatus <NUM> to/from the ear. Further, the attachment and detachment detector <NUM> may, for example, oscillate an ultrasonic wave inaudible to humans, and detect the attachment/detachment based on the presence/absence of a reflected wave of the ultrasonic wave. Furthermore, the attachment and detachment detector <NUM> may detect the attachment/detachment using an infrared sensor, an accelerometer, or the like. Note that the attachment/detachment detection method is not limited to these methods.

If the attachment and detachment detector <NUM> has detected attachment of the voice input/output apparatus <NUM>, a noise canceler <NUM> performs noise cancellation processing using an adaptive filter <NUM>, and an echo canceler <NUM> performs echo cancellation processing using an adaptive filter <NUM>. The echo state changes for each user wearing the voice input/output apparatus <NUM>, so that a controller <NUM> updates the adaptive filter <NUM> every time the attachment of the voice input/output apparatus <NUM> is detected. On the other hand, the noise state also changes for each attachment situation (location or time), so that the controller <NUM> updates the adaptive filter <NUM> every time the attachment is detected. According to this example embodiment, since the attachment/detachment detector is provided, even if the user who uses the voice input/output apparatus changes or the user refits the voice input/output apparatus, the quality of a transmission signal can be increased. Note that if it is detected by the attachment and detachment detector <NUM> that the voice input/output apparatus <NUM> has been detached, the voice input/output apparatus <NUM> may stop all functions of the voice input/output apparatus <NUM>.

Next, a voice input/output apparatus according to the seventh example embodiment of the present invention will be described with reference to <FIG> is a view showing the arrangement of the voice input/output apparatus according to this example embodiment. The voice input/output apparatus according to this example embodiment is different from that in the above-described second example embodiment in that a sound insulator is provided. The remaining components and operations are similar to those in the second example embodiment. Hence, the same reference numerals denote the similar components and operations, and a detailed description thereof will be omitted.

A sound insulator <NUM> limits the intrusion route of external noise <NUM> to an internal microphone <NUM>. The sound insulator is, for example, a cylindrical member surrounding the internal microphone <NUM>. So as not to insulate a main voice <NUM> that arrives through an ear canal <NUM> of a user <NUM>, the side of the sound insulator <NUM> facing the ear canal <NUM> of the user <NUM> is open. Note that the shape of the sound insulator <NUM> is not limited to the shape described here, and any shape may be used as long as the external noise <NUM> transmitted through the body of the user <NUM> or a voice input/output apparatus <NUM> can be insulated. Further, the material of the sound insulator <NUM> may be any material as long as the sound insulator <NUM> functions as a member capable of insulating the external noise <NUM>. For example, rubber, a resin, glass, or the like can be employed. According to this example embodiment, since a noise canceler <NUM>, an echo canceler <NUM>, and the sound insulator <NUM> are provided, a high-quality pseudo main voice signal can be generated.

While the invention has been particularly shown and described with reference to example embodiments thereof, the invention is not limited to these example embodiments. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the claims. A system or apparatus including any combination of the individual features included in the respective example embodiments may be incorporated in the scope of the present invention.

The present invention is applicable to a system including a plurality of devices or a single apparatus. The present invention is also applicable even when an information processing program for implementing the functions of example embodiments is supplied to the system or apparatus directly or from a remote site. Hence, the present invention also incorporates the program installed in a computer to implement the functions of the present invention by the computer, a medium storing the program, and a WWW (World Wide Web) server that causes a user to download the program. Especially, the present invention incorporates at least a non-transitory computer readable medium storing a program that causes a computer to execute processing steps included in the above-described example embodiments.

<FIG> is a block diagram showing the configuration of a computer <NUM> that executes a signal processing program when the second example embodiment is formed by the signal processing program. The computer <NUM> includes an input unit <NUM>, a CPU (Central Processing Unit) <NUM>, an output unit <NUM>, and a memory <NUM>.

The CPU <NUM> controls an operation of the computer <NUM> by reading the signal processing program stored in the memory <NUM>. That is, the CPU <NUM> executing the signal processing program captures external noise <NUM> of the user from the input unit <NUM> in step S801. In step S803, the CPU <NUM> outputs a voice signal from the output unit <NUM>. In step S805, the CPU <NUM> captures, from the input unit <NUM>, a mixed voice signal <NUM> in which the external noise <NUM>, a main voice <NUM>, and an output voice <NUM> from a voice output unit are mixed. In step S807, the CPU <NUM> performs noise cancellation processing on the captured mixed voice signal <NUM>. In step S809, the CPU <NUM> uses a voice signal input to a loudspeaker <NUM> to perform echo cancellation processing on the captured mixed voice signal <NUM>. In step S811, the CPU <NUM> transmits a voice signal.

<FIG> is a flowchart illustrating the procedure of processing performed by the CPU <NUM>. In step S821, the CPU <NUM> determines whether the mixed voice signal <NUM> is captured by the internal microphone <NUM>. If it is determined that the mixed voice signal <NUM> is captured (YES in step S821), the CPU <NUM> terminates the processing. If it is determined that no mixed voice signal <NUM> is captured (NO is step S821), the CPU <NUM> advances to step S823. In step S823, the CPU <NUM> determines whether the output voice <NUM> is being output from the loudspeaker <NUM>. If it is determined that the output voice <NUM> is being output (YES in step S823), the CPU <NUM> terminates the processing. If it is determined that no output voice <NUM> is being output (NO in step S823), the CPU <NUM> advances to step S825. In step S825, the CPU <NUM> updates an adaptive filter <NUM> of a noise canceler <NUM>.

<FIG> is a flowchart illustrating the procedure of processing performed by the CPU <NUM>. In step S831, the CPU <NUM> determines whether the output voice <NUM> is being output from the loudspeaker <NUM>. If it is determined that no output voice <NUM> is being output (NO in step S831), the CPU <NUM> terminates the processing. If it is determined that the output voice <NUM> is being output (YES in step S831), the CPU <NUM> advances to step S832. In step S832, the CPU <NUM> determines whether the main voice is captured. If it is determined that the main voice is captured (YES in step S832), the CPU <NUM> terminates the processing. If it is determined that the main voice is not captured (NO in step S832), the CPU <NUM> advances to step S833. In step S833, the CPU <NUM> updates an adaptive filter (<NUM>) of an echo canceler <NUM>.

Claim 1:
A voice input/output apparatus comprising:
a noise acquirer (<NUM>, <NUM>) that acquires external noise arriving from the outside of the user;
a voice output unit (<NUM>, <NUM>) that accepts an input of a voice signal and outputs a voice to an ear canal of the user;
a main voice acquirer (<NUM>, <NUM>) that acquires a mixed voice, in which the external noise, the output voice, and a main voice of the user transmitted from a vocal cord of the user through the ear canal are mixed, and outputs a mixed voice signal;
a noise canceler (<NUM>, <NUM>) that processes the mixed voice signal using a noise signal based on the external noise and an echo canceler (<NUM>, <NUM>) that processes the mixed voice signal using the voice signal,
wherein the voice output unit (<NUM>, <NUM>) is configured to output the voice signal processed by the noise canceler (<NUM>, <NUM>) and echo canceler (<NUM>, <NUM>),
wherein the noise canceler (<NUM>, <NUM>) performs noise cancellation processing using a first adaptive filter, and the echo canceler performs echo cancellation processing using a second adaptive filter, and wherein
the first adaptive filter (<NUM>) is updated at a timing at which the main voice acquirer (<NUM>) does not capture the main voice (<NUM>) and the voice output unit (<NUM>) is not outputting the output voice (<NUM>), wherein
the second adaptive filter (<NUM>) is updated at a timing at which the voice output unit (<NUM>) is outputting the output voice (<NUM>), and wherein
at a timing at which the main voice acquirer (<NUM>) captures the main voice (<NUM>) and the voice output unit (<NUM>) is outputting the output voice (<NUM>), the first (<NUM>) and second (<NUM>) adaptive filters are not updated.