Patent Description:
The use of sound sensors installed in various electronic devices to sense sound is increasing. A plurality of sound sensors are employed in electronic devices to distinguish various types of received sounds or to sense only a specific sound. However, in order to improve the accuracy of sensing a specific sound, a large number of sound sensors are required, and thus, process cost, complexity, and power consumption increase. Additionally, when the plurality of sound sensors are used to receive the sound signals, the complexity of a time delay calculation for the sound signals also increases. Accordingly, there is a need for a technology for clearly and efficiently sensing a specific sound.

In addition, the use of wearable devices equipped with sound sensors is increasing. Due to the characteristics of the wearable device that may be used in various sound environments, a technology for clearly discriminating and sensing a user's voice and sound generated from outside the user is required.

<CIT> describes a small array microphone system including an array microphone having a plurality of microphones and operative to provide a plurality of received signals.

<CIT> describes systems and methods to extract desired audio from an apparatus to be worn on a user's head. A first microphone is coupled to the head wearable device.

<CIT> describes a method and a headset for reducing popnoise in voice communication between a user and a far-end device.

<NPL>", describes an adaptive noise cancellation scheme based on two-stage adaptive filtering.

<CIT> describes a broadside small array microphone beamforming apparatus comprising first and second omni-directional microphones.

<CIT> describes a directional microphone which includes a substrate having a cavity that penetrates therethrough and a resonator array of at least one resonator.

One or more example embodiments provide sound signal processing apparatuses. The technical problems to be achieved are not limited to the above technical problems, and other technical problems may be inferred from the following embodiments.

According to an aspect of an example embodiment, there is provided a sound signal processing apparatus according to claim <NUM>.

The directional microphone may include a plurality of vibration structures configured to sense sound of different frequency bands, wherein each of the plurality of vibration structures may include a vibrator that forms one plane for receiving the mixed sound signal, and as the mixed sound signal is received, vibrates in a direction orthogonal to the one plane based on a frequency of the mixed sound signal.

The vibrator vibrates with a vibration intensity based on an angle between a propagation direction of the mixed sound signal and the one plane formed by the vibrator.

The vibrator vibrates with a higher vibration intensity as the angle approaches <NUM>°, and vibrates with a lower vibration intensity as the angle approaches <NUM>°.

The directional microphone is arranged so that an angle formed between the one plane and a direction from the utterance point of the user's voice is in a range of <NUM>° to <NUM>°.

Each of the plurality of vibration structures may include a vibration detector configured to receive a vibration of the vibrator.

The directional microphone is configured to determine an electrical signal to be attenuated from among electrical signals generated by the vibration structures, and attenuate the determined electrical signal.

The directional microphone is further configured to determine a threshold value based on an average magnitude of the electrical signals generated by the vibration structures.

The sound signal processing apparatus may include an adaptive filter configured to adjust parameters for combining the user voice signal and the mixed sound signal, so that the user's voice is attenuated from the mixed sound signal based on a feedback signal, wherein the processor is further configured to: generate the feedback signal by differentially calculating a signal output from the adaptive filter from the mixed sound signal as the user voice signal is input to the adaptive filter; and control the adaptive filter to adjust the parameters by inputting the feedback signal to the adaptive filter.

The non-directional microphone is configured to generate a first external sound signal from which the user's voice is attenuated, from the mixed sound signal, by arranging a plane receiving the mixed sound signal in a direction different from a direction in which the direction microphone is arranged, and in a direction corresponding to a point where the external sound is generated; and the processor is further configured to generate a second external sound signal from which the user's voice is further attenuated than that of the first external sound signal, by differentially calculating the user voice signal from the first external sound signal.

Terminologies used herein are selected as commonly used by those of ordinary skill in the art in consideration of functions of the current embodiment, but may vary according to the technical intention, precedents, or a disclosure of a new technology. Also, in particular cases, some terms are arbitrarily selected by the applicant, and in this case, the meanings of the terms will be described in detail at corresponding parts of the specification Accordingly, the terms used in the specification should be defined not by simply the names of the terms but based on the meaning and contents of the whole specification.

In the descriptions of the embodiments, it will be understood that, when an element is referred to as being connected to another element, it may include electrically connected when the element is directly connected to the other element and when the element is indirectly connected to the other element by intervening a constituent element. Also, it should be understood that, when a part "comprises" or "includes" a constituent element in the specification, unless otherwise defined, it is not excluding other elements but may further include other elements.

It will be further understood that the term "comprises" or "includes" should not be construed as necessarily including various constituent elements and various operations described in the specification, and also should not be construed that portions of the constituent elements or operations of the various constituent elements and various operations may not be included or additional constituent elements and operations may further be included.

It will be understood that, although the terms 'first', 'second', etc. may be used herein to describe various constituent elements, these constituent elements should not be limited by these terms. These terms are only used to distinguish one constituent element from another.

The descriptions of the embodiments should not be interpreted as limiting the scope of right, and embodiments that are readily inferred from the detailed descriptions and embodiments by those of ordinary skill in the art will be construed as being included in the inventive concept.

<FIG> is a block diagram illustrating a configuration of a sound signal processing apparatus according to an example embodiment.

Referring to <FIG>, the sound signal processing apparatus <NUM> may include a user microphone <NUM>, an ambient microphone <NUM>, and a processor <NUM>. In the sound signal processing apparatus <NUM> illustrated in <FIG>, components related to the present embodiments are illustrated. Accordingly, it is apparent to those skilled in the art that general-purpose components other than the components shown in <FIG> may further be included in the sound signal processing apparatus <NUM>.

The sound signal processing apparatus <NUM> may be a wearable device worn by a user to receive the user's voice. Alternatively, the sound signal processing apparatus <NUM> is not wearable by the user and may be disposed adjacent to the sound output apparatus or included in the sound output apparatus. However, this is only an example, and the sound signal processing apparatus <NUM> may be modified and implemented in various forms capable of receiving sound. Examples of the sound signal processing apparatus <NUM> will be described later with reference to <FIG>.

The sound signal processing apparatus <NUM> may include different types of microphones to generate various sound signals for the received sound. Even if the same sound is received, the sound signal generated by the microphone may be different according to the configuration and operation of the microphone. Accordingly, the sound signal processing apparatus <NUM> may generate a target sound signal by including different types of microphones. The sound signal processing apparatus <NUM> may include a user microphone <NUM> for detecting a user's voice and an ambient microphone <NUM> for detecting a whole sound including the user's voice. The whole sound may be a mixed sound signal including the user's voice and other ambient sound.

The user microphone <NUM> and the ambient microphone <NUM> may receive the whole sound including the user's voice and an external sound generated from outside the user. The user's voice may correspond to the voice of a user who uses or wears the sound signal processing apparatus <NUM>. The external sound is a sound received from the outside of the user and may correspond to a sound other than the user's voice. For example, the external sound may include a voice of an outsider having a conversation with the user, a sound output from an image viewed by the user, or a sound generated in an environment around the user. The whole sound is a sound including both a user's voice and an external sound, and may correspond to all sounds transmitted (or received) to the sound signal processing apparatus <NUM>. The whole sound is transmitted (or received by) to the user microphone <NUM>, but external sound may be attenuated from the whole sound by a structure or operation of the user microphone <NUM>, and thus, a user voice signal may be generated.

The user microphone <NUM> and the ambient microphone <NUM> may convert a received sound into an electrical signal including information, such as frequency, amplitude, and time.

The user microphone <NUM> may generate a user voice signal by attenuating an external sound from the whole received sound. The user microphone <NUM> may generate a further clearer user voice signal by attenuating the external sound. For example, the user microphone <NUM> may have directivity with respect to a user's voice in order to attenuate a received external sound. Alternatively, the user microphone <NUM> may attenuate a signal corresponding to the external sound based on a threshold value. The configuration and operation of the user microphone <NUM> will be described later with reference to <FIG>.

Also, the user microphone <NUM> may receive a sound through one plane formed by the user microphone <NUM>. Here, the one plane may denote a plane formed by a vibrating unit of the user microphone <NUM> or may denote a plane formed by a plurality of vibrating units arranged in a plane. The user microphone <NUM> may be arranged in the sound signal processing apparatus <NUM> so that the one plane formed by the user microphone <NUM> is disposed in a direction corresponding to the point of utterance of the user's voice, or to face the positon of utterance of the user's voice. Due to the arrangement of the user's microphone <NUM>, the user's voice may be sensed with a high sensitivity and an external sound may be sensed with a low sensitivity. Accordingly, an external sound is attenuated from the whole sound received by the user microphone <NUM>, and the user voice signal, which is a sound signal generated by the user microphone <NUM>, may be a signal from which the external sound is attenuated.

For example, the user microphone <NUM> may be disposed in the sound signal processing apparatus <NUM> so that an angle formed between the one plane receiving the whole sound and a direction from the utterance point of the user's voice to the one plane is in a range of <NUM>° to <NUM>°. The arrangement of the user microphone <NUM> (or the vibrator of the user microphone) will be described later with reference to <FIG> and <FIG>.

The ambient microphone <NUM> may generate a whole sound signal from the received whole sound. The ambient microphone <NUM> may generate a whole sound signal from which neither the user's voice nor the external sound is attenuated or emphasized.

The processor <NUM> may receive the sound signals generated by microphones and perform an operation with respect to the received sound signals. The processor <NUM> may generate an external sound signal by differentially calculating the user voice signal from the whole sound signal. The external sound signal may be a signal from which a signal corresponding to the user's voice is attenuated from the whole sound signal. Accordingly, the external sound signal may include only a signal corresponding to the external sound or may be a signal in which a signal corresponding to the external sound is emphasized. Here, the emphasis of a specific signal does not mean that the specific signal is amplified, but rather that the specific signal becomes clear as other signals are attenuated.

A method for the processor <NUM> to perform the difference operation will be described later with reference to <FIG> and <FIG>.

The processor <NUM> may be implemented as an array of a plurality of logic gates, or may be implemented as a combination of a general-purpose microprocessor and a memory in which a program executable in the microprocessor is stored. In addition, it may be understood by those skilled in the art that the present embodiment may be implemented in other types of hardware.

As described above, because the sound signal processing apparatus <NUM> may generate a user voice signal separately from an external sound signal, it is possible to distinguish the user's voice and the external sound from whole received sounds. That is, even when a user's voice and an external sound are simultaneously received by the sound signal processing apparatus <NUM>, the sound signal processing apparatus <NUM> may distinguish each sound and generate a signal corresponding to each sound. Accordingly, the sound signal processing apparatus <NUM> may perform a function or process a command corresponding to each of a user's voice and an external sound in any sound environment.

<FIG> is a block diagram illustrating a configuration of a user microphone <NUM> according to an example embodiment.

Referring to <FIG>, the user microphone <NUM> may include a plurality of vibration structures <NUM>. Each vibration structure <NUM> may include a vibrator <NUM> and a vibration detector <NUM>. In the user microphone <NUM> shown in <FIG>, components related to the present embodiments are shown. Accordingly, it is apparent to those skilled in the art that other general-purpose components other than the components shown in <FIG> may further be included in the user microphone <NUM>. For example, the user microphone <NUM> may further include a support or a sound controller.

The user microphone <NUM> may include a plurality of vibration structures <NUM> configured to sense sounds of different frequency bands. The plurality of vibration structures <NUM> may be formed in different shapes (e.g., length, thickness, shape, weight, etc.) and may have a resonant frequency corresponding to the shape. The plurality of vibration structures <NUM> may sense sound in a frequency band corresponding to each resonant frequency. A detailed structure of the vibration structure <NUM> will be described later with reference to <FIG> and <FIG>.

The vibrator <NUM> may vibrate as the whole sound is received. For example, the vibrator <NUM> may vibrate as a sound having a frequency close to the resonant frequency of the vibrator <NUM> is received. Each vibrator <NUM> may form a plane for receiving a whole sound. In addition, as the vibrators <NUM> are arranged in a plane within the user microphone <NUM>, the user microphone <NUM> may form one plane corresponding to a plurality of planes of the vibrators <NUM>. As the whole sound is received, the vibrator <NUM> may vibrate in a direction orthogonal to one plane based on the frequency of the whole sound. One plane formed by the vibrator <NUM> will be described later with reference to <FIG>.

The vibration detector <NUM> may receive the vibration of the vibrator <NUM> and generate an electrical signal corresponding to the received vibration. As the vibration is converted into an electrical signal by the vibration detector <NUM>, the sound signal processing apparatus <NUM> may perform various processes and operations on the received sound.

<FIG> is a diagram illustrating a configuration of the user microphone <NUM>.

Referring to <FIG>, the user microphone <NUM> may include a support <NUM> and a plurality of vibration structures <NUM>. The support <NUM> may be formed to support the plurality of vibration structures <NUM> in a cavity (or a through-hole) <NUM>. For example, the support <NUM> may be a silicon substrate, but is not limited thereto.

The plurality of vibration structures <NUM> may be arranged in a predetermined shape on the cavity <NUM> of the support <NUM>. The vibration structures <NUM> may be arranged in a plane without overlapping each other. Each vibrating structure <NUM>, as shown, may be arranged so that one side is fixed to the support <NUM> and the other side extends toward the cavity <NUM>.

The vibration structure <NUM> may be configured to sense, for example, sound frequencies of different bands. That is, the vibration structures <NUM> may be configured to have different center frequencies or resonant frequencies. To this end, the vibration structure <NUM> may be provided to have different dimensions. The dimension of the vibrating structure <NUM> may be set in consideration of a resonant frequency desired for the vibrating structure <NUM>.

<FIG> are cross-sectional views illustrating a vibration structure <NUM> of <FIG>.

Referring to <FIG>, the vibration structure <NUM> may include the vibrator <NUM>, the vibration detector <NUM>, and a mass body <NUM>. As shown, the vibrating structure <NUM> may be arranged so that one side is fixed to the support <NUM> and the other side extends toward the cavity <NUM>.

Each vibration structure <NUM> may include the vibrator <NUM> configured to vibrate in response to an input sound, and the vibration detector <NUM> configured to sense the movement of the vibrator <NUM>. In addition, the vibrating structure <NUM> may further include the mass body <NUM> for providing a predetermined mass to the vibrator <NUM>.

The vibrator <NUM> may vibrate based on a frequency of a received sound. The vibrator <NUM> may vibrate significantly as the frequency of the received sound approaches the resonant frequency, and vibrates slightly as the frequency of the received sound is farther from the resonant frequency. Alternatively, the vibrator <NUM> may vibrate when a sound of a sensible frequency band is received, and may not vibrate when a sound outside the sensible frequency band is received.

The vibrator <NUM> may have a cantilever structure that extends horizontally, and is supported at only one end. The vibrator <NUM> may be formed as a beam or plate, and one end of the beam is connected to the support <NUM> and an opposing end of the beam overhangs without additional support.

Referring to <FIG> and <FIG>, the vibrator <NUM> may form a plane 112a for receiving a sound.

The vibrator <NUM> may vibrate in a direction orthogonal to the one plane 112a as the whole sound is received. The vibrator <NUM> may vibrate with an intensity based on an angle between the propagation direction <NUM> of a receiving sound and the one plane 112a. The vibrator <NUM> may vibrate with a large vibration intensity as the angle between the propagation direction <NUM> of the sound and the plane 112a approaches <NUM>°, and vibrates with a small vibration strength as the angle approaches <NUM>°.

As shown in <FIG>, when a sound propagating at an angle of <NUM>° with respect to one plane 112a is received, the vibrator <NUM> may vibrate with the greatest vibration intensity. In addition, as shown in <FIG>, when a sound propagating at an angle less than <NUM>° with respect to one plane 112a is received, the vibrator <NUM> may vibrate with a vibration intensity less than that in <FIG>.

Due to the vibrating operation of the vibrator <NUM> as described above, the user's microphone <NUM> (or vibrating structures <NUM>) may be arranged in the sound signal processing apparatus <NUM> in consideration of the sound propagation direction <NUM>. For example, the user's microphone <NUM> may be arranged in the sound signal processing apparatus <NUM> so that the user's voice is propagated to the plane 112a at an angle close to <NUM>°. In other words, the user's microphone <NUM> may be arranged so that the one plane 112a faces an utterance point of the user's voice, and this arrangement will be described later with reference to <FIG> and <FIG>.

<FIG> is a diagram for explaining a sound sensing method using ambient microphones according to a comparative example.

The sound sensing method according to the comparative example of <FIG> may use a plurality of ambient microphones <NUM> to maximize sound in a specific direction. The plurality of ambient microphones <NUM> are arranged with a predetermined interval D, due to the interval D, a time or phase delay for sound to reach each ambient microphone <NUM> occurs, and by varying the degree of compensating for the time or phase delay occurred, the overall directivity may be adjusted. This directivity control method may be referred to as Time Difference of Arrival (TDOA).

However, the method described above assumes that there is a difference in the time for sound to reach each ambient microphone <NUM>, and because the interval must be set in consideration of a wavelength of an audible frequency band, there may be a restriction in setting the interval between the ambient microphones <NUM>. Because there is a restriction in setting the interval, there may be a restriction on the miniaturization of the apparatus for performing the above-described method. In particular, because the low frequency has a long wavelength, the interval between the ambient microphones <NUM> is set to be wide in order to distinguish the low frequency sound, and a signal-to-noise ratio (SNR) of each ambient microphone <NUM> must be high.

In addition, in the method described above, because the phase is different according to the frequency band of the sound sensed by each ambient microphone <NUM>, it may be necessary to compensate the phase for each frequency. In order to compensate the phase for each frequency, the method described above may require a complex signal processing process of applying an appropriate weight to each frequency.

Unlike the comparative example of <FIG>, the sound signal processing apparatus <NUM> according to an example embodiment may not require restrictions on the distance between microphones. The sound signal processing apparatus <NUM> may acquire sound in a specific direction by distinguishing directions using a simple operation without complex signal processing. Hereinafter, an efficient structure and operation of the sound signal processing apparatus <NUM> will be described in detail with reference to the drawings.

<FIG> is a diagram for describing a directivity pattern of a user's microphone <NUM> according to an example embodiment.

Referring to <FIG>, the user microphone <NUM> may have bi-directional signal patterns <NUM> and <NUM>. For example, the bi-directional signal patterns <NUM> and <NUM> may be a figure-<NUM> directional pattern including a front plane unit <NUM> oriented toward a front (+z direction) of the user microphone <NUM> and a rear plane unit <NUM> oriented toward a rear (-z direction) of the user microphone <NUM>.

When a sound source is on a primary axis of the user microphone <NUM>, and a sound is propagated vertically to the plane 112a formed by the vibrator <NUM>, the vibrator <NUM> may react most sensitively and vibrate with a great vibration intensity. Accordingly, a directivity pattern may be formed based on sensitive directions of the front direction (+z direction) and the rear direction (-z direction) of the user microphone <NUM>, which is a direction orthogonal to the one plane 112a. In this case, the sensitivity of the user's microphone <NUM> to the sound may reduce when the user's microphone <NUM> moves off-axis and the sound is received in a non-sensitive direction (e.g., +x direction and -x direction). Accordingly, the user's microphone <NUM> may attenuate a sound received in a non-sensitive direction (e.g., +x direction and -x direction).

Depending on the structure of the user's microphone <NUM>, a unidirectional signal pattern in the +z direction or -z direction may be formed by blocking the reception of sound on one plane. The directivity patterns described above of the user microphone <NUM> are merely examples, and the directivity patterns may be variously modified according to the arrangement of the vibrating structures <NUM> (or vibrators <NUM>).

<FIG> is a diagram illustrating a result of measuring a directivity pattern of a user's microphone.

As shown in <FIG>, it may be confirmed that the user's microphone has a uniformly bi-directional signal pattern with respect to various frequencies. That is, it may be confirmed that a <NUM>° direction and a <NUM>° direction for various frequencies have directivity in the +z axis direction and the -z axis direction of <FIG>.

<FIG> is a diagram for describing a signal processing of a sound signal processing apparatus according to an example embodiment.

Referring to <FIG>, the user microphone <NUM> may have a bi-directional signal pattern <NUM>, and the ambient microphone <NUM> may have an omni-directional or non-directional signal pattern <NUM>. The user microphone <NUM> may sense a sound that is inphase with a phase of the sound sensed by the ambient microphone <NUM> from a front direction of the bi-directional signal pattern <NUM> (e.g., +z direction in <FIG>), and a sound that is anti-phase to a phase of a sound sensed by the ambient microphone <NUM> from a rear direction (e.g., -z direction in <FIG>). However, the directivity pattern of the user microphone <NUM> shown in <FIG> is merely an example, and as described above, the directivity pattern may be variously modified according to the structure of the user microphone <NUM> and the arrangement of vibration structures <NUM> (or vibrators).

<FIG> is a graph showing a result of measuring directivity patterns of a user microphone and an ambient microphone according to an example embodiment.

Referring to <FIG>, it may be seen that the user microphone has a bi-directional signal pattern, and the ambient microphone has an omni-directional (or non-directional) signal pattern. For example, the user microphone may sense a sound transmitted from a <NUM>° to <NUM>° area (<NUM>° to <NUM>° based on one plane formed by the user microphone) corresponding to a front plane (+z direction in <FIG>), and sense a sound transmitted from a <NUM>° to <NUM>° area (<NUM>° to <NUM>° based on one plane formed by the user microphone) corresponding to a rear plane (-z direction in <FIG>). For example, the user's microphone may sense approximately <NUM> times the size of sound in the area of <NUM>° (<NUM>° based on one plane formed by the user's microphone) compared to the area of <NUM>° (<NUM>° based on one plane formed by the user's microphone).

The ambient microphone may sense sound transmitted from all directions in the surrounding <NUM>° area.

The user's microphone may attenuate a sound received in a direction close to <NUM>° or <NUM>° (<NUM>° based on one plane formed by the user's microphone). Referring to <FIG>, because the user microphone according to an example embodiment responds with a low sensitivity to a sound received in a direction in an angle range of <NUM>° to <NUM>°, the sound in the corresponding direction may be attenuated.

In <FIG> shows the results for only one frequency, as described above with reference to <FIG>, because the user microphone may have uniform sensitivity to various frequencies, the results for various frequencies may also form a directivity pattern of a similar shape. For example, the various frequencies may be frequencies in an audible frequency region, and a directivity pattern having a similar shape may be formed with respect to the user microphone regardless of the high or low frequency.

<FIG> and <FIG> are diagrams illustrating an arrangement of a vibrator with respect to an utterance point of a user's voice.

Referring to <FIG> and <FIG>, a user's voice propagated from an utterance point <NUM> of the user's voice may be received on one plane 112a formed by the vibrator <NUM>.

As shown in <FIG>, when the propagation direction of the user's voice and the plane 112a formed by the vibrator <NUM> are orthogonal to each other, the vibrator <NUM> responds most sensitively, and the user's voice may be sensed the greatest. Accordingly, the user microphone may be disposed in the sound signal processing apparatus so that one plane 112a formed by the vibrator <NUM> (or a plurality of vibrators) is disposed in a direction corresponding to the utterance point <NUM> of the user's voice.

In other words, the user microphone may be arranged so that the plane 112a formed by the vibrator <NUM> (or a plurality of vibrators) and a direction from the utterance point <NUM> of the user's voice towards the one plane 112a correspond to each other (preferably <NUM>°).

When an angle between the one plane 112a and the propagation direction of the user's voice is <NUM>°, a sound may be sensed with the greatest sensitivity, but the angle may be difficult to be maintained at <NUM>° due to various restrictions in process or use. For example, as shown in <FIG>, the direction of propagation of the user's voice and one plane 112a may form an angle of less than <NUM>°. However, even in this case, as described above with reference to <FIG>, the user microphone may sense the user's voice.

The user microphone may be disposed in the sound signal processing apparatus at an angle for securing flexibility in process and use and effectively sensing the user's voice. The user microphone may be disposed in the sound signal processing apparatus so that an angle formed between the one plane 112a formed by the vibrator <NUM> (or a plurality of vibrators) and a direction of the user's voice utterance point <NUM> toward the one plane 112a is in a range of <NUM>° to <NUM>°. As described above with reference to <FIG>, even when the user microphone receives a sound at an angle of <NUM>° or <NUM>°, the user microphone may receive the sound with a size approximately <NUM> times the size when received at <NUM>°. Accordingly, the angle in a range from <NUM>° to <NUM>° may be an angle sufficient to provide flexibility in process and use and to sense a user's voice.

In this way, when the user microphone is disposed to face the utterance point <NUM> of the user's voice, the user microphone may respond with a low sensitivity to an external sound generated at a location separated from the utterance point <NUM> of the user's voice. Accordingly, the user microphone may attenuate the external sound.

An example embodiment in which the user microphone is applied to a sound signal processing apparatus will be schematically described with reference to <FIG>.

<FIG> is a diagram illustrating a sound adjustment process of a sound adjustment unit according to an example embodiment.

<FIG> shows electrical sound signal frames 1110a to 1110f generated by three vibration structures that sense different frequency bands in each of two time frames. Each of the electrical sound signal frames 1110a to 1110f shows sound waveforms in a time domain. The sound signal frames are input to sound control units <NUM>, and each of the sound control units <NUM> may be included in each of vibration structures or in a user's microphone.

The sound control unit <NUM> of the user's microphone may determine an electrical signal to be attenuated from among the electrical signals generated by the vibration structures based on a threshold value. The sound control unit <NUM> may attenuate the determined electrical signal. Here, the electrical signal to be attenuated may be a signal corresponding to an external sound. As the electrical signal corresponding to the external sound is attenuated by the sound control unit <NUM>, the user's voice may be maximized.

"Frame <NUM>" indicates a sound signal frame measured at a first time interval. "Frame j" indicates a sound signal frame measured in a j-th time interval after the first time interval. The first to third sound signal frames 1110a to 1110c are frames measured in the same time period (the first time period), and the fourth to sixth sound signal frames 1110d to 1110f are also frames measured in the same time period (the j-th time period).

The first and fourth sound signal frames 1110a and 1110d may be in the same frequency band and may be input to the sound control unit <NUM> through the same vibration structure. The second and fifth sound signal frames 1110b and 1110e may be in the same frequency band and may be input to the sound control unit <NUM> through the same vibration structure. The third and sixth sound signal frames 1110c and 1110f may be in the same frequency band and may be input to the sound control unit <NUM> through the same vibration structure. The frequency bands of the first and fourth sound signal frames 1110a and 1110d, the frequency bands of the second and fifth sound signal frames 1110b and 1110e, and the frequency bands of the third and sixth sound signal frames 1110c and 1110f are different from each other.

In <FIG>, "Drop" indicates a case in which the sound control unit <NUM> determines that an input sound signal is to be attenuated, and "Add" indicates a case in which the sound control unit <NUM> does not attenuate the input sound signal.

Referring to <FIG>, as in the case of the first to fourth sound signal frames 1110a to 1110d, when the intensity of the sound signal is less than or equal to a threshold value T or exceeds the threshold value T, but the degree of excess is less than or equal to a set value, the sound control unit <NUM> may attenuate the corresponding sound signal (Drop).

On the other hand, as the fifth and sixth sound signal frames 1110e and 1110f, when the intensity of the sound signal exceeds the threshold value T and the degree of excess exceeds a set value, the sound control unit <NUM> may not attenuate the corresponding sound signal (Add).

The sound control unit <NUM> may include a switch and an attenuator (or an attenuator circuit). When the input sound signal exceeds the threshold value T, the sound control unit <NUM> may turn on the switch to pass the input sound signal to the attenuator, and the attenuator may reduce the power of the input sound signal. The attenuator may include resistors that are connected to form a voltage divider. When the input sound signal is less than or equal to the threshold value T, the sound control unit <NUM> may turn off the switch to block the input sound signal from flowing into the attenuator.

An output result of the sound control unit <NUM> may be transmitted to the processor <NUM> through, for example, an amplifying unit.

<FIG> is a diagram illustrating a user voice signal generated from a user microphone according to an example embodiment.

Referring to <FIG>, a first graph <NUM> showing a result of sensing the user's voice by the method according to the comparative example of <FIG> and a second graph <NUM> showing a result of sensing the user's voice by the user's microphone are shown.

The first graph <NUM> shows a result of attenuating an external sound by using a plurality of ambient microphones according to the comparative example of <FIG>. In the first graph <NUM>, a signal 1210a corresponding to a user's voice and a signal 1210b corresponding to an external sound are shown. It is confirmed that the signal 1210b corresponding to the external sound is attenuated than the signal 1210a corresponding to the user's voice, but it is confirmed that enough signal remains to allow the signal to be sensed.

The second graph <NUM> represents a user voice signal generated by the user's microphone that attenuates an external sound signal. In the first graph <NUM>, a signal 1220a corresponding to a user's voice and a signal 1220b corresponding to an external sound are shown. In the second graph <NUM>, it is confirmed that the signal 1220b corresponding to the external sound is significantly attenuated. In the second graph <NUM>, it is confirmed that the signal 1220b corresponding to the external sound is attenuated to a level close to silence, which is difficult to be sensed.

The user's microphone may attenuate an external sound through arrangement toward a point of origin of the user's voice based on the directivity of the vibrating structures. Alternatively, the user's microphone may attenuate the external sound by attenuating some of the signals generated by the vibration structures based on a threshold value. As a result, the user's microphone may attenuate an external sound signal and generate a user voice signal by using one or both of the two methods described above.

<FIG> is a block diagram for describing a method of calculating a difference according to an example embodiment.

Referring to <FIG>, a whole sound signal generated from the ambient microphone <NUM> and a user voice signal generated from the user microphone <NUM> may be input to the processor <NUM>. The processor <NUM> may generate an external sound signal through an operation on the input signals.

Because the whole sound includes the external sound and the user's voice, a whole sound signal corresponding to the whole sound may include a signal corresponding to the external sound and a signal corresponding to the user's voice. The whole sound signal may be a signal from which no sound of any kind is attenuated or emphasized. The user voice signal may be a signal from which the external sound is attenuated from the whole sound by sensing the user's voice with a high sensitivity and sensing the external sound with a low sensitivity.

Accordingly, the processor <NUM> may generate a signal from which a signal corresponding to the user's voice is attenuated from the whole sound signal and a signal corresponding to the external sound is maintained by differentially calculating the user voice signal from the whole sound signal. In this way, the processor <NUM> may generate an external sound signal in which a signal corresponding to the external sound is emphasized.

<FIG> is a block diagram for explaining an example of the method of calculating the difference of <FIG>.

Referring to <FIG>, a user voice signal generated from the user microphone <NUM> may be input to an adaptive filter <NUM>. An output signal of the adaptive filter <NUM> may be differentially calculated from a whole sound signal generated from the ambient microphone <NUM>, and a feedback signal which is a signal resulted from the differential calculation may be input to the adaptive filter <NUM>. As a result of differentially calculating an output signal of the fed back adaptive filter <NUM> from the whole sound signal, an external sound signal may be finally generated.

The adaptive filter <NUM> may adjust parameters for combining the ambient sound signal and the user's voice signal, based on the feedback signal. Here, the parameters may be adjusted so that the user's voice is attenuated from the whole sound signal as a result of the differential calculation. The adaptive filter <NUM> may be operated according to various algorithms, for example, a least squares mean (LMS) algorithm for minimizing an error signal, a filtered-X LMS (FXLMS) algorithm, a filterederror LMS (FELMS) algorithm, steepest descent algorithm, or a recursive least squares (RLS) algorithm. The parameters may include parameters relating to, for example, a correlation coefficient between signals, a delay of signals, or an amplitude of signals. The correlation coefficient may include a Spearman correlation coefficient, a Cronbach's alpha coefficient, or a Pearson correlation coefficient.

The processor may generate an external sound signal through an operation on the input signals. As a user voice signal is input to the adaptive filter <NUM>, the processor may generate a feedback signal by differentially calculating a signal output from the adaptive filter <NUM> from all sound signals. The processor may control the adaptive filter <NUM> to adjust parameters by inputting the feedback signal to the adaptive filter <NUM>. The processor may generate an external sound signal from which a signal corresponding to the user's voice is attenuated by differentially calculating the output signal from the adaptive filter <NUM>, in which parameters are adjusted as the feedback signal is applied, from the whole sound signal.

In another example embodiment, the sound signal processing apparatus may perform a differential calculation through a neural network operation without using the adaptive filter <NUM>. For example, the sound signal processing apparatus may perform a differential calculation through a convolution neural network (CNN) operation, a deep neural network (DNN) operation, or a recurrent neural network (RNN) operation. However, the type of neural network employed in the sound signal processing apparatus is not limited thereto.

<FIG> is a diagram illustrating an external sound signal according to an example embodiment.

Referring to <FIG>, a first graph <NUM> showing a sound signal output by the method according to the comparative example of <FIG> and a second graph <NUM> showing an external sound signal generated by the sound signal processing apparatus are shown. In the first graph <NUM>, a signal 1510b corresponding to an external sound and a signal 1510a corresponding to a user's voice are shown. In the second graph <NUM>, a signal 1520b corresponding to an external sound and a signal 1520a corresponding to a user's voice are also shown.

The first graph <NUM> represents a sound signal output by using a plurality of ambient microphones according to the comparative example of <FIG>. It is confirmed that the signal 1510a corresponding to the user's voice started at a point close to the ambient microphone is emphasized and the signal 1510b corresponding to the external sound is attenuated. According to the first graph <NUM>, in the comparative example of <FIG>, an external sound is not clearly sensed, and functions according to the external sound are also difficult to perform.

The second graph <NUM> also represents an external sound signal generated by the sound signal processing apparatus. It is confirmed that the signal 1520a corresponding to the user's voice is attenuated despite the close proximity of the user's microphone and the ambient microphone to the utterance point of the user's voice. On the other hand, it is confirmed that the signal 1520b corresponding to the external sound is emphasized. According to the second graph <NUM>, the sound signal processing apparatus may clearly sense an external sound while excluding the user's voice, and accordingly, may perform a corresponding function in response to the external sound.

In the first graph <NUM>, the signal 1510b corresponding to the external sound was measured as -<NUM> dB, and the signal 1510a corresponding to the user's voice was measured as -<NUM> dB. In the second graph <NUM>, the signal 1520b corresponding to the external sound was measured as -<NUM> dB, and the signal 1520a corresponding to the user's voice was measured as -<NUM> dB. Accordingly, differences between the signals 1510a and 1520a corresponding to the user's voice and the signals 1510b and 1520b corresponding to the external sound are -<NUM> dB in the first graph <NUM> and <NUM> dB in the second graph <NUM>. These numerical values indicate the degree of emphasis of the external sound compared to the user's voice, and a difference between the numerical values in the first graph <NUM> and the second graph <NUM> is <NUM> dB. It is confirmed that the sound signal processing apparatus performs attenuation of the user's voice and emphasis of external sound by a value <NUM> dB greater than the case according to the comparative example of <FIG>.

<FIG> are diagrams illustrating embodiments in which the sound signal processing apparatus is a glasses-type wearable apparatus.

Referring to <FIG>, the sound signal processing apparatus <NUM> is a glasses-type wearable apparatus and may include a glasses frame <NUM>. The glasses frame <NUM> may include a glasses bridge 1700a, a glasses frame 1700b, and a glasses leg 1700c.

A user microphone and an ambient microphone may be disposed on the glasses frame <NUM>. The user microphone and the ambient microphone may be disposed in various positions of the glasses frame <NUM> according to the sound to be received. For example, the user's microphone may be disposed on the glasses bridge 1700a or the glasses frame 1700b to receive the user's voice at a closer position. Also, the ambient microphone may be disposed on the glasses frame 1700b or the glasses leg 1700c.

In <FIG>, although it shows that the sound signal processing apparatus <NUM> is a glasses-type wearable apparatus, this is only an example, and the sound signal processing apparatus <NUM> is in the form of a watch or bracelet worn on a wrist, in the form of a necklace worn on the neck, or in various types of wearable devices, such as earphones and headphones worn on the ears. The sound signal processing apparatus <NUM> may correspond to any wearable apparatus without limitation as long as it is wearable.

Referring to <FIG>, the user microphone <NUM> is disposed on the glasses bridge 1700a of the sound signal processing apparatus <NUM> and the ambient microphone <NUM> is disposed on the glasses leg 1700c of the sound signal processing apparatus <NUM>.

Because the utterance point of a user's voice corresponds to a user's mouth or lips, the user's microphone <NUM> may be disposed on the glasses bridge 1700a to correspond to the utterance point. The ambient microphone <NUM> may be disposed on the glasses leg 1700c so as to more effectively receive an external sound in a lateral direction of the user and to be far from an utterance point of the user's voice. However, as described above, microphones may be disposed at various locations within the glasses frame <NUM>.

Referring to <FIG>, it is shown that a user's voice is propagated from the utterance point <NUM> of the user's voice to the user's microphone <NUM>.

The utterance point <NUM> of the user's voice may be a position corresponding to the user's mouth or lips. The user's voice is propagated to the user's microphone <NUM> and may be received on the one plane 112a formed by the vibrator <NUM> of the user's microphone <NUM>. Here, when the user's voice is propagated orthogonal to the one plane 112a formed by the vibrator <NUM>, it may be sensed with the greatest sensitivity by the user's microphone <NUM>.

Accordingly, as shown in <FIG> the user's microphone <NUM> may be disposed in the sound signal processing apparatus <NUM> so that a direction from the utterance point <NUM> of the user's voice to the one plane 112a is vertical. When an outsider's voice is received from the front or side of the user, because it is received in a direction parallel to the one plane 112a of the user's microphone <NUM>, the outsider's voice may be sensed with the lowest sensitivity or may not be sensed by the user's microphone <NUM>. Due to this arrangement, the user's microphone <NUM> may attenuate an external sound and emphasize the user's voice.

However, because it is difficult to maintain a vertical direction due to various restrictions in process or use, the user microphone <NUM> may be disposed so that an angle between the direction of the user's voice and the one plane 112a is in a range of <NUM>° to <NUM>°. As described above with reference to <FIG> and <FIG>, even when the user's microphone <NUM> is disposed at the angle described above, the user's voice may be effectively sensed, and thus, an external sound signal from which the user's voice is attenuated may be generated.

<FIG> is a block diagram illustrating a configuration of a sound signal processing apparatus <NUM> according to another example embodiment.

Referring to <FIG>, the sound signal processing apparatus <NUM> may include a user microphone <NUM>, an ambient microphone <NUM>, and a processor <NUM>. In the sound signal processing apparatus <NUM> illustrated in <FIG>, only components related to the present embodiments are illustrated. Accordingly, it is apparent to those skilled in the art that general-purpose components other than those shown in <FIG> may further be included in the sound signal processing apparatus <NUM>. The user microphone <NUM> of <FIG> corresponds to the user microphone of <FIG>, and the ambient microphone <NUM> of <FIG> has a structure and operation method different from the ambient microphone of <FIG> and the ambient microphone of <FIG>, and may have a structure similar to that of the user microphone of <FIG>.

In the sound signal processing apparatus <NUM> according to the embodiment of <FIG>, unlike the sound signal processing apparatus according to the embodiment of <FIG>, the ambient microphone <NUM> may have a structure corresponding to the user microphone <NUM>. The ambient microphone <NUM> may include a plurality of vibration structures like the user microphone <NUM>, and may be arranged in the sound signal processing apparatus <NUM> in consideration of the propagation direction of the received sound.

The user microphone <NUM> forms a first plane and may receive a sound through the first plane. The user microphone <NUM> may be arranged in the sound signal processing apparatus <NUM> so that the first plane is arranged in a direction corresponding to an utterance point of the user's voice. Due to this arrangement, the user microphone <NUM> may generate a user voice signal from which an external sound is attenuated.

The ambient microphone <NUM> forms a second plane and may receive sound through the second plane. The ambient microphone <NUM> may be arranged in the sound signal processing apparatus <NUM> so that the second plane is arranged in a direction different from the direction in which the user microphone is arranged. Therefore, because the ambient microphone <NUM> is not arranged to correspond to an utterance point of the user's voice, in the ambient microphone <NUM>, a sound signal from which the user's voice is attenuated compared to the sound signal generated by the user microphone <NUM> may be generated.

Also, the ambient microphone <NUM> may be provided in the sound signal processing apparatus <NUM> so that the second plane is arranged in a direction corresponding to the point where the external sound is generated. Due to the arrangement of the ambient microphone <NUM>, an external sound may be sensed with a high sensitivity and a user's voice may be sensed with a low sensitivity. Accordingly, the user's voice may be attenuated from a whole sound received by the ambient microphone <NUM>, and a first external sound signal that is a sound signal generated by the ambient microphone <NUM> may be a signal from which the user's voice has been attenuated.

The processor <NUM> may generate a second external sound signal by differentially calculating the user voice signal from the first external sound signal. Although the user's voice has already been attenuated and sensed in the first external sound signal, the processor <NUM> may generate a second external sound signal from which the user's voice is further attenuated by differentially calculating the user voice signal of the user's microphone <NUM> from the first external sound signal of the ambient microphone <NUM>.

<FIG> is a diagram for explaining the arrangement of the user microphone <NUM> and the ambient microphone <NUM> according to the embodiment of <FIG>.

Referring to <FIG>, the user's voice propagated from an utterance point <NUM> of the user's voice may be received on a first plane 1912a formed by the vibrator <NUM> of the user's microphone <NUM>. In addition, an external sound propagated from an external sound generating point <NUM> may be received by the second plane 1922a formed by the vibrator <NUM> of the ambient microphone <NUM>.

As shown in <FIG>, when the propagation direction of the user's voice and the first plane 1912a formed by the vibrator <NUM> of the user's microphone <NUM> are orthogonal to each other, the vibrator <NUM> may respond most sensitively and the user's voice may be sensed the greatest. Accordingly, the user's microphone <NUM> may be disposed in the sound signal processing apparatus so that the first plane 1912a formed by the vibrator <NUM> (or a plurality of vibrators) is disposed in a direction corresponding to the utterance point <NUM> of the user's voice.

In other words, the user microphone <NUM> may be arranged so that the first plane 1912a formed by the vibrator <NUM> (or a plurality of vibrators) and a direction from the utterance point <NUM> of the user's voice toward the first plane 1912a correspond to each other (preferably, to form <NUM>°). For example, the user microphone <NUM> may be arranged in the sound signal processing apparatus so that an angle formed between the first plane 1912a formed by the vibrator <NUM> (or a plurality of vibrators) and the direction from the utterance point <NUM> of the user's voice towards the first plane 1912a is in a range of <NUM>° to <NUM>°.

In addition, as shown in <FIG>, when a propagation direction of an external sound and the second plane 1922a formed by the vibrator <NUM> of the ambient microphone <NUM> are orthogonal to each other, the vibrator <NUM> may respond most sensitively, and the external sound may be sensed the greatest. Accordingly, the ambient microphone <NUM> may be arranged in the sound signal processing apparatus so that the second plane 1922a formed by the vibrator <NUM> (or a plurality of vibrators) is arranged in a direction corresponding to the external sound generating point <NUM>.

In other words, the ambient microphone <NUM> may be arranged so that the second plane 1922a formed by the vibrator <NUM> (or a plurality of vibrators) and the direction from the external sound generating point <NUM> toward the second plane 1922a correspond to each other (preferably to form <NUM>°). For example, in the ambient microphone <NUM> may be arranged in the sound signal processing apparatus so that an angle formed between the second plane 1922a formed by the vibrator <NUM> (or a vibrators) and the direction from the external sound generation point <NUM> toward the second plane 1922a is in a range of <NUM>° to <NUM>°.

As shown in <FIG>, as the user microphone <NUM> and the ambient microphone <NUM> are disposed in directions corresponding to different points in the sound signal processing apparatus, the external sound is received at an angle away from <NUM>° (or at an angle close to parallel) on the first plane 1912a of the user microphone <NUM>, and the user's voice is received at an angle away from <NUM>° (or at an angle close to parallel) on the second plane 1922a of the ambient microphone <NUM>. Accordingly, an external sound may be sensed with a low sensitivity to the user's microphone <NUM>, and a user's voice may be sensed with a low sensitivity to the ambient microphone <NUM>. That is, the user microphone <NUM> may generate a user voice signal from which an external sound is attenuated, and the ambient microphone <NUM> may generate a first external sound signal from which the user's voice is attenuated.

As in the embodiment of <FIG>, when the sound signal processing apparatus is a glasses-type wearable apparatus, the user's microphone may be arranged in the sound signal processing apparatus so that the first plane 1912a is arranged in a direction corresponding to the user's lips or oral cavity. The ambient microphone may be arranged in a direction different from the direction in which the user's microphone is arranged, and may be arranged in the sound signal processing apparatus so that the second plane 1922a is arranged in a direction corresponding to the front or side of the user.

On the other hand, the direction in which the second plane 1922a of the ambient microphone is arranged is not limited to the front or side of the user, and may be arranged in various directions according to design.

<FIG> is a block diagram for explaining a differential calculation method according to the embodiment of <FIG>.

Referring to <FIG>, a first external sound signal generated from the ambient microphone <NUM> and a user voice signal generated from the user microphone <NUM> may be input to the processor <NUM>. The processor <NUM> may generate a second external sound signal through a calculation on the input signals.

The first external sound signal may be a signal from which the user's voice is attenuated from a whole sound by sensing the external sound with a high sensitivity and the user's voice with a low sensitivity. The user voice signal may be a signal from which the external sound is attenuated from the whole sound by sensing the user's voice with a high sensitivity and sensing the external sound with a low sensitivity.

The processor <NUM> may generate a signal from which a signal corresponding to the user's voice in the first external sound signal is further attenuated and a signal corresponding to the external sound is maintained by differentially calculating the user voice signal from the first external sound signal.

The processor <NUM> may perform a differential calculation between signals by using an adaptive filter or a neural network.

<FIG> is a block diagram illustrating a configuration of a sound signal processing apparatus according to another example embodiment.

Referring to <FIG>, the sound signal processing apparatus <NUM> may include a directivity microphone <NUM>, an ambient microphone <NUM>, and a processor <NUM>. The sound signal processing apparatus <NUM> may receive an output sound from a sound output apparatus <NUM>. In the sound signal processing apparatus <NUM> illustrated in <FIG>, only components related to the present embodiments are illustrated. Accordingly, it is apparent to those skilled in the art that other general-purpose components other than the components shown in <FIG> may further be included in the sound signal processing apparatus <NUM>. The directivity microphone <NUM> of <FIG> may correspond to the user microphone of <FIG>.

In the embodiment of <FIG>, the sound signal processing apparatus <NUM> is not worn by the user and may be arranged adjacent to the sound output apparatus <NUM> or included in the sound output apparatus <NUM>. The output sound of the embodiment of <FIG> may correspond to the user's voice of the embodiment of <FIG>.

In the embodiment of <FIG>, the sound signal processing apparatus <NUM> attenuates a user's voice generated at a nearby location through a differential calculation, however, in the embodiment of <FIG>, the sound signal processing apparatus <NUM> is located close to the sound output apparatus <NUM>, an output sound generated at a nearby location may be attenuated through a differential calculation. In the embodiment of <FIG>, the sound signal processing apparatus <NUM> generates an external sound from which an output sound is attenuated, but the external sound may include a user's voice. Accordingly, the sound output apparatus <NUM> may generate an external sound signal from which an output sound is attenuated and a user's voice is emphasized while receiving the output sound.

The directivity microphone <NUM> may receive a whole sound including a sound output from the sound output apparatus <NUM> and an external sound generated from the outside of the sound output apparatus <NUM>. The directivity microphone <NUM> may generate an output sound signal by attenuating an external sound from the whole received sound. The directivity microphone <NUM> may be disposed in the sound signal processing apparatus <NUM> so that one plane that receives the whole sound is arranged in a direction corresponding to a point of generation of the output sound. Due to the arrangement of the directivity microphone <NUM>, an output sound may be sensed with a high sensitivity and an external sound may be sensed with a low sensitivity. Accordingly, an external sound may be attenuated from the whole sound received by the directivity microphone <NUM>, and an output sound signal that is a sound signal generated by the directivity microphone <NUM> may be a signal from which the external sound has been attenuated.

For example, the directivity microphone <NUM> may be arranged so that an angle formed between a plane for receiving a sound and a direction towards the plane from a point of generating an output sound is in a range of <NUM>° to <NUM>°.

The ambient microphone <NUM> may receive a whole sound and may generate an whole sound signal from the received whole sound. The processor <NUM> may generate an external sound signal from which the output sound is attenuated by differentially calculating the output sound signal from the whole sound signal.

The sound signal processing apparatus <NUM> of <FIG> differs only in the type of signal to be attenuated or emphasized, but the operation method and arrangement thereof correspond to the sound signal processing apparatus of <FIG>, and thus redundant descriptions of the sound signal processing apparatus <NUM> are herein omitted.

<FIG> is a diagram for explaining a differential calculation method according to the embodiment of <FIG>.

Referring to <FIG>, a whole sound signal generated from the ambient microphone <NUM> and an output sound signal generated from the directivity microphone <NUM> may be input to the processor <NUM>. The processor <NUM> may generate an external sound signal through a calculation on the input signals.

Because a whole sound includes an external sound and an output sound, the whole sound signal corresponding to the whole sound may include a signal corresponding to the external sound and a signal corresponding to the output sound. The external sound may include a user's voice. The whole sound signal may be a signal from which no sound of any kind is attenuated or emphasized. The output sound signal may be a signal from which the external sound is attenuated from the whole sound by sensing the output sound with a high sensitivity and the external sound with a low sensitivity.

Accordingly, the processor <NUM> may generate a signal from which a signal corresponding to the output sound is attenuated from the whole sound signal and a signal corresponding to the external sound (or user voice) is maintained by differentially calculating the output sound signal from the whole sound signal. In this way, the processor <NUM> may generate an external sound signal in which a signal corresponding to the external sound is emphasized.

<FIG> is a flowchart illustrating a method of processing a sound signal, according to an example embodiment.

Referring to <FIG>, the method of processing a sound signal includes operations processed in time series by the sound signal processing apparatus shown in <FIG>. Therefore, it may be seen that the above-described information regarding the sound signal processing apparatus with reference to <FIG> and the like is also applied to the method of <FIG> even if the content is omitted below.

In operation <NUM>, the sound signal processing apparatus may receive a whole sound including a user's voice and an external sound generated from an outside of the user.

In the sound signal processing apparatus, a plurality of vibration structures sensing sound of different frequency bands may vibrate in a direction orthogonal to one plane formed to receive the whole sound based on the frequency of the received whole sound.

The sound signal processing apparatus may vibrate with a vibration intensity based on an angle between a propagation direction of a received sound and an angle formed by one plane.

The sound signal processing apparatus may vibrate with a high vibration intensity as the angle approaches <NUM>°, and vibrates with a low vibration intensity as the angle approaches <NUM>°.

The sound signal processing apparatus may generate an electrical signal corresponding to the vibration of each of the plurality of vibration structures.

In operation <NUM>, the sound signal processing apparatus may generate a whole sound signal from the received whole sound.

In operation <NUM>, the sound signal processing apparatus may generate a user voice signal from which an external sound is attenuated from the whole received sound.

The sound signal processing apparatus may determine an electrical signal to be attenuated from among electrical signals based on a threshold value, and may attenuate the determined electrical signal.

The sound signal processing apparatus may determine the threshold value based on an average magnitude of the electrical signals.

In operation <NUM>, the sound signal processing apparatus may generate an external sound signal from which the user's voice is attenuated by differentially calculating the user voice signal from the whole sound signal.

The sound signal processing apparatus may generate a feedback signal by inputting a user voice signal to an adaptive filter, and differentially calculating a signal output from the adaptive filter from a whole sound signal, and may control the adaptive filter to adjust parameters by inputting the feedback signal to the adaptive filter.

The sound signal processing apparatus may perform a function corresponding to a user voice signal and a function corresponding to an external sound signal, and display results of each of the functions in different regions of the display.

As described above, the sound signal processing apparatus may generate a user voice signal without an additional separate operation process, and may generate an external sound signal from which the user's voice is attenuated only through simple calculations on the user voice signal and a whole sound signal. The sound signal processing apparatus may perform various functions by using each of the generated user voice signal and the external sound signal.

The method of <FIG> described above may be recorded in a computer-readable recording medium in which one or more programs including instructions for executing the method are recorded. Examples of non-transitory computer-readable recording medium include magnetic media, such as hard disks, floppy disks, and magnetic tapes, optical media, such as CD-ROMs and DVDs, magneto-optical media, such as floppy disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes, such as those generated by a compiler, but also high-level language codes that may be executed by a computer using an interpreter or the like.

Claim 1:
A sound signal processing apparatus (<NUM>) comprising:
a directional microphone (<NUM>) configured to receive a mixed sound signal comprising a user's voice and an external sound, to detect a user voice signal comprising the user's voice, and configured such that in use the directional microphone faces an utterance point of the user's voice;
a non-directional microphone (<NUM>) configured to detect the mixed sound signal; and
a processor (<NUM>) configured to generate an external sound signal by attenuating the user's voice from the mixed sound signal, by differentially calculating the user voice signal from the mixed sound signal; and characterized in that
the sound signal processing apparatus is a glasses-type wearable apparatus, the directional microphone and the non-directional microphone are arranged on a glasses frame (<NUM>) of the glasses-type wearable apparatus, and the directional microphone is arranged so that one plane for receiving the mixed sound faces the utterance point of the user's voice, and wherein the directional microphone is arranged on a glasses bridge (1700a) or the glasses frame (1700b) of the glasses-type wearable apparatus, and the non-directional microphone is separated from the directional microphone and is arranged on a frame or leg (1700c) of the glasses-type wearable apparatus.