Patent Description:
In recent years, a method of controlling a sound in view of the difference between both ear positions of a hearer is known as a technique of reproducing an acoustic signal output from a speaker to give a hearer realistic feeling (see e.g., PTL <NUM> and NPL <NUM>). For example, a sound control filter is used to calculate the transfer functions from right and left speakers to both ear positions, thereby controlling the sound. The use of the sound control filter allows localization of the sound indicated by the input acoustic signal to any place and causes the hearer to hear the sound with desired sound control effects.

The transfer functions described above are calculated in advance in view of the distance from the right and left speakers to both the ears of the hearer. In the background art, if the hearer moves, the transfer functions in the position after the movement are thus different from those calculated in advance. It is thus anticipated that no expected sound control effect is obtained, if the hearer moves at a long distance or the transfer functions from the reproducing speakers to both the ear positions of the hearer largely change under the influence of the reproduction environment.

It is an objective of the present disclosure to provide a signal processing device and a signal processing method that give a hearer sound control effects, even if the hearing position of the hearer changes.

A signal processing device according to an aspect of the present invention is defined in claim <NUM>. Specific embodiments are defined in dependent claims <NUM> to <NUM>.

With this configuration, the sound control filters designed under different hearing conditions emit sounds. Accordingly, the device gives the hearer sound control effects, even if the hearing position of the hearer changes.

The plurality of hearing conditions may include at least information on a hearing position to which a hearer is likely to move.

With this configuration, the sound control filters designed in the hearing position, to which the hearer may move, emit sounds. Accordingly, the device gives the hearer sound control effects, even if the hearing position changes.

The output data selector may include one or more gain adjusters that adjust gains of the output signals subjected to the sound localization processing to select the output signal to be output to the speaker.

The speaker may include a first speaker and a second speaker in positions different from each other. The output data selector may include: a first adder that adds, out of the output signals whose gains are adjusted, an output signal to be output through the first speaker; and a second adder that adds, out of the output signals whose gains are adjusted, an output signal to be output through the second speaker.

The signal processing device may further include: an auxiliary information input that inputs auxiliary information on two ear positions or a seated position of the hearer for selecting a range of the plurality of filter coefficients set by the coefficient setter; an auxiliary information analyzer that analyzes the auxiliary information input; and a coefficient range selector that selects the range of the plurality of filter coefficients set by the coefficient setter based on a result of analysis by the auxiliary information analyzer.

With this configuration, the input auxiliary information limits the filter processor to be set. Accordingly, the signal processing device more easily gives the hearer sound control effects.

The auxiliary information input may input, as one of the plurality of filter coefficients, a position of a seat on which the hearer is seated.

This configuration allows the use of the information on the position of the seat on which the hearer is seated, to select the range of the filter coefficients. Accordingly, the device easily gives the hearer sound control effects.

The auxiliary information input may input, as the plurality of filter coefficients, image information including the auxiliary information on the two ear positions.

This configuration allows the use of the image information to select the range of the filter coefficients. Accordingly, the device easily gives the hearer sound control effects.

The signal processing device may further include: an acoustic signal analyzer that analyzes the input acoustic signal and inputs the time for switching to the output data selector.

This configuration allows the analysis of the acoustic signal and the control of the timing for switching the output data. The device properly gives the hearer sound control effects when generating the acoustic signal to be recognized by the hearer.

The acoustic signal analyzer may include: a power detector that detects a power of the input acoustic signal; and a determiner that determines whether the power of the input acoustic signal is greater than or equal to a threshold.

A signal processing method according to the present invention is defined in claim <NUM>. Specific embodiments are defined in dependent claims <NUM> and <NUM>.

With this configuration, the sound control filters designed under different hearing conditions emits sounds. Accordingly, the device gives the hearer sound control effects, even if the hearing position of the hearer changes.

The signal processing method may further include: obtaining auxiliary information; and analyzing, by an auxiliary information analyzer, the auxiliary information, and selecting a coefficient range of the plurality of filter coefficients.

This configuration allows the selection of the filter coefficients based on the auxiliary information such as the position of the hearer supposed in advance. This reduces the use of the filter coefficients that provide less sound localization control effects and thus facilitates sound localization control.

The signal processing method may further include: detecting, by the acoustic signal analyzer, a power of the input acoustic signal. In the causing, the controller may cause the data selection processor to select the output signal based on the power detected of the input acoustic signal.

This configuration gives the hearer sound control effects and causes the hearer to recognize the acoustic signal in the period when the auditory effective acoustic signal is generated or, if no auditory effective acoustic signal is generated, when the time for switching/selecting the output data has elapsed.

The present invention provides a signal processing device and a signal processing method that give a hearer sound control effects, even if the hearing position of the hearer changes.

First, the background art and the objective of the background art will be described in more detail for easier understanding of the present disclosure.

<FIG> is a schematic diagram showing a positional relationship, between a hearer and a speaker, meeting desired hearing conditions in an acoustic control method according to the background art. <FIG> is a schematic diagram showing an actual positional relationship between the hearer and speakers in reproducing an acoustic signal in the acoustic control method according to the background art. The "positional relationship, between a hearer and a speaker, meeting desired hearing conditions" will be hereinafter referred to as a "desired system", whereas the "actual positional relationship between the hearer and speakers in reproducing an acoustic signal" will be hereinafter referred to as a "reproduction system".

In the configuration of desired system <NUM> shown in <FIG>, desired speaker <NUM> reproduces the acoustic signal, which reaches both the ear positions of hearer <NUM>. The "desired speaker" here is an imaginary speaker located in a position causing hearer <NUM> to recognize the generation of the acoustic signal regardless of the actual position of the speaker. That is, the speaker is an imaginary speaker located in any place to which the sound of the acoustic signal is localized. <FIG> shows a configuration of reproduction system <NUM> including filter processor <NUM> that performs sound control processing of the acoustic signal. The signal is reproduced by left speaker <NUM> and right speaker <NUM> and reaches both the ear positions of hearer <NUM>.

Assume that the acoustic signal obtained in both the ear positions of hearer <NUM> in the configuration of desired system <NUM> is identical with the acoustic signal obtained in both the ear positions of hearer <NUM> in the configuration of reproduction system <NUM>. In this case, hearer <NUM> recognizes the sound from the position of desired speaker <NUM> as viewed from hearer <NUM> in the configuration of reproduction system <NUM>, although the acoustic signal comes from left speaker <NUM> and right speaker <NUM>. That is, the acoustic signal obtained in both the ear positions of hearer <NUM> in the configuration of desired system <NUM> is controlled to be identical with the acoustic signal obtained in both the ear positions of hearer <NUM> in the configuration of reproduction system <NUM>. This allows the control causing hearer <NUM> to recognize the sound from the position of desired speaker <NUM>.

Such a control method has been used as a method of reproducing a realistic feeling to be obtained in the configuration of desired system <NUM>, in the configuration of reproduction system <NUM> that is physically different from the configuration of desired system <NUM>.

Specifically, the transfer functions from left speaker <NUM> and right speaker <NUM> to both ears of hearer <NUM> in the configuration of reproduction system <NUM> are measured in advance. The measured transfer functions are subjected to predetermined convolution (calculation) to obtain the transfer functions from desired speaker <NUM> to both ears of hearer <NUM> in the configuration of desired system <NUM>. The configuration of reproduction system <NUM> includes filter processor <NUM> for convolving input acoustic signal S as shown in <FIG>.

Filter processor <NUM> includes filter XI and filter Xr as shown in <FIG>. Filter XI and filter Xr have transfer functions HII, Hlr, Hrl, and Hrr from left speaker <NUM> and right speaker <NUM> to both the ear positions of hearer <NUM>. On the other hand, in the configuration of desired system <NUM>, DI and Dr are the transfer functions from desired speaker <NUM> to both the ear positions of hearer <NUM>.

Transfer functions HII, HIr, Hrl, and Hrr used in filter processor <NUM> will be hereinafter referred to as the values in the frequency domain. Actually, the suffixes w indicating the frequencies need to be added like HII (ω) but will be omitted for simplification.

The convolution of the transfer functions measured in advance in reproduction system <NUM> is expressed by multiplication in the frequency domain. Transfer functions Hil, HIr, Hrl, and Hrr set for filter XI and filter Xr can be designed in accordance with Expression (<NUM>) (see, e.g., NPL <NUM>). <NUM>] <MAT>.

Note that the functions used in Expression (<NUM>) may be in any of the time domain and the frequency domain.

Filter processor <NUM> designed here in accordance with Expression (<NUM>) has transfer functions HII, Hlr, Hrl, and Hrr from left speaker <NUM> and right speaker <NUM> to both ears of hearer <NUM> measured in advance. Assume that hearer <NUM> moves from the position in which transfer functions HII, Hlr, Hrl, and Hrr were measured. In this case, the transfer functions from left speaker <NUM> and right speaker <NUM> to both ears of hearer <NUM> in the position after the movement become different from HII, HIr, Hrl, and Hrr. In reproduction system <NUM>, filter processor <NUM> designed in accordance with Expression (<NUM>) cannot generate the signal obtained in both the ear positions of hearer <NUM> in desired system <NUM>. That is, the effects of the sound localization control cannot be obtained.

For example, PTL <NUM> teaches the problem of obtaining the effects of the sound localization control in limited hearing positions. PTL <NUM> discloses a method of achieving more robust control not by reproducing the absolute sound pressures at both the ear positions of hearer <NUM> but by causing an interaural difference. It is however anticipated in the method disclosed in PTL <NUM> that expected sound localization control effects are not obtained, if the hearer moves at a long distance. It also applies if the hearer moves at a slight distance but the transfer functions from the reproducing speaker to both the ear positions of the hearer largely change under the influence of the reproduction environment.

To address the problem, the present disclosure provides a signal processing device and a signal processing method that give a hearer sound control effects, even if the hearing position of the hearer changes.

Now, embodiments of the signal processing device and the signal processing method according to the present disclosure will be described in detail with reference to the drawings as appropriate. In the following embodiments, the same reference marks are used to represent substantially the same configurations, and the explanation thereof may be omitted.

Note that the embodiments described below are mere specific examples. The numerical values, shapes, materials, constituent elements, the arrangement and connection of the constituent elements, steps, step orders etc. shown in the following embodiments are thus mere examples, and are not intended to limit the scope of the present disclosure. Among the constituent elements in the following embodiments, those not recited in any of the independent claims defining the broadest concept are described as optional constituent elements. Note that unnecessarily detailed description may be omitted. For example, detailed description of well-known matters or duplicated description of substantially the same configurations may be omitted. This is for reduction in unnecessarily redundant description and easier understanding of those skilled in the art. In the following, the same reference marks are used to represent the same or unchanged configurations.

The appended drawings and the following description are for those skilled in the art to sufficiently understand the present disclosure and are not intended to limited the subject matters of the claims.

First, a configuration of a signal processing system according to Embodiment <NUM> will be described. <FIG> is a block diagram showing an example configuration of the signal processing system according to Embodiment <NUM>.

As shown in <FIG>, the signal processing system according to this embodiment includes signal processing device <NUM>, left speaker <NUM>, and right speaker <NUM>.

Signal processing device <NUM> processes an input acoustic signal and outputs the processed signal to left speaker <NUM> and right speaker <NUM>. A configuration and an operation of signal processing device <NUM> will be described later in more detail. Note that the constituent elements of signal processing device <NUM> may be dedicated hardware devices or may be achieved by executing software programs suitable for the constituent elements. The constituent elements may be achieved by a program executor, such as a CPU or a processor, reading and executing software programs stored in a storage medium such as a hard disk or a semiconductor memory. Alternatively, the constituent elements may be large-scale integrated (LSI) circuits, dedicated circuits, general-purpose processors, field-programmable gate arrays (FPGAs), or reconfigurable processors capable of reconfiguring connections and settings of circuit cells inside an LSI circuit.

Note that signal processing device <NUM> may include left speaker <NUM> and right speaker <NUM>.

Left speaker <NUM> and right speaker <NUM> output the acoustic signal processed by signal processing device <NUM>. In this embodiment, left speaker <NUM> is a first speaker, and right speaker <NUM> is a second speaker. Left speaker <NUM> and right speaker <NUM> intend to reproduce input signals over the full bandwidth, for example.

Left speaker <NUM> and right speaker <NUM> are located in different positions. For example, as shown in <FIG>, left speaker <NUM> and right speaker <NUM> are symmetrical about hearer <NUM>. Left speaker <NUM> is located on the left of hearer <NUM>. Right speaker <NUM> is located on the right of hearer <NUM>.

As shown in <FIG>, signal processing device <NUM> includes input <NUM>, a plurality of filter processors, storage device <NUM>, coefficient setter <NUM>, controller <NUM>, output data selector <NUM>, timer <NUM>, counter <NUM>, and output <NUM>. In this embodiment, signal processing device <NUM> includes, as the plurality of filter processors, first filter processor 302a, second filter processor 302b,. , and n-th filter processor 302n. Note that first filter processor 302a, second filter processor 302b,. , and n-th filter processor 302n may be collectively referred to as "first filter processor 302a to n-th filter processor 302n".

Input <NUM> receives acoustic signal S from the outside of signal processing device <NUM>. Input <NUM> outputs the acoustic signal received from the outside of signal processing device <NUM> to first filter processor 302a to n-th filter processor 302n.

First filter processor 302a to n-th filter processor 302n perform sound control processing for sound localization of acoustic signal S input from input <NUM>. First filter processor 302a to n-th filter processor 302n are, for example, finite impulse response (FIR) filters. Note that first filter processor 302a to n-th filter processor 302n are not limited to the FIR filters and may be for example, infinite impulse response (IIR) filters or a combination of FIR filters and IIR filters. The transfer functions of the filter processors may be designed in the frequency domain or in the time domain employing the least-squares method. First filter processor 302a to n-th filter processor 302n may not have fixed filter coefficients and may be adaptive filters with filter coefficients variable over time in accordance with feedback, for example.

Storage device <NUM> stores the filter coefficients for first filter processor 302a to n-th filter processor 302n to perform the sound control processing. As will be described later, the filter coefficients are generated under a plurality of hearing conditions. The hearing conditions are, for example, the conditions of a plurality of physically closer hearing positions or the size of the head of the hearer. The filter coefficients of first filter processor 302a to n-th filter processor 302n are stored in a coefficient table, which includes, for example, first filter processor 302a to n-th filter processor 302n in association with the filter coefficients.

Coefficient setter <NUM> sets the filter coefficients for first filter processor 302a to n-th filter processor 302n. Coefficient setter <NUM> reads the filter coefficients from storage device <NUM> and sets the coefficients for the filter processors.

Output data selector <NUM> selects, out of the output signals (i.e., the output data) subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n, those to be output through left speaker <NUM> and right speaker <NUM>. As will be described later, output data selector <NUM> includes a plurality of gain adjusters, adder <NUM>, and adder <NUM>. In this embodiment, adder <NUM> is a first adder, and adder <NUM> is a second adder.

Output data selector <NUM> outputs the selected output data to output <NUM>. Note that a configuration and an operation of output data selector <NUM> will be described later in more detail.

Controller <NUM> causes output data selector <NUM> to select the output data to be output through left speaker <NUM> and right speaker <NUM>. Controller <NUM> adjusts the respective gains set for the gain adjusters. Specifically, controller <NUM> performs control for switching the respective gains set for the gain adjusters and multiplying the gains by the output data. Controller <NUM> causes output data selector <NUM> to switch the output data based on predetermined times for switching the output data.

At timer <NUM>, the times for output data selector <NUM> to switch/select the output data are set in advance. Counter <NUM> counts elapsed times. In this embodiment, timer <NUM> and counter <NUM> are time measurers that monitor the times for output data selector <NUM> switching the output data. When a time set at timer <NUM> has elapsed, counter <NUM> notifies controller <NUM> of the elapse of time. Note that timer <NUM> and counter <NUM> may be included inside controller <NUM> or may be attached outside controller <NUM>.

Now, an operation of signal processing device <NUM> will be described.

Acoustic signal S is input through input <NUM> and subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n. At this time, coefficient setter <NUM> reads the filter coefficients of first filter processor 302a to n-th filter processor 302n from the coefficient table stored in storage device <NUM>, and sets the coefficients for first filter processor 302a to n-th filter processor 302n.

The transfer functions of first filter processor 302a to n-th filter processor 302n are designed based on Expression (<NUM>) under different conditions. The output signals, that is, the output data subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n are input to output data selector <NUM>.

Under the control by controller <NUM>, output data selector <NUM> selects the output data subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n to be output through left speaker <NUM> and right speaker <NUM>. The selector outputs then the selected output data to output <NUM>. The output data output to output <NUM> are as acoustic signals output through left speaker <NUM> and right speaker <NUM>.

In the present disclosure, the expression "selects the output data" is also referred to as "switches the output data". As will be described later, the expression "selects the output data" or "switches the output data" specifically means switching the gains of gain adjusters 412a to 412n located in output data selector <NUM> and multiplying, at gain adjusters 412a to 412n, the gains by the acoustic signal subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n.

<FIG> shows here example hearing positions in designing first filter processor 302a to n-th filter processor 302n according to this embodiment. <FIG> shows example design conditions of the filter coefficient, under which the filter coefficients are designed while changing the hearing positions. <FIG> shows an example of hearer <NUM> and the hearing positions as viewed from the left ear of hearer <NUM>. Hearing positions <NUM>, <NUM> and <NUM> are supposed positions in which the left ear of hearer <NUM> is supposed to be located. The filter coefficients are designed in the positions in which hearer <NUM> is supposed to hear the sound. That is, the hearing conditions for generating the filter coefficients include at least the information on the hearing positions to which the hearer is likely to move. The interval between the hearing positions shown in <FIG> is, for example, <NUM>.

As described above, the filter coefficients are stored, in the coefficient table, in storage device <NUM> of <FIG>. The filter coefficients designed in this manner are set for first filter processor 302a to n-th filter processor 302n shown in <FIG> by coefficient setter <NUM>.

<FIG> is a block diagram showing a configuration of output data selector <NUM> according to this embodiment. Output data selector <NUM> includes a plurality of gain adjusters, adder <NUM>, and adder <NUM>. The gain adjusters are provided, for example, in the same number as the filter processors in one to one correspondence.

In this embodiment, output data selector <NUM> includes, as the plurality of gain adjusters, gain adjusters 412a, 412b,. , and 412n. Gain adjusters 412a, 412b,. , and 412n correspond to first filter processor 302a, second filter processor 302b,. , and n-th filter processor 302n, respectively. In the following, gain adjusters 412a, 412b,. , and 412n may be collectively referred to as "gain adjusters 412a to 412n".

In output data selector <NUM>, gain adjusters 412a to 412n multiply the gains by the acoustic signal subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n. More specifically, the acoustic signal output from left speaker <NUM> are multiplied by the gain independently from the acoustic signal output from right speaker <NUM>. In addition, the acoustic signal output from left speaker <NUM> and the acoustic signal output from right speaker <NUM> are multiplied by the same gain.

At this time, controller <NUM> receives the information on the timing for switching the gains of gain adjusters 412a to 412n from timer <NUM> and counter <NUM>. Controller <NUM> changes then the values of gains g1, g2,. , and gn set for gain adjusters 412a to 412n of output data selector <NUM> at the obtained timing. Gain adjusters 412a to 412n multiply the gains by the output data processed by the filter processors. In this manner, output data selector <NUM> selects the output data to be output through left speaker <NUM> and right speaker <NUM>.

Out of the output data multiplied by the gains by gain adjusters 412a to 412n, the output data to be output through left speaker <NUM> is added by adder <NUM>. On the other hand, out of the output data multiplied by the gain, the output data to be output through right speaker <NUM> is added by adder <NUM>. The output data added by adders <NUM> and <NUM> is output as the acoustic signals through left speaker <NUM> and right speaker <NUM>.

<FIG> shows example acoustic signals obtained by output data selector <NUM> according to this embodiment. In (a) to (c) of <FIG>, the horizontal axis represents the time, whereas the vertical axis represents the amplitude levels of the output signals. In each of (a) to (c) of <FIG>, the upper stage represents the output data for left speaker <NUM>, whereas the lower stage represents the output data for right speaker <NUM>.

In the periods surrounded by the broken rectangles in (a) to (c) of <FIG>, the output data selected by output data selector <NUM> is output. As shown in <FIG>, signal processing device <NUM> according to this embodiment performs control for switching the output data at times t(<NUM>), t(<NUM>),. , and t(<NUM>). The transition periods between times t(<NUM>), t(<NUM>),. , and t(<NUM>) are constant.

Assume that the gains set for gain adjusters 412a, 412b,. , and 412n are g1, g2,. In this case, gain adjusters 412a to 412n switch gains g1 to gn of gain adjusters 412a to 412n to be g1 = <NUM>, g2 = <NUM>,. , and gn = <NUM> in the transition period from time t(<NUM>) to time t(<NUM>), and to be g1 = <NUM>, g2 = <NUM>,. , and gn = <NUM> in the transition period from time t(<NUM>) to time t(<NUM>). As shown in (a) to (c) of <FIG>, the output data from first filter processor 302a to n-th filter processor 302n may be switched at certain times, selected sequentially, and output to output <NUM>.

Each time interval (i.e., the time difference) Δt for switching the output data is set to a value ranging, for example, from about <NUM> seconds to about <NUM> seconds, depending on the type and length of input acoustic signal S. If acoustic signal S indicates meaningful wording (e.g., "dangerous" or "there is an obstacle"), each time interval may be a continuous time causing the hearer to hear the wording at least once. If acoustic signal S serves as an intermittent alarm, the time interval may be shortened in accordance with the continuous time of the alarm for one period.

<FIG> shows example gain settings for gain adjusters 412a to 412n of output data selector <NUM> according to Embodiment <NUM>. <FIG> shows superposition of two of the gains of gain adjusters 412a to 412n shown in <FIG>. An example has been described in <FIG> and <FIG> where the outputs of first filter processor 302a to n-th filter processor 302n are switched at the switch timing. As shown in <FIG>, out of the gains of gain adjusters 412a to 412n, those set for two filter processors continuously output the signals are cross-faded. This reduces the noises generated at the switch timing.

Changes in the gains in the transition period from time t(<NUM>) to time t(<NUM>)' that is the gain switching time will be described with reference to <FIG>. As shown in <FIG>, the value of gain g1 gradually decreases from time t(<NUM>) and reaches zero at time t(<NUM>)'. On the other hand, gain g2 is zero until time t(<NUM>) but gradually increases from time t(<NUM>) and reaches time t(<NUM>)'. At this time, gains g1 and g2 change to satisfy the equation g1 + g2 = <NUM>.

In this embodiment, an example has been described where gains g1 and g2 are cross-faded as indicated by the straight lines in the transition period from time t(<NUM>) to time t(<NUM>)'. Instead, gains g1 and g2 may be cross-faded as indicated by sine- or cosine-squared curves.

The transition period (e.g. from time t(<NUM>) to time t(<NUM>)') shown in <FIG> is generally set to a value smaller than time difference Δt, but is not limited thereto.

Now, a procedure of the signal processing performed by signal processing device <NUM> will be described. <FIG> is a flow chart showing an operation of signal processing device <NUM> according to this embodiment.

First, at a time of initial setting such as startup, coefficient setter <NUM> reads the filter coefficients from storage device <NUM> (step S10). The read filter coefficients are then set for first filter processor 302a to n-th filter processor 302n (coefficient setting processing) (step S11).

Acoustic signal S starts then to be input to first filter processor 302a to n-th filter processor 302n (step S12). Input acoustic signal S is subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n (filter processing).

After that, controller <NUM> inputs control information to output data selector <NUM> and causes the selector to select the output signals (control processing) (step S13). Subsequently, output data selector <NUM> sequentially selects, as the output data, the acoustic signal subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n (output data selecting processing) (step S14). The selected output data is then output from output data selector <NUM> to output <NUM>. The output data output to output <NUM> is output as an acoustic signal through selected left speaker <NUM> or right speaker <NUM> (step S15).

Counter <NUM> counts the time while outputting the output data to detect whether the time for switching/selecting the output data set at timer <NUM> has elapsed (time measuring processing) (step S16).

If the time for switching/selecting the output data set at timer <NUM> has elapsed (Yes in step S16), controller <NUM> causes output data selector <NUM> to switch the output data and repeats steps S13, S14, and S15. Namely, in step S13, the control information is input to output data selector <NUM>. In step S14, output data selector <NUM> selects the output data. In step S15, the acoustic signal after the filter processing is output. If the time for switching/selecting the output data set at timer <NUM> has elapsed, signal processing device <NUM> may end the processing or may repeat the processing in step S10 to step S15 again without ending the processing.

If the time for switching/selecting the output data set at timer <NUM> has not elapsed (No in step S16), the selected output data continues to be output (step S15).

Accordingly, the sound is sequentially localized to the hearing positions shown in <FIG>. That is, the sound sequentially moves among the hearing positions. As a result, hearer <NUM> recognizes the acoustic signal at any time in any one of the hearing positions.

Signal processing device <NUM> with the configuration described above processes acoustic signal S in the operation shown in the flow chart in <FIG>. This causes hearer <NUM> to hear the sounds output any time from left speaker <NUM> and right speaker <NUM> and suitable for the hearing position. Accordingly, signal processing device <NUM> gives hearer <NUM> desired sound control effects.

Now, a signal processing system and signal processing device <NUM> according to Embodiment <NUM> will be described. Different from signal processing device <NUM> according to Embodiment <NUM>, signal processing device <NUM> according to this embodiment sets the range of the filter coefficients for use.

<FIG> is a block diagram showing an example configuration of the signal processing system according to this embodiment. As shown in <FIG>, the signal processing system according to this embodiment includes signal processing device <NUM>, left speaker <NUM>, and right speaker <NUM>. Note that left speaker <NUM> and right speaker <NUM> have the configurations the same or similar to left speaker <NUM> and right speaker <NUM> shown in Embodiment <NUM> and the explanation thereof will thus be omitted.

As shown in <FIG>, signal processing device <NUM> includes auxiliary information input <NUM>, auxiliary information analyzer <NUM>, and coefficient range selector <NUM> in addition to the configuration of signal processing device <NUM> shown in <FIG>.

Auxiliary information input <NUM> receives auxiliary information for selecting the range of the filter coefficients set for first filter processor 302a to n-th filter processor 302n. The auxiliary information relates to the hearing position of hearer <NUM> for selecting the range of the filter coefficients set for first filter processor 302a to n-th filter processor 302n by coefficient setter <NUM>. The auxiliary information may include, for example, the information on both the ear positions of hearer <NUM> or the information on the seated position of hearer <NUM>. The auxiliary information may include the information on the position of the seat on which hearer <NUM> is seated.

For example, if signal processing device <NUM> according to this embodiment is applied to in-vehicle equipment, the auxiliary information may be controller area network (CAN) information including the information on the position of the seat for hearer <NUM> or image information obtained by a vehicle interior camera placed in a drive recorder, for example.

Auxiliary information analyzer <NUM> analyzes the input auxiliary information and extracts, out of the auxiliary information, the information useful for detecting the hearing position of hearer <NUM>. For example, the input auxiliary information is the CAN information, auxiliary information analyzer <NUM> analyzes the input CAN information and obtains the information on the position of the seat from the input CAN information. On the other hand, assume that the input auxiliary information is the image information from the drive recorder. In this case, auxiliary information analyzer <NUM> analyzes the image information using a technique such as an image recognition technique to recognize the position of the face of the driver and extracts the information on the hearing position of the driver.

Based on the result of analysis by auxiliary information analyzer <NUM>, coefficient range selector <NUM> selects one of the filter coefficients stored in storage device <NUM> for use and the range (i.e., the coefficient range) of the filter coefficient for use. Coefficient range selector <NUM> inputs the filter coefficient within the selected coefficient range to coefficient setter <NUM>.

<FIG> shows an example of hearing positions and a group of hearing positions in designing first filter processor 302a to n-th filter processor 302n according to this embodiment. More specifically, <FIG> shows example settings of the range of the filter coefficients for use set by coefficient range selector <NUM>. Like the hearing positions shown in <FIG>, <FIG> shows an example of hearer <NUM> and expected hearing positions in designing first filter processor 302a to n-th filter processor 302n as viewed from the left ear of hearer <NUM>.

In signal processing device <NUM>, storage device <NUM> stores a plurality of filter coefficients designed under a plurality of hearing conditions shown as the hearing positions in <FIG>. The filter coefficients stored in storage device <NUM> are classified into groups depending on the respective hearing positions. For example, assume that the hearer is located in position A as a result of analysis on the auxiliary information obtained by auxiliary information analyzer <NUM>. In this case, coefficient range selector <NUM> inputs, to coefficient setter <NUM>, as the coefficient range, the information indicating the use of the filter coefficients of the hearing positions included in first group <NUM> to which A belongs.

Note that each group, such as first group <NUM> or second group <NUM>, for setting the coefficient range may include the filter coefficients designed in physically closer hearing positions or the filter coefficients designed by changing the size of the head. Alternatively, the group for setting the coefficient range may be designed by combining the plurality of hearing conditions. For example, the hearing position may be classified as a first group, while the size of the head may be classified as the a-th group.

Upon receipt of the output result of coefficient range selector <NUM>, coefficient setter <NUM> reads the coefficients of the corresponding group from storage device <NUM> and sets the coefficients for first filter processor 302a to n-th filter processor 302n. For example, in the example group shown in <FIG>, the coefficients set under nine conditions (i.e., hearing positions) included in first group <NUM> are set for first filter processor 302a to n-th filter processor 302n.

Each of first filter processor 302a to n-th filter processor 302n performs the sound control processing of input acoustic signal S and input the processed signal to output data selector <NUM>. Operations (i.e., gain settings) of gain adjusters 412a to 412n of output data selector <NUM> are as shown in <FIG>.

Now, a procedure of the signal processing by signal processing device <NUM> will be described. <FIG> is a flow chart showing an operation of signal processing device <NUM> according to this embodiment.

First, as described above, in signal processing device <NUM>, auxiliary information input <NUM> obtains the auxiliary information (obtainment of auxiliary information) (step S20). After that, auxiliary information analyzer <NUM> analyzes the input auxiliary information and extracts, out of the auxiliary information, the information useful for detecting the hearing position of hearer <NUM> (step S21). Subsequently, coefficient range selector <NUM> selects one of the filter coefficients stored in storage device <NUM> for use and the coefficient range for use (selection of a coefficient range) (step S22).

Based on the coefficient range selected by coefficient range selector <NUM>, coefficient setter <NUM> reads the filter coefficients from storage device <NUM> (step S23). Subsequently, coefficient setter <NUM> sets the filter coefficients for first filter processor 302a, second filter processor 302b,. , and n-th filter processor 302n (step S24).

After that, acoustic signal S starts to be input to input <NUM> (step S25). Input acoustic signal S is subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n. Controller <NUM> inputs then the control information to output data selector <NUM> (step S26).

Based on the control information input from controller <NUM>, output data selector <NUM> sequentially selects, as the output data, the acoustic signal subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n (step S27). The selected output data is then output from output data selector <NUM> to output <NUM>. The output data output to output <NUM> is output as an acoustic signal through left speaker <NUM> or right speaker <NUM> based on the selected output data (step S28).

As in signal processing device <NUM> shown in <FIG>, counter <NUM> counts the time to detect whether the predetermined time for switching/selecting the output data set at timer <NUM> has elapsed (step S29).

If the time for switching/selecting the output data set at timer <NUM> has elapsed (Yes in step S29), controller <NUM> causes output data selector <NUM> to switch the output data and repeats step S26, step S27, and step S28. Namely, in step S26, the control information is input to output data selector <NUM>. In S27, output data selector <NUM> selects the output data. In step S28, the acoustic signal after the filter processing is output. If the time for switching/selecting the output data set at timer <NUM> has not elapsed (No in step S29), the selected output data continues to be output (step S28).

Once auxiliary information analyzer <NUM> detects a change in the auxiliary information (Yes in step S30), auxiliary information analyzer <NUM> analyzes the auxiliary information again (step S21) and repeats the operation in step S22 to step S30. If auxiliary information analyzer <NUM> detects no change in the auxiliary information (No in step S30), signal processing device <NUM> ends the processing. If auxiliary information analyzer <NUM> detects no change in the auxiliary information, signal processing device <NUM> may end the processing or repeat the processing in step S20 to step S30 again without ending the processing.

Accordingly, the sound is sequentially localized to the hearing positions within in first group <NUM> shown in <FIG>. That is, the sound sequentially moves among the hearing positions within first group <NUM>. As a result, hearer <NUM> recognizes the acoustic signal at any time in any one of the hearing positions.

Signal processing device <NUM> with the configuration described above processes acoustic signal S in the operation shown in the flow chart in <FIG>. Accordingly signal processing device <NUM> selects and uses one of the filter coefficients within the group extracted from the filter coefficients stored in storage device <NUM> based on the auxiliary information input to auxiliary information input <NUM>. This causes signal processing device <NUM> to hinder the use of the filter coefficients that hardly provide the sound localization control effects. Accordingly, signal processing device <NUM> gives hearer <NUM> desired sound control effects.

Now, a signal processing system and signal processing device <NUM> according to Embodiment <NUM> will be described. Different from signal processing device <NUM> according to Embodiment <NUM>, signal processing device <NUM> according to this embodiment changes the switch timing of the acoustic signal output from left speaker <NUM> and right speaker <NUM> in accordance with the power of input acoustic signal S.

As shown in <FIG>, signal processing device <NUM> includes acoustic signal analyzer <NUM> in addition to the configuration of signal processing device <NUM> shown in <FIG>.

Acoustic signal analyzer <NUM> analyzes the power of input acoustic signal S. Acoustic signal analyzer <NUM> inputs the result of analysis to controller <NUM>. Based on the power of acoustic signal S analyzed by acoustic signal analyzer <NUM>, controller <NUM> sets the timing for switching the output data selected by output data selector <NUM>.

The power of acoustic signal S is, for example, the amplitude of acoustic signal S expressed by a decibel. Specifically, the power is a parameter that may be expressed as <NUM> log<NUM>|Z|[dB], where acoustic signal S has amplitude Z. Note that the power of acoustic signal S may be calculated using the square value of the amplitude. In this case, the power may have a momentary square value for each sampling or may be a sum of squares for a certain period.

<FIG> is a block diagram showing a configuration of acoustic signal analyzer <NUM> according to this embodiment. As shown in <FIG>, acoustic signal analyzer <NUM> includes power detector <NUM> and determiner <NUM>.

Power detector <NUM> detects the power of acoustic signal S. Determiner <NUM> determines whether the power of acoustic signal S is higher than or equal to a threshold.

The power of acoustic signal S input from input <NUM> to acoustic signal analyzer <NUM> is detected by power detector <NUM> of acoustic signal analyzer <NUM>. Based on the detection result, determiner <NUM> determines whether the power detected by power detector <NUM> is over a certain threshold, and outputs the determination result to controller <NUM>.

The certain threshold is here, for example, the minimum power value for acoustic signal S to be recognized as an auditory effective acoustic signal. For example, the environmental sound such as the sound of a fan is not regarded as the auditory effective acoustic signal but is background noise. The threshold of the power of the acoustic signal may be at a level that allows detection of the input of auditory effective signals, for example, at a level obtained by adding <NUM> dB to the level of the acoustic signal of the background noise.

If the power of acoustic signal S at acoustic signal analyzer <NUM> is over the threshold, controller <NUM> that receives the result of determining the power of acoustic signal S from determiner <NUM> causes output data selector <NUM> to perform the output data selecting operation. This output data selecting operation is performed when the power of acoustic signal S is over the threshold and is not necessarily performed at a certain time interval unlike the selecting operation by signal processing device <NUM> shown in Embodiment <NUM>. That is, the gains of gain adjusters 412a to 412n are switched not at a certain time interval but in accordance with the magnitude of the power of input acoustic signal S.

<FIG> shows example acoustic signals obtained by output data selector <NUM> in using acoustic signal analyzer <NUM> according to this embodiment. In (a) to (c) of <FIG>, the horizontal axis represents the time, whereas the vertical axis represents the amplitude levels of the output signals. In each of (a) to (c) of <FIG>, the upper stage represents the output data for left speaker <NUM>, whereas the lower stage represents the output data for right speaker <NUM>.

<FIG> show example timing for switching the reproduced sounds. In the periods surrounded by the broken rectangles in (a) to (c) of <FIG>, the output data selected by output data selector <NUM> is output. The vertical arrows shown in <FIG> represent the times for controller <NUM> to perform the switching operation of the reproduced sound.

As shown in (a) to (c) of <FIG>, signal processing device <NUM> according to this embodiment performs control for switching the output data at times t(<NUM>), t(<NUM>),. , and t(<NUM>). The transition periods between times t(<NUM>), t(<NUM>),. , and t(<NUM>) are not constant but controlled by controller <NUM>. Controller <NUM> controls the timing for switching the output data based on the control information generated by acoustic signal analyzer <NUM>.

Specifically, acoustic signal analyzer <NUM> determines whether the power of input acoustic signal S changes from a value smaller than a threshold to reach and exceed the threshold. Based on the determination result, controller <NUM> generates the control information for controlling the timing at which output data selector <NUM> selects the output data. For example, assume that the power of input acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold. In this case, acoustic signal analyzer <NUM> switches the gains of gain adjusters 412a to 412n of output data selector <NUM>. On the other hand, if the power of input acoustic signal S does not exceed the threshold, acoustic signal analyzer <NUM> generates the control information not to switch the gains of gain adjusters 412a to 412n of output data selector <NUM>.

Controller <NUM> causes output data selector <NUM> using the control information. Accordingly, the outputs of first filter processor 302a to the n-th filter processor are not switched in the period when the power of acoustic signal S does not exceed the threshold. On the other hand, the outputs of first filter processor 302a to the n-th filter processor are switched in the period when the power of acoustic signal S has an auditory effective magnitude.

Note that the power of input acoustic signal S may change from a value smaller than the threshold to be a value greater than or equal to the threshold immediately after the start of the input and remain over the threshold. Counter <NUM> counts the time elapsed after switching the output data. In the case that the time period when the power of acoustic signal S is greater than or equal to the threshold continues for the time set in advance at timer <NUM>, controller <NUM> may perform the control for switching the output of first filter processor 302a to n-th filter processor 302n.

There is a case where the power of acoustic signal S does not exceed the threshold. In view of the case, acoustic signal analyzer <NUM> may use the following as conditions for determining acoustic signal S for setting the switch timing. The determination conditions are that the power of acoustic signal S is greater than or equal to the threshold and that the time when the filter processor is selected is over Δt2. Note that Δt2 may be set to a time causing the hearer to recognize that acoustic signal S is an alarm, for example, ranging from <NUM> seconds to <NUM> seconds. Note that Δt2 is not limited thereto and may change in accordance with the type of the acoustic signal.

At a time of initial setting such as start-up, coefficient setter <NUM> reads the filter coefficients from storage device <NUM> (step S40). The read filter coefficients are then set for first filter processor 302a to n-th filter processor 302n (step S41).

After that, acoustic signal S starts to be input to first filter processor 302a to n-th filter processor 302n (step S42). Input acoustic signal S is subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n.

Acoustic signal S is then analyzed by acoustic signal analyzer <NUM> whether the power of acoustic signal S is greater than the threshold set in advance (power detection) (step S43). Based on the result of analysis by acoustic signal analyzer <NUM>, controller <NUM> generates the control information for causing output data selector <NUM> to switch the output data (step S44). The control information generated by controller <NUM> is input from controller <NUM> to output data selector <NUM> (step S45).

Subsequently, output data selector <NUM> sequentially selects, as the output data, the acoustic signal subjected to the sound control processing by first filter processor 302a to n-th filter processor 302n (step S46). The selected output data is then output from output data selector <NUM> to output <NUM>. The output data output to output <NUM> is output as an acoustic signal through left speaker <NUM> or right speaker <NUM> based on the selected output data (step S47).

Power detector <NUM> detects the power of acoustic signal S. Based on the detection result, determiner <NUM> detects whether the power of acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold (step S48). If the power of acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold (Yes in step S48), controller <NUM> generates the control information to switch the output data (step S44). If the power of acoustic signal S does not change from a value smaller than the threshold to a value greater than or equal to the threshold (No in step S48), counter <NUM> counts the time for outputting the output data. It is then detected whether the time for switching/selecting the output data set at timer <NUM> has elapsed (step S49).

If the time for switching/selecting the output data set at timer <NUM> has elapsed (Yes in step S49), controller <NUM> causes output data selector <NUM> to switch the output data and performs step S43, step S44, step S45, step S46, and step S47 are performed. Namely, in step S43, the power of acoustic signal S is analyzed. In step S44, controller <NUM> generates the control signal. In step S45, from controller <NUM>, the control information is input. In step S46, output data selector <NUM> selects the output data. In step S47, the acoustic signal after the filter processing is output. If the time for switching/selecting the output data set at timer <NUM> has not elapsed (No in step S49), the selected output data continues to be output (step S47). If the time for switching/selecting the output data set at timer <NUM> has not elapsed, signal processing device <NUM> may end the processing or repeat the processing in step S40 to step S49 again without ending the processing.

With this procedure, signal processing device <NUM> performs control for switching the output data, if the power of input acoustic signal S changes from a value smaller than the threshold to a value greater than or equal to the threshold. The device performs control for maintaining the output data without switching the data, if the power of acoustic signal S does not change from a value smaller than the threshold to a value greater than or equal to the threshold. If the power of acoustic signal S does not change from a value smaller than the threshold to be a value greater than or equal to the threshold for a long time, the device performs control for switching the output data when the time for switching/selecting the output data has elapsed. As a result, hearer <NUM> recognizes the acoustic signal at any time in any one of the hearing positions.

Signal processing device <NUM> with the configuration described above processes acoustic signal S in the operation shown in the flow chart in <FIG>. In signal processing device <NUM>, acoustic signal analyzer <NUM> analyzes input acoustic signal S to control the timing for switching the output data. Accordingly, signal processing device <NUM> switches the output data, gives hearer <NUM> sound control effects and causes the hearer to recognize the acoustic signal in the period when the auditory effective acoustic signal is generated or, if no auditory effective acoustic signal is generated, when the time for switching/selecting the output data has elapsed.

The signal processing device according to the aspects of the present disclosure has been described above based on the embodiments. The present disclosure is however not limited to the embodiments. For example, within the scope of the appended claims, the constituent elements according to the present disclosure may be freely combined or some of the constituent elements may be excluded to form another embodiment. The present disclosure includes variations obtained by variously modifying the embodiments as conceived by those skilled in the art without departing from the scope of the claims.

For example, in the embodiments described above, the filter processors may be FIR filters, IIR filters, or a combination of FIR filters and IIR filters. Having been described where the filter processors are designed in the frequency domain, the method is not limited thereto. The method of obtaining least squares in the time domain may be employed. In addition, the filters may not be fixed filters but adaptive filters.

While an example has been described above in the embodiments where the signal processing device includes three or more filter processors, the configuration is not limited thereto. For example, the device may include only one filter processor whose filter coefficient may be varied by the coefficient setter as appropriate for use. If the device includes IIR filters, the variation in the filter coefficient may cause oscillations. At least two or more filter processors are desired to be used in turn.

While an example has been described above in the embodiments where the output data selector includes three or more gain adjusters, the configuration is not limited thereto. For example, the device may include only one gain adjuster whose gain may be varied by the controller as appropriate.

In Embodiment <NUM>, <FIG> shows the example operation of the output data selector switching the outputs of the filter processors and outputting the selected output. <FIG> show the example of cross-fading and smoothly switching the gains. These configurations are clearly also applicable to Embodiments <NUM> and <NUM>.

While an example has been described above in the embodiments where left speaker <NUM> and right speaker <NUM> intend to reproduce an input signal over the full bandwidth, the configurations are not limited to thereto. Left speaker <NUM> and right speaker <NUM> may be multi-way speakers including units such as a tweeter, a squawker, and a woofer associated with the frequencies of signals to be reproduced. In this case, the speakers may include the units in individual cases spaced apart from each other. In addition, the speakers may include a subwoofer capable of reproducing low-frequency effect (LFE) signals.

Left speaker <NUM> and right speaker <NUM> may be included in each of the signal processing devices.

The filter processors may include, at the input stage or the output stage, configurations that perform effect processing such as delays, reverbs, or echoes in addition to the processing described above in the embodiments. Examples may be an equalizer or a filter that adjusts frequency characteristics and a gain or an auto gain controller (AGC) that adjusts output amplitudes. At this time, the even characteristics are desired to be multiplied by the outputs of the right and left speakers.

The signal processing device according to the present disclosure has been described above based on the embodiments. The present disclosure is however not limited to the embodiments. The present disclosure includes other embodiments, such as those obtained by variously modifying the embodiments as conceived by those skilled in the art or those achieved by freely combining the constituent elements in the different embodiments without departing from the scope of the claims.

In the present disclosure, the constituent elements of the signal processing device may be dedicated hardware devices or may be achieved by executing software programs suitable for the constituent elements. The constituent elements may be achieved by a program executor, such as a CPU or a processor, reading and executing software programs stored in a storage medium such as a hard disk or a semiconductor memory. Alternatively, the constituent elements may be LSI circuits, dedicated circuits, general-purpose processors, FPGAs, or reconfigurable processors capable of reconfiguring connections and setting of circuit cells inside an LSI circuit.

In the present disclosure, a D/A converter that converts digital signals into analog signals, an amplifier that amplifies the signals when outputting the signals through the speakers, and other elements have been omitted for simplification. Needless to mention, even if these elements may be software or hardware and output signals through the speakers, the effects of the present disclosure will not change.

Claim 1:
A signal processing device (<NUM>; <NUM>; <NUM>) for controlling sound localization, the signal processing device comprising:
one or more filter processors (302a to 302n) that perform sound localization processing of an input acoustic signal and generate output signals;
a coefficient setter (<NUM>) that sets, for the one or more filter processors (302a to 302n), a plurality of filter coefficients for use in the one or more filter processors (302a to 302n);
an output data selector (<NUM>) that selects, out of the output signals subjected to the sound localization processing by the one or more filter processors (302a to 302n), an output signal to be output to a speaker (<NUM>, <NUM>);
a time measurer (<NUM>, <NUM>) that monitors a time for selecting the output signal; and
a controller (<NUM>) that causes the output data selector (<NUM>) to select the output signal in accordance with the time for selecting the output signal,
characterised in that:
the plurality of filter coefficients includes filter coefficients generated under the conditions of a plurality of hearing positions (<NUM>, <NUM>, <NUM>);
the time for selecting the output signal is set to a value ranging from <NUM> seconds to <NUM> seconds; and
the controller (<NUM>) is configured to cause the output data selector (<NUM>) to change which output signal is output to the speaker (<NUM>, <NUM>) in accordance with the time for selecting the output signal.