Patent Description:
For example, there are systems in which speakers are embedded in the headrest part, at its left and right positions, of a seat where a user such as the driver of a vehicle sits, and sound is output from the speakers.

However, in a case of providing speakers in the headrest part, the user (listener) such as the driver hears sounds coming from behind the ears, which may feel unnatural, and some users may, in some cases, experience listening fatigue.

Sound localization processing is a technology that addresses such a problem. Sound localization processing is audio signal processing that causes a user to perceive sound as if the sound is coming from a virtual sound source position that is different from the actual speaker position, such as a virtual sound source position set to a position in front of the listener, for example.

For example, if an audio signal that has been subjected to sound localization processing is output from a speaker behind the ears of the user (listener), the user will perceive sound as if the sound source is in front of the user.

An example of a disclosed technology of the related art regarding sound localization processing is Patent Document <NUM> (<CIT>).

Note that the above patent document discloses a configuration that generates sound to output from a speaker by performing signal processing that considers a head-related transfer function (HRTF) from the speaker to the ears of the listener. Also, the documents <CIT>, <CIT>, <CIT>, and <CIT> describe apparatuses and methods related to signal processing based on HRTFs.

Performing signal processing based on the head-related transfer function (HRTF) makes it possible to control the optimal virtual sound source position for the listener.

As described above, by outputting a processed signal based on the head-related transfer function (HRTF) from a speaker, it is possible to perform a sound image position control that sets an optimal virtual sound source position for the listener.

However, the head-related transfer function (HRTF) is different for each individual. Consequently, in a case of outputting a processed signal to which a head-related transfer function (HRTF) corresponding to a specific user has been applied from a speaker, there is a problem in that the virtual sound source position is an optimal position for that specific user, but not necessarily an optimal virtual sound source position for another user.

The present disclosure addresses such a problem, and provides an acoustic signal processing device, an acoustic signal processing system, an acoustic signal processing method, and a program capable of controlling the output, from a speaker, of a processed signal to which a head-related transfer function (HRTF) specific to a user (listener) has been applied, and setting an ideal virtual sound source position for each user (listener).

Aspects of the present invention are defined in the appended claims.

Other objects, features, and advantages of the present disclosure will become apparent from the detailed description based on the embodiments of the present disclosure and the attached drawings which are described later. Note that, in the present description, a system refers to a logical set configuration including a plurality of devices, and the devices of the configuration are not necessarily included in the same casing.

According to the configuration of exemplary aspects of the present disclosure, there is achieved a configuration that executes sound localization processing applying a head-related transfer function (HRTF) corresponding to a user identified by a user identification, and makes an output from an output unit for each user position.

Specifically, for example, a user identification unit that executes user identification and a user position identification process and a sound localization processing unit that executes sound localization processing using, as a processing parameter, a head-related transfer function (HRTF) specific to the user are included. The sound localization processing unit executes sound localization processing that treats the HRTF specific to the identified user as a processing parameter, and outputs a signal obtained by the sound localization processing to an output unit for the identified user position. In a case where the user identification unit identifies multiple users, the sound localization processing unit executes the sound localization processing using the HRTF of each of the multiple users in parallel, and outputs processed signals to an output unit for each user position.

According to the present configuration, there is achieved a configuration that executes sound localization processing applying a head-related transfer function (HRTF) corresponding to a user identified by a user identification, and makes an output from an output unit for each user position.

Note that the effects described in this specification are merely non-limiting examples, and there may be additional effects.

Hereinafter, an acoustic signal processing device, an acoustic signal processing system, an acoustic signal processing method, and a program according to the present disclosure will be described in detail with reference to the drawings. Note that the description will be given in the following sections.

First, with reference to <FIG> and subsequent drawings, an overview of audio signal processing based on sound localization processing and the head-related transfer function (HRTF) will be described.

<FIG> illustrates an automobile <NUM>. A user (listener) <NUM> sits in the driver's seat. A left speaker <NUM> and a right speaker <NUM> are installed in a headrest part of the driver's seat, and a stereo signal (LR signal) from a sound source such as a CD not illustrated is output from the two speakers.

In the case of providing speakers in the headrest part and simply outputting a stereo signal (LR signal) from the sound source in this way, the user (listener) <NUM> hears sounds coming from behind the ears, which may feel unnatural, and some users may, in some cases, experience listening fatigue.

To address such a problem, an acoustic signal processing device internal to the automobile <NUM> executes signal processing on the LR signal output from a sound source such as a CD, and outputs a signal obtained by the signal processing from the left speaker <NUM> and the right speaker <NUM>. The signal processing is sound localization processing.

As described above, sound localization processing is signal processing causing the user (listener) to perceive sound as if a sound source exists at a virtual sound source position different from the actual speaker position.

In the example illustrated in <FIG>, it is possible to cause the user to perceive sound as if the L signal of the sound source is being output from a virtual left speaker <NUM> and the R signal of the sound source is being output from a virtual right speaker <NUM> at positions (virtual sound source positions) in front of the user (listener) <NUM>.

<FIG> will be referenced to describe an example of a process of measuring the head-related transfer function (HRTF) treated as a parameter to apply to the sound localization processing. Note that <FIG> is a diagram recorded in Patent Document <NUM> (<CIT>) described earlier as a disclosed technology of the related art regarding sound localization processing. The process according to the present disclosure can be executed by using existing sound localization processing described in Patent Document <NUM> and the like.

As illustrated in <FIG>, in a predetermined playback sound field such as a studio for example, a real left speaker <NUM> and a real right speaker <NUM> are actually installed at the left and right virtual speaker positions (positions where speakers are expected to exist) with respect to the user <NUM>.

Thereafter, sounds emitted by the real left speaker <NUM> and the real right speaker <NUM> are picked up at portions near either ear of the user <NUM>, and a head-related trnsfer function (HRTF) indicating how the sounds emitted from the real left speaker <NUM> and the real right speaker <NUM> change when reaching the portions near either ear of the user <NUM> is measured.

In the example illustrated in <FIG>, M11 is the head-related transfer function of the sound from the real left speaker <NUM> to the left ear of the user <NUM>, and M12 is the head-related transfer function of the sound from the real left speaker <NUM> to the right ear of the user <NUM>. Similarly, M21 is the head-related transfer function of the sound from the real right speaker <NUM> to the left ear of the user <NUM>, and M22 is the head-related transfer function of the sound from the real right speaker <NUM> to the right ear of the user <NUM>.

These head-related transfer functions (HRTFs) are parameters to apply to the signal processing performed on the LR signal output from the sound source such as a CD. The signal obtained by the signal processing using these parameters is output from a left speaker L21 and a right speaker <NUM> in the headrest part of the driver's seat illustrated in <FIG>. This arrangement makes it possible to cause the user to perceive sound as if the sounds emitted from the speakers in the headrest part are being output from the virtual speaker positions.

In other words, it is possible to cause the user <NUM> to perceive sound as if the L signal of the sound source is being output from the virtual left speaker <NUM> and the R signal of the sound source is being output from the virtual right speaker <NUM> at positions (virtual sound source positions) in front of the user (listener) <NUM> illustrated in <FIG>.

<FIG> is a diagram illustrating an exemplary configuration of a device that performs sound localization processing using the head-related transfer function (HRTF).

An L signal and an R signal are reproduced as a stereo signal from a sound source <NUM> such as a CD. The reproduced signal is inputted (Lin, Rin) into an HRTF-applying sound localization processing unit <NUM>.

The HRTF-applying sound localization processing unit <NUM> acquires a head-related transfer function (HRTF) measured by the measurement process described earlier with reference to <FIG> from an HRTF storage unit <NUM>, executes signal processing applying the acquired data, and generates output signals (Lout, Rout) to be output to the left speaker <NUM> and the right speaker <NUM> of the headrest part, for example.

The left speaker <NUM> outputs the output signal (Lout) processed in the HRTF-applying sound localization processing unit <NUM>.

In addition, the right speaker <NUM> outputs the output signal (Rout) processed in the HRTF-applying sound localization processing unit <NUM>.

In this way, when a signal subjected to sound localization processing in the HRTF-applying sound localization processing unit <NUM> is output to the left speaker <NUM> and the right speaker <NUM> in the headrest part, the user <NUM> is able to perceive sound as if the sounds emitted from the speakers in the headrest part are at the virtual speaker positions, or in other words, as if the L signal of the sound source is being output from the virtual left speaker <NUM> and the R signal of the sound source is being output from the virtual right speaker <NUM> at positions (virtual sound source positions) in front of the user <NUM> illustrated in <FIG>.

Thus, performing signal processing based on the head-related transfer function (HRTF) makes it possible to control the optimal virtual sound position for the listener.

However, as described above, the head-related transfer function (HRTF) is different for each individual. Consequently, in a case of outputting a processed signal to which a head-related transfer function (HRTF) corresponding to a specific user has been applied from a speaker, there is a problem in that the virtual sound source position can be an optimal position for that specific user, but not necessarily an optimal virtual sound source position for another user.

For example, it is anticipated that multiple different users will sit in the driver's seat of the automobile <NUM> as illustrated in <FIG>.

In such cases, the HRTF-applying sound localization processing unit <NUM> illustrated in <FIG> needs to perform signal processing based on the head-related transfer function (HRTF) corresponding to each user.

As illustrated in <FIG>, in the case where three users A to C change places, it is necessary to perform signal processing applying the head-related transfer function (HRTF) corresponding to each user.

In the example of <FIG>, from a time t1, a user A <NUM> is sitting in the driver's seat, and in this case, it is necessary to execute signal processing applying the head-related transfer function (HRTF) of the user A <NUM> to output from the speakers.

From a time t2, a user B <NUM> is sitting in the driver's seat, and in this case, it is necessary to execute signal processing applying the head-related transfer function (HRTF) of the user B <NUM> to make an output from the speakers.

Further, from a time t3, a user C <NUM> is sitting in the driver's seat, and in this case, it would be necessary to execute signal processing applying the head-related transfer function (HRTF) of the user C <NUM> to make an output from the speakers.

Next, a configuration and processing of an acoustic signal processing device according to the present disclosure will be described.

As described above, the head-related transfer function (HRTF) is different for every user, and an optimal virtual sound source position cannot be set unless sound localization processing applying the head-related transfer function (HRTF) unique to the user acting as the listener is executed.

The acoustic signal processing device according to the present disclosure described hereinafter executes a user identification process and a user position identification process, decides the head-related transfer function (HRTF) to apply to the sound localization processing on the basis of identification information, and performs signal processing applying the head-related transfer function (HRTF) corresponding to each user. Moreover, the signal processing result obtained as the output is output from speakers provided at the position of the user having the head-related transfer function (HRTF) applied to the signal processing.

First, a configuration and process of Embodiment <NUM> according to the present disclosure will be described with reference to <FIG> and subsequent drawings.

<FIG> illustrates an automobile <NUM>. An acoustic signal processing device <NUM> according to the present disclosure is installed onboard the automobile <NUM>. Note that a specific example of the configuration of the acoustic signal processing device <NUM> according to the present disclosure will be described later.

Four users, namely a user A 110a, a user B 110b, a user C 110c, and a user D 110d, are on the automobile <NUM>.

LR speakers corresponding to each user are installed in a headrest part of each user's seat.

In the headrest part for the user A 110a, a user A left speaker 122aL and a user A right speaker 122aR are installed.

In the headrest part for the user B 110b, a user B left speaker 122bL and a user B right speaker 122bR are installed.

In the headrest part for the user C 110c, a user C left speaker 122cL and a user C right speaker 122cR are installed.

In the headrest part for the user D 110d, a user D left speaker 122dL and a user D right speaker 122dR are installed.

Also, a sensor (camera) <NUM> that captures an image of the face of each of the users A to D is installed onboard the automobile <NUM>.

The captured image of the face of each of the users A to D acquired by the sensor (camera) <NUM> is inputted into the acoustic signal processing device <NUM> according to the present disclosure.

The acoustic signal processing device <NUM> according to the present disclosure executes user identification and user position identification on the basis of the captured image of the face of each of the users A to D acquired by the sensor (camera) <NUM>.

The acoustic signal processing device <NUM> according to the present disclosure acquires the head-related transfer function (HRTF) of each of the users A to D from a database on the basis of user identification information, and executes signal processing (sound localization processing) applying the acquired head-related transfer function (HRTF) of each of the users A to D in parallel.

Moreover, four pairs of output LR signals obtained by the signal processing (sound localization processing) applying the head-related transfer function (HRTF) of each of the users A to D are output from the LR speakers at the position of each user specified on the basis of user position identification information.

Through these processes, each of the users A to D can individually listen to the output signal obtained by the signal processing (sound localization processing) applying that user's own head-related transfer function (HRTF) from the speakers in the headrest part, and each user can listen to sounds from an ideal virtual sound source position.

<FIG> is a diagram illustrating an exemplary configuration of an acoustic signal processing device <NUM> according to the present disclosure.

As illustrated in <FIG>, the acoustic signal processing device <NUM> according to the present disclosure includes a sensor (such as a camera) <NUM>, a user & user position identification unit <NUM>, a user-corresponding HRTF acquisition unit <NUM>, an HRTF database <NUM>, and an HRTF-applying sound localization processing unit <NUM>.

The HRTF-applying sound localization processing unit <NUM> includes a plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n capable of executing processing in parallel.

The sensor (such as a camera) <NUM> is a sensor that acquires information that can be used to identify the user and the user position, and includes, for example, a camera.

Sensor detection information acquired by the sensor (such as a camera) <NUM>, such as an image captured by a camera for example, is inputted into the user & user position identification unit <NUM>.

The user & user position identification unit <NUM> identifies the user and the user position on the basis of sensor detection information acquired by the sensor (such as a camera) <NUM>, such as an image captured by a camera for example.

As an example, the user & user position identification unit <NUM> identifies the user by comparing a face image included in the image captured by a camera to user face image information stored in a user database not illustrated.

Furthermore, the user & user position identification unit <NUM> also identifies the position of each identified user. The identification of the user position is performed as a process of determining the position where each user is located to hear the sound output from which speakers.

The user identification information and user position identification information generated by the user & user position identification unit <NUM> are inputted into the user-corresponding HRTF acquisition unit <NUM>.

The user-corresponding HRTF acquisition unit <NUM> acquires the head-related transfer function (HRTF) corresponding to each identified user from the HRTF database <NUM>, on the basis of the user identification information inputted from the user & user position identification unit <NUM>.

The head-related transfer function (HRTF) corresponding to each user measured in advance is stored in the HRTF database <NUM>.

In the HRTF database <NUM>, the head-related transfer function (HRTF) corresponding to each user is stored in association with a user identifier. Note that the head-related transfer function (HRTF) corresponding to each user is measurable by the process described with reference to <FIG> above.

The user-corresponding HRTF acquisition unit <NUM> outputs the head-related transfer function (HRTF) corresponding to each identified user acquired from the HRTF database <NUM> in association with the user identification information and the user position identification information inputted from the user & user position identification unit <NUM>.

As described above, the HRTF-applying sound localization processing unit <NUM> includes a plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n.

Each of the plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n is pre-associated with LR speakers that respectively output processed signals (Lout, R-out).

For example, the user-corresponding HRTF-applying sound localization processing unit <NUM>-<NUM> is connected to the LR speakers of the driver's seat, namely the user A left speaker 122aL and the user A right speaker 122aR of the driver's seat where the user A 110a illustrated in <FIG> is sitting.

In this way, each of the user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n is pre-associated with LR speakers that respectively output processed signals (Lout, R-out).

The HRTF-applying sound localization processing unit <NUM> executes signal processing applying the HRTF corresponding to each user in the user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n on the basis of the data associating the user identification information and the user position identification information inputted from the user-corresponding HRTF acquisition unit <NUM> with the head-related transfer function (HRTF) corresponding to each identified user.

Specifically, for example, the user-corresponding HRTF-applying sound localization processing unit <NUM>-<NUM>, which is connected to the user A left speaker 122aL and the user A right speaker 122aR of the driver's seat where the user A 110a is sitting, executes signal processing (sound localization processing) that accepts the head-related transfer function (HRTF) corresponding to the user A as input.

Output signals (Lout-a, Rout-a) are generated by the signal processing. The generated output signals (Lout-a, Rout-a) are output from the user A left speaker 122aL and the user A right speaker 122aR of the driver's seat where the user A 110a is sitting.

Similarly, the user-corresponding HRTF-applying sound localization processing unit <NUM>-n, which is connected to the user N left speaker 122nL and the user N right speaker 122nR of the driver's seat where the user N 110n illustrated in <FIG> is sitting, executes signal processing (sound localization processing) that accepts the head-related transfer function (HRTF) corresponding to the user N as input.

Output signals (Lout-n, Rout-n) are generated by the signal processing. The generated output signals (Lout-n, Rout-n) are output from the user N left speaker 122nL and the user N right speaker 122nR of the driver's seat where the user N 110n is sitting.

The same applies to the other users, and output signals (Lout-x, Rout-x) generated by signal processing (sound localization processing) applying the head-related transfer function (HRTF) corresponding to each user are output from the speakers at each user's position.

Through these processes, all users are able to listen to the signals (Lout-x, Rout-x) obtained by executing sound localization processing applying each user's own head-related transfer function (HRTF) from the speakers in the headrest part at the position where each user is sitting, and listen to sounds from an optimal virtual sound source position for each user.

Note that the exemplary configuration of the acoustic signal processing device <NUM> illustrated in <FIG> is an example, and other configurations are also possible.

For example, it is also possible to place the HRTF database <NUM> of the acoustic signal processing device <NUM> illustrated in <FIG> on an external server.

This exemplary configuration is illustrated in <FIG>.

As illustrated in <FIG>, the acoustic output device <NUM> built into an automobile is configured to be connected over a network <NUM> and capable of communication with a management server <NUM>.

The acoustic output device <NUM> built into an automobile does not include the HRTF database <NUM> described with reference to <FIG>.

The HRTF database <NUM> is held in the management server <NUM>.

The management server <NUM> includes the HRTF database <NUM> that stores the head-related transfer function (HRTF) corresponding to each user measured in advance. In the HRTF database <NUM>, the head-related transfer function (HRTF) corresponding to each user is stored in association with a user identifier.

The acoustic output device <NUM> executes a process of searching the HRTF database <NUM> in the management server <NUM> to acquire the head-related transfer function (HRTF) corresponding to each user on the basis of the user identification information generated by the user & user position identification unit <NUM>.

The processes thereafter are similar to the processes described with reference to <FIG>.

In this way, by placing the HRTF database <NUM> in the management server <NUM>, it is possible to perform signal processing applying the head-related transfer functions (HRTFs) of a greater number of users.

Next, the flowchart illustrated in <FIG> will be referenced to describe a sequence of processes executed by an acoustic signal processing device according to the present disclosure.

Note that the processes following the flows in <FIG> and subsequent drawings described hereinafter may be executed according to a program stored in a storage unit of the acoustic signal processing device, for example, and are executed under the control of a control unit having a program execution function, such as a CPU for example. Hereinafter, the process in each step of the flow illustrated in <FIG> will be described consecutively.

First, in step S101, the acoustic signal processing device executes user identification and user position identification.

This process is executed by the user & user position identification unit <NUM> illustrated in <FIG>.

Next, in step S102, the acoustic signal processing device acquires the head-related transfer function (HRTF) of each identified user from a database.

This process is executed by the user-corresponding HRTF acquisition unit <NUM> illustrated in <FIG>.

In the HRTF database <NUM>, the head-related transfer function (HRTF) corresponding to each user is stored in association with a user identifier.

The user-corresponding HRTF acquisition unit <NUM> executes a database search process based on the user identification information inputted from the user & user position identification unit <NUM>, and acquires the head-related transfer function (HRTF) corresponding to each identified user.

Next, in step S103, the acoustic signal processing device inputs the head-related transfer function (HRTF) of each user into respective user-corresponding HRTF-applying sound localization processing units, and generates an output signal corresponding to each user.

This process is executed by the HRTF-applying sound localization processing unit <NUM> illustrated in <FIG>.

As described with reference to <FIG>, the HRTF-applying sound localization processing unit <NUM> includes a plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n.

Each of the plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n is pre-assigned with LR speakers that respectively output processed signals (Lout, R-out).

Finally, in step S104, the acoustic signal processing device outputs the generated output signal corresponding to each user to speakers installed at the user position corresponding to each generated signal.

This process is also executed by the HRTF-applying sound localization processing unit <NUM> illustrated in <FIG>.

Output signals (Lout-x, Rout-x) generated by signal processing (sound localization processing) applying the head-related transfer function (HRTF) corresponding to each user are output from the speakers at each user's position.

Next, as Embodiment <NUM>, an embodiment output control according to the presence or absence of a user is executed will be described.

In the example described above with reference to <FIG>, all users (listeners) are sitting in seats where speakers of the automobile <NUM> are installed. However, in actuality, some of the seats may be empty in many cases, for example, as illustrated in <FIG>.

In such cases, outputting sounds from the speakers in the empty seats leads to increased power consumption. Moreover, if the output sounds from these speakers enter the ears of a user sitting in another seat, the user will perceive the sounds as unwanted noise.

The embodiment described hereinafter addresses such a problem, and is an embodiment the output from speakers at positions where no user is present is controlled to stop or mute.

A processing sequence according to Embodiment <NUM> will be described with reference to the flowchart illustrated in <FIG>.

Hereinafter, the process in each step of the flow illustrated in <FIG> will be described consecutively.

The flow illustrated in <FIG> is obtained by adding steps S101a and S101b between step S101 and step S102 of the flow illustrated in <FIG> described above.

The processes in the other steps (step S101 and steps S102 to S104) are similar to the processes described with reference to <FIG> and therefore a description is omitted.

Hereinafter, the process in step S101a and the process in step S101b will be described.

In step S101, the acoustic signal processing device executes user identification and user position identification, and then executes processing of step S101a.

In step S101a, the acoustic signal processing device determines whether or not a speaker-installed seat without a user present exists.

The user & user position identification unit <NUM> identifies the user and the user position on the basis of sensor detection information acquired by the sensor (such as a camera) <NUM>, such as an image captured by a camera for example. At this time, it is determined whether or not a speaker-installed seat without a user present exists.

In the case where a speaker-installed seat without a user present does not exist, the flow proceeds to step S102, and the processes in steps S102 to S104 are executed.

These processes are similar to the processes described above with reference to <FIG>, and signals obtained by performing signal processing (sound localization processing) corresponding to each user are output from the speakers in all seats.

On the other hand, in the case of determining that a speaker-installed seat without a user present exists in the determination process of step S101a, the flow proceeds to step S101b.

In the case of determining that a speaker-installed seat without a user present exists in the determination process of step S101a, the flow proceeds to step S101b.

In step S101b, the acoustic signal processing device stops the output or executes a mute control on the output from each speaker-installed seat without a user present.

In the case of stopping the output, the generation of output sounds for the speakers in these seats is not executed either. Among the user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n of the HRTF-applying sound localization processing unit <NUM> illustrated in <FIG>, the processing units that generate output sounds for speakers without a user present do not execute any processing.

Also, in the case of executing a mute control, output sounds are generated to be limited to playback sounds at a level that is inaudible to the ears of nearby users. Note that the HRTF to apply to the signal processing (sound localization processing) in this case is an HRTF of standard type stored in the HRTF database <NUM>. Alternatively, playback sounds may be output directly from the sound source without executing signal processing (sound localization processing).

Thereafter, in steps S102 to S104, the signal processing and outputting of playback sounds is executed only for the speakers at positions where a user is present in the seat.

By performing these processes, the output from speakers at positions without a user present is stopped or muted, and a reduction in power consumption is achieved. Furthermore, it is possible to reduce noise entering the ears of the users in other seats.

The embodiment described above describes an acoustic output control configuration inside an automobile, but the processes according to the present disclosure are otherwise usable in a variety of places.

Hereinafter, an embodiment in which the present disclosure is applied to seats on an airplane, an embodiment in which the present disclosure is applied to an attraction at an amusement park, and an embodiment in which the present disclosure is applied to an art museum will be described.

First, with reference to <FIG> and subsequent drawings, an embodiment in which the acoustic signal processing device according to the present disclosure is applied to a seat on an airplane will be described.

Seats on an airplane are equipped with a socket for inserting headphones (headphone jack), and users (passengers) sitting in the seats are able to listen to music and the like by plugging in headphones.

As illustrated in <FIG>, some seats are filled by users (passengers) while other seats are empty. Moreover, some users are using headphones while other users are not.

The seats are assigned, and the seat where each user sits is predetermined.

A record of which user sits in which seat is recorded in a database in a boarding reservation system.

In the case of such settings, an acoustic signal processing device onboard an airplane is capable of checking the seat position of each user (passenger) on the basis of the record data in the boarding reservation system.

<FIG> illustrates an exemplary system configuration according to the present embodiment.

An acoustic signal processing device <NUM> onboard an airplane is connected to a boarding reservation system <NUM> and a management server <NUM> over a network.

Note that the management server <NUM> includes an HRTF database <NUM> in which the head-related transfer function (HRTF) of each user (passenger) is recorded. The acoustic signal processing device <NUM> onboard an airplane has a configuration substantially similar to the configuration described above with reference to <FIG>.

However, the configuration omits the HRTF database <NUM>, and also does not include the sensor <NUM>. User identification and user position identification is executed using record data in the boarding reservation system <NUM> connected over the network.

A user & user position identification unit (that is, the user & user position identification unit <NUM> illustrated in <FIG>) of the acoustic signal processing device <NUM> onboard an airplane identifies the user at each seat position on the basis of the boarding reservation system <NUM> connected over the network. Specifically, a user identifier of the user who reserved each seat position is acquired.

Furthermore, a user-corresponding HRTF acquisition unit (that is, the user-corresponding HRTF acquisition unit <NUM> illustrated in <FIG>) of the acoustic signal processing device <NUM> acquires the head-related transfer function (HRTF) corresponding to each user from the HRTF database <NUM> of the management server <NUM> on the basis of the user identifier for each seat position.

Next, the acoustic signal processing device <NUM> generates output sounds through the headphone jack in each set. The generation of output sounds is a process executed by an HRTF-applying sound localization processing unit (that is, the HRTF-applying sound localization processing unit <NUM> illustrated in <FIG>) of the acoustic signal processing device <NUM>.

Each of the plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n is pre-assigned with the headphone jack that respectively output processed signals (Lout, R-out).

The HRTF-applying sound localization processing unit <NUM> executes signal processing in the user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n on the basis of the data associating the user (seat) identification information and the user position identification information inputted from the user-corresponding HRTF acquisition unit <NUM> with the head-related transfer function (HRTF) corresponding to each identified user.

In each of the user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM>, signal processing applying the HRTF corresponding to each identified user is executed to generate a sound localization processed signal corresponding to each user. The signal corresponding to each user is output as output sounds from the headphone jack at the seat position of each user.

Through this process, the users who are passengers on the airplane are able to listen to signals that have been subjected to processing (sound localization processing) on the basis of each user's own head-related transfer function (HRTF), and are able to listen to sounds from an ideal virtual sound source position.

Next, the flowchart illustrated in <FIG> will be referenced to describe a sequence of processes executed by an acoustic signal processing device according to the present embodiment.

First, in step S201, the acoustic signal processing device executes user identification and user position identification on the basis of check-in information.

This process is executed by a user & user position identification unit (that is, the user & user position identification unit <NUM> illustrated in <FIG>) of the acoustic signal processing device <NUM> onboard the airplane illustrated in <FIG>.

A user & user position identification unit of the acoustic signal processing device <NUM> identifies the user at each seat position on the basis of the boarding reservation system <NUM> connected over the network. Specifically, a user identifier of the user who reserved each seat position is acquired.

Next, in step S202, the acoustic signal processing device acquires the head-related transfer function (HRTF) of each identified user from a database.

This process is executed by a user-corresponding HRTF acquisition unit (that is, the user-corresponding HRTF acquisition unit <NUM> illustrated in <FIG>) of the acoustic signal processing device <NUM>.

The user-corresponding HRTF acquisition unit acquires the head-related transfer function (HRTF) corresponding to each user from the HRTF database <NUM> of the management server <NUM> on the basis of the user identifier of the user who reserved each seat.

Next, in step S203, the acoustic signal processing device inputs the head-related transfer function (HRTF) of each user into respective user-corresponding HRTF-applying sound localization processing units, and generates an output signal corresponding to each user.

Each of the plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n generates an output signal corresponding to a user by executing signal processing (sound localization processing) that treats the head-related transfer function (HRTF) corresponding to each user at each seat position as a processing parameter.

Finally, in step S204, the acoustic signal processing device outputs the generated output signal corresponding to each user as an output signal from the headphone jack at the seat position of each user corresponding to the generated signal.

The output from the headphone jack at the seat position of each user is output signals (Lout-x, Rout-x) generated by signal processing (sound localization processing) applying the head-related transfer function (HRTF) corresponding to each user.

Through these processes, all users (passengers) are able to listen to the signals (Lout-x, Rout-x) obtained by executing sound localization processing applying each user's own head-related transfer function (HRTF) at the seat position where each user is sitting, and listen to sounds from an optimal virtual sound source position for each user.

Next, with reference to <FIG>, an embodiment in which the acoustic signal processing device according to the present disclosure is applied to an attraction at an amusement park will be described.

<FIG> illustrates a user <NUM> playing an attraction at an amusement park.

When the user <NUM> buys a ticket at the entrance to the amusement park, user information is registered, and during the registration process the user receives a sensor <NUM> storing a user identifier to wear on the user's arm.

The sensor <NUM> communicates with communication equipment <NUM> installed at various locations inside the amusement park, and transmits the user identifier to an acoustic signal processing device disposed in a management center of the amusement park. The acoustic signal processing device disposed in the management center of the amusement park has a configuration substantially similar to the configuration described above with reference to <FIG>.

However, the user & user position identification unit <NUM> receives user identification information and user position information from the sensor <NUM> worn by the user <NUM> illustrated in <FIG> through the communication equipment <NUM>, and identifies each user and the position of each user.

As illustrated in <FIG>, a plurality of speakers, such as a speaker L <NUM> and a speaker R <NUM>, is installed in each attraction.

The acoustic signal processing device disposed in the management center of the amusement park uses the output from these speakers as a processed signal (sound localization processed signal), in which the head-related transfer function (HRTF) of the user <NUM> in front of the speakers has been applied as a processing parameter.

The flowchart illustrated in <FIG> will be referenced to describe a sequence of processes executed by an acoustic signal processing device according to the present embodiment.

First, in step S301, the acoustic signal processing device executes user identification and user position identification on the basis of a received signal from the sensor <NUM> worn by the user.

This process is executed by a user & user position identification unit (that is, the user & user position identification unit <NUM> illustrated in <FIG>) of the acoustic signal processing device in the management center of the amusement park.

The user & user position identification unit of the acoustic signal processing device executes user identification and user position identification by receiving the output of the sensor <NUM> worn by the user illustrated in <FIG> through the communication equipment <NUM>.

Next, in step S302, the acoustic signal processing device acquires the head-related transfer function (HRTF) of each identified user from a database.

This process is executed by a user-corresponding HRTF acquisition unit (that is, the user-corresponding HRTF acquisition unit <NUM> illustrated in <FIG>) of the acoustic signal processing device in the management center of the amusement park.

The user-corresponding HRTF acquisition unit acquires the head-related transfer function (HRTF) corresponding to each user from the HRTF database on the basis of the user identifier of the user in each attraction.

Note that the HRTF database may be stored in the acoustic signal processing device in the management center of the amusement park in some cases, or may be stored in a management server connected over a network in other cases.

Next, in step S303, the acoustic signal processing device inputs the head-related transfer function (HRTF) of each user into respective user-corresponding HRTF-applying sound localization processing units, and generates an output signal corresponding to each user.

Each of the plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n generates an output signal corresponding to a user by executing signal processing (sound localization processing) that treats the head-related transfer function (HRTF) corresponding to each user at each attraction position as a processing parameter.

Finally, in step S304, the acoustic signal processing device outputs the generated output signal corresponding to each user as an output signal from the speaker at the attraction position of each user corresponding to the generated signal.

The output from the speakers at each attraction is output signals (Lout-x, Rout-x) generated by signal processing (sound localization processing) applying the head-related transfer function (HRTF) corresponding to the user playing the attraction.

Through these processes, users playing the attraction are able to listen to the signals (Lout-x, Rout-x) obtained by executing sound localization processing applying each user's own head-related transfer function (HRTF), and listen to sounds from an optimal virtual sound source position for each user.

Next, with reference to <FIG> and subsequent drawings, an embodiment in which the acoustic signal processing device according to the present disclosure is applied to an art museum will be described.

<FIG> illustrates a user <NUM> visiting an art museum.

When the user <NUM> buys a ticket at the entrance to the art museum, user information is registered, and during the registration process the user receives a user terminal <NUM> storing a user identifier.

The user terminal <NUM> is provided with a headphone jack, and by inserting a plug of headphones <NUM> into the headphone jack, the user <NUM> is able to listen to various commentary from the headphones.

The user terminal <NUM> is capable of communicating with an acoustic signal processing device disposed in a management center of the art museum.

The acoustic signal processing device disposed in the management center of the art museum has a configuration substantially similar to the configuration described above with reference to <FIG>.

However, the user & user position identification unit <NUM> receives user identification information and user position information from the user terminal <NUM> worn by the user <NUM> illustrated in <FIG>, and identifies each user and the position of each user.

Note that in the case where a membership database storing registered membership information exists, for example, the database registration information may also be used for user identification.

Furthermore, the acoustic signal processing device disposed in the management center of the art museum uses the output from the headphones <NUM> used by the user <NUM> as a processed signal (sound localization processed signal), in which the head-related transfer function (HRTF) of the user <NUM> has been applied as a processing parameter.

First, in step S401, the acoustic signal processing device executes user identification and user position identification on the basis of a received signal from the user terminal <NUM> worn by the user or registered membership information.

This process is executed by a user & user position identification unit (that is, the user & user position identification unit <NUM> illustrated in <FIG>) of the acoustic signal processing device in the management center of the art museum.

The user & user position identification unit of the acoustic signal processing device executes user identification and user position identification by receiving the output of the user terminal <NUM> worn by the user illustrated in <FIG>. Note that user identification may also be executed using registered membership information, such as a membership database that is referenced during a check when entering the art museum, for example.

Next, in step S402, the acoustic signal processing device acquires the head-related transfer function (HRTF) of each identified user from a database.

This process is executed by a user-corresponding HRTF acquisition unit (that is, the user-corresponding HRTF acquisition unit <NUM> illustrated in <FIG>) of the acoustic signal processing device in the management center of the art museum.

The user-corresponding HRTF acquisition unit acquires the head-related transfer function (HRTF) corresponding to each user from the HRTF database on the basis of the user identifier of the user.

Note that the HRTF database may be stored in the acoustic signal processing device in the management center of the art museum in some cases, or may be stored in a management server connected over a network in other cases.

Next, in step S403, the acoustic signal processing device inputs the head-related transfer function (HRTF) of each user into respective user-corresponding HRTF-applying sound localization processing units, and generates an output signal corresponding to each user.

Each of the plurality of user-corresponding HRTF-applying sound localization processing units <NUM>-<NUM> to <NUM>-n generates an output signal corresponding to a user by executing signal processing (sound localization processing) that treats the head-related transfer function (HRTF) corresponding to each user at various locations in the art museum as a processing parameter.

Finally, in step S404, the acoustic signal processing device transmits the generated output signal corresponding to each user to the user terminal <NUM> of the user corresponding to the generated signal as an output signal from the headphones <NUM> plugged into the user terminal <NUM>.

The output from the headphones <NUM> plugged into the user terminal <NUM> carried by the user at various locations inside the art museum is output signals (Lout-x, Rout-x) generated by signal processing (sound localization processing) applying the head-related transfer function (HRTF) corresponding to the user.

Through these processes, users at various locations inside the art museum are able to listen to the signals (Lout-x, Rout-x) obtained by executing sound localization processing applying each user's own head-related transfer function (HRTF), and listen to sounds from an optimal virtual sound source position for each user.

Note that, although the embodiment described above illustrates an example in which the acoustic signal processing device disposed in the management center of the art museum generates the sound localization processed signal, the signal processing (sound localization processing) applying the head-related transfer function (HRTF) corresponding to each user may also be configured to be performed in the user terminal <NUM> carried by each user, for example.

Although the foregoing describes embodiments in which sound localization processing using the head-related transfer function (HRTF) is performed, it is also possible to perform sound localization processing by signal processing using data other than the head-related transfer function (HRTF).

For example, parameters that determine the head-related transfer function (HRTF) or an approximate value thereof are applicable to the signal processing. The parameters are, for example:.

Specifically, it is possible to use information such as the Fq, Gain, and Q in the case of reproducing the HRTF through EQ.

Additionally, it is also possible to use data based on individual physical characteristics that are used in signal processing other than sound localization processing, such as a filter used for individual optimization of noise canceling, for example.

Furthermore, data based on individual preferences, such as EQ parameters for adjusting the sound quality and the volume for example may also be used.

Next, with reference to <FIG> and subsequence drawings, an embodiment in which the head-related transfer function (HRTF) specific to a user in a user terminal is stored will be described.

The foregoing describes embodiments in which the head-related transfer functions (HRTFs) of various users are stored in an HRTF database.

In contrast, the embodiment described with reference to <FIG> and subsequent drawings is an embodiment in which the head-related transfer function (HRTF) <NUM> unique to a specific user <NUM> is stored in a user terminal <NUM> carried by the user <NUM>.

The user terminal <NUM> outputs an audio signal to headphones <NUM> wirelessly or through a headphone jack. The user <NUM> listens to audio output from the headphones <NUM>.

The output sounds from the headphones <NUM> are signals processed by signal processing (sound localization processing) applying the head-related transfer function (HRTF) <NUM> unique to the user <NUM>.

For example, the user <NUM> receives music provided by a music delivery server <NUM> by downloading or streaming to the user terminal <NUM>.

The user terminal <NUM> performs signal processing (sound localization processing) applying the user-corresponding head-related transfer function (HRTF) <NUM> unique to the user <NUM> stored in the user terminal <NUM> to an audio signal acquired from the music delivery server <NUM>, and outputs a processed audio signal to the headphones <NUM>.

With this arrangement, an audio signal that has been subjected to sound localization processing applying the head-related transfer function (HRTF) unique to the user can be heard.

However, in the case of performing signal processing (sound localization processing) in a signal processing unit inside the user terminal <NUM>, it may be necessary, in some cases, to acquire authorization information from a management server <NUM>.

A configuration and process of the present embodiment will be described with reference to <FIG>.

As illustrated in <FIG>, the user terminal <NUM> includes the user-corresponding head-related transfer function (HRTF) <NUM> unique to the user carrying the user terminal <NUM>, a signal processing unit <NUM> that executes signal processing (sound localization processing) applying the head-related transfer function (HRTF) unique to the user, and a communication unit <NUM> that outputs a processed signal from the signal processing unit <NUM> to the headphones <NUM>.

Audio signals (Lin, Rin) of music <NUM> provided by the music delivery server <NUM> are inputted into the signal processing unit <NUM> of the user terminal <NUM>.

The signal processing unit <NUM> executes signal processing (sound localization processing) applying the user-corresponding head-related transfer function (HRTF) <NUM> stored in a storage unit of the user terminal <NUM> to the audio signals acquired from the music delivery server <NUM>.

However, in the case of performing signal processing (sound localization processing) in a signal processing unit <NUM>, it is necessary, in some cases, to acquire authorization information from a management server <NUM>.

The user terminal <NUM> acquires authorization information <NUM> from the management server <NUM>. The authorization information <NUM> is key information or the like that enables the execution of a signal processing (sound localization processing) program in the signal processing unit <NUM>, for example.

The user terminal <NUM> executes the signal processing (sound localization processing) applying the user-corresponding head-related transfer function (HRTF) <NUM> to the audio signals delivered from the music delivery server <NUM>, on the condition that the authorization information <NUM> is acquired from the management server <NUM>.

Processed audio signals (Lout, Rout) are output to the headphones <NUM> through the headphone jack or the communication unit <NUM>.

With this arrangement, the user is able to listen to an audio signal that has been subjected to sound localization processing applying the head-related transfer function (HRTF) unique to the user.

Note that, as a configuration that stores the head-related transfer functions (HRTFs) for a plurality of different users in the user terminal <NUM>, the user terminal may be configured such that the using user selects which head-related transfer function (HRTF) to use.

Alternatively, the user terminal may be provided with a user identification unit, and the user identification unit may be configured to execute audio output control applying the head-related transfer function (HRTF) corresponding to an identified user.

As another example, a configuration in which an audio output system such as an in-vehicle audio system communicates with the user terminal <NUM>, the audio output system acquires the head-related transfer function (HRTF) stored in the user terminal <NUM>, and audio output control in accordance with the acquired head-related transfer function (HRTF) is executed on the audio output system side may be taken.

Note that although the foregoing embodiments are described by taking a stereo signal as an example of the sound source, the processes according to the present disclosure are also applicable to processes performed on signals other than stereo signals, such as multi-channel signals, object-based signals that play back sounds in units of objects, and Ambisonic signals or higher-order Ambisonic signals that reproduce a sound field.

Next, an explanation will be given for an exemplary hardware configuration of the acoustic signal processing device, the user terminal, the server, and the like described in the embodiment above.

The hardware to be described with reference to <FIG> is an exemplary hardware configuration of the acoustic signal processing device, the user terminal, the server, and the like described in the embodiment above.

A central processing unit (CPU) <NUM> functions as a control unit and a data processing unit which execute various processing according to a program stored in a read only memory (ROM) <NUM> or a storage unit <NUM>. For example, processing according to the sequence described in the above embodiment is executed. A random access memory (RAM) <NUM> stores the program executed by the CPU <NUM>, data, and the like. The CPU <NUM>, the ROM <NUM>, and the RAM <NUM> are connected to each other by a bus <NUM>.

The CPU <NUM> is connected to an input/output interface <NUM> via the bus <NUM>, and the input/output interface <NUM> is connected to an input unit <NUM> including various switches, a keyboard, a mouse, a microphone, a sensor, and the like and an output unit <NUM> including a display, a speaker, and the like. The CPU <NUM> executes various processing in response to an instruction input from the input unit <NUM> and outputs the processing result to, for example, the output unit <NUM>.

The storage unit <NUM> connected to the input/output interface <NUM> includes, for example, a hard disk and the like and stores the program executed by the CPU <NUM> and various data. A communication unit <NUM> functions as a transmission/reception unit of Wi-Fi communication, Bluetooth (registered trademark) (BT) communication, and other data communication via a network such as the Internet and a local area network, and communicates with an external apparatus.

A drive <NUM> connected to the input/output interface <NUM> drives a removable medium <NUM> such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card and records or reads data.

The embodiment of the present disclosure has been described in detail with reference to the specific embodiment above. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments.

Further, the series of processes described herein can be executed by hardware, software, or a composite configuration thereof. In the case where the processes are executed by software, a program having a process sequence therefor recorded therein can be executed after being installed in a memory incorporated in dedicated hardware in a computer, or can be executed after being installed in a general-purpose computer capable of various processes. For example, such a program may be previously recorded in a recording medium. The program can be installed in the computer from the recording medium. Alternatively, the program can be received over a network such as a LAN (Local Area Network) or the internet, and be installed in a recording medium such as an internal hard disk.

Note that the processes described herein are not necessarily executed in the described time-series order, and the processes may be executed parallelly or separately, as needed or in accordance with the processing capacity of a device to execute the processes. Further, in the present description, a system refers to a logical set configuration including a plurality of devices, and the devices of the respective configurations are not necessarily included in the same casing.

As described above, according to the configuration of exemplary aspects of the present disclosure, there is achieved a configuration that executes sound localization processing applying a head-related transfer function (HRTF) corresponding to a user identified by a user identification, and makes an output from an output unit for each user position.

Claim 1:
An acoustic signal processing device (<NUM>) comprising:
a user identification unit (<NUM>) configured to execute a user identification process and a user position identification process, wherein the user position corresponds to a seat of the user in a vehicle;
an acquisition unit (<NUM>) configured to acquire a head-related transfer function, HRTF, unique to the user identified by the user identification unit (<NUM>), from among one or a plurality of head-related transfer functions, HRTFs; and
a sound localization processing unit (<NUM>) configured to
execute sound localization processing using, as a processing parameter, the HRTF unique to the user acquired by the acquisition unit (<NUM>), and
output a signal obtained by the sound localization processing from a speaker (<NUM>; <NUM>; <NUM>) installed at the seat of the user identified in the user identification unit (<NUM>).