Patent Description:
A mixing console disclosed in <CIT> receives coordinates of an acoustic image localization point in a rectangular parallelepiped space. The mixing console disclosed in <CIT> calculates the volume of a sound to be outputted from a plurality of speakers placed in a space so that an acoustic image is localized in the received coordinates.

However, a physical space such as a concert hall is not limited to a rectangular parallelepiped space. Therefore, an apparatus such as the mixing console as disclosed in <CIT>, even though receiving coordinates of an acoustic image localization point in a rectangular parallelepiped space, does not consider the coordinates in the physical space, and thus may not be able to localize an acoustic image to a position as intended by a user, in some cases.

In chapter <NUM> of "<NPL>. discloses concept and implementation of wave filed synthesis (WFS) reproduction, including the general concept, a laboratory demonstration system, and application.

<CIT> discloses an acoustic design support apparatus in which a speaker selection supporter selects a desired speaker as a candidate for use in a given space based on shape information representing a shape of the space. A speaker mounting angle optimizer calculates an optimal mounting direction of the selected speaker by selecting a mounting direction pattern which minimizes a degree of variation among sound pressure levels at a plurality of positions on a sound receiving surface defined in the space. An acoustic parameter calculator calculates a variety of acoustic parameters at sound receiving points within the space based on both of the shape information of the space and the optimal mounting direction of the speaker.

<CIT> discloses an information processing method including receiving first space information including a first coordinate system of one of a logical space or a physical space, and second space information including a second coordinate system of the other of the logical space or the physical space; receiving first sound localization information indicating a position where a sound image is to be localized in the first coordinate system; and transforming the first sound localization information into second sound localization information indicating a position where the sound image is to be localized in the second coordinate system.

In view of the foregoing, an object of an embodiment of the present disclosure is to provide an information processing method and an information processing apparatus that achieve acoustic image localization in consideration of a shape of a physical space.

The present invention provides an information processing method, in accordance with claim <NUM>.

The present invention also provides an information processing apparatus, in accordance with claim <NUM>.

The present invention also provides a program, in accordance with claim <NUM>.

According to an embodiment of the present disclosure, acoustic image localization in consideration of a shape of a physical space is able to be achieved.

<FIG> is a block diagram showing a configuration of an information processing apparatus <NUM>. The information processing apparatus <NUM> includes a communicator <NUM>, a processor <NUM>, a RAM <NUM>, a flash memory <NUM>, a display <NUM>, and a user I/F <NUM>.

The information processing apparatus <NUM> is a personal computer, a smartphone, a tablet computer, or the like. In addition, an acoustic device such as an audio mixer is also an example of an information processing apparatus.

The communicator <NUM> communicates with another apparatus such as a server. The communicator <NUM> has a wireless communication function such as Bluetooth (registered trademark) or Wi-Fi (registered trademark), for example, and a wired communication function such as a USB or a LAN. The communicator <NUM> obtains space information that shows the shape of a physical space such as a concert hall, for example. The space information is information that shows two-dimensional or three-dimensional coordinates using a certain position as a reference point (an origin). The space information is information that includes two-dimensional or three-dimensional coordinates such as CAD data that show the shape of a physical space such as a concert hall, for example.

The processor <NUM> is a CPU, a DSP, a SoC (System on a Chip), or the like, and is equivalent to a processor of the present disclosure. The processor <NUM> reads out a program from the flash memory <NUM> being a storage medium, and temporarily stores the program in the RAM <NUM>, and thus performs various operations. It is to be noted that the program does not need to be stored in the flash memory <NUM>. The processor <NUM>, for example, may download the program from another apparatus such as a server and may temporarily store the program in the RAM <NUM>, when necessary.

The display <NUM> is an LCD or the like. The display <NUM>, for example, displays an acoustic image localization setting screen as shown in <FIG>.

The user I/F <NUM> is an example of an operator. The user I/F <NUM> is a mouse, a keyboard, a touch panel, or the like. The user I/F <NUM> receives an operation from a user. It is to be noted that the touch panel may be stacked on the display <NUM>.

With reference to <FIG> and <FIG>, the acoustic image localization setting screen will be described. <FIG> is a view showing an example of the acoustic image localization setting screen displayed on the display <NUM>. <FIG> is a flow chart showing an operation of the processor <NUM>. The acoustic image localization setting screen shown in <FIG> is an example of an edit screen of content. A user edits an acoustic image localization position of a sound source included in the content on the acoustic image localization setting screen. It is to be noted that the sound source means a sound of one or more objects (such as a moving object such as a helicopter, a talker, or a musical instrument, for example) in a predetermined content that includes a sound of a movie, a concert event, or an attraction, for example.

The display <NUM> displays a logical spatial image <NUM> of a logical coordinate system, and a physical spatial image <NUM> of a physical coordinate system. In this example, the display <NUM> displays the logical spatial image <NUM> on the upper left of the screen, and displays the physical spatial image <NUM> on the upper right of the screen. In addition, the display <NUM> displays a logical planar image <NUM> on the lower left of the screen, and displays a physical planar image <NUM> on the lower right of the screen.

The logical spatial image <NUM> is a rectangular parallelepiped as an example. The logical planar image <NUM> corresponds to a planar view of the logical spatial image <NUM>. The physical spatial image <NUM> is an octagonal prism as an example. The physical planar image <NUM> corresponds to a planar view of the physical spatial image <NUM>.

First, the processor <NUM> receives a setting of first space information being information corresponding to a logical space and second space information being information corresponding to a physical space such as a concert hall (S11).

The first space information defines logical coordinates. The logical coordinates include, for example, normalized coordinates having values from <NUM> to <NUM>. In the present embodiment, the processor <NUM>, although receiving a setting of space information on a rectangular parallelepiped as the first space information, may receive space information on various other shapes such as a polygonal pyramid, a prism, a polyhedron, a circular cylinder, a circular cone, or a sphere. In addition, the processor <NUM> may receive information on a two-dimensional space. The two-dimensional space includes, for example, a polygon configured by straight lines, a round shape configured by curved lines, or a composite shape configured by straight lines and curved lines.

The second space information defines physical coordinates. The physical coordinates are two-dimensional or three-dimensional coordinates included in CAD data or the like showing the shape of a physical space such as a concert hall. The processor <NUM> reads out information including the two-dimensional or three-dimensional coordinates such as CAD data or the like, from the flash memory <NUM> and then receives a setting of the second space information, for example.

Next, the processor <NUM> generates the logical spatial image <NUM>, the physical spatial image <NUM>, the logical planar image <NUM>, and the physical planar image <NUM>, and displays the images on the display <NUM> (S12). In the example of <FIG>, the logical spatial image <NUM> is a cube elevation image and the logical planar image <NUM> is a square image. The physical spatial image <NUM> and the physical planar image <NUM> are images that imitate a real space such as a concert hall. The processor <NUM> generates the physical spatial image <NUM> and the physical planar image <NUM> based on the information including the two-dimensional or three-dimensional coordinates such as CAD data.

Next, the processor <NUM> receives speaker placement information or acoustic image localization information (S13). Both of the speaker placement information and the acoustic image localization information are coordinates in the logical coordinate system and are an example of first acoustic image localization information.

A user operates the user I/F <NUM> to edit the speaker placement information or the acoustic image localization information on the logical spatial image <NUM> or the logical planar image <NUM> shown in <FIG>. For example, in the example of <FIG>, the user, in the logical spatial image <NUM> and the logical planar image <NUM>, places a speaker <NUM> placed on the left front, a speaker <NUM> placed in the center, a speaker <NUM> placed on the right front, a speaker <NUM> placed on the left rear, and a speaker <NUM> placed on the right rear. The speaker <NUM>, the speaker <NUM>, the speaker <NUM>, the speaker <NUM>, and the speaker <NUM> are placed at a middle in a height direction.

When the upper left corner in the logical planar image <NUM> is defined as an origin, the position of the speaker <NUM> is indicated by coordinates (x, y) = (<NUM>, <NUM>). The position of the speaker <NUM> is indicated by coordinates (x, y) = (<NUM>, <NUM>). The position of the speaker <NUM> is indicated by coordinates (x, y) = (<NUM>, <NUM>). The position of the speaker <NUM> is indicated by coordinates (x, y) = (<NUM>, <NUM>). The position of the speaker <NUM> is indicated by coordinates (x, y) = (<NUM>, <NUM>).

In addition, in the example of <FIG>, the user, in the logical spatial image <NUM> and the logical planar image <NUM>, places the acoustic image localization position of a sound source <NUM> on the left of the center (between a left end and the center). In other words, the sound source <NUM> is indicated by coordinates (x, y) = (<NUM>, <NUM>).

In the example of <FIG>, the speakers <NUM> to <NUM> and the sound source in the height direction are all indicated by the coordinate z = <NUM>.

The processor <NUM>, as shown in <FIG>, for example, receives an operation to edit the speaker placement information or the acoustic image localization information of the sound source from the user and thus receives the speaker placement information or the acoustic image localization information (S13).

The processor <NUM> performs coordinate transformation based on the received speaker placement information or sound source position information (S14).

<FIG> and <FIG> are diagrams illustrating a concept of coordinate transformation. The processor <NUM> transforms the speaker placement information and the sound source position information by transforming first coordinates in the logical coordinate system defined by the first space information into second coordinates in the physical coordinate system defined by the second space information. In the example of <FIG>, the physical coordinate system shows eight reference points, 70A(x1, y1), 70B(x2, y2), 70C(x3, y3), 70D(x4, y4), 70E(x5, y5), 70F(x6, y6), <NUM>(x7, y7), and <NUM>(x8, y8), and the logical coordinate system before transformation shows eight reference points 70A(<NUM>, <NUM>), 70B(<NUM>, <NUM>), 70C(<NUM>, <NUM>), 70D(<NUM>, <NUM>), 70E(<NUM>, <NUM>), 70F(<NUM>, <NUM>), <NUM>(<NUM>, <NUM>), and <NUM>(<NUM>, <NUM>). The processor <NUM> determines a centroid G of the eight reference points in the logical coordinate system before transformation and a centroid G' of the eight reference points in the physical coordinate system after transformation, and then generates triangular meshes by using these centroids as centers. The processor <NUM> transforms an internal space of a triangle in the logical coordinate system and an internal space of a triangle in the physical coordinate system by a predetermined coordinate transformation. The transformation uses an affine transformation, for example. The affine transformation is an example of a geometric transformation. The affine transformation defines an x-coordinate (x') and a y-coordinate (y') after transformation by a function of an x-coordinate (x) and a y-coordinate (y) before transformation. In other words, the affine transformation performs the coordinate transformation by the following formulas: x' = ax + by + c; and y' = dx + ey + f. The coordinates of the three apexes of the triangle before transformation and the coordinates of the three apexes of the triangle after transformation are able to uniquely obtain coefficients a to f. The processor <NUM> obtains affine transformation coefficients similarly for all the triangles, and thus transforms the first coordinates in the logical coordinate system into the second coordinates in the physical coordinate system of the second space information. It is to be noted that the coefficients a to f may be obtained by the least-squares method.

Then, the processor <NUM> transforms the coordinates of the speaker placement information and the sound source position information by using the obtained coefficients a to f. In <FIG>, the processor <NUM>, by using the formulas, transforms coordinates (x, y) of the sound source <NUM> in the logical coordinate system into coordinates (x', y') in the physical coordinate system.

As a result, the coordinates of the speaker placement information and the sound source position information are transformed into second acoustic image localization information according to the shape of the physical space. The processor <NUM> stores the second acoustic image localization information in the flash memory <NUM>, for example. Alternatively, the processor <NUM> sends the second acoustic image localization information to another apparatus such as an acoustic device, for example, through the communicator <NUM>. The acoustic device performs processing to localize an acoustic image, based on the received second acoustic image localization information. Such localization processing is based on an object-based system. The acoustic device, based on the speaker placement information and the position information of each object (a sound source) that are included in the second acoustic image localization information, calculates level balance between audio signals to be outputted to the plurality of speakers so as to localize an acoustic image of the sound source of each object to a designated position, and performs panning processing to adjust levels of the audio signals. A listener feels localization in a direction of the speaker that outputs an audio signal of the higher level. The panning processing uses the perception of such a listener and adjusts the level of the audio signal to be outputted to each speaker according to a distance between a sound source and a speaker. For example, the processor <NUM> maximizes the level of the audio signal to be outputted to a speaker nearest to the position of a sound source, and reduces the level of the audio signal to be outputted to each speaker according to a distance to the sound source. Accordingly, the listener perceives the acoustic image of the object in the position of the sound source of each object included in the second acoustic image localization information. Therefore, the information processing apparatus <NUM> according to the present embodiment is able to be achieve acoustic image localization in consideration of the shape of a physical space.

It is to be noted that the meshes may be meshes of any other polygonal shape other than a triangle, or a combination of the polygonal shape. For example, the processor <NUM>, as shown in <FIG>, may generate quadrangular meshes and may perform coordinate transformation. A transformation method is not limited to the affine transformation. For example, the processor <NUM> may transform each of the quadrangular meshes based on the following formulas and may transform coordinates (x, y) of the sound source <NUM> in the logical coordinate system into coordinates (x', y') in the physical coordinate system (however, x0, y0, x1, y1, x2, y2, x3, and y3 each denote coordinates of transformation points). <MAT> <MAT>.

The transformation method may be any other geometric transformation such as isometric mapping, homothetic transformation, or projective transformation. For example, the projective transformation may be represented by the following formulas: x' = (ax+by+c) / (gx+hy+<NUM>) and y' = (dx+ey+f)/(gx+hy+<NUM>). The coefficients are obtained in the same way as in a case of affine transformation. For example, the eight coefficients (a to h) that configure the quadrangular projective transformation are uniquely obtained by a set of eight simultaneous equations. Alternatively, the coefficients may be obtained by the least-squares method.

<FIG> is a block diagram showing a configuration of an information processing apparatus 1A according to a first modification. <FIG> is a flow chart showing an operation of the information processing apparatus 1A. The same configuration, function and operation as the configuration, function and operation of the information processing apparatus <NUM> are denoted by the same reference numerals, and the description will be omitted.

The information processing apparatus 1A further includes an audio I/F <NUM>. The audio I/F <NUM> is an analogue audio terminal, a digital audio terminal, or the like. The processor <NUM> obtains an audio signal from a sound source of a microphone, a musical instrument, or the like, for example, through the audio I/F <NUM>. Thus, the processor <NUM> functions as an audio signal obtainer. In addition, the audio signal may be obtained from an external apparatus through the communicator <NUM>. Moreover, the audio signal may be stored in the flash memory <NUM>.

The audio I/F <NUM> is connected to a plurality of speakers <NUM> to <NUM> that are installed in a real space such as a concert hall.

The processor <NUM> includes a DSP. The processor <NUM> performs predetermined signal processing on an audio signal. The processor <NUM> outputs the audio signal on which the signal processing has been processed, to a plurality of speakers <NUM> to <NUM> through the audio I/F <NUM>.

The processor <NUM>, based on each of the speaker placement information and the sound source position information (the second acoustic image localization information) in the physical coordinate system, performs processing to localize the acoustic image of the audio signal to a position corresponding to the second acoustic image localization information (S15). Specifically, the processor <NUM>, based on the speaker placement information and the sound source position information that are included in the second acoustic image localization information, calculates level balance between audio signals to be outputted to the plurality of speakers <NUM> to <NUM> so as to localize an acoustic image of the sound source to the designated position, and performs panning processing to adjust levels of the audio signals. In this manner, the information processing apparatus may perform acoustic image localization processing. It is to be noted that the information processing apparatus may adjust output timing of an audio signal to be outputted to a plurality of speakers so as to localize an acoustic image of each sound source to the designated position.

The information processing apparatus 1A is also able to output the audio signal of a sound source to each of a plurality of physical spaces corresponding to a plurality of logical spaces. <FIG> is a diagram showing an example of the acoustic image localization setting screen displayed on the display <NUM>. <FIG> is a flow chart showing an operation of the information processing apparatus 1A. The same configuration, function and operation as the configuration, function and operation of the information processing apparatus <NUM> are denoted by the same reference numerals, and the description will be omitted.

The processor <NUM> receives settings of a plurality of pieces of information on the plurality of physical spaces that correspond to a plurality of pieces of information on the plurality of logical spaces, respectively. In the example of <FIG>, the processor <NUM> receives three physical spaces Z1, Z2, and Z3 respectively corresponding to three logical spaces L1, L2, and L3.

In the example of <FIG>, the physical spaces Z1, Z2, and Z3 are defined by sectioning one certain concert hall R1 into three regions. For example, the physical space Z1 corresponds to a first floor seat of the concert hall, and the physical space Z2 corresponds to a second floor seat of the concert hall. The physical space Z3 corresponds to the entire concert hall. It is to be noted that, although the plurality of physical spaces correspond to a plurality of regions set to one certain sound space (the concert hall R1) in this example, the plurality of physical spaces may correspond to respective completely different acoustic spaces.

In the concert hall R1, the plurality of speakers <NUM> to <NUM> are placed. The speaker <NUM> to the speaker <NUM> are arranged along a wall surface of the concert hall R1. For example, the speaker <NUM> is placed on a front left side of the concert hall R1. The speaker <NUM> is placed on a front center of the concert hall R1. The speaker <NUM> is placed on a front right side of the concert hall R1. The speaker <NUM> and the speaker <NUM> are placed on a left side of the longitudinal center of the concert hall R1. The speaker <NUM> and the speaker <NUM> are placed on a right side of the longitudinal center of the concert hall R1. The speaker <NUM> is placed on a rear left side of the concert hall R1. The speaker <NUM> is placed on a rear right side of the concert hall R1.

In the example of <FIG>, the speakers <NUM> to <NUM> configure a region Z1. In addition, the speakers <NUM> to <NUM> configure a region Z2. Moreover, all the speakers <NUM> to <NUM> configure a region Z3. The processor <NUM> performs localization processing on a sound source placed in the region Z1 by using the speakers <NUM> to <NUM>. The processor <NUM> performs localization processing on a sound source placed in the region Z2 by using the speakers <NUM> to <NUM>. The processor <NUM> performs localization processing on a sound source placed in the region Z3 by using the speakers <NUM> to <NUM>.

The user, by editing the positions of the sound source 55A, the sound source 55B, and the sound source 55C that are respectively placed in the three logical spaces L1, L2, and L3, can control the positions of the sound source 55A, the sound source 55B, and the sound source 55C of the physical spaces Z1, Z2, and Z3. In other words, the user, by editing the positions of the sound sources of the three logical spaces L1, L2, and L3, can control each of the position of a sound source desired to be listened to by a listener in the first floor seat of the concert hall, the position of a sound source desired to be listened to by a listener in the second floor seat of the concert hall, and the position of a sound source desired to be listened to by listeners in the entire concert hall.

Then, the processor <NUM> receives the first acoustic image localization information of the plurality of sound sources in the plurality of logical spaces, as a group (S52). In the example of <FIG>, the processor <NUM> receives the sound source 55A, the sound source 55B, and the sound source 55C, as one group.

Then, the processor <NUM> receives a change in one piece of the first acoustic image localization information in the group (S53), and changes other pieces of the first acoustic image localization information in the group corresponding to the received change in the one piece of the first acoustic image localization information (S54). For example, when the user changes the position of the sound source 55A in the logical space L1, the processor <NUM> changes the positions of other sound source 55B and sound source 55C in the same group. The processor <NUM> maintains a relative positional relationship between each of a plurality of acoustic images in the same group, and changes the first acoustic image localization information.

For example, the user, as shown in <FIG>, changes the coordinates of the sound source 55A in the logical space L1 from (x1, y1) = (<NUM>, <NUM>) to (x1, y1) = (<NUM>, <NUM>). The processor <NUM> maintains the relative positional relationship among the sound source 55A, the sound source 55C, and the sound source 55B that are included in the same group, and changes the coordinates of the sound source 55B and the sound source 55C. In this example, the coordinates of the sound source 55A, the sound source 55C, and the sound source 55B are all the same (<NUM>, <NUM>). In such a case, the relative position is (<NUM>, <NUM>). Therefore, the processor <NUM> also changes the coordinates of the sound source 55B to (x2, y2) = (<NUM>, <NUM>), and also changes the coordinates of the sound source 55C to (x3, y3) = (<NUM>, <NUM>).

Even in a case in which each of the grouped plurality of pieces of first acoustic image localization information has different first coordinates, the processor <NUM> maintains the relative positional relationship between the grouped plurality of pieces of first acoustic image localization information, and changes other pieces of first acoustic image localization information. For example, in a case in which the coordinates of the sound source 55A are (x1, y1) = (<NUM>, <NUM>), and the coordinates of the sound source 55B are (x2, y2) = (<NUM>, <NUM>), the relative position is indicated by (x1-x2, y1-y2) = (<NUM>, <NUM>). In addition, in a case in which the coordinates of the sound source 55C are (x3, y3) = (<NUM>, <NUM>), the relative position is indicated by (x1-x3, y1-y3) = (-<NUM>, -<NUM>). Therefore, when the user changes the coordinates of the sound source 55A in the logical space L1 from (x1, y1) = (<NUM>, <NUM>) to (x1, y1) = (<NUM>, <NUM>), the processor <NUM> also changes the coordinates of the sound source 55B to (x2, y2) = (<NUM>, <NUM>), and changes the coordinates of the sound source 55C to (x3, y3) = (<NUM>, <NUM>).

It is to be noted that, in the case in which each of the grouped plurality of sound sources has different first coordinates, and the positions of other sound sources are changed while the relative positional relationship between the plurality of sound sources is maintained, the positions of other sound sources may be outside the logical space. The processor <NUM>, in a case in which the positions of other sound sources are outside the logical space, causes at least one of the x-coordinate or the y-coordinate to correspond to <NUM> or <NUM>. For example, the processor <NUM>, in a case in which changed coordinates of the sound source 55C are (x3, y3) = (-<NUM>, -<NUM>), changes the changed coordinates of the sound source 55C to (x3, y3) = (<NUM>, <NUM>). In other words, the processor <NUM> changes the coordinates of a sound source to <NUM> when the changed coordinates of the sound source are negative values, and changes the coordinates to <NUM> when the changed coordinates exceed <NUM>.

The processor <NUM> transforms the plurality of pieces of first acoustic image localization information in the group that are changed as described above, into the plurality of pieces of second acoustic image localization information by use of second coordinates in the plurality of physical spaces corresponding respectively (S55).

The processor <NUM> performs the above affine transformation on each of the logical space and the physical space, for example, and transforms the coordinates (x, y) of each sound source in the logical coordinate system into the coordinates (x', y') in the physical coordinate system. As a result, each sound source placed in the plurality of logical spaces is transformed into the second acoustic image localization information according to the shape of each physical space.

For example, as shown in <FIG>, in the physical space Z1, the position of the sound source 55A is moved from the right front to the left rear. In addition, in the physical space Z2, the position of the sound source 55B is moved from the right front to the left rear. Moreover, in the physical space Z3, the position of the sound source 55C is moved from the right front to the left rear.

In this manner, the processor <NUM> according to the present embodiment is able to collectively control the positions of the sound sources in the plurality of physical spaces by collectively transforming the grouped plurality of logical coordinates into respective physical coordinates. Accordingly, the user can collectively control movement of the sound sources to the plurality of physical spaces of different shapes. For example, the user of the information processing apparatus 1A, only by performing an operation of moving the sound source in the logical space L1 from the right front to the left rear, can provide such production that a sound source moves from the right front to the left rear, to both the listener in the physical space Z1 (the first floor seat of the concert hall), and the listener in the physical space Z2 (the second floor seat of the concert hall).

In addition, the user of the information processing apparatus 1A may designate in which region (in which physical space) each sound source is to be reproduced. In such a case, the processor <NUM>, in each of a plurality of regions, receives a setting of reproduction information that shows of which a sound source the audio signal is to be outputted.

<FIG> is a view showing an example of reproduction information. As shown in <FIG>, the reproduction information shows to which a region an audio signal is to be outputted for each sound source. In other words, the reproduction information shows of which a sound source the audio signal is to be outputted for each region. The processor <NUM> displays the reproduction information on the display <NUM>. The user edits the reproduction information by using the user I/F <NUM>. The user designates a region to which an audio signal is outputted, for each sound source. In other words, the user, in each of a plurality of regions, designates of which a sound source the audio signal is to be outputted.

In the example of <FIG>, the region Z1 outputs an audio signal of the sound source 55A. The region Z2 outputs an audio signal of the sound source 55B. The region Z3 outputs an audio signal of the sound source 55C. In other words, the audio signal of the sound source 55A is outputted only to the region Z1. The sound source 55B is outputted only to the region Z2. The sound source 55C is outputted to all the regions.

The processor <NUM> reproduces the audio signal of each sound source based on the reproduction information edited as described above. The processor <NUM> outputs the audio signal of the sound source 55A to the speakers <NUM> to <NUM>. Accordingly, the sound source 55A is able to be heard in the region Z1. The processor <NUM> outputs the audio signal of the sound source 55B to the speakers <NUM> to <NUM>. Accordingly, the sound source 55B is able to be heard in the region Z2. The processor <NUM> outputs the audio signal of the sound source 55C to the speakers <NUM> to <NUM>. Accordingly, the sound source 55C is able to be heard at any position of the region Z3.

In this manner, the information processing apparatus 1A is able to output an audio signal of any sound sources to each of the plurality of regions. For example, in a case in which the R1 shown in <FIG> is a building of an attraction in a certain theme park, the user of the information processing apparatus 1A can reproduce a footstep as the sound source 55C in all the regions. Therefore, a user of the attraction hears a footstep at any position in the attraction. In addition, the user of the information processing apparatus 1A can designate a region for each object in the attraction and can reproduce a sound. For example, with a sound of a helicopter as the sound source 55A, the user of the information processing apparatus 1A can cause the sound of the helicopter to be heard only in the region Z1 in the attraction. For example, with a sound of a car as the sound source 55B, the user of the information processing apparatus 1A can cause the sound of the car to be heard only in the region Z2 in the attraction. As a result, the user of the attraction can hear a sound of a different object for each region while hearing the same sound (a footstep, for example) in all the regions in the attraction.

<FIG> is a view showing a modification example of the reproduction information. As shown in <FIG>, the reproduction information may include information that shows to which a region an audio signal is to be outputted for each speaker. In other words, the reproduction information includes speaker designation information by which a speaker to be used for each of the plurality of regions is designated.

In the example of <FIG>, the region Z1 uses the speakers <NUM> to <NUM>. The region Z2 uses the speakers <NUM> to <NUM>. The region Z3 uses all the speakers <NUM> to <NUM>. For example, when the user of the information processing apparatus 1A designates the speakers <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> as the speaker to be used in the region Z1, the range of the region Z1 is increased. For example, when the user of the information processing apparatus 1A designates the speakers <NUM> to <NUM> as the speaker to be used in the region Z1, the range of the region Z1 is increased in the entire R1.

In this manner, the user can also easily change a position that each region covers, by designating the speaker to be used for each region.

On the other hand, as shown in <FIG>, the user may designate the speakers <NUM>, <NUM>, <NUM>, and <NUM> as the speaker to be used in the region Z3, for example. In such a case, the processor <NUM> outputs the audio signal (the audio signal of the sound source 55C in the example of <FIG>) of the sound source designated in the region Z3 to the speakers <NUM>, <NUM>, <NUM>, and <NUM> at four corners in the R1, to the speakers <NUM>, <NUM>, <NUM>, and <NUM> of the four corners of R1. In this case as well, the region Z3 remains as the entire R1. Therefore, in this case as well, the user of the information processing apparatus 1A can reproduce the sound source 55C of a footstep in all the regions, for example, in the attraction of a theme park.

The description of the foregoing embodiments is illustrative in all points and should not be construed to limit the present disclosure. The scope of the present disclosure is defined not by the foregoing embodiments but by the following claims for patent.

For example, the number of sound sources placed in one logical space is not limited to one. <FIG> is a diagram showing an example of the acoustic image localization setting screen displayed on the display <NUM> in a case in which a plurality of sound sources 55A and sound sources 55AB are placed in a logical space L1 and acoustic image localization position information is edited.

In this example, the user places acoustic image localization positions of the sound source 55A and the sound source 55AB in the logical space L1. For example, the sound source 55A is indicated by coordinates (x1, y1) = (<NUM>, <NUM>). The sound source 55AB is indicated by coordinates (x2, y2) = (<NUM>, <NUM>).

The user edits each of the sound source 55A and the sound source 55AB that are placed in the logical space L1. For example, the user changes the positions of the sound source 55A and the sound source 55AB that are placed in the logical space L1, to respective different positions. The processor <NUM> transforms the first acoustic image localization information of the changed sound source 55A and sound source 55AB, respectively, into the second acoustic image localization information of the physical space Z1.

In addition, the processor <NUM> may define a plurality of sound sources in one logical space as the same second group. <FIG> is a diagram showing an example of the acoustic image localization setting screen displayed on the display <NUM> in a case in which the acoustic image localization position information of the sound sources 55A and the sound source 55AB that are defined as the second group is edited.

In such a case, the sound source 55A and the sound source 55AB are defined as the same second group. The user edits either the sound source 55A or the sound source 55AB in the logical space L1. The processor <NUM> maintains the relative positional relationship between each of a plurality of acoustic images included in the same second group, and changes the first acoustic image localization information. For example, the user, as shown in <FIG>, changes the coordinates (x1, y1) = (<NUM>, <NUM>) of the sound source 55A placed in the logical space L1 to the coordinates (x1, y1) = (<NUM>, <NUM>). The processor <NUM> maintains the relative positional relationship between the sound source 55A and the sound source 55AB that are included in the same second group, and changes the coordinates of the sound source 55AB. The sound source 55AB is indicated by coordinates (x2, y2) = (<NUM>, <NUM>). In such a case, the relative position is indicated by (x1-x2, y1-y2) = (<NUM>, -<NUM>). Therefore, the processor <NUM> changes the position of the sound source 55AB to the coordinates (x2, y2) = (<NUM>, <NUM>). The display <NUM> displays the sound source 55A and the sound source 55AB in the logical space L1 according to the changed coordinates of the sound source 55A and the sound source 55AB.

Then, the processor <NUM> transforms sound source position coordinates (first acoustic image localization information) of the changed sound source 55A and the sound source 55AB in the logical coordinate system, respectively, into sound source position information (second acoustic image localization information) in the physical coordinate system. Alternatively, the processor <NUM> may transform the coordinates of the changed sound source 55A and the coordinates indicating the relative positional relationship between the sound source 55A and the sound source 55AB in the logical coordinate system into corresponding coordinates in the physical coordinate system. In such a case, the processor <NUM> may determine for the position of the sound source 55AB in the physical coordinate system based on the coordinates of the sound source 55A in the physical coordinate system, and the relative positional relationship between the sound source 55A and the sound source 55AB in the physical coordinate system. Subsequently, the display <NUM>, as shown in <FIG>, changes the positions of the sound source 55A and the sound source 55AB in the physical space Z1.

Claim 1:
An information processing method of acoustic-image localizing a plurality of physical spaces, the information processing method comprising:
receiving settings of a plurality of pieces of information on a plurality of logical spaces defining first coordinates in the plurality of logical spaces;
receiving settings of a plurality of pieces of information on a plurality of physical spaces that respectively correspond to the plurality of pieces of information on the plurality of logical spaces and that define second coordinates in the plurality of physical spaces;
receiving a first group of a plurality of pieces of first acoustic image localization information, each of which indicates a position of an acoustic image to be localized in one of the plurality of logical spaces using the first coordinates;
receiving a change in position of one piece of first acoustic image localization information, among the first group of the plurality of pieces of first acoustic image localization information;
changing a position of each of the other pieces of first acoustic image localization information, among the first group of the plurality of pieces of first acoustic image localization, in response to the received change in position of the one piece of first acoustic image localization information; and
transforming the first group of the plurality of pieces of first acoustic image localization information respectively into a plurality of pieces of second acoustic image localization information using second coordinates.