Acoustic processing system, acoustic processing method, and information processing apparatus

An acoustic processing system for audio signal processing includes a first apparatus including a first memory that stores a first parameter for the audio signal processing and a user interface that receives an operation for changing the first parameter, a second apparatus including a second memory that stores a second parameter synchronized with the first parameter and a first CPU that performs system control, and a third apparatus including a second CPU that performs the audio signal processing. The first CPU sends, to the third apparatus, control information for controlling the audio signal processing based on the second parameter, and the second CPU receives the control information, and performs the audio signal processing based on the control information.

CROSS REFERENCE TO RELATED APPLICATIONS

This Nonprovisional application claims priority under 35 U.S.C. § 119(a) on Patent Application No. 2021-115712 filed in Japan on Jul. 13, 2021, the entire contents of which are hereby incorporated by reference.

BACKGROUND

Technical Field

An embodiment of the present disclosure relates to an acoustic processing system, an acoustic processing method, and an information processing apparatus.

Background Information

Japanese Unexamined Patent Application Publication No. 2010-072656 discloses a personal computer in which a large amount of remote control software that is able to be plugged in music software is installed. The personal computer performs synchronous processing of operation parameters between each remote control software and a corresponding external device.

Japanese Unexamined Patent Application Publication No. 2021-018590 discloses a control apparatus including first and second control boards capable of two-way communication. The first and second control boards include a parameter storage that stores a parameter. The parameters of the first and second control boards are synchronized.

Both Japanese Unexamined Patent Application Publication No. 2010-072656 and Japanese Unexamined Patent Application Publication No. 2021-018590 simply disclose a configuration to simply synchronize a memory (a parameter) of a certain device and a certain device. Neither prior art has considered distributing audio signal processing.

SUMMARY

In view of the foregoing, an embodiment of the present disclosure is directed to provide an acoustic processing system capable of flexibly and easily distributing audio signal processing.

An acoustic processing system for audio signal processing includes a first apparatus including a first memory that stores a first parameter for the audio signal processing and a user interface that receives an operation for changing the first parameter, a second apparatus including a second memory that stores a second parameter synchronized with the first parameter and a first CPU that performs system control, and a third apparatus including a second CPU that performs audio signal processing. The first CPU sends, to the third apparatus, control information for controlling the audio signal processing based on the second parameter, and the second CPU receives the control information, and performs the audio signal processing based on the control information.

An embodiment of the present disclosure is able to flexibly and easily distribute audio signal processing.

DETAILED DESCRIPTION

FIG.1is a block diagram showing a configuration of an acoustic processing system1. The acoustic processing system1includes a processor11, an information processing apparatus12, a network13, a speaker14, and a microphone15.

The processor11and the information processing apparatus12are connected through the network13. The network13includes a LAN (a local area network) or the Internet. The processor11is connected to the speaker14and the microphone15through an audio cable.

However, in the present disclosure, the connection between the devices is not limited to such an example. For example, the processor11, the speaker14, and the microphone15may be connected through the network. In addition, the processor11and the information processing apparatus12may be connected by a communication line such as a USB cable.

The processor11is an example of an audio signal processing apparatus. The processor11receives an audio signal from the microphone15. In addition, the processor11outputs the audio signal to the speaker14. While the present embodiment shows the speaker14and the microphone15as an example of an acoustic device to be connected to the processor11, a greater number of acoustic devices may be further connected.

FIG.2is a block diagram showing a configuration of the processor11. The processor11includes a display201, a user I/F202, an audio I/O (Input/Output)203, a CPU204, a network I/F205, a flash memory206, and a RAM207.

The display201is mainly made of an LED or an LCD, and displays various types of information (a power ON/OFF state, for example). The user I/F202is a physical controller such as a switch or a button. The user I/F202takes a user operation such as power ON/OFF.

The CPU204functions as a controller (a first CPU) to perform system control. The CPU204also functions as a signal processor (a second CPU) to perform audio signal processing. The CPU204reads and executes a predetermined program stored in the flash memory206being a storage medium to the RAM207and performs operations of a controller and a signal processor.

The CPU204performs audio signal processing such as filter processing on an audio signal to be inputted from an acoustic device such as the microphone15through the audio I/O203or the network I/F205. The CPU204outputs the audio signal on which the signal processing has been performed, to an acoustic device such as the speaker14, through the audio I/O203or the network I/F205.

A parameter that shows content of the audio signal processing is stored in a current memory251in the flash memory206. The CPU204performs audio signal processing based on the parameter stored in the current memory251.

Setting details (setting information) of the system control is stored in a setting memory252in the flash memory206. The CPU204performs the system control based on the setting information stored in the setting memory252. The system control includes patch setting (wire connection management) for an input port (a physical port) to receive an input of an audio signal and an input channel, for example.

It is to be noted that the program that the CPU204reads does not need to be stored in the flash memory206in the own apparatus. For example, the program may be stored in a storage medium of an external apparatus such as a server. In such a case, the CPU204may read out the program each time from the server to the RAM207and may execute the program.

Next,FIG.3is a block diagram showing a configuration of the information processing apparatus12. The information processing apparatuses12is an information processing apparatus such as a personal computer or a dedicated embedded system, for example.

The information processing apparatus12includes a display301, a user I/F302, a CPU303, a RAM304, a network I/F305, and a flash memory306.

The CPU303reads out a program stored in the flash memory306being a storage medium to the RAM304and implements a predetermined function. It is to be noted that the program that the CPU303reads out does not also need to be stored in the flash memory306in the own apparatus. For example, the program may be stored in a storage medium of an external apparatus such as a server. In such a case, the CPU303may read out the program each time from the server to the RAM304and may execute the program.

The flash memory306includes a current memory351and a setting memory352. The current memory351is synchronized with the current memory251of the processor11. In addition, the setting memory352is synchronized with the setting memory252of the processor11.

For example, when a user operates the user I/F202of the processor11and changes the parameter, the processor11updates content of the current memory251and then sends updated content of the current memory251to the information processing apparatus12. The CPU303, through the network I/F305, receives the updated content of the current memory251, and synchronizes content of the current memory351with the updated content of the current memory251. In addition, when the user operates the user I/F302of the information processing apparatus12and changes the parameter, the information processing apparatus12updates the content of the current memory351and sends updated content of the current memory351to the processor11. The CPU204, through the network I/F205, receives the updated content of the current memory351, and synchronizes the updated content of the current memory251with the content of the current memory351.

It is to be noted that the processor11and the information processing apparatus12, in a case of being not connected to each other, independently change the content of the current memory. Then, the processor11and the information processing apparatus12, in a case of being connected to each other, update the content of one of the current memory251of the processor11or the current memory351of the information processing apparatus12with the content of the other. The user may select to use either the content of the current memory251of the processor11or the content of the current memory351of the information processing apparatus12.

Subsequently,FIG.4is a functional block diagram of the processor11and the information processing apparatus12.FIG.5is a flow chart showing an operation of the acoustic processing system. As shown inFIG.4, the processor11functionally configures a player502and a manager503. The manager503configures a controller (a first CPU2041) to perform system control. The player502configures a signal processor (a second CPU2042) to perform audio signal processing. In this example, the information processing apparatus is an example of a first apparatus, the manager503is an example of a second apparatus, and the player502is an example of a third apparatus.

The player502and the manager503are configured as virtually different apparatuses within the same physical apparatus. The player502and the manager503communicate using a predetermined protocol (TCP/IP: Transmission Control Protocol/Internet Protocol, for example). It is to be noted that, in this example, the first CPU2041and the second CPU2042in one physical CPU204function as virtually different CPUs. However, the first CPU2041and the second CPU2042may be different cores in one physical CPU including a plurality of cores. In addition, the first CPU2041and the second CPU2042may be physically different CPUs.

The CPU303of the information processing apparatus12takes an operation of a parameter through the user I/F302being an operator (S11). The CPU303updates the current memory351being a first memory by a changed parameter (S12).

The manager503synchronizes the current memory251being a second memory with the current memory351being the first memory (S22). In addition, at this time, the manager503may synchronize the setting memory252and the setting memory352. The manager503performs system control based on synchronized setting memory252. In other words, the first memory may include both the current memory351and the setting memory352, and the second memory may include both the current memory251and the setting memory252.

Next, the first CPU2041sends control information to control audio signal processing to the player502based on the parameter stored in the current memory251(S23). The control information includes a filter coefficient in filter processing, for example. As described above, the manager503and the player502are configured as virtually different apparatuses, and the manager503sends the control information to the player502by using a protocol such as TCP/IP.

The second CPU2042of the player502receives the control information (S31), and performs audio signal processing based on the control information (S32). Specifically, the second CPU2042performs audio signal processing such as filter processing on an audio signal to be inputted from an acoustic device such as the microphone15, and outputs the audio signal on which the signal processing has been performed, to an acoustic device such as the speaker14.

As described above, according to the acoustic processing system1of the present embodiment, the processor11configures the manager503and the player502as different apparatuses, and the manager503sends control information to the player502by using a protocol such as TCP/IP. Therefore, the manager503is able to send the control information not only to the player502in the processor11but also to any audio signal processing apparatus capable of receiving information by a protocol such as TCP/IP, and control the audio signal processing. For example,FIG.6is a block diagram of the acoustic processing system1further including a cloud server20.FIG.7is a functional block diagram of the processor11, the cloud server20, and the information processing apparatus12.

The cloud server20is an example of an audio signal processing apparatus. In such a case, the first CPU2041of the manager503sends the control information to the cloud server20by using a protocol such as TCP/IP. The cloud server20configures a second CPU211. The second CPU211receives the control information from the first CPU2041, and performs audio signal processing based on the control information. At this time, the first CPU2041sends an audio signal to be inputted from the acoustic device such as the microphone15to the second CPU211by similarly using a protocol such as TCP/IP. The second CPU211receives the control information and the audio signal from the first CPU2041, and performs audio signal processing on a received audio signal based on the control information. The second CPU211sends the audio signal on which the signal processing has been performed, to the first CPU2041by a protocol such as TCP/IP. The first CPU2041outputs the received audio signal to the acoustic device such as the speaker14.

In this manner, the second apparatus that performs the system control and the third apparatus that performs the audio signal processing do not need to be configured as virtually different apparatuses within the same physical apparatus and may be as physically different apparatuses. In other words, each of the second apparatus and the third apparatus may be independent information processing apparatus.

The acoustic processing system1according to the present embodiment may be able to cause the player502of the own apparatus to execute audio signal processing or may be able to cause a different apparatus such as the cloud server20to execute audio signal processing. In addition, as shown inFIG.8, the first CPU2041of the manager503is also able to cause both the second CPU2042of the player502of the own apparatus and the second CPU211of the cloud server20to execute audio signal processing. In such a case, the manager503may determine audio signal processing to be executed by the second CPU2042and audio signal processing to be executed by the second CPU211based on the processing capacity of each of the second CPU2042and the second CPU211. Alternatively, the manager503may determine audio signal processing to be executed by the second CPU2042and audio signal processing to be executed by the second CPU211according to the acceptable range of latency in filter processing. In a case in which an audio signal is sent and received to the cloud server20, the latency by communication is increased. The manager503, for example, may cause the second CPU211to execute audio signal processing of which the acceptable range of latency is large.

As described above, the manager503, since using a general-purpose protocol such as TCP/IP, is able to flexibly and easily distribute audio signal processing. In addition, the user only remotely changes the parameter of the processor11by using the information processing apparatus12, and does not need to control the player502on the side of signal processing, and also does not need to manage which apparatus performs which signal processing.

Furthermore, the information processing apparatus12is also able to change a parameter not only to one audio signal processing apparatus but also to a plurality of audio signal processing apparatuses.FIG.9is a block diagram of the acoustic processing system1further including a processor11A, a speaker14A, and a microphone15A.FIG.10is a functional block diagram of the processor11, the processor11A, and the information processing apparatus12. The hardware and the functional configuration of the processor11A are the same as the hardware and the functional configuration of the processor11.

In this example, the information processing apparatus12includes a current memory351A that stores a parameter different from the parameter of the current memory351. The current memory351A is an example of a third memory. The current memory351A is synchronized with a current memory251A of the processor11A. It is to be noted that the processor11A and the information processing apparatus12, in the case of being not connected to each other, independently change the content of the current memory. Then, the processor11A and the information processing apparatus12, in the case of being connected to each other, update the content of one of the current memory251of the processor11A or the current memory351of the information processing apparatus12with the content of the other. In other words, the information processing apparatus12may be able to independently change the content of the current memory351in a case of being not connected to the processor11A or may be able to independently change the content of the current memory351in a case of being not connected to the processor11.

As shown inFIG.10, the processor11A, as with the processor11, functionally configures a player502A and a manager503A. The manager503A configures a controller (a third CPU2041A) to perform system control. The player502A configures a signal processor (a fourth CPU2042A) to perform audio signal processing. In this example, the manager503A includes a current memory251A being a fourth memory, and is an example of a fourth apparatus that performs system control, and the player502A is an example of a fifth apparatus that performs audio signal processing.

In this example as well, the player502A and the manager503A are configured as virtually different apparatuses within the same physical apparatus. The player502A and the manager503A communicate by a protocol such as TCP/IP. Moreover, the fourth apparatus that performs the system control and the fifth apparatus that performs the audio signal processing do not need to be configured as virtually different apparatuses within the same physical apparatus and may be as physically different apparatuses. In other words, each of the fourth apparatus and the fifth apparatus may also be independent information processing apparatus.

The third CPU2041A sends control information to control audio signal processing to the player502A based on the parameter stored in the current memory251A. The fourth CPU2042A of the player502A receives the control information, and performs audio signal processing based on the control information.

In this manner, the information processing apparatus12is also able to remotely control content (a current memory) of signal processing of a plurality of audio signal processing apparatuses.

In addition, the manager503A of the processor11A, as with the manager503, is also able to cause a different apparatus such as the cloud server20to execute audio signal processing. In addition, as shown inFIG.11, the third CPU2041A of the manager503A is also able to cause both the fourth CPU2042A of the player502A of the own apparatus and the second CPU211of the cloud server20to execute audio signal processing. In such a case, the manager503A may determine audio signal processing to be executed by the fourth CPU2042A and audio signal processing to be executed by the second CPU211based on the processing capacity of each of the fourth CPU2042A and the second CPU211. Alternatively, the manager503A may determine audio signal processing to be executed by the fourth CPU2042A and audio signal processing to be executed by the second CPU211according to the acceptable range of latency in filter processing.

The description of the foregoing embodiments is illustrative in all points and should not be construed to limit the present disclosure. The scope of the present disclosure is defined not by the foregoing embodiments but by the following claims for patent. Further, the scope of the present disclosure is intended to include all modifications within the scopes of the claims for patent and within the meanings and scopes of equivalents.

The audio signal processing apparatus includes an amplifier, a mixer, or an audio amplifier, for example, in addition to a processor.

In the above embodiment, the CPU configures the function to perform audio signal processing. However, as shown inFIG.12, for example, the processor11may perform a signal processing function by hardware (a DSP or an FPGA, for example). The processor11shown inFIG.12further includes a signal processing apparatus702including an FPGA902. The manager503sends the control information to control audio signal processing to the player502and the signal processing apparatus702based on the parameter stored in the current memory251. The FPGA902of the signal processing apparatus702receives the control information, and performs audio signal processing based on the control information.

The manager503may determine audio signal processing to be executed by the second CPU2042and audio signal processing to be executed by the FPGA902based on the processing capacity of each of the second CPU2042and the FPGA902. Alternatively, the manager503may determine audio signal processing to be executed by the second CPU2042and audio signal processing to be executed by the FPGA902according to the acceptable range of latency in filter processing.

The manager503, in a case of sending the control information to the plurality of audio signal processing apparatuses, may send to one apparatus by a first protocol and may send to another apparatus by a second protocol.FIG.13is a functional block diagram showing an example in which the control information is sent to an audio amplifier20A. The audio amplifier20A includes a fourth CPU211A that performs audio signal processing. The manager503may send the control information to the player502by TCP/IP, and may send the control information to the fourth CPU211A of the audio amplifier20A by a different protocol (TMDS: Transition Minimized Differential Signaling, for example).

FIG.14is a functional block diagram showing an example in which a signal processing component is stored as a DLL (Dynamic Link Library). The signal processing component collects specific content of the signal processing as information, and includes content of a parameter, a filter coefficient, and the like. The processor11functionally includes an SDK (Software Development Kit)80. The SDK80is an example of an application program to store a signal processing component as a DLL. The SDK80generates a signal processing component including a parameter managed by the first CPU and a filter coefficient managed by the second CPU as a DLL85. The DLL85is stored in the flash memory206, for example.

As a result, the processor11is able to store the content of the signal processing that the user has set as a DLL. Any audio signal apparatus capable of developing a DLL is able to perform audio signal processing by executing the DLL.