Patent Description:
An I/O device including a plurality of input/output terminals connects acoustic devices such as a large number of microphones. A user such as a sound engineer performs patch setting to assign each of the plurality of input/output terminals to a predetermined channel.

As the number of channels and the number of input/output terminals are increased, it is difficult for the user to grasp what type of audio processing parameter is assigned to which input/output terminal. The user, when looking at an assignment table written on paper, for example, has grasped what type of audio processing parameter has been set for which input/output terminal. However, when assignment is changed, it is necessary to revise the contents written on the paper and it is also necessary to confirm that the contents on the paper and the contents of the actual assignment are in agreement.

Attention is drawn to document <CIT> which relates to a system which includes a mobile device configured to transmit at least one system variable control signal indicative of an audio processing command, and a translation controller distinct and separate from the mobile device. The translation controller may be configured to receive the system variable control signal, and transmit a mixer message in a protocol specific to an audio mixing console based on the system variable control signal, the mixer message including at least one audio processing command.

Further attention is drawn to document <CIT> which relates to an audio mixing system for providing an audio processing interface at a mobile device which may include a mobile device including an interface configured to present a display screen to receive user input to control a remote audio mixer that is operably coupled to at least one musical instrument, transmit, via a wireless network, a mobile device command indicating an audio setting, the command being generated in response to user input, receive, via the wireless network and in response to the mobile device command, first mixer data indicative of audio settings of the remote audio mixer, and present an updated display screen, the updated display screen reflecting the first mixer data as a result of the mobile device command to present a real-time display of the audio settings of the remote audio mixer.

Attention is also drawn to document <CIT> which relates to a method and system for delivering device specific service information to a mobile platform. A mobile phone and a Device Assist Server are operatively connected to prompt a user to capture relevant device information using a camera associated with the mobile phone. A remote Device Assist Server processes this device information and provides service related information to the user via the mobile phone.

Further embodiments of the invention are defined by the appended dependent claims. In view of the foregoing, an example embodiment of the present disclosure is directed to provide an information processing terminal, an audio system, and an information processing method that enable a user to intuitively grasp what type of audio processing parameter is set for which input/output terminal.

An information processing terminal includes a display, an identifier that identifies a model of an I/O device that includes a plurality of input/output terminals, an arrangement data generator that generates arrangement data that shows arrangement of the plurality of input/output terminals, based on an identification result of the identifier, an obtainer that obtains an audio processing parameter corresponding to each of the plurality of input/output terminals, and a display processor that displays the audio processing parameter corresponding to each of the plurality of input/output terminals on the display, based on the arrangement data.

A user can intuitively grasp what type of audio processing parameter is set for which input/output terminal. Other objects, advantages and novel features of the present disclosure will become apparent from the following detailed description of one or more preferred embodiments when considered in conjunction with the accompanying drawings, in which:.

<FIG> is a block diagram showing a configuration of an audio system <NUM>. The audio system <NUM> includes a mixer <NUM>, an information processing terminal <NUM>, an I/O device <NUM>, a plurality of speakers <NUM>, and a plurality of microphones <NUM>.

The mixer <NUM> and the I/O device <NUM> are connected to each other through a network cable. The I/O device <NUM>, the plurality of speakers <NUM>, and the plurality of microphones <NUM> are connected to one another through an audio cable. The information processing terminal <NUM> is connected to the mixer <NUM> through wireless communication.

However, in the present disclosure, the connection between the devices is not limited to the above-stated example. For example, the mixer <NUM> and the information processing terminal <NUM> may be connected by a communication line such as a USB cable, an HDMI (registered trademark), or a MIDI. In addition, the mixer <NUM> and the I/O device <NUM> may be connected with an audio cable.

The mixer <NUM> is an example of an audio processing apparatus of the present disclosure. The mixer <NUM> receives an input of an audio signal from the I/O device <NUM> or outputs an audio signal to the I/O device <NUM>. It is to be noted that the audio processing apparatus is not limited to the mixer <NUM>. For example, a system (DAW: Digital Audio Workstation) including hardware or software for performing work such as audio recording, editing, or mixing is also an example of the audio processing apparatus.

<FIG> is a block diagram showing a configuration of the I/O device <NUM>. <FIG> is a block diagram showing a configuration of the mixer <NUM>. <FIG> is a block diagram functionally showing a digital signal processor. <FIG> is a block diagram showing a configuration of the information processing terminal <NUM>.

The I/O device <NUM> includes a display <NUM>, a user interface (I/F) <NUM>, an input/output terminal <NUM>, a flash memory <NUM>, a RAM <NUM>, a network interface (I/F) <NUM>, and a CPU <NUM>.

The display <NUM>, the user interface (I/F) <NUM>, the input/output terminal <NUM>, the flash memory <NUM>, the RAM <NUM>, the network interface (I/F) <NUM>, and the CPU <NUM> are connected to a bus <NUM>.

The display <NUM> includes an LCD (Liquid Crystal Display) or an OLED (Organic Light-Emitting Diode), for example, and displays various types of information. The user I/F <NUM> includes a switch, a knob, or a touch panel, and takes an operation from a user. In a case in which the user I/F <NUM> is a touch panel, the user I/F <NUM> constitutes a GUI (Graphical User Interface, the rest is omitted) together with the display <NUM>.

The CPU <NUM> reads the program stored in the flash memory <NUM> being a storage medium to the RAM <NUM> and implements a predetermined function. It is to be noted that the program that the CPU <NUM> reads does not need to be stored in the flash memory <NUM> in the own apparatus. For example, the program may be stored in a storage medium of an external apparatus such as a server. In such a case, the CPU <NUM> may read the program each time from the server to the RAM <NUM> and may execute the program.

<FIG> shows an appearance of the I/O device <NUM>. As an example, the I/O device <NUM> has a housing having a rectangular parallelepiped shape. <FIG> is a view showing a front panel of the housing. The display <NUM>, the input/output terminal <NUM>, and the network I/F <NUM> are arranged in the front panel of the housing. It is to be noted that the user I/F <NUM> including a touch panel is stacked on the display <NUM>.

The display <NUM> displays a model name (A0001 in the example of <FIG>) of the I/O device <NUM>. However, the model name does not need to be displayed on the display <NUM>. The model name may be printed or engraved on a portion of the housing.

The input/output terminal <NUM> includes a plurality of input/output terminals. In the example of <FIG>, the input/output terminal <NUM> includes <NUM> input terminals of eight rows x three columns. Each input terminal is connected to a microphone <NUM>. Each input terminal receives an input of an audio signal from the microphone <NUM>. In addition, the input/output terminal <NUM> includes eight output terminals. Each output terminal is connected to a speaker <NUM>. Each output terminal outputs an audio signal to the speaker <NUM>. It is to be noted that the number of terminals is not limited to this example.

The CPU <NUM> sends the audio signal inputted from each input terminal of the input/output terminal <NUM>, to the mixer <NUM> through the network I/F <NUM>. In addition, the CPU <NUM> outputs the audio signal received from the mixer <NUM> through the network I/F <NUM>, to each output terminal of the input/output terminal <NUM>.

The mixer <NUM> includes components such as a display <NUM>, a user I/F <NUM>, an audio I/O (Input/Output) <NUM>, a digital signal processor (DSP) <NUM>, a network I/F <NUM>, a CPU <NUM>, a flash memory <NUM>, and a RAM <NUM>. These components are connected to each other through a bus <NUM>.

The CPU <NUM> is a controller that controls an operation of the mixer <NUM>. The CPU <NUM> reads and implements a predetermined program stored in the flash memory <NUM> being a storage medium to the RAM <NUM> and performs various types of operations.

It is to be noted that the program that the CPU <NUM> reads does not also need to be stored in the flash memory <NUM> in the own apparatus. For example, the program may be stored in a storage medium of an external apparatus such as a server. In such a case, the CPU <NUM> may read the program each time from the server to the RAM <NUM> and may execute the program.

The digital signal processor <NUM> includes a DSP for performing various types of signal processing. The digital signal processor <NUM> performs signal processing such as mixing processing and filter processing, on an audio signal inputted from a device such as the I/O device <NUM>, through the audio I/O <NUM> or the network I/F <NUM>. The digital signal processor <NUM> outputs the audio signal on which the signal processing has been performed, to another device such as the I/O device <NUM>, through the audio I/O <NUM> or the network I/F <NUM>.

<FIG> is a functional block diagram of signal processing to be executed by the digital signal processor <NUM> and the CPU <NUM>. As shown in <FIG>, the signal processing is functionally performed through an input patch <NUM>, an input channel <NUM>, a bus <NUM>, an output channel <NUM>, and an output patch <NUM>.

The input channel <NUM> has a signal processing function of <NUM> channels as an example. The input patch <NUM> assigns each input terminal of the I/O device <NUM> to any channel of the input channel <NUM>.

An audio signal is supplied from the input patch <NUM> to each channel of the input channel <NUM>. The each channel of the input channel <NUM> performs various types of signal processing on the inputted audio signal. In addition, the each channel of the input channel <NUM> sends out the audio signal on which the signal processing has been performed, to the bus <NUM> provided in the subsequent stage.

The bus <NUM> mixes and outputs the audio signal to be inputted. The bus <NUM> has a plurality of buses such as an STL (a stereo L) bus, an STR (a stereo R) bus, an AUX bus, and a MIX bus.

The output channel <NUM> performs signal processing on each audio signal outputted from the plurality of buses. The output patch <NUM> assigns each channel of the output channel <NUM> to each output terminal of the I/O device <NUM>. The output patch <NUM> sends an audio signal to the I/O device <NUM> through the audio I/O <NUM> or the network I/F <NUM>.

The information processing terminal <NUM> may be an information processing apparatus such as a personal computer, a smartphone, or a tablet PC, for example. The information processing terminal <NUM> includes a display <NUM>, a user I/F <NUM>, a CPU <NUM>, a network I/F <NUM>, a flash memory <NUM>, a RAM <NUM>, and a camera <NUM>.

The user I/F <NUM> including a touch panel is stacked on the display <NUM>, which configures a GUI. The CPU <NUM> reads out a program stored in the flash memory <NUM> being a storage medium to the RAM <NUM> and implements a predetermined function. It is to be noted that the program that the CPU <NUM> reads out does not also need to be stored in the flash memory <NUM> in the own apparatus. For example, the program may be stored in a storage medium of an external apparatus such as a server. In such a case, the CPU <NUM> may read out the program each time from the server to the RAM <NUM> and may execute the program.

The CPU <NUM> configures an identifier <NUM>, an arrangement data generator <NUM>, an obtainer <NUM>, and a display processor <NUM> by the program.

<FIG> is a flow chart showing an operation of the CPU <NUM>. The identifier <NUM> of the CPU <NUM> first identifies a model of the I/O device <NUM> (S11). Specifically, the identifier <NUM> extracts information on a model name from data of an image captured by the camera <NUM>, and identifies a model, based on an extracted model name. A user captures the front panel of the housing of the I/O device <NUM>, using the camera <NUM> of the information processing terminal <NUM>. The identifier <NUM> extracts information corresponding to the model name by image recognition processing. In the example of <FIG>, the model name is displayed on the display <NUM>. Accordingly, the identifier <NUM> extracts the model name of "A0001. " It is to be noted that the identifier <NUM> may identify a model by sending image data to a server and extracting a corresponding model name by the server. In addition, in a case in which the information on a model name is not displayed on the housing, the identifier <NUM> may identify a model by image recognition processing. In such a case, the identifier <NUM> determines a model most similar to the data of the image captured by the camera <NUM>, and identifies a model.

Subsequently, the arrangement data generator <NUM> of the CPU <NUM> generates arrangement data that shows arrangement of a plurality of input/output terminals, based on the identification result of the identifier <NUM> (S12). The flash memory <NUM> previously stores the arrangement data for each model. The arrangement data generator <NUM> refers to the flash memory <NUM> using the information on the model name being the identification result, and reads out corresponding arrangement data. The arrangement data includes information on the number of input/output terminals, information that indicates a name of each input/output terminal, information that indicates a position of each input/output terminal. The position of an input/output terminal is indicated, for example, by means of an orthogonal coordinate system with reference to a predetermined position (a lower left position when the front panel is viewed straight, for example) of the I/O device <NUM>.

In addition, the arrangement data generator <NUM> may download the arrangement data from a server. The server accumulates the arrangement data for each model. The arrangement data generator <NUM> sends the information on the model name being the identification result, to the server. The server returns the arrangement data corresponding to the information on a received model name.

On the other hand, the obtainer <NUM> of the CPU <NUM> obtains an audio processing parameter corresponding to each of the plurality of input/output terminals (S13). The audio processing parameter is a channel name, a gain, on and off of a phantom power source, a polarity, content of signal processing (filter processing, for example), on and off of a CUE, for example. The obtainer <NUM> obtains the audio processing parameter corresponding to each of the plurality of input/output terminals from the mixer <NUM>. For example, the obtainer <NUM> obtains assignment information of the input patch <NUM>.

The display processor <NUM> displays the audio processing parameter corresponding to each of the plurality of input/output terminals on the display <NUM>, based on the arrangement data generated in S12 (S14). For example, the display processor <NUM>, as shown in <FIG>, displays a channel name at a position of each of the plurality of input/output terminals, the position being in the image of the front panel of the I/O device <NUM>. The image of the front panel of the I/O device <NUM> may be previously stored in the flash memory <NUM> or may be downloaded from the server. In addition, the image of the front panel of the I/O device <NUM> may be an image captured by the camera <NUM>. In a case in which the image captured by the camera <NUM> is used, the display processor <NUM> displays an audio processing parameter by superimposing the audio processing parameter on the image that is currently being captured by the camera <NUM>.

In the example of <FIG>, the input channel with a channel name of Vocal corresponds to a first input terminal. Therefore, the display processor <NUM> displays the channel name of Vocal on the first input terminal. It is to be noted that, in this example, a user previously inputs a channel name to each input channel. However, in a case in which the user has not inputted a channel name, the display processor <NUM> may display a channel name such as, for example, "Input Channel <NUM>" on each input/output terminal.

As a result, the user can easily grasp what type of audio processing parameter is assigned to which input/output terminal. In addition, even in a case in which assignment is temporarily changed by the mixer <NUM>, the display processor <NUM> displays changed content on the display <NUM>. Accordingly, the user, even when changing the assignment, is able to easily grasp the content of the audio processing parameter currently assigned to each input/output terminal.

In the above-stated example, the identifier <NUM> identifies the model, based on the image of the front panel of the I/O device <NUM>, the image having been captured by the camera <NUM>. However, the identifier <NUM> may obtain model information from the I/O device <NUM>, using a predetermined communication function, for example. <FIG> shows an appearance of an I/O device <NUM> and an information processing terminal <NUM> according to a first modification.

In the example of <FIG>, NFC is used as a communication interface. An NFC I/F <NUM>, as shown in <FIG>, is provided in a portion of a housing of the I/O device <NUM>, for example. The NFC I/F <NUM> is an example of a communication interface and performs communication with other devices through an antenna. According to the NFC standards, a communicable distance is limited to a close range such as <NUM>, for example. Therefore, the NFC is able to communicate with only a device at the close range. As a matter of course, the communication interface used for the present disclosure is not limited to the NFC. For example, the housing of the I/O device <NUM> may include a beacon with Bluetooth (registered trademark) Low Energy technology. The information processing terminal <NUM> may obtain the information on a model name using Bluetooth (registered trademark).

A user, as shown in <FIG>, brings the information processing terminal <NUM> closer to the housing of the I/O device <NUM>. In such a case, the information processing terminal <NUM> also includes an NFC I/F. The identifier <NUM> obtains the information on a model name from the I/O device <NUM> through the NFC. In such a manner, the identifier <NUM> may identify a model.

<FIG> and <FIG> show a display example of the display <NUM> according to a second modification. The user I/F <NUM> including a touch panel is stacked on the display <NUM>, which configures a GUI. The user I/F <NUM> takes an operation with respect to an audio processing parameter from a user through the touch panel.

For example, when the user touches the display <NUM>, the display processor <NUM> displays a screen of "INPUT INFO" shown in <FIG> and <FIG>. The "INPUT INFO" is a screen for an operation of switching what is displayed. In the example of <FIG>, the "INPUT INFO" includes "NAME," "GAIN," "+48V," "POLARITY," and "FILTER. " The "NAME" indicates a channel name. The "GAIN" indicates a gain. The "+48V" indicates a phantom power source. The "POLARITY" indicates a polarity. The "FILTER" indicates a filter.

Herein, the user selects the "GAIN," for example, as the operation of switching what is displayed. Then, as shown in <FIG>, the display processor <NUM>, as an audio processing parameter, displays a gain in place of a channel name. In the example of <FIG>, the display processor <NUM> displays a numerical value and level gauge of a gain. The gain may be indicated only by the numerical value or may be indicated only by the level gauge. In addition, as shown in <FIG>, for example, the display processor <NUM> may display both a channel name and a level gauge. Accordingly, the user can look over the gain of each input/output terminal.

It is to be noted that the switching of display is not limited to the above-stated example. For example, the display processor <NUM> may display a preview of a scene recall. The scene recall is processing of reading out scene data stored in the flash memory <NUM> of the mixer <NUM>. When the user performs a scene recall, the content of the audio processing parameter changes. Displaying a preview of a scene recall is a function in which only the content of the audio processing parameter to be displayed on the display <NUM> changes while the audio processing parameter in the mixer <NUM> is maintained. When the user performs an operation of displaying a preview of a scene recall, the information processing terminal <NUM> receives corresponding scene data from the mixer <NUM>. The display processor <NUM> displays the content of the audio processing parameter corresponding to the scene data, at a position of each input/output terminal of the display <NUM>. Accordingly, the user can grasp how the content of the audio processing parameter changes in a case of performing the scene recall. At such a time, the content of signal processing of the mixer <NUM> has not changed yet, so that the user can easily grasp the content of the audio processing parameter even in a state in which sound is not able to be switched, such as an actual performance of a concert.

<FIG> shows a display example of the display <NUM> according to a third modification. The information processing terminal <NUM> according to the third modification is able to set the mixer <NUM>. For example, when a user touches a position of each input/output terminal that is currently being displayed on the display <NUM>, the display processor <NUM> displays a setting screen of each input/output terminal as shown in <FIG>.

In the example of <FIG>, an input terminal <NUM> is being touched. The display processor <NUM> displays the setting screen "IN <NUM>: Vocal" of the input terminal <NUM>. The setting screen includes "PATCH," "NAME," "GAIN," "+48V," "POLARITY," "FILTER," "EDIT," "CUE," and "CANCEL.

The user, when touching the "PATCH," can change an input channel to be assigned to the input terminal <NUM>. When the user changes the input channel to be assigned to the input terminal <NUM>, the information processing terminal <NUM> sends information that indicates the input channel to be assigned, to the mixer <NUM>. The mixer <NUM> changes assignment of the input patch <NUM>, based on received information.

The user, when touching the "NAME," can change a channel name. In such a case, the assignment of the input patch <NUM> is not changed but only the channel name is changed.

The user, when touching the "GAIN," can change a gain. The display processor <NUM>, when taking a touch of the "GAIN," displays a knob or a fader, for example. The information processing terminal <NUM>, by taking an operation of the knob or the fader, takes a gain change operation. The information processing terminal <NUM> sends the information on changed gain, to the mixer <NUM>. The mixer <NUM> changes the assignment of the input patch <NUM>, based on received information on the gain.

The user, when touching the "+48V," can turn on and off a phantom power source. The user, when touching the "POLARITY," can reverse polarity. When the user touches the "FILTER," the screen shifts to a filter setting screen, and thus the user can turn on and off of a filter and can set filter property.

When the user touches the "EDIT," the screen shifts to a channel setting screen. The channel setting screen enables the user to set content of signal processing, a destination of an audio signal, or an amount of feed, for example.

The user, when touching the "CUE," can turn on and off a CUE. When the CUE is turned on, an audio signal corresponding a channel is sent out to monitor headphones of a user.

When the user touches the "CANCEL," the setting screen closes.

Although <FIG> shows an example in which the content of the audio processing parameter of the input terminal and the input channel is changed, the content of an audio processing parameter of the mixer <NUM> is able to be similarly changed at the output terminal and the output channel.

In the above-stated example, the identifier <NUM> extracts information on a model name from data of an image captured by the camera <NUM>, and identifies a model, based on an extracted model name. However, the identifier <NUM> may identify the model,
based on, for example, a unit ID of a user, unique information (a manufacturing number) for each device, or the like, in place of a model name. It is to be noted that, the unit ID is a management number (an alphanumeric character, for example) that is uniquely assigned, within the audio system <NUM>, to each of a plurality of devices that configure the audio system <NUM>. The unit ID may be manually assigned to each device by a user using a device (the mixer <NUM>, for example) used as a master, or may be automatically assigned by the device used as a master. As a result, the identifier <NUM> is able to identify each I/O device even when a plurality of I/O devices of the same model are used.

The description of the present embodiments is illustrative in all points and should not be construed to limit the present disclosure. The scope of the present disclosure is defined not by the foregoing embodiments but by the scope of the claims Further, the scope of the present disclosure is intended to include all modifications within the scope of the claims.

Claim 1:
An information processing terminal (<NUM>) comprising:
a display (<NUM>);
an identifier (<NUM>) configured to identify a model of an I/O device (<NUM>) based on data of an image obtained by capturing the I/O device (<NUM>);
an arrangement data generator (<NUM>) configured to read identified model arrangement data corresponding to an identified model of the I/O device (<NUM>) identified by the identifier (<NUM>) from a memory that stores arrangement data indicating positions of input/output terminals (<NUM>) for each model of I/O devices;
an obtainer (<NUM>) configured to obtain an audio processing parameter corresponding to each of the plurality of input/output terminals (<NUM>); and
a display processor (<NUM>) configured to display on the display:
an image of a panel of the I/O device including the input/output terminals, and
the audio processing parameter at the position in the image of the panel of each of the input/output terminals (<NUM>) indicated by the identified model arrangement data.