Patent Description:
In Non-Patent Document <NUM>, a headphone used through pairing with a portable terminal is disclosed. The headphone can control a sound volume, an effect size of built-in sound effect, or the like, according to a touch panel operation on the paired portable terminal.

[Non-Patent Document <NUM>] [Accessed July <NUM>, <NUM>] The Internet <URL: https://static. com/assets/media/pdf/WAZA-AIR_jpn04_W.

<NPL>, relates to a catalog of BomeBox products including versatile MIDIs, network connections and translation boxes.

<CIT> relates to a communication system providing connection, configuration, and control of a musical instrument.

In recent years, in electronic musical instruments, there has been an increasing demand to control a sound volume or the like with operations using not only a control device operated by hands such as a portable terminal or the like but also a control device operated by feet such as a pedal device or the like. However, since a headphone in Non-Patent Document <NUM> has only one control device capable of connection through pairing, the headphone can be controlled from one control device, and the headphone cannot be controlled from a plurality of control devices.

According to embodiments of the disclosure, the disclosure provides a control device, a control method and a control system that are capable of control of an electronic musical instrument that can be connected to one control device from at least two control devices. The following disclosure serves a better understanding of the present invention.

According to an embodiment, a control device of the disclosure is a device configured to control an electronic musical instrument, including: an input unit configured to receive a control instruction; a first communication unit configured to wirelessly communicate with the electronic musical instrument; a second communication unit configured to wirelessly communicate with a second control device that controls the electronic musical instrument; and an instruction transmission unit configured to transmit a control instruction received by the input unit and a second control instruction received from the second control device via the second communication unit to the electronic musical instrument via the first communication unit, wherein the control device is a pedal device comprising a pedal switch treated as the input unit, and the second control device is a portable terminal.

According to an embodiment, a control method of the disclosure is a control method executed by a control device connected to an electronic musical instrument and a second control device configured to control the electronic musical instrument through wireless communication, the method including: an input step of receiving a control instruction from a pedal switch (<NUM>) included in the control device (<NUM>) which is a pedal device; a first communication step of wirelessly communicating with the electronic musical instrument; a second communication step of wirelessly communicating with the second control device configured to control the electronic musical instrument; and an instruction transmission step of transmitting the control instruction input in the input step and a second control instruction received from the second control device in the second communication step to the electronic musical instrument in the first communication step.

According to an embodiment, a control system includes an electronic musical instrument, a second control device configured to control the electronic musical instrument, and a control device connected to the electronic musical instrument and the second control device through wireless communication, wherein the second control device includes a transmission unit configured to transmit a second control instruction to the control device, and the control device includes: an input unit configured to receive a control instruction; a first communication unit configured to wirelessly communicate with the electronic musical instrument; a second communication unit configured to wirelessly communicate with the second control device; and an instruction transmission unit configured to transmit the control instruction received by the input unit and the second control instruction received from the second control device via the second communication unit to the electronic musical instrument via the first communication unit, wherein the control device is a pedal device comprising a pedal switch treated as the input unit, and the second control device is a portable terminal.

Hereinafter, a preferred example will be described with reference to the accompanying drawings. A control system S of an embodiment will be schematically described with reference to <FIG> is a view schematically showing the control system S. The control system S is constituted by a pedal device <NUM>, a headphone <NUM>, and a portable terminal <NUM>. The pedal device <NUM> and the headphone <NUM> are connected by wireless communication, and the pedal device <NUM> and the portable terminal <NUM> are also connected by wireless communication.

The pedal device <NUM> is a device configured to receive an operation of setting (for example, a level of a sound volume, a sound effect, or the like) related to musical performance from a user H who performs music, and create and transmit a control instruction that is information for instructing control to another device (specifically, the headphone <NUM> and the portable terminal <NUM>) based on parameters according to an operation amount thereof. The pedal device <NUM> also has a function of transmitting a control instruction transmitted from the portable terminal <NUM> to the headphone <NUM>, and a function of transmitting a reply to the control instruction of the portable terminal <NUM> transmitted from the headphone <NUM> to the portable terminal <NUM>. These transmissions will be described below with reference to <FIG>.

The headphone <NUM> is an electronic musical instrument configured to output a musical performance sound based on musical performance of an electric guitar G by the user H. The electric guitar G and the headphone <NUM> are wirelessly connected by a music transmission device Gt connected to the electric guitar G. A musical performance signal output when the user H plays the electric guitar G is transmitted to the headphone <NUM> via the music transmission device Gt.

In the headphone <NUM>, a musical performance sound according to the received musical performance signal is output from speakers R and L. Here, a sound effect such as delay or distortion can be added to the output musical performance sound, and a degree of the sound effect is changed according to the parameter from the pedal device <NUM> or the portable terminal <NUM>.

Further, transmission of the musical performance signal to the headphone <NUM> is not limited to the electric guitar G to which the music transmission device Gt is connected, and for example, may be another electric musical instrument or electronic musical instrument such as an electronic drum, an electronic wind instrument, or the like, to which the music transmission device Gt is connected.

The portable terminal <NUM> is an information processing device (a computer) configured to transmit a control instruction to the pedal device <NUM> and the headphone <NUM>. The control instruction input from the portable terminal <NUM> is transmitted to the headphone <NUM> via the pedal device <NUM>. Accordingly, it is possible to control the pedal device <NUM> and the headphone <NUM> from the portable terminal <NUM>.

Here, a configuration of the pedal device <NUM> and the headphone <NUM> will be described with reference to <FIG> is a left side view of the pedal device <NUM>, <FIG> is a right side view of the pedal device <NUM>, and <FIG> is a rear view of the pedal device <NUM>. A pedal switch <NUM>, an operator <NUM>, an LED <NUM>, a DC input terminal <NUM>, a Musical Instrument Digital Interface (MIDI) output terminal <NUM> connected to an external MIDI standard device in a wired manner, and a communication terminal <NUM> connected to an external information processing device in a wired manner are provided on the pedal device <NUM>.

The pedal switch <NUM> is a device provided on an upper section of the pedal device <NUM> and configured to detect an angle when stepped on by the user H's foot. The pedal switch <NUM> is configured like "a seesaw" with a predetermined position as a fulcrum, and the parameter according to the angle of the pedal switch <NUM> changed when stepped on by the user H's foot is output. The parameter is transmitted to the headphone <NUM> and the portable terminal <NUM> through wireless communication. In the embodiment, a MIDI standard control change message (hereinafter, abbreviated as "CC message") configured to include parameters acquired based on the pedal switch <NUM> is transmitted from the pedal device <NUM>.

The pedal device <NUM> is configured such that an angle of the pedal switch <NUM> configured to output a maximum parameter and an angle of the pedal switch <NUM> configured to output a minimum parameter can be calibrated. In addition, the "number" of the CC messages can be switched to a predetermined value by pushing a tip side (a left side of a drawing of <FIG>) of the pedal switch <NUM> with a predetermined pedaling force or more.

The operator <NUM> is an input device configured to receive from the user H an instruction to start pairing with another device or the like, and is provided on a back surface of the pedal device <NUM>. The LED <NUM> is a device configured to output a state of the pedal device <NUM> or a connection state of the headphone <NUM> and the portable terminal <NUM> through color lighting or flickering, and provided on left and right side surfaces and a back surface of the pedal device <NUM>. The DC input terminal <NUM> is a terminal configured to input direct current to the pedal device <NUM>, and provided on a back surface of the pedal device <NUM>. Electric power input from the DC input terminal <NUM> is used for a power source of the pedal device <NUM>. While not shown, when a battery is built in the pedal device <NUM> and direct current is not input from the DC input terminal <NUM>, electric power supplied from the battery is used for the power source of the pedal device <NUM>.

Further, data transmitted from the pedal device <NUM> is not limited to the MIDI standard CC message, and may be another MIDI standard message such as a system exclusive message (hereinafter abbreviated as "a SysEx message").

Next, the headphone <NUM> will be described. <FIG> is an appearance view of the headphone <NUM>. In addition to the speakers R and L, an LED <NUM> configured to output a state of operators <NUM> and the headphone <NUM> or a connection state to the pedal device <NUM> through color lighting or flickering is provided on the headphone <NUM>.

The plurality of operators <NUM> are input devices configured to switch a sound volume of a musical performance sound output by the speakers R and L from the user H and a sound effect added to the musical performance sound, are configured to input various instructions such as a connection start instruction or the like to the pedal device <NUM>, and are provided in the headphone <NUM>. When the music is played by the headphone <NUM>, the operator <NUM> functions to control playing of music such as play/stop, fast forward, or the like.

Next, establishment procedures of communication between the pedal device <NUM>, the headphone <NUM> and the portable terminal <NUM>, and reception and transmission of information will be described with reference to <FIG>. First, an establishment procedure of communication between the pedal device <NUM> and the headphone <NUM> will be described with reference to <FIG>.

<FIG> is a view for describing the establishment procedure of the communication between the pedal device <NUM> and the headphone <NUM>. A communication mode is set for a communication device such as the pedal device <NUM>, the headphone <NUM> and the portable terminal <NUM> of the embodiment, and communication is performed according to the set communication mode. "Central" in which an instruction to another communication device is performed, and "peripheral" in which a reply according to the instruction from the other communication device set as the center is performed are provided as communication modes.

The portable terminal <NUM> of the embodiment is set as central, and the headphone <NUM> is set as peripheral. In the pedal device <NUM>, the peripheral mode is used when communication with the central portable terminal <NUM> is performed, and the central mode is used when communication with the peripheral headphone <NUM> is performed. That is, the pedal device <NUM> is configured to switch between the central and peripheral modes or simultaneously operate them according to a communication mode of the communication partner.

In establishment of communication between the headphone <NUM> and the portable terminal <NUM>, first, the pedal device <NUM> attempts to establish communication with the headphone <NUM> to set as peripheral. Here, the pedal device <NUM> is regarded as the central communication device, and it is confirmed whether an advertising packet AD is received. The advertising packet AD is a signal transmitted when the peripheral communication device establishes communication with the central communication device. The pedal device <NUM> establishes communication with a communication device of an origin of the advertising packet AD when the advertising packet AD is received.

In <FIG>, when the advertising packet AD transmitted from the headphone <NUM> is received by the pedal device <NUM>, first communication w1 that is communication with the headphone <NUM> is established, and the headphone <NUM> and the pedal device <NUM> are paired. An operation performed by the user H on the pedal device <NUM> in this case will be described.

First, when the user H double-clicks the operator <NUM>, a central function and a peripheral function are alternately switched (with a toggle). The central function is a function of connecting the pedal device <NUM> to the peripheral communication device, and the peripheral function is a function of connecting the pedal device <NUM> to the central communication device. In the pedal device <NUM>, a lighting color of the LED <NUM> when the central function is set is white, and a lighting color of the LED <NUM> when the central function is set is blue.

First, the central function will be described. When the central function is switched to by double-clicking the operator <NUM>, a "reception standby mode" in which reception of the advertising packet AD transmitted from the peripheral communication device, i.e., the headphone <NUM>, is on standby is switched to. In the reception standby mode, the LED <NUM> flickers slowly with white light.

In a state of the reception standby mode, a "scan mode" in which the advertising packet AD from the headphone <NUM> is received is switched to by single-clicking the operator <NUM>. In the scan mode, the LED <NUM> flickers quickly with white light. When pairing with the headphone <NUM> by receiving the advertising packet AD from the headphone <NUM> is successful in the scan mode, a "connection complete mode" is switched to. In the connection completion mode, the LED <NUM> shines with white light. The user H can understand a pairing situation with the headphone <NUM> according to such white lighting or flickering of the LED <NUM>.

The control instruction from the central pedal device <NUM> is transmitted to the headphone <NUM> through the first communication w1 established in this way, and a reply from the headphone <NUM> to the control instruction is transmitted to the pedal device <NUM>.

Further, establishment of the first communication w1 with the pedal device <NUM> is not limited to the headphone <NUM>, and may be with another communication device set as peripheral, for example, a portable effecter <NUM>, a type of effecter <NUM> installed on a floor, or the like, in <FIG>. These effecters <NUM> and <NUM> are all connected to the electric guitar G (see <FIG>), and are devices that output the musical performance sound according to the musical performance signal from the electric guitar G in addition to the sound effect.

Next, an establishment procedure of communication between the pedal device <NUM> and the portable terminal <NUM> by a peripheral function will be described with reference to <FIG> is a view for describing an establishment procedure of communication between the pedal device <NUM> and the portable terminal <NUM>. The pedal device <NUM> performs connection to the central communication device, i.e., the portable terminal <NUM>, by the peripheral function.

When the peripheral function is switched to by double-clicking the operator <NUM>, a "transmission standby mode" in which transmission of the advertising packet AD to the portable terminal <NUM> is on standby is switched to. In the transmission standby mode, the LED <NUM> flickers slowly with blue light.

In a state of the transmission standby mode, an "advertising mode" in which the advertising packet AD is transmitted to the portable terminal <NUM> is switched to by single-clicking the operator <NUM>. In the advertising mode, the LED <NUM> flickers quickly with blue light. In a state of the advertising mode, when the pedal device <NUM> is paired with the portable terminal <NUM> in which the transmitted advertising packet AD is received, a "connection complete mode" is switched to. In the connection completion mode, the LED <NUM> shines with blue light. The user H can understand a pairing situation with the portable terminal <NUM> according to such blue light or flickering of the LED <NUM>.

A control instruction from the central portable terminal <NUM> is transmitted to the pedal device <NUM> through second communication w2 established in this way, and a reply according to the control instruction from the pedal device <NUM> is transmitted to the portable terminal <NUM>. While both of the first communication w1 and the second communication w2 are performed based on the Bluetooth (registered trademark) Low Energy (BLE) standard in the embodiment, the first communication w1 or the second communication w2 may be performed based on a communication standard other than the BLE standard.

When the second communication w2 is established, from the fact that information indicating that communication with the headphone <NUM> is established is included in the advertising packet AD, the portable terminal <NUM> can determine that communication with the headphone <NUM> via the pedal device <NUM> is possible. In such a case, "ABC+" is displayed on an LCD <NUM> of the portable terminal <NUM>. Meanwhile, "ABC" (not shown) is displayed on the LCD <NUM> when information indicating that communication with the headphone <NUM> is established is not included in the advertising packet AD.

Here, "ABC" is a name for identifying a device, and for example, a model number, a product ID, or its abbreviation is adopted. The user H can determine at a glance whether the pedal device <NUM> has completed the communication establishment with the headphone <NUM> according to "ABC+" or "ABC" displayed on the LCD <NUM>.

Here, whether the portable terminal <NUM> and the headphone <NUM> are connected via the pedal device <NUM> can also be understood by checking a lighting color, or lighting or flickering of the LED <NUM> of the pedal device <NUM>. Specifically, after it is confirmed from the blue lighting of the LED <NUM> that the pedal device <NUM> attempted to pair with and was paired with the headphone <NUM>, by confirming from the white lighting of the LED <NUM> that the pedal device <NUM> attempted to pair with and was paired with the portable terminal <NUM>, it can be confirmed that the portable terminal <NUM> and the headphone <NUM> are connected. However, since the user H's foot is placed on the pedal device <NUM>, the user H who plays the electric guitar G must put the electric guitar G down once and change his/her posture, such as bending over to see the LED <NUM>.

On the other hand, since the portable terminal <NUM> can be placed in the hand of the user H, the user H can check whether the pedal device <NUM> completes communication establishment with the headphone <NUM> according to the display of "ABC+" or "ABC" without putting the electric guitar that he/she is playing down and further without changing his/her posture. In addition, since the LCD <NUM> on which these are displayed is more flexible and versatile than the LED <NUM>, it is possible to visually present to the user H whether the headphone <NUM> and the portable terminal <NUM> are connected.

Further, the fact that information indicating that communication with the headphone <NUM> is established is included in the advertising packet AD and the fact that the information is not included are not limited to being displayed on the LCD <NUM>, and for example, they may be output as sound or may be output using another method. When output as sound, the fact that the information is included may be output as "ABC+" and sound, and the fact that the information is not included may be output as "ABC" and sound.

In addition, in the portable terminal <NUM>, between the pedal device <NUM> and the headphone <NUM>, the communication device used as a control object is configured to be selectable by switching the application (hereinafter abbreviated as "app"). In <FIG>, since the app using the headphone <NUM> as the control object is executed in the portable terminal <NUM>, "headphone" is displayed on the LCD <NUM>. Meanwhile, when the app using the pedal device <NUM> as the control object is executed in the portable terminal <NUM>, "pedal device" (see <FIG>) is displayed on the LCD <NUM>.

In this way, after the first communication w1 and the second communication w2 are established, an inquiry message IQ of the MIDI standard that is information related to the communication device such as version information or the like of control programs 32a and 52a (see <FIG>) is acquired from the communication device of the control object from the portable terminal <NUM>. Acquisition of the inquiry message IQ will be described with reference to <FIG>.

<FIG> is a view for describing acquisition of the inquiry message IQ from the headphone <NUM> of the portable terminal <NUM>, and <FIG> is a view for describing acquisition of the inquiry message IQ from the pedal device <NUM> of the portable terminal <NUM>. In <FIG>, when the portable terminal <NUM> requests the inquiry message IQ from the headphone <NUM>, first, the portable terminal <NUM> creates identity request data SR that instructs a request of the inquiry message IQ.

The identity request data SR includes "model ID" that represents a name or a type of the communication device that requests the inquiry message IQ, i.e., the communication device using the portable terminal <NUM> as the control object. In <FIG>, since the control object of the portable terminal <NUM> is the headphone <NUM>, a unique ID that specifies the headphone <NUM> is set as the model ID of the identity request data SR.

First, the identity request data SR created in this way is transmitted to the pedal device <NUM> in which the portable terminal <NUM> and the second communication w2 are established. In the pedal device <NUM>, the received identity request data SR is transmitted to the headphone <NUM> through the first communication w1, and the model ID included in the identity request data SR is confirmed.

In <FIG>, since the model ID included in the identity request data SR is "headphone," the pedal device <NUM> determines that the received identity request data SR does not belong to the object itself, and discards the received identity request data SR. That is, the pedal device <NUM> causes the received identity request data SR to pass (through) the headphone <NUM>.

When the headphone <NUM> checks the model ID of the identity request data SR received from the pedal device <NUM> and it belongs thereto, the inquiry message IQ thereof is transmitted to the pedal device <NUM>. Like the identity request data SR, the model ID of the headphone <NUM> is included in such an inquiry message IQ.

The pedal device <NUM> that received the inquiry message IQ from the headphone <NUM> transmits the inquiry message IQ to the portable terminal <NUM>, and checks whether the model ID included in the inquiry message IQ belongs thereto. In <FIG>, since the model ID included in the inquiry message IQ is an ID that specifies the headphone <NUM>, the pedal device <NUM> determines that the received inquiry message IQ does not belong to the object, and discards the received inquiry message IQ.

The portable terminal <NUM> that received the inquiry message IQ from the pedal device <NUM> checks whether the model ID included in the inquiry message IQ belongs thereto. In <FIG>, the model ID included in the inquiry message IQ is an ID that specifies the headphone <NUM>. In this case, the portable terminal <NUM> acquires information related to the headphone <NUM> included in the inquiry message IQ, and then it is used for a control instruction to the headphone <NUM>.

In addition, as shown in <FIG>, like the case in which the control object of the portable terminal <NUM> is the pedal device <NUM> and the inquiry message IQ of the pedal device <NUM> is requested, a unique ID that specifies the pedal device <NUM> is set as the model ID of the identity request data SR transmitted from the portable terminal <NUM>, and the identity request data SR is transmitted to the pedal device <NUM>.

The pedal device <NUM> transmits the received identity request data SR to the headphone <NUM>, and checks the model ID of the identity request data SR. In <FIG>, since the model ID of the identity request data SR is an ID that specifies the pedal device <NUM>, the inquiry message IQ thereof is transmitted to the portable terminal <NUM>. The model ID of the pedal device <NUM> is included in such an inquiry message IQ.

The portable terminal <NUM> that received the inquiry message IQ from the pedal device <NUM> checks whether the model ID included in the inquiry message IQ belongs thereto, and in <FIG>, the model ID included in the inquiry message IQ is an ID that specifies the pedal device <NUM>. In this case, the portable terminal <NUM> acquires information related to the pedal device <NUM> included in the inquiry message IQ, and then it is used for a control instruction to the pedal device <NUM> aft.

Meanwhile, the model ID of the identity request data SR is also checked in the headphone <NUM> that received the identity request data SR from the pedal device <NUM>. In <FIG>, since the model ID of the received identity request data SR is "pedal device" and does not coincide with that of the headphone <NUM>, the received identity request data SR is discarded.

In this way, in the portable terminal <NUM>, after the second communication w2 with the pedal device <NUM> is established, the inquiry message IQ is acquired from the pedal device <NUM> or the headphone <NUM> that is the control object, and then used for the control instruction. Accordingly, immediately after the communication with the control object is established, an appropriate control instruction according to a function or specification included in the control object can be transmitted.

In particular, when the control object of the portable terminal <NUM> is the headphone <NUM>, it is can be specifically understood that the communication device connected via the pedal device <NUM> is the headphone <NUM>. In addition, since the version information of the control program 32a (see <FIG>) of the headphone <NUM> is acquired by the inquiry message IQ, it is possible to check whether the control program 32a is updated to a correct version from the portable terminal <NUM>.

Next, control of the headphone <NUM> and the pedal device <NUM> with the operation of the portable terminal <NUM> will be described with reference to <FIG> is a view for describing control of the headphone <NUM> with the operation of the portable terminal <NUM>, and <FIG> is a view for describing control of the pedal device <NUM> with the operation of the portable terminal <NUM>.

In <FIG>, the case in which the sound volume of the musical performance sound output by the headphone <NUM> from the portable terminal <NUM> is changed will be exemplified. Further, the object that operates the headphone <NUM> from the portable terminal <NUM> is not limited thereto, and for example, a degree of the sound effect of the musical performance sound output by the headphone <NUM> from the portable terminal <NUM> may be operated, and other settings of the headphone <NUM> may be operated.

In <FIG>, when an instruction of updating a sound volume of the headphone <NUM> to <NUM> is input to the portable terminal <NUM> from the user H via a touch panel <NUM> (see <FIG>), the portable terminal <NUM> creates a control instruction RS to request the instruction from the headphone <NUM>. The control instruction RS includes an updated parameter ("sound volume/<NUM>" in <FIG>) and a model ID of the control object (an ID that specifies the headphone <NUM> in <FIG>). The portable terminal <NUM> transmits the MIDI standard SysEx message configured to include such a control instruction RS to the pedal device <NUM>.

The pedal device <NUM> that received the SysEx message transmits the SysEx message to the headphone <NUM>, and checks the model ID included in the control instruction RS of the SysEx message. In <FIG>, since the model ID included in the control instruction RS is an ID that specifies the headphone <NUM> and is not a request for the pedal device <NUM>, the pedal device <NUM> discards the received SysEx message.

The headphone <NUM> that received the SysEx message from the pedal device <NUM> checks the model ID included in the control instruction RS of the SysEx message. In <FIG>, since the model ID included in the control instruction RS is an ID that specifies the headphone <NUM>, the headphone <NUM> updates the sound volume thereof using the parameter ("sound volume/<NUM>") included in the control instruction RS. Accordingly, the sound volume of the headphone <NUM> is updated according to the request from the portable terminal <NUM>.

In <FIG>, the case in which a type of the sound effect controlled by the pedal device <NUM> is changed from the portable terminal <NUM> is exemplified. Further, the change from the portable terminal <NUM> is not limited to the type of the sound effect controlled with the operation of the pedal device <NUM>. For example, the object controlled by the pedal device <NUM> may be changed from the sound effect to the sound volume, or may be changed to the other setting items.

In <FIG>, when the instruction that changes the sound effect controlled by the pedal device <NUM> to "reverberation" is input from the user H to the portable terminal <NUM> via the touch panel <NUM>, the portable terminal <NUM> creates the control instruction RS including the updated parameter (in <FIG>, "sound effect (in the drawings, expressed as "FX")/reverberation") and the model ID of the control object (in <FIG>, an ID that specifies the pedal device <NUM>). The MIDI standard SysEx message configured to include the created control instruction RS is transmitted to the pedal device <NUM>.

The pedal device <NUM> that received the SysEx message transmits the SysEx message to the headphone <NUM>, and checks the model ID included in the control instruction RS of the SysEx message. In <FIG>, since the model ID included in the control instruction RS is an ID that specifies the pedal device <NUM>, the pedal device <NUM> changes the sound effect controlled with the operation of the pedal switch <NUM> thereof using the parameter ("sound effect/reverberation") included in the control instruction RS. Accordingly, the sound effect controlled by the pedal device <NUM> is changed according to the request from the portable terminal <NUM>.

Next, control of the headphone <NUM> with the operation of the pedal device <NUM> will be described with reference to <FIG> is a view for describing control of the headphone <NUM> with the operation of the pedal device <NUM>. In <FIG>, update of the sound volume of the headphone <NUM> according to the operation of the pedal switch <NUM> of the pedal device <NUM> is exemplified. Here, it is assumed that the app using the headphone <NUM> as the control object is also executed in the portable terminal <NUM>.

When the pedal switch <NUM> of the pedal device <NUM> is pushed by the user H's foot, the parameter according to the angle of the pedal switch <NUM> is transmitted to the headphone <NUM> and the portable terminal <NUM>. Here, the MIDI standard CC message including the acquired parameter is transmitted to the headphone <NUM> and the portable terminal <NUM>.

The headphone <NUM> updates the sound volume thereof using the parameter included in the update instruction CC when the CC message including the update instruction CC is received from the pedal device <NUM>.

Then, the parameter included in the update instruction CC and a reply instruction PS including the model ID thereof are created, and the MIDI standard SysEx message including the reply instruction PS is transmitted to the pedal device <NUM>.

The pedal device <NUM> that received the SysEx message including the reply instruction PS transmits the SysEx message to the portable terminal <NUM>, and checks the model ID included in the reply instruction PS of the SysEx message. In <FIG>, since the model ID included in the reply instruction PS is an ID that specifies the headphone <NUM> and not the request for the pedal device <NUM>, the pedal device <NUM> discards the received SysEx message.

In the portable terminal <NUM>, the SysEx message including the update instruction CC and the reply instruction PS is transmitted from the pedal device <NUM>. Among these, while the portable terminal <NUM> discards the update instruction CC, the SysEx message including the reply instruction PS is acquired. When the model ID of the reply instruction PS of the acquired SysEx message is checked and coincides with the control object thereof (in <FIG>, the headphone <NUM>), corresponding settings (in <FIG>, sound volume) are updated using the parameters of the reply instruction PS.

That is, in the portable terminal <NUM>, while the update instruction CC based on the pedal switch <NUM> from the pedal device <NUM> is discarded, the settings thereof are updated by the reply instruction PS transmitted when the parameters are updated based on the update instruction CC based on the pedal switch <NUM> from the pedal device <NUM> in the headphone <NUM>. Accordingly, the settings of the portable terminal <NUM> are updated when the settings of the headphone <NUM> are updated by the update instruction CC of the pedal device <NUM>. Accordingly, the update instruction CC of the pedal device <NUM> can be reliably reflected in the settings of the headphone <NUM> and the portable terminal <NUM>.

Here, in general, the headphone <NUM> can only communicate with one communication device. On the other hand, in the control system S of the embodiment, the headphone <NUM> and the pedal device <NUM> in communication with each other through the first communication w1, and the pedal device <NUM> and the portable terminal <NUM> are in communication with each other through the second communication w2.

Accordingly, the control instruction from the central pedal device <NUM> can be transmitted to the headphone <NUM>, and the control instruction from the central portable terminal <NUM> can be transmitted to the headphone <NUM> through the second communication w2 and the first communication w1. Accordingly, since flexible functions by the portable terminal <NUM>, the pedal device <NUM> and the headphone <NUM> can be provided and two of the pedal device <NUM> and the central portable terminal <NUM> and the one peripheral headphone <NUM> can be in communication with each other without through another communication device, the configuration of the communication device and its costs can be minimized.

In addition, the first communication w1 and the second communication w2 of the embodiment can transmit the control instruction RS from the portable terminal <NUM> and the update instruction CC from the pedal device <NUM> through the same communication route.

Incidentally, in the embodiment, since the control instruction RS or the update instruction CC can be input from each of the pedal device <NUM> and the portable terminal <NUM>, in the pedal device <NUM>, a timing when the control instruction RS from the portable terminal <NUM> is transmitted to the headphone <NUM> and a timing when the update instruction CC is transmitted to the headphone <NUM> based on the pedal switch <NUM> may overlap each other. Processing in such a case will be described with reference to <FIG>.

<FIG> is a view for describing a case in which transmission timings of the control instruction RS and the update instruction CC overlap each other. <FIG> shows a case in which the control instruction RS from the portable terminal <NUM> is first transmitted to the headphone <NUM> by the pedal device <NUM>, the pedal switch <NUM> is operated during transmission thereof, and the update instruction CC is created based on this.

In such a case, after transmission of the control instruction RS that is transmitted in advance is completed, transmission of the update instruction CC is started. Accordingly, even in the case in which timings when the control instruction RS and the update instruction CC from the pedal device <NUM> are transmitted to the headphone <NUM> overlap each other, transmission of the control instruction RS and the update instruction CC to the headphone <NUM> can be reliably completed without missing both or one of them.

Next, a function of the pedal device <NUM> will be described with reference to <FIG> is a function block diagram of the pedal device <NUM>. As shown in <FIG>, the pedal device <NUM> has a first communication unit <NUM>, a reception buffer <NUM>, a transmission buffer <NUM>, a second communication unit <NUM>, a reception buffer <NUM>, a transmission buffer <NUM>, an instruction transmission unit <NUM>, the pedal switch <NUM>, a first storage part <NUM>, a determination unit <NUM>, a modification unit <NUM>, a MIDI message generating part <NUM>, the operator <NUM>, a pairing mode transition part <NUM>, a second storage part <NUM>, a first communication establishment determination part <NUM>, and an advertising packet generating part <NUM>.

The first communication unit <NUM> is a unit configured to wirelessly communicate with the headphone <NUM>, and realized by a CPU <NUM>, which will be described below in <FIG>. The reception buffer <NUM> is configured to temporarily store data received by the first communication unit <NUM>, and realized by a RAM <NUM>, which will be described below in <FIG>. The transmission buffer <NUM> is configured to temporarily store data transmitted from the first communication unit <NUM> and realized by the RAM <NUM>.

The second communication unit <NUM> is a unit configured to wirelessly communicate with the portable terminal <NUM>, and realized by the CPU <NUM>. The reception buffer <NUM> is configured to temporarily store data received by the second communication unit <NUM>, and realized by the RAM <NUM>. The transmission buffer <NUM> is configured to temporarily store data transmitted from the second communication unit <NUM>, and realized by the RAM <NUM>. In addition, data such as a SysEx message from the headphone <NUM> received by the first communication unit <NUM> and stored in the reception buffer <NUM> is transmitted to the transmission buffer <NUM>, and the data is transmitted to the portable terminal <NUM> from the transmission buffer <NUM> via the second communication unit <NUM>.

The instruction transmission unit <NUM> is a unit configured to transmit a CC message (a control instruction) created by the MIDI message generating part <NUM> based on the input from the pedal switch <NUM> and a SysEx message (a second control instruction) received from the portable terminal <NUM> via the second communication unit <NUM> to the headphone <NUM> via the first communication unit <NUM>, and realized by the CPU <NUM>. The instruction transmission unit <NUM> has a serialization part 507a configured to convert the CC message created by the MIDI message generating part <NUM> and the SysEx message received from the portable terminal <NUM> via the second communication unit <NUM> into serial data. The CC message and the SysEx message converted into the serial data by the serialization part 507a are transmitted to the headphone <NUM> via the transmission buffer <NUM> and the first communication unit <NUM>.

In this way, the CC message based on the input from the pedal switch <NUM> and the SysEx message received from the portable terminal <NUM> via the second communication unit <NUM> are transmitted to the headphone <NUM> via the first communication unit <NUM>. Accordingly, even when the headphone <NUM> is only connected to one control device, the headphone <NUM> can be controlled from two control devices of the pedal device <NUM> and the portable terminal <NUM>.

Further, the CC message created by the MIDI message generating part <NUM> and the SysEx message received from the portable terminal <NUM> via the second communication unit <NUM> are converted into serial data by the serialization part 507a, and the CC message and the SysEx message can be transmitted through the same communication route of the first communication unit <NUM>.

Next, creation of the CC message will be described. The first storage part <NUM> is configured to store the model ID or the version information of the pedal device <NUM>, and realized by a flash ROM <NUM>, which will be described below in <FIG>. The determination unit <NUM> is a unit configured to determine whether the SysEx message received from the portable terminal <NUM> via the second communication unit <NUM> and the reception buffer <NUM> is a control instruction thereto, and realized by the CPU <NUM>.

The modification unit <NUM> is a unit configured to change the CC message generated by the MIDI message generating part <NUM> based on the pedal switch <NUM> according to the SysEx message when the SysEx message received by the determination unit <NUM> via the second communication unit <NUM> is a control instruction thereto, and realized by the CPU <NUM>.

The MIDI message generating part <NUM> is configured to create the CC message based on the parameter input from the pedal switch <NUM> and the model ID or the version information of the first storage part <NUM>, and realized by the CPU <NUM>. In the MIDI message generating part <NUM>, when it is determined by the modification unit <NUM> that the SysEx message received by the determination unit <NUM> via the second communication unit <NUM> is the control instruction thereto, the CC message generated by the MIDI message generating part <NUM> based on the pedal switch <NUM> is changed according to the SysEx message. Accordingly, the control object controlled based on the operation of the pedal switch <NUM> can be changed by the SysEx message from the portable terminal <NUM>.

Next, an operation upon establishment of communication with the portable terminal <NUM> will be described. The pairing mode transition part <NUM> is configured to determine whether it is transited to the advertising mode in <FIG> by double-clicking or single-clicking the operator <NUM>, and realized by the CPU <NUM>. The second storage part <NUM> is configured to store information of the pedal device <NUM> ("ABC"), information of the pedal device <NUM> and information showing establishment of communication with the headphone <NUM> ("ABC+"), and realized by the flash ROM <NUM>.

The first communication establishment determination part <NUM> is configured to acquire information from the second storage part <NUM> according to whether communication with the headphone <NUM> is established by the first communication unit <NUM>, and realized by the CPU <NUM>. Specifically, the first communication establishment determination part <NUM> acquires information of the pedal device <NUM> from the second storage part <NUM> when communication with the headphone <NUM> is not established by the first communication unit <NUM>, and acquires information of the pedal device <NUM> from the second storage part <NUM> and information that communication with the headphone <NUM> is established when communication with the headphone <NUM> is established by the first communication unit <NUM>.

The advertising packet generating part <NUM> is configured to create the advertising packet AD based on the information acquired from the first communication establishment determination part <NUM> when it is determined that the mode is transited to the advertising mode by the pairing mode transition part <NUM> and transmit the advertising packet AD to the portable terminal <NUM> via the second communication unit <NUM>, and realized by the CPU <NUM>. The advertising packet AD generated by the advertising packet generating part <NUM> is transmitted to the portable terminal <NUM> via the transmission buffer <NUM> and the second communication unit <NUM>.

That is, the advertising packet AD transmitted from the advertising packet generating part <NUM> to the portable terminal <NUM> includes information showing that information of the pedal device <NUM> and communication with the headphone <NUM> are established when communication with the headphone <NUM> is established by the first communication unit <NUM>. Accordingly, it can be determined that the portable terminal <NUM> connected to the headphone <NUM> is communicable with the headphone <NUM> via the pedal device <NUM> in actuality.

Next, an electric configuration of the control system S will be described with reference to <FIG> is a block diagram showing the electric configuration of the control system S. The headphone <NUM> has a CPU <NUM>, a flash ROM <NUM>, and a RAM <NUM>, which are connected to an input/output port <NUM> via a bus line <NUM>. A music reception device <NUM>, the operator <NUM> and the LED <NUM>, an amplifier <NUM>, a wireless communication device <NUM> in wireless communication with the pedal device <NUM>, and a gyrosensor <NUM> are further connected to the input/output port <NUM>.

The CPU <NUM> is an arithmetic operation device configured to control the respective parts connected by the bus line <NUM>. The flash ROM <NUM> is a rewritable non-volatile storage device in which a program executed by the CPU <NUM>, fixed value data, or the like, is stored, and in which the control program 32a and model ID data 32b in which the model ID of the headphone <NUM> is stored are stored. When the control program 32a is executed by the CPU <NUM>, the headphone processing of <FIG> is executed. The RAM <NUM> is a memory configured to rewritably store various work data, flags, or the like when the CPU <NUM> executes the program.

The music reception device <NUM> is a device configured to receive a musical performance signal from the music transmission device Gt through wireless communication. The amplifier <NUM> is a device configured to amplify the musical performance sound created by the CPU <NUM>. The speakers R and L are connected to the amplifier <NUM>, and the musical performance sound amplified by the amplifier <NUM> is output to the speakers R and L. The gyrosensor <NUM> is a sensor configured to detect an angular speed, and upward, downward, forward, rearward, leftward and rightward movements, inclinations and rotations of the head of the user H who wears the headphone <NUM> are detected.

The headphone <NUM> is configured such that a mixed sound of the musical performance sound ("first music") based on the musical performance signal input from the electric guitar G via the music reception device <NUM> and the music ("second music") input from the portable terminal <NUM> or the like via the wireless communication device <NUM> can be output.

Further, in the mixed sound, at least one of the first music and the second music is configured such that a virtual position at which the music is output can be changed according to the movement or inclination of the head of the user H detected by the gyrosensor <NUM>. For example, the second music is used as the drum sound, a virtual position at which the drum sound is output is set behind the user H who plays the electric guitar G, and thus, even when an inclination of the head of the user H who wears the headphone <NUM> and plays the electric guitar G is changed, the user H sounds like the drum sound is always output from behind.

Next, an electric configuration of the pedal device <NUM> of the control system S will be described. The pedal device <NUM> has the CPU <NUM>, the flash ROM <NUM> and the RAM <NUM>, which are connected to an input/output port <NUM> via a bus line <NUM>. The pedal switch <NUM>, the operator <NUM> and the LED <NUM>, and a wireless communication device <NUM> configured to wirelessly communicate with the headphone <NUM> and the portable terminal <NUM> are further connected to the input/output port <NUM>.

The CPU <NUM> is an arithmetic operation device configured to control the respective parts connected by the bus line <NUM>. The flash ROM <NUM> is a rewritable non-volatile storage device in which a program executed by the CPU <NUM>, fixed value data, or the like, is stored, and in which a control program 11a and model ID data 11b in which the model ID of the headphone <NUM> is stored are stored. When the control program 11a is executed by the CPU <NUM>, pedal processing of <FIG> is executed.

The RAM <NUM> is a memory configured to rewritably store various work data, flags, or the like, when the CPU <NUM> executes the program, in which a transmission data memory 12a configured to store the SysEx message received from the headphone <NUM> or the portable terminal <NUM> and a transmission destination thereof, and a musical performance data memory 12b configured to store a CC message created based on the pedal switch <NUM> are provided.

Next, an electric configuration of the portable terminal <NUM> of the control system S will be described. The portable terminal <NUM> has a CPU <NUM>, a flash ROM <NUM> and a RAM <NUM>, which are connected to an input/output port <NUM> via a bus line <NUM>. A wireless communication device <NUM> configured to wirelessly communicate with the pedal device <NUM>, the touch panel <NUM> to which an instruction from the user H is input, and the LCD <NUM> are further connected to the input/output port <NUM>.

The CPU <NUM> is an arithmetic operation device configured to control the respective parts connected by the bus line <NUM>. The flash ROM <NUM> is a rewritable non-volatile storage device configured to store a program executed by the CPU <NUM>, fixed value data, or the like, and in which a control program 52a is stored. When the control program 52a is executed by the CPU <NUM>, portable terminal processing of <FIG> is executed. More specifically, the control program 52a includes an app using the pedal device <NUM> as the control object and an app using the headphone <NUM> as the control object, and portable terminal processing according to the app started according to the operation of the touch panel <NUM> is executed. Details of the portable terminal processing will be described below with reference to <FIG>.

The RAM <NUM> is a memory configured to rewritably store various work data, flags, or the like, when the CPU <NUM> executes the program, and in which an IQ memory 53a configured to store the inquiry message IQ is provided.

Next, processing of the control system S will be described with reference to <FIG>. First, processing executed by the CPU <NUM> of the headphone <NUM> will be described. <FIG> is a flowchart of headphone processing. The headphone processing is processing executed when the power source of the headphone <NUM> is turned on.

The headphone processing first checks whether a connection start operation is performed to start connection of another communication device such as the pedal device <NUM> or the like from the user H to the operator <NUM> (S1). Specifically, when the operator <NUM> is pressed and elongated, it is determined that the connection start operation is performed. In the processing of S1, when the connection start operation is performed (S1: Yes), peripheral connection processing (S2) is executed. Here, the peripheral connection processing will be described with reference to <FIG>.

<FIG> is a flowchart of the peripheral connection processing. The peripheral connection processing is performed by the CPU <NUM> of the headphone <NUM>, and equivalent processing is also performed by the CPU <NUM> of the pedal device <NUM>.

In the peripheral connection processing, first, in <FIG>, the advertising packet AD is transmitted to another communication device (S20). Transmission of the advertising packet AD to the other communication device is performed using the wireless communication device <NUM> in the case of the headphone <NUM>, and performed using the wireless communication device <NUM> in the case of the pedal device <NUM>. Hereinafter, communication with the other communication device in the peripheral connection processing is performed using the wireless communication device <NUM> in the case of the headphone <NUM>, and performed using the wireless communication device <NUM> in the case of the pedal device <NUM>.

After processing of S20, it is checked whether the connection request from the other communication device is received according to the advertising packet AD transmitted in the processing of S20 (S21). In the processing of S21, when the connection request is received (S21: Yes), connection processing to the other communication device to which the connection request is transmitted (i.e., the pedal device <NUM> or the portable terminal <NUM>) is performed (S22).

Meanwhile, in the processing of S21, when the connection request is not received (S21: No), it is checked whether a predetermined time or more elapses from the transmission start of the advertising packet AD in the processing of S20 (S23). In the processing of S23, when the predetermined time or more does not elapse from the transmission start of the advertising packet AD (S23: No), the processing after S20 is executed again. After the processing of S22 or in the processing of S23, when the predetermined time or more elapses from the transmission start of the advertising packet AD (S23: Yes), the peripheral connection processing is terminated.

Returning to <FIG>, in the processing of S1, when the connection start operation is not performed (S1: No) or after the peripheral connection processing of S2, it is checked whether the identity request data SR is received in <FIG> (S3). In the processing of S3, when the identity request data SR is received (S3: Yes), the identity request reply processing is executed (S4). Here, the identity request reply processing will be described with reference to <FIG>.

<FIG> is a flowchart of the identity request reply processing. The identity request reply processing is executed by the CPU <NUM> of the headphone <NUM>, and equivalent processing is also executed by the CPU <NUM> of the pedal device <NUM>.

In the identity request reply processing, first, it is checked whether the model ID of the received the identity request data SR belongs to the device itself (S30). Specifically, in the case of the model ID included in the identity request data SR, the model ID of the device itself, i.e., the headphone <NUM>, the model ID of the model ID data 11b is compared with the model ID of the model ID data 32b or the pedal device <NUM>, and it is checked whether the IDs coincide with each other.

In the processing of S30, when the model ID of the identity request data SR belongs to the device itself (S30: Yes), the inquiry message IQ of the device itself is created (see <FIG>), and the created inquiry message IQ is transmitted (returned) to the transmission source of the identity request data SR, i.e., the pedal device <NUM> or the portable terminal <NUM> (S31). The transmission is performed using the wireless communication device <NUM> in the case of the headphone <NUM> and performed using the wireless communication device <NUM> in the case of the pedal device <NUM>.

Meanwhile, in the processing of S30, when the model ID of the identity request data SR does not belong to the device itself (S30: No), the received identity request data SR is discarded (S32). After the processing of S31 and S32, the identity request reply processing is terminated.

Returning to <FIG>, in the processing of S3, when the identity request data SR is not received or after the processing of S4, it is checked whether the SysEx message is received (S5). In the processing of S5, when the SysEx message is received (S5: Yes), it is checked whether the model ID of the control instruction RS in the SysEx message coincides with the model ID of the model ID data 32b (S6).

In the processing of S6, when the model ID of the control instruction RS in the SysEx message coincides with the model ID of the model ID data 32b (S6: Yes), the settings thereof are updated using the parameters included in the control instruction RS of the SysEx message (S7). Meanwhile, when the model ID of the control instruction RS in the SysEx message does not coincide with the model ID of the model ID data 32b (S6: No), the received SysEx message is discarded (S8).

In the processing of S5, when the SysEx message is not received (S5: No) or after the processing of S7 and S8, it is checked whether the CC message (see <FIG>) is received in <FIG> (S9). In the processing of S9, when the CC message is received (S9: Yes), it is checked whether the headphone <NUM> is in a mode in which the settings thereof are updated by the received CC message (S10).

In the processing of S10, when it is the mode in which the settings thereof are updated by the received CC message (S10: Yes), the settings thereof are updated using the parameters of the update instruction CC included in the CC message (S11).

After the processing of S11, the reply instruction PS (see <FIG>) is created from the parameter of the update instruction CC of the CC message received in the processing of S9 and the model ID of the model ID data 32b, and the SysEx message to which the reply instruction PS is assembled is transmitted (returned) to the transmission source of the CC message, i.e., the pedal device <NUM> (S12). Meanwhile, in the processing of S10, when it is not in the mode in which the settings thereof are updated by the received CC message (S10: No), the received CC message is discarded (S13).

In the processing of S9, when the CC message is not received (S9: No), after the processing of S12 and S13, inherent processing (S14) is executed. The inherent processing is another processing performed in the headphone <NUM>, and for example, the musical performance sound based on the musical performance signal input from the electric guitar G via the music reception device <NUM> or the musical performance sound input from the portable terminal <NUM> via the pedal device <NUM> is output to the speakers R and L via the amplifier <NUM>. After the inherent processing of S14, the processing after S1 is repeated.

Next, the processing executed by the CPU <NUM> of the pedal device <NUM> will be described. <FIG> is a flowchart of pedal processing. The pedal processing is processing executed when the power source of the pedal device <NUM> is turned on.

In the pedal processing, first, it is checked whether a connection scan start operation of instructing start of reception of the advertising packet AD from the other communication device (specifically, the headphone <NUM>) is performed (S50). Specifically, as described in <FIG>, when it is transited to the scan mode by double-clicking the operator <NUM> by the user H until the lighting color of the LED <NUM> is white (i.e., the central function) and then single-clicking the operator <NUM> by the user H, it is determined that the connection scan start operation is performed. In the processing of S50, when the connection scan start operation is performed (S50: Yes), central connection processing (S51) is executed. Here, the central connection processing will be described with reference to <FIG>.

<FIG> is a flowchart of the central connection processing. The central connection processing is executed by the CPU <NUM> of the pedal device <NUM>, and equivalent processing is also executed by the CPU <NUM> of the portable terminal <NUM>. In the central connection processing, first, reception of the advertising packet AD is started (S70). Reception of the advertising packet AD is performed using the wireless communication device <NUM> in the case of the pedal device <NUM> and performed using the wireless communication device <NUM> in the case of the portable terminal <NUM>. Hereinafter, communication with the other communication device in the central connection processing is performed using the wireless communication device <NUM> in the case of the pedal device <NUM> and performed using the wireless communication device <NUM> in the case of the portable terminal <NUM>.

After the processing of S70, it is checked whether the advertising packet AD is received from the other communication device (S71). In the processing of S71, when the advertising packet AD is received (S71: Yes), a connection request is transmitted to the communication device to which the advertising packet AD is received (S72), and the connection processing to the communication device is performed (S73).

In the processing of S71, when the advertising packet AD is not received (S71: No), it is checked whether a predetermined time or more elapses from reception start of the advertising packet AD in the processing of S70 (S74). In the processing of S74, when the predetermined time or more does not elapse from the reception start of the advertising packet AD (S74: No), the processing after S70 is repeated.

Meanwhile, in the processing of S74, when the predetermined time or more elapses from the reception start of the advertising packet AD (S74: Yes) or after the processing of S73, the central connection processing is terminated. The first communication w1 with the headphone <NUM> and the pedal device <NUM> or the second communication w2 with the pedal device <NUM> and the portable terminal <NUM> is established by such central connection processing and the above-mentioned peripheral connection processing.

Returning to <FIG>, in the processing of S50, when the connection scan start operation is not performed (S50: No) or after the central connection processing of S51, it is checked whether the connection start operation is performed from the operator <NUM> (S52). Specifically, as described above in <FIG>, when it is transited to the advertising mode by double-clicking the operator <NUM> by the user H until the lighting color of the LED <NUM> is blue (i.e., the peripheral function) and single-clicking the operator <NUM> by the user H, it is determined that the connection start operation is performed. In the processing of S52, when the connection start operation is performed (S52: Yes), it is confirmed whether communication with the other communication device is established in the central connection processing of S51 (S53).

In the processing of S53, when communication with the other communication device is established in the central connection processing (S53: Yes), the information thereof and the information of the communication device in which communication is established (see <FIG>) are added to advertising packet AD (S54). In the processing of S53, when communication with the other communication device is established in the central connection processing (S53: No), the information thereof is added to the advertising packet AD (S55). After the processing of S54 and S55, the peripheral connection processing of S2 is executed.

In the processing of S52, when the connection start operation is not performed (S52: No) or after the processing of S2, it is confirmed whether the identity request data SR (see <FIG>) is received (S56). In the processing of S55, when the identity request data SR is received (S56: Yes), the identity request reply processing (S4) is executed. In the processing of S56, when the identity request data SR is not received (S56: No), the processing of S4 is skipped. After the processing of S4 and S56, pedal device reception and transmission processing (S57) is executed, and the processing after S50 is repeated. Here, the pedal device reception and transmission processing will be described with reference to <FIG>.

<FIG> is a flowchart of the pedal device reception and transmission processing. In the pedal device reception and transmission processing, first, it is checked whether the SysEx message is received (S80). In the processing of S80, when the SysEx message is received (S80: Yes), the received SysEx message is stored in the transmission source of the SysEx message and the transmission data memory 12a (S81). The transmission source of the SysEx message is specifically set to the headphone <NUM> when the SysEx message is received from the portable terminal <NUM> and set to the portable terminal <NUM> when the SysEx message is received from the headphone <NUM>.

After the processing of S81, it is checked whether the model ID of the control instruction RS in the SysEx message coincides with the model ID of the model ID data 11b (S82). In the processing of S82, when the model ID of the control instruction RS in the SysEx message coincides with the model ID of the model ID data 11b (S82: Yes), the settings thereof are updated using the parameters included in the control instruction RS of the SysEx message (S83). Accordingly, for example, when the control instruction RS of the SysEx message received from the portable terminal <NUM> changes the sound effect controlled by the pedal device <NUM> to "delay," after that, the sound effect that controls the effect size is changed to "delay" by the pedal switch <NUM> of the pedal device <NUM>.

Meanwhile, When the model ID of the control instruction RS in the SysEx message does not coincide with the model ID of the model ID data 11b (S82: No), the received SysEx message is discarded (S84).

In the processing of S80, when the SysEx message is not received (S80), after the processing of S83 and S84, it is checked whether the pedal switch <NUM> is operated (S85). In the processing of S85, when the pedal switch <NUM> is operated (S85: Yes), a parameter according to the angle is acquired from the pedal switch <NUM> and the update instruction CC based on the acquired parameter is created. The CC message including the created update instruction CC is created (S86). After the processing of S86, the created CC message is stored in the musical performance data memory 12b (S87).

In the processing of S85, when the pedal switch <NUM> is not operated (S85: No) or after the processing of S87, it is checked whether the SysEx message during non-transmission or transmission is present in the transmission data memory 12a (S88). In the processing of S88, where the SysEx message during non-transmission or transmission is present in the transmission data memory 12a (S88: Yes), the SysEx message of the transmission data memory 12a is transmitted to the transmission source stored in the transmission data memory 12a (S89).

Meanwhile, in the processing of S88, when the SysEx message during non-transmission or transmission is not present in the transmission data memory 12a (S88: No), it is checked whether the CC message during non-transmission or transmission is present in the musical performance data memory 12b (S90).

In the processing of S90, when the CC message during non-transmission or transmission is present in the musical performance data memory 12b (S90: Yes), the CC message of the musical performance data memory 12b is transmitted to each communication device connected to the pedal device <NUM> (S91). Meanwhile, in the processing of S90, when the CC message during non-transmission or transmission is not present in the musical performance data memory 12b (S90: No), the processing of S91 is skipped.

That is, in a state in which the SysEx message is received from the portable terminal <NUM> or the headphone <NUM> and the received SysEx message is in non-transmission or transmission, even when the pedal switch <NUM> is operated and the CC message is created, after completion of transmission of the SysEx message received in advance, transmission of the CC message created after that is started. As the SysEx message and the CC message received in this way are serialized for transmission, the SysEx message and the CC message can be transmitted to the same communication route (the first communication w1or the second communication w2).

After the processing of S89, S90 and S91, the pedal device reception and transmission processing is terminated.

Next, the processing executed by the CPU <NUM> of the portable terminal <NUM> will be described. <FIG> is a flowchart of the portable terminal processing. The portable terminal processing is processing executed when a starting instruction of an app using the pedal device <NUM> as the control object or an app using the headphone <NUM> as the control object is input with the operation of the user H via the touch panel <NUM>.

In the portable terminal processing, first, it is checked from the touch panel <NUM> whether a connection scan start operation that instructs to start reception of the advertising packet AD from the other communication device (specifically, the pedal device <NUM>) is performed (S100). Specifically, in the portable terminal <NUM>, after starting of the app using the pedal device <NUM> as the control object and the app using the headphone <NUM> as the control object, when a button (not shown) that starts connection scan displayed on the LCD <NUM> is displayed and the button is selected via the touch panel <NUM>, it is determined that the connection scan start operation is performed. In the processing of S100, when the connection scan start operation is performed (S100: Yes), the central connection processing (S51) is executed.

After the central connection processing of S51, it is checked whether information of the communication device in which communication is established is included in the advertising packet AD received in the central connection processing (S101). In the processing of S105, when the information of the communication device in which communication is established is included in the advertising packet AD (S101: Yes), "ABC+" is displayed on the LCD <NUM> (S102). Meanwhile, in the processing of S105, when the information of the communication device in which communication is established is not included in the advertising packet AD (S101: No), "ABC" is displayed on the LCD <NUM> (S103).

After the processing of S102 and S103, the identity request data SR is created based on the model ID of the control object (i.e., the pedal device <NUM> or the headphone <NUM>) of the app that is starting, and transmitted to the connected communication device (specifically, the pedal device <NUM>) (S104).

In the processing of S100, when the connection scan start operation is not performed (S100: No) or after the processing of S104, it is checked whether the inquiry message IQ is received (S105). In the processing of S105, when the inquiry message IQ is received (S105: Yes), the received inquiry message IQ is stored in the IQ memory 53a (S106). Meanwhile, in the processing of S105, when the inquiry message IQ is not received (S105: No), the processing of S106 is skipped.

After the processing of S105 and S106, portable terminal reception and transmission processing (S107) is executed, and the processing after S100 is repeated. Here, the portable terminal reception and transmission processing will be described with reference to <FIG>.

<FIG> is a flowchart of the portable terminal reception and transmission processing. In the portable terminal reception and transmission processing, first, it is checked whether the SysEx message is received (S120). In the processing of S120, when the SysEx message is received (S120: Yes), it is checked whether the model ID of the control instruction RS in the SysEx message coincides with the model ID of the control object of the app that is starting (S121).

In the processing of S121, when the model ID of the control instruction RS in the SysEx message coincides with the model ID of the control object of the app that is starting (S121: Yes), the settings thereof are updated using the parameter included in the control instruction RS of the SysEx message (S122). Meanwhile, when the model ID of the control instruction RS in the SysEx message does not coincide with the model ID of the control object of the app that is starting (S121: No), the received SysEx message is discarded (S123).

In the processing of S120, when the SysEx message is not received (S120: No) or after the processing of S122 and S123, it is checked whether the CC message is received (S124). In the processing of S124, when the CC message is received (S124: Yes), it is checked whether it is in a mode in which the settings thereof is updated by the CC message (S125).

In the processing of S125, when it is in a mode in which the settings thereof are updated by the CC message (S125: Yes), the settings thereof are updated using the parameter of the update instruction CC included in the CC message (S126).

Meanwhile, in the processing of S125, when it is not the mode in which the settings thereof are updated by the received CC message (S125: No), the received CC message is discarded (S127).

In the processing of S124, when the CC message is received (S124: Yes) or after the processing of S126 and S127, it is checked whether the parameter (for example, a type of the sound volume in <FIG> or the sound effect in <FIG>) is input from the user H via the touch panel <NUM> (S128). In the processing of S128, when the parameter is input (S128: Yes), the settings thereof are updated using the input parameter (S129).

After the processing of S129, the control instruction RS is created from the input parameter, the model ID of the control object of the app that is starting, and the inquiry message IQ of the IQ memory 53a. The SysEx message including the created control instruction RS is created and transmitted to the connected communication device (specifically, the pedal device <NUM>) (S130). Accordingly, the control instruction RS from the portable terminal <NUM> is transmitted to the pedal device <NUM> and the headphone <NUM>.

In the processing of S128, when the parameter is not input from the touch panel <NUM> (S128: No) or after the processing of S130, the portable terminal reception and transmission processing is terminated.

Hereinabove, while the present invention has been described based on the embodiment, it can be easily inferred that various improvements and modifications are possible.

In the embodiment, while the headphone <NUM> or the effecters <NUM> and <NUM> (see <FIG>) has been exemplified as the device connected to the pedal device <NUM> and the portable terminal <NUM>, there is no limitation thereto. The electronic musical instrument other than the headphone <NUM> or the effecters <NUM> and <NUM> may be connected to, for example, a synthesizer <NUM> shown in <FIG>. That is, in a control system S' shown in <FIG>, the first communication w1 is established by the synthesizer <NUM> and the pedal device <NUM>.

A musical score is displayed on the LCD <NUM> of the portable terminal <NUM> in the variant. A position of the displayed musical score is changed with the operation of the touch panel <NUM>. Here, the position of the musical score displayed on the LCD <NUM> is also changed with the operation of the pedal switch <NUM> of the pedal device <NUM>.

Mainly, a keyboard <NUM>, a setting key <NUM> configured to input various settings, and a musical score LCD <NUM> are disposed in the synthesizer <NUM> in the variant. A plurality of keys 354a are disposed on the keyboard <NUM>, which is an input device configured to acquire musical performance information according to musical performance of the user H. MIDI standard musical performance information according to key pushing/releasing operations of the keys 354a by the user H is output to a CPU <NUM> (see <FIG>).

The musical score LCD <NUM> is a display device configured to display the same musical score as the musical score displayed on the LCD <NUM> of the portable terminal <NUM>. The musical score displayed on the musical score LCD <NUM> and the display position thereof are transmitted from the portable terminal <NUM> and the pedal device <NUM>.

That is, when the display position of the musical score is changed by the portable terminal <NUM> or when the display position of the musical score is changed by the pedal switch <NUM> of the pedal device <NUM>, the same musical score as the musical score displayed on the LCD <NUM> of the portable terminal <NUM> is displayed on the musical score LCD <NUM>. Accordingly, the display position of the musical score of the synthesizer <NUM> that is one can be changed from the portable terminal <NUM> and the pedal device <NUM> that are two. In particular, since the pedal switch <NUM> of the pedal device <NUM> is operated by the stepping of the user H, the user H can change the display position of the musical score of the musical score LCD <NUM> without releasing his/her hand from the keyboard <NUM>.

Next, an electric configuration of the control system S' in the variant will be described with reference to <FIG> is a block diagram showing the electric configuration of the control system S'. The synthesizer <NUM> of the control system S' has the CPU <NUM>, a flash ROM <NUM> <IMG> and a RAM <NUM>, which are connected via a bus line <NUM>. The keyboard <NUM>, the setting key <NUM> and the musical score LCD <NUM>, a wireless communication device <NUM> configured to wirelessly communicate with the pedal device <NUM>, a sound source <NUM>, and a digital signal processor360 (hereinafter, referred to as "the DSP <NUM>") are further connected to the bus line <NUM>. The DSP <NUM> is also connected to the sound source <NUM>.

The CPU <NUM> is an arithmetic operation device configured to control the respective parts connected by the bus line <NUM>. The flash ROM <NUM> is a rewritable non-volatile storage device in which a program executed by the CPU <NUM>, fixed value data, or the like, are stored, and model ID data 352b in which a control program 352a and a model ID are stored is stored therein. When the control program 352a is executed by the CPU <NUM>, the same processing as the headphone processing in <FIG> is executed. Further, in inherent processing (S14) in the headphone processing, while inherent processing of the synthesizer <NUM> is executed, details will be described below with reference to <FIG>.

The RAM <NUM> is a memory configured to rewritably store various work data, flags, or the like, when the CPU <NUM> executes the program. The sound source <NUM> is a device configured to output waveform data according to the musical performance information output from the CPU <NUM>. The DSP <NUM> is an arithmetic operation device configured to perform arithmetic operation processing of the waveform data output from the sound source <NUM>. A digital-analog converter (DAC) <NUM> is connected to the DSP <NUM>, an amplifier <NUM> is connected to the DAC <NUM>, and speakers <NUM> are connected to the amplifier <NUM>.

Next, processing executed by the CPU <NUM> of the synthesizer <NUM> will be described. In the synthesizer <NUM>, processing related to communication with the pedal device <NUM> and the portable terminal <NUM> is substantially the same as the processing of the headphone <NUM> except the connection start operation (S1) and the inherent processing (S14) of the headphone processing in <FIG> in the embodiment. In the synthesizer <NUM>, by long pressing the predetermined setting key <NUM>, it is determined that the connection start operation in the processing of S1 in the headphone processing is performed.

Next, the inherent processing (S14) of the synthesizer <NUM> will be described. <FIG> is a flowchart of the inherent processing of the synthesizer <NUM> according to the variant. In the inherent processing of the synthesizer <NUM>, first, switch event processing is performed (S200). In the switch event processing, it is checked whether the setting key <NUM> is operated, and when the setting key <NUM> is operated, processing according to the setting key <NUM> is performed.

After the processing of S200, keyboard event processing (S201) is performed. In the keyboard event processing, in the keyboard <NUM>, which the keys 354a is pressed or released is detected. After the processing of S201, MIDI processing is performed (S202). In the MIDI processing, output of the musical performance sound and stoppage of the output are performed according to the operations of the keys 354a detected in the processing of S201, and the musical score displayed on the musical score LCD <NUM> or the display position of the musical score is acquired from the update instruction CC from the pedal device <NUM> or the parameter included in the control instruction RS of the portable terminal <NUM>.

After the processing of S202, automatic musical performance processing (S203) is performed. In the automatic musical performance processing, concert magic musical performance processing, automatic accompaniment processing, demonstration processing, and the like, are performed. After the processing of S203, musical score display processing (S204) is performed. In the musical score display processing, an image of the musical score is created based on the musical score acquired in the MIDI processing and the display position of the musical score, and displayed on the musical score LCD <NUM>. Accordingly, the same musical score as the musical score displayed on the LCD <NUM> of the portable terminal <NUM> is displayed on the musical score LCD <NUM>. After the processing of S204, the other processing (S205) related to the synthesizer <NUM> is performed, and inherent processing is terminated.

Further, in the variant, while the configuration in which the musical score displayed on the LCD <NUM> of the portable terminal <NUM> is displayed on the musical score LCD <NUM> of the synthesizer <NUM> and the position of the musical score displayed on the musical score LCD <NUM> is changed with the operations from the pedal device <NUM> and the portable terminal <NUM> has been exemplarily described, there is no limitation thereto. For example, in the musical score displayed on the LCD <NUM> and the musical score LCD <NUM>, a display aspect (for example, a size of color, a musical note, or the like, and marking) of the musical note or the like to be played currently may be changeable, or the musical note or the like that changes a display aspect according to the operations of the portable terminal <NUM> and the pedal device <NUM> may be changed (advanced, retracted, or the like). In addition, the sound volume of the musical performance sound output by the synthesizer <NUM> or a degree or a type of the sound effect added to the musical performance sound may be changed with the operations of the portable terminal <NUM> and the pedal device <NUM>.

While the pedal device <NUM> having the pedal switch <NUM> as the control device has been defined in the embodiment, other examples departing from the scope of the claims are possible. For example, the control device may be a device having a switch configured to switch an ON/OFF state, or a device having "a knob" or a fader that can variably control the output parameter. In addition, a device using the sensor information (for example, a device configured to acquire a variation of an acceleration sensor and control the control object according to the variation) may be a control device, or a device configured to set the other parameters may be a control device.

Claim 1:
A control device (<NUM>) configured to control an electronic musical instrument (<NUM>, <NUM>, <NUM>, <NUM>), comprising:
an input unit (<NUM>) configured to receive a control instruction;
a first communication unit (S89) configured to wirelessly communicate with the electronic musical instrument (<NUM>, <NUM>, <NUM>, <NUM>);
a second communication unit (S91) configured to wirelessly communicate with a second control device (<NUM>) that controls the electronic musical instrument (<NUM>, <NUM>, <NUM>, <NUM>); and
an instruction transmission unit (S89, S91) configured to transmit the control instruction received by the input unit (<NUM>) and a second control instruction received from the second control device (<NUM>) via the second communication unit (S91) to the electronic musical instrument (<NUM>, <NUM>, <NUM>, <NUM>) via the first communication unit (S89),
characterised in that
the control device (<NUM>) is a pedal device comprising a pedal switch (<NUM>) treated as the input unit, and
the second control device (<NUM>) is a portable terminal.