Patent Description:
<CIT> discloses a laptop PC connected to a plurality of microphones. The laptop PC includes a CPU. The laptop PC stores a control table in which a device ID corresponding to each of the plurality of microphones is registered. The CPU puts a microphone corresponding to the device ID registered in the control table into the same mute state by a single operation.

In a microphone system including a plurality of microphones, a certain talker (hereinafter, referred to as a talker A), when muting on the own microphone, may assume that the own voice has not reached a telephone call partner and may engage in a conversation desired not to be heard by the telephone call partner. At this time, a different microphone present in the same space as a space in which the talker A is present may be muted off. In such a case, the different microphone collects a conversation of the talker A. As a result, the different microphone may cause the conversation of the talker A to be heard by the telephone call partner. <CIT> proposes, when a microphone is muted, to mute all microphones and display a muted indicator at all of them.

In view of the foregoing, an embodiment of the present disclosure present is directed to provide a microphone state display method capable of preventing a talker from mistakenly assuming that a telephone call partner cannot hear since a microphone is in a muted-on state.

A microphone state display method according to an embodiment of the present disclosure receives a mute-on or a mute-off operation by each of a plurality of microphones, displays a state of a microphone that has received the mute-off operation as a first state on a display, when receiving the mute-on operation, in a case in which at least one microphone among the plurality of microphones is in a mute-off state, displays a state of a microphone that has received the mute-on operation as a second state on the display, and, when receiving the mute-on operation, in a case in which all of the plurality of microphones are in a mute-on state, displays the state of the microphone that has received the mute-on operation as a third state on the display.

According to a microphone state display method according to an embodiment of the present disclosure, a talker can be prevented from mistakenly assuming that a telephone call partner cannot hear since a microphone is in a muted-on state.

Hereinafter, a management apparatus <NUM> that executes a microphone state display method according to a first embodiment of the present disclosure will be described with reference to the drawings. <FIG> is a block diagram showing an example of connection of the management apparatus <NUM>, microphones <NUM>, <NUM>, and <NUM>, and a PC <NUM>. <FIG> is a block diagram showing a configuration of the management apparatus <NUM>.

The management apparatus <NUM> is used for a remote conversation, for example. As shown in <FIG>, the management apparatus <NUM> connects the plurality of microphones <NUM>, <NUM>, and <NUM>. Each of the plurality of microphones <NUM>, <NUM>, and <NUM> obtains an audio signal according to voice of talkers U20, U21, and U22, and sends the audio signal to the management apparatus <NUM>. The management apparatus <NUM> performs various types of signal processing on an obtained audio signal, and sends the audio signal to the PC <NUM>. The PC <NUM> sends a received audio signal to an information processing apparatus (not shown) such as a PC on a far-end side, through a communication line. In addition, the PC <NUM> receives the audio signal from the information processing apparatus such as a PC on a far-end side, through the communication line. The PC <NUM> sends the audio signal received from the information processing apparatus on the far-end side, to the management apparatus <NUM>. The management apparatus <NUM> connects a speaker (not shown). The speaker outputs the voice of a talker on a far-end side, based on the audio signal received from the PC <NUM> through the management apparatus <NUM>. As a result, the talkers U20, U21, and U22 can converse with the talker on a far-end side. The management apparatus <NUM> is an example of a microphone state display apparatus. The management apparatus <NUM> is an example of a first information processing apparatus to be connected to the plurality of microphones <NUM>, <NUM>, and <NUM>.

It is to be noted that the PC <NUM> communicates with the information processing apparatus such as a PC on a far-end side, through a communication line such as the Internet or a LAN (Local Area Network). The PC <NUM> communicates with the information processing apparatus such as a PC on a far-end side, through a wireless or wired connection.

It is to be noted that, in the example shown in <FIG>, although the three microphones <NUM>, <NUM>, and <NUM> are connected to the management apparatus <NUM>, the number of microphones to be connected to the management apparatus <NUM> may not necessarily be three. The management apparatus <NUM> may be connected to two microphones or may be connected to four or more microphones.

It is to be noted that the management apparatus <NUM> does not necessarily have to be connected to the speaker. For example, the PC <NUM> may connect a speaker (not shown). In such a case, the speaker connected to the PC <NUM> makes an output, based on the audio signal received from the information processing apparatus such as a PC on a far-end side.

The management apparatus <NUM>, as shown in <FIG>, includes a first communication interface <NUM>, a second communication interface <NUM>, a user interface <NUM>, a flash memory <NUM>, a RAM (Random Access Memory) <NUM>, and a processor <NUM>. The processor <NUM> is, for example, a CPU (Central Processing Unit).

The first communication interface <NUM> communicates with the microphones <NUM>, <NUM>, and <NUM> through a signal line such as a LAN cable. The first communication interface <NUM> receives the audio signal according to the voice of the talkers U20, U21, and U22, from each of the microphones <NUM>, <NUM>, and <NUM>.

The second communication interface <NUM> is an interface based on standards such as a USB (Universal Serial Bus). The second communication interface <NUM> communicates with the PC <NUM> through a signal line. The processor <NUM> mixes audio signals obtained from the microphones <NUM>, <NUM>, and <NUM>, and sends mixed audio signals to the PC <NUM>.

It is to be noted that the management apparatus <NUM> does not necessarily have to communicate with the microphones <NUM>, <NUM>, and <NUM> through the wired connection. The management apparatus <NUM> may communicate with the microphones <NUM>, <NUM>, and <NUM> through the wireless connection based on standards such as Bluetooth (registered trademark).

The user interface <NUM> receives an operation to the management apparatus <NUM> from a user of the management apparatus <NUM>. The user interface <NUM> is a button or the like for volume control of the management apparatus <NUM>.

The flash memory <NUM> stores various programs. The various programs are, for example, a program to operate the management apparatus <NUM>, a program to execute processing according to the microphone state display method, or the like. In addition, the flash memory <NUM> stores data (hereinafter, referred to as state data) showing whether each of the microphones <NUM>, <NUM>, and <NUM> connected to the management apparatus <NUM> is in a mute-off state or a mute-on state. For example, the flash memory <NUM> stores the state data showing "microphone <NUM>: mute off, microphone <NUM>: mute on, and microphone <NUM>: mute off.

It is to be noted that the flash memory <NUM> does not necessarily have to store the various programs. The various programs may be stored in a different apparatus such as a server, for example. In such a case, the management apparatus <NUM> receives various programs from the different apparatus such as a server.

The processor <NUM> executes various types of operations by reading out the program stored in the flash memory <NUM>, to the RAM <NUM>. The processor <NUM>, for example, performs processing according to communication between the management apparatus <NUM> and the microphones <NUM>, <NUM>, and <NUM>, or processing according to communication between the management apparatus <NUM> and the PC <NUM>.

Hereinafter, a configuration of the microphones <NUM>, <NUM>, and <NUM> will be described with reference to the drawings. <FIG> is a block diagram showing the configuration of the microphone <NUM>. The configuration of the microphones <NUM> and <NUM> is the same as the configuration of the microphone <NUM>. Hereinafter, the configuration of the microphone <NUM> will be described as an example and a description of the configuration of the microphones <NUM> and <NUM> will be omitted.

The microphone <NUM>, as shown in <FIG>, includes a microphone unit <NUM>, a user interface <NUM>, a communication interface <NUM>, a flash memory <NUM>, a RAM <NUM>, a processor <NUM>, and a display <NUM>. The processor <NUM> is, for example, a CPU. The display <NUM> is, for example, an LED (Light Emitting Diode).

The microphone unit <NUM> converts a sound into an audio signal being an electric signal. In the example shown in <FIG>, the microphone unit <NUM> obtains the voice of the talker U20, and converts obtained voice of the talker U20 into an audio signal. The microphone unit <NUM> outputs the audio signal obtained by conversion, to the communication interface <NUM>.

The user interface <NUM> receives a mute-on or mute-off operation of the microphone <NUM>, from the talker U20. The user interface <NUM> is, for example, a switching button. The talker U20 switches mute-on or mute-off of the microphone <NUM> by operating the switching button.

The communication interface <NUM> communicates with the management apparatus <NUM> through a signal line such as a LAN cable. The communication interface <NUM> sends the audio signal obtained by the microphone unit <NUM>, to the management apparatus <NUM>. The communication interface <NUM>, in a case in which the user interface <NUM> receives the mute-on operation, does not send the audio signal to the management apparatus <NUM>. The communication interface <NUM>, in a case in which the user interface <NUM> receives the mute-off operation, sends the audio signal to the management apparatus <NUM>.

It is to be noted that the management apparatus <NUM> does not output the audio signal received from the microphones <NUM>, <NUM>, and <NUM> that have received the mute-on operation, to the PC <NUM>, which may achieve a mute-on function.

The flash memory <NUM> stores various programs. The various programs may include a program to operate the microphone <NUM>. The program to operate the microphone <NUM> is a program according to communication between the management apparatus <NUM> and the microphone <NUM>, a program according to the display of the display <NUM>, or the like.

The processor <NUM> executes various types of operations by reading out the program stored in the flash memory <NUM>, to the RAM <NUM>.

In the present embodiment, the display <NUM> is configured by three LEDs of a green LED, an orange LED, and a red LED, for example. The display <NUM> turns on the green LED, the orange LED, or the red LED, based on control of the processor <NUM>. Specifically, the processor <NUM> receives a command to turn on or turn off either of the green LED, the orange LED, or the red LED, from the processor <NUM>. The processor <NUM> controls turnon or turn-off of the green LED, the orange LED, or the red LED, based on the command received from the processor <NUM>.

The processor <NUM> executes processing (hereinafter, referred to as processing P) to change the display of the display <NUM> of the microphones <NUM>, <NUM>, and <NUM>, when receiving the mute-on or mute-off operation from the microphones <NUM>, <NUM>, and <NUM>. Hereinafter, the processing P will be described with reference to the drawings. <FIG> is a flow chart showing an example of the processing of the processor <NUM> when at least one microphone receives the mute-on operation. <FIG> is a flow chart showing an example of the processing of the processor <NUM> when at least one microphone receives the mute-off operation.

The processor <NUM>, for example, starts the processing P when the management apparatus <NUM> is powered on (<FIG> or <FIG>: START).

After the start of the processing P (<FIG>: START), the processor <NUM> determines whether or not at least one microphone of the microphones <NUM>, <NUM>, and <NUM> has received the mute-on operation (<FIG>: Step S11). For example, the user interface <NUM> of the microphone <NUM> receives an operation to switch to the mute-on, from the talker U20. At this time, the processor <NUM> of the microphone <NUM> sends a signal that shows that the microphone <NUM> has received the mute-on operation, to the processor <NUM>. The processor <NUM>, when having received the signal, determines to have received the mute-on operation by the microphone <NUM>. At this time, the processor <NUM> updates information according to the microphone <NUM> in the state data to "microphone <NUM>: mute on," for example.

In a case in which, in Step S11, the processor <NUM>, when determining to have received the mute-on operation by at least one microphone among the microphones <NUM>, <NUM>, and <NUM> (<FIG>: Yes in Step S11), determines whether or not all the microphones <NUM>, <NUM>, and <NUM> are in the mute-on state (<FIG>: Step S12). The processor <NUM>, by referring to the state data stored in the flash memory <NUM>, determines whether all the microphones <NUM>, <NUM>, and <NUM> are in the mute-on state or the mute-off state.

In a case in which the processor <NUM> determines that all the microphones <NUM>, <NUM>, and <NUM> are in the mute-on state (<FIG>: Yes in Step S12), outputs a command to cause the display <NUM> to display the states of all the microphones <NUM>, <NUM>, and <NUM> as a third state (<FIG>: Step S13).

For example, in <FIG>, when the microphone <NUM> is muted off, and when the microphones <NUM> and <NUM> are muted on, the microphone <NUM> receives the mute-on operation. In such a case, all the microphones <NUM>, <NUM>, and <NUM> are in the mute-on state. The processor <NUM> outputs the command to display the state of the microphone <NUM> as the third state, to the microphone <NUM>. In the present embodiment, the processor <NUM> outputs a command to cause the red LED of the microphone <NUM> to be turned on as the third state. The processor <NUM> of the microphone <NUM> turns on the red LED, based on the command. Similarly, the processor <NUM> outputs a command to display the state of the microphones <NUM> and <NUM> as the third state, to each of the microphones <NUM> and <NUM>. The processor <NUM> of the microphones <NUM> and <NUM> turn on the red LED, based on the command.

In Step S12, in a case in which the processor <NUM> determines that at least one microphone is in the mute-off state (<FIG>: No in Step S12), outputs a command to cause the display <NUM> to display the state of the microphone that has received the mute-on operation as a second state (<FIG>: Step S14).

For example, in <FIG>, when the microphones <NUM> and <NUM> are muted off, and when the microphone <NUM> is muted on, the microphone <NUM> receives the mute-on operation. In such a case, the microphone <NUM> is in the mute-off state. Therefore, the processor <NUM> outputs the command to display the state of the microphone <NUM> as the second state, to the microphone <NUM>. In the present embodiment, the processor <NUM> outputs a command to cause the orange LED of the microphone <NUM> to be turned on as the second state. The processor <NUM> of the microphone <NUM> turns on the orange LED, based on the command.

The processor <NUM>, when executing processing that determines that at least one microphone does not receive the mute-on operation (<FIG>: No in Step S11), processing of Step S13, or processing of Step S14, ends the processing P (<FIG>: END).

In addition, after the start of the processing P (<FIG>: START), the processor <NUM> determines whether or not at least one microphone has received the mute-off operation (<FIG>: Step S21). For example, the processor <NUM>, in a case in which the user interface <NUM> of the microphone <NUM> has received the mute-off operation, determines that the microphone <NUM> has received the mute-off operation.

The processor <NUM>, in a case of determining that at least one microphone receives the mute-off operation (<FIG>: Yes in Step S21), outputs a command to cause the display <NUM> to display the state of the microphone that has received the mute-off operation as a first state (<FIG>: Step S22).

For example, the microphone <NUM> receives the mute-off operation. The processor <NUM> outputs the command to display the state of the microphone <NUM> as the first state, to the microphone <NUM>. In the present embodiment, the processor <NUM> outputs a command to cause the green LED of the microphone <NUM> to be turned on as the first state. The processor <NUM> of the microphone <NUM> turns on the green LED, based on the command.

After Step S22, the processor <NUM>, by referring to the state data stored in the flash memory <NUM>, determines whether or not any of the microphones <NUM>, <NUM>, and <NUM> is in the mute-on state (<FIG>: Step S23).

In Step S23, the processor <NUM>, in a case of determining that any of the microphones <NUM>, <NUM>, and <NUM> is in the mute-on state (<FIG>: Yes in Step S23), outputs a command to cause the state of the mute-on microphone to be displayed as the second state, to the mute-on microphone (<FIG>: Step S24).

For example, in <FIG>, when all the microphones <NUM>, <NUM>, and <NUM> are in the mute-on state, the microphone <NUM> receives the mute-off operation. In such a case, the microphones <NUM> and <NUM> are in the mute-on state. Therefore, the processor <NUM> outputs a command to cause the display <NUM> of the microphones <NUM> and <NUM> to display the state of the microphones <NUM> and <NUM> as the second state, to the microphones <NUM> and <NUM>. The processor <NUM> of the microphones <NUM> and <NUM> turns on the orange LED, based on the command.

The processor <NUM>, when executing processing that determines that at least one microphone does not receive the mute-off operation (<FIG>: No in Step S21), processing that determines that no microphone in the mute-on state is present (<FIG>: No in Step S23), or processing of Step S24, ends the processing P (<FIG>: END).

It is to be noted that the processor <NUM> does not necessarily have to start the processing P when the management apparatus <NUM> is powered on. The processor <NUM>, for example, in a case of receiving an operation to start execution of an application program according to the processing P, may start the processing P. In such a case, the management apparatus <NUM> includes a button that receives the start of the processing P as the user interface <NUM>, for example.

With the above processing P, each of the microphones <NUM>, <NUM>, and <NUM> transitions into the first state, the second state, and the third state. Hereinafter, transition of a state of the microphones <NUM>, <NUM>, and <NUM> will be described with reference to the drawings. <FIG> is a view showing state transition of the microphone <NUM>. The state transition of the microphones <NUM> and <NUM> is the same as the state transition of the microphone <NUM>. Hereinafter, the state transition of the microphone <NUM> will be described as an example and a description of the state transition of the microphones <NUM> and <NUM> will be omitted.

As shown in <FIG>, the microphone <NUM> (a first microphone) displayed as the first state transitions to the second state or the third state.

When the microphone <NUM> displayed as the first state receives the mute-on operation, in a case in which at least one microphone among the microphones <NUM> and <NUM> is in the mute-off state (in a case of satisfying a condition Tr1 shown in <FIG>), the display of the microphone <NUM> transitions from the first state to the second state.

When the microphone <NUM> displayed as the first state receives the mute-on operation, in a case in which all the microphones <NUM>, <NUM>, and <NUM> are in the mute-on state (in a case of satisfying a condition Tr2 shown in <FIG>), the display of the microphone <NUM> transitions from the first state to the third state.

As shown in <FIG>, the microphone <NUM> (a second microphone) displayed as the second state transitions to the second state or the third state.

When the microphone <NUM> displayed as the second state receives the mute-off operation (in a case of satisfying a condition Tr3 shown in <FIG>), the display of the microphone <NUM> transitions from the second state to the first state.

In a case in which all the microphones <NUM>, <NUM>, and <NUM> are in the mute-on state (in a case of satisfying a condition Tr4 shown in <FIG>), the display of the microphone <NUM> displayed as the second state transitions from the second state to the third state.

As shown in <FIG>, the microphone <NUM> (a third microphone) displayed as the third state transitions to the first state or the second state. Specifically, the microphone <NUM> displayed as the third state, in a case of satisfying a condition Tr5, transitions to the first state while, in a case of satisfying a condition Tr6, transitioning to the second state.

The condition Tr5 is, for example, a condition that "the microphone <NUM> in the mute-on state receives the mute-off operation. " Therefore, when the microphone <NUM> displayed as the third state receives the mute-off operation (in the case of satisfying the condition Tr5 shown in <FIG>), the display of the microphone <NUM> transitions from the third state to the first state.

The condition Tr6 is, for example, a condition that "the microphone <NUM> is in the mute-on state while the microphone <NUM> or the microphone <NUM> being a microphone other than the microphone <NUM> is in the mute-off state. " Therefore, in a case in which at least one microphone (the microphone <NUM> or the microphone <NUM>) other than microphone <NUM>, among the microphones <NUM>, <NUM>, and <NUM>, is in the mute-off state (in the case of satisfying the condition Tr6 shown in <FIG>), the display of the microphone <NUM> transitions from the third state to the second state.

It is to be noted that the display <NUM> does not necessarily have to be configured by the LEDs of green, orange, and red, and may be configured by the LED of a color other than green, orange, and red.

It is to be noted that the display <NUM> may be configured by one LED of which the color changes. For example, the one LED changes to any of the colors of green, orange, and red. The processor <NUM> outputs a command to change the color of the one LED, to the processor <NUM>.

It is to be noted that, in the present embodiment, the processor <NUM>, instead of displaying the LED in different colors, may display the one LED at a different blinking rate corresponding to each of the first state, the second state, and the third state. For example, the processor <NUM>, in a case in which the microphone <NUM> is in the first state, always turns on the LED. For example, the processor <NUM>, in a case in which the microphone <NUM> is in the second state, blinks the LED at an interval of once per second. For example, the processor <NUM>, in a case in which the microphone <NUM> is in the third state, turns on the LED (at an interval of once every <NUM> seconds, for example) at a faster rate than the second state. As a result, the talker U20 can recognize the state of the microphone <NUM> without depending on the color.

It is to be noted that the display <NUM> may not necessarily be the LED. The displays <NUM> may be a screen such as an organic electroluminescence display, for example. In such a case, the display <NUM> displays a text message (a text message saying that "the microphone <NUM> is in the first state," for example) or the like that shows the state of the microphone <NUM>. As a result, the talker U20 can recognize the state of the microphone <NUM> without depending on the color.

According to the management apparatus <NUM>, for example, the talker U20 can be prevented from mistakenly assuming that a telephone call partner cannot hear because the microphone <NUM> is in the mute-on state. For example, the talker U20 mutes on the microphone <NUM>. At this time, the management apparatus <NUM>, in a case in which at least one microphone of the microphones <NUM> and <NUM> is muted off, displays on the display <NUM> of the microphone <NUM> the state of the microphone <NUM> as the second state. The talker U20, by looking at the display <NUM> of the microphone <NUM>, can know that the own voice can be heard by a telephone call partner because either of the microphones <NUM> and <NUM> is in the mute-off state. In short, the talker U20 does not mistakenly assume that the own voice cannot be heard by the telephone call partner. As a result, the talker U20 does not carelessly conduct a conversation desired not to be heard by the telephone call partner and can enjoy customer experience to smoothly talk on the telephone.

Hereinafter, a management apparatus 10a according to Modification <NUM> and a processor 105a (not shown) included in the management apparatus 10a will be described with reference to the drawings. <FIG> is a flow chart showing an example of processing of the processor 105a included in the management apparatus 10a according to Modification <NUM>. It is to be noted that, since the configurations other than the processor 105a in the management apparatus 10a are the same or substantially the same as the configurations of the management apparatus <NUM>, the illustration of the management apparatus 10a is omitted.

The management apparatus 10a is different from the management apparatus <NUM> in that processing (hereinafter, referred to as processing Q) to determine whether or not a sound obtained by a certain microphone, when obtained, is diffracted to other microphones is executed. The management apparatus 10a, when being powered on or when receiving an operation to start an application program according to the processing Q, for example, starts the execution of the processing Q (<FIG>: START).

After the start of the processing Q, the processor 105a determines whether or not all the microphones are in the mute-on state (<FIG>: Step S31).

The processor 105a, in a case of determining that at least one microphone is in the mute-off state (<FIG>: No in Step S31), performs comparison between an audio signal (hereinafter, referred to as a first audio signal) obtained by the microphone in the mute-on state and an audio signal (hereinafter, referred to as a second audio signal) obtained by the microphone in the mute-off state (<FIG>: Step S33). The processor 105a determines whether or not the second audio signal includes a sound of a sound source included in the first audio signal, based on a result of the comparison (<FIG>: Step S34).

For example, the microphone <NUM> obtains voice of the talker U20. At this time, the voice of the talker U20 may be diffracted to the microphone <NUM> present in the same space and may be obtained by the microphone <NUM>. In such a case, the second audio signal obtained by the microphone <NUM> includes the voice of the talker U20 included in the first audio signal obtained by the microphone <NUM>. At this time, the processor 105a determines that "the second audio signal includes the sound of the sound source included in the first audio signal. " The processor 105a determines whether or not diffraction of the sound occurs in each of all the microphones in the mute-off state.

In the present modification, the processor 105a performs the comparison, based on a cross correlation between the first audio signal and the second audio signal. Specifically, the processor 105a calculates a peak value of the cross correlation between the first audio signal and the second audio signal. The processor 105a, when the peak value is high (in a case in which the peak value is not less than a predetermined threshold value), determines that the second audio signal includes the sound of the sound source included in the first audio signal.

In a case in which the processor 105a determines that "the second audio signal includes the sound of the sound source included in the first audio signal" (<FIG>: Yes in Step S34), outputs a command to cause the display <NUM> to display the state of the microphone that has received the mute-on operation as the second state (<FIG>: Step S35). For example, in a case in which the second audio signal obtained by the microphone <NUM> or the microphone <NUM> includes the voice of the talker U20 included in the first audio signal obtained by the microphone <NUM>, the voice of the talker U20 is able to be heard by a telephone call partner through the microphone <NUM> or the microphone <NUM>. Then, the processor 105a causes the display <NUM> of the microphone <NUM> to display the state of the microphone <NUM> as the second state. The talker U20, by looking at the display of the microphone <NUM>, can know in advance (before conducting a conversation desired not to be heard by a telephone call partner) that the own voice is diffracted to the microphone <NUM> or the microphone <NUM> and is obtained. As a result, the talker U20 does not carelessly conduct the conversation desired not to be heard by the telephone call partner and can enjoy customer experience to smoothly talk on the telephone.

In a case in which the processor 105a determines that "the second audio signal does not include the sound of the sound source included in the first audio signal" (<FIG>: No in Step S34), outputs a command to cause the display <NUM> to display the state of the microphone that has received the mute-on operation as the third state, even when at least one microphone among the plurality of microphones <NUM>, <NUM>, and <NUM> is in the mute-off state (<FIG>: Step S36).

For example, in a case in which the second audio signal obtained by the microphone <NUM> and the microphone <NUM> does not include the voice of the talker U20 included in the first audio signal obtained by the microphone <NUM>, the voice of the talker U20 is obtained without being diffracted to the microphone <NUM> and the microphone <NUM>. Accordingly, the voice of the talker U20 is not heard by a telephone call partner through the microphones <NUM> and <NUM>. Then, the processor 105a causes the display <NUM> of the microphone <NUM> to display the state of the microphone <NUM> as the third state. The talker U20, by looking at the display of the microphone <NUM>, can easily determine whether the own conversation is heard by a telephone call partner or not, and thus can enjoy customer experience to smoothly talk on the telephone.

In Step S31, in a case in which the processor 105a determines that all the microphones are in the mute-on state (<FIG>: Yes in Step S31), outputs a command to cause the display <NUM> to display the state of all the microphones as the third state (<FIG>: Step S32).

The processor 105a, when executing processing of Step S32, processing of Step S35, or processing of Step S36, ends the processing P (<FIG>: END).

It is to be noted that the processor 105a may repeatedly execute the processing Q. In such a case, the processor 105a, when the management apparatus 10a is powered off or when an operation to end an application program according to the processing Q is received, for example, ends the processing Q.

It is to be noted that the processor 105a may execute both the processing P and processing Q in parallel.

Hereinafter, a management apparatus 10b according to Modification <NUM> will be described with reference to the drawings. <FIG> is a block diagram showing a configuration of the management apparatus 10b according to Modification <NUM>. It is to be noted that, in the management apparatus 10b, the same reference numerals are assigned to the same configurations in the management apparatus <NUM>, and the description is omitted.

As shown in <FIG>, the management apparatus 10b is different from the management apparatus <NUM> in that a display 106b is provided. The display 106b, for example, is a LED as with the display <NUM> of the microphone <NUM>. The processor <NUM> of the management apparatus 10b, when receiving the mute-on or mute-off operation in the microphones <NUM>, <NUM>, and <NUM>, executes processing to change the display of the display 106b.

In a case in which the management apparatus 10b includes the display 106b as described in the present modification, each of the microphones <NUM> to <NUM> connected to the management apparatus 10b does not necessarily have to include the display <NUM>.

Such a management apparatus 10b is able to produce an advantageous effect similar to the advantageous effect achieved by the management apparatus <NUM>.

Hereinafter, a management apparatus 10c according to Modification <NUM> will be described with reference to the drawings. <FIG> is a view showing an example of processing of the management apparatus 10c according to Modification <NUM>. <FIG> is a view showing an example of a menu screen MN1 displayed on an LCD <NUM>. It is to be noted that, since the configurations of the management apparatus 10c are the same or substantially the same as the configurations of the management apparatus <NUM>, the illustration of the management apparatus 10c is omitted.

The management apparatus 10c is different from the management apparatus <NUM> in that the state of the microphones <NUM> to <NUM> is displayed on a display such as an LCD (Liquid Crystal Display) or an organic electroluminescence display included in the PC <NUM> (a second information processing apparatus). For example, the management apparatus 10c, as shown in <FIG>, outputs a command to cause the LCD <NUM> (the display) included in the PC <NUM> to display the state of the microphones <NUM> to <NUM>, to the PC <NUM>. The PC <NUM> displays the state of the microphones <NUM> to <NUM> on OSD (On Screen Display), based on the command, for example. The OSD functions to display on a display a menu screen according to setting of a device or the like. For example, the PC <NUM>, as shown in <FIG>, displays on the LCD <NUM> the menu screen MN1 that displays the state of the microphones <NUM> to <NUM> by the OSD. The PC <NUM> displays text messages saying that "microphone <NUM>: mute ON, microphone <NUM>: mute OFF, microphone <NUM>: mute ON" on the menu screen MN1, for example. In the present modification, the PC <NUM> is an example of the information processing apparatus connected to the management apparatus 10c (the microphone state display apparatus).

It is to be noted that the PC <NUM> does not necessarily have to show the state of the microphones <NUM>, <NUM>, and <NUM> by displaying a text message on the menu screen MN1. For example, the PC <NUM>, by displaying images Ca20, Ca21, and Ca22 that respectively simulate the microphones <NUM>, <NUM>, and <NUM> on the menu screen MN1 and changing the color of the images Ca20, Ca21, and Ca22, may show the state of the microphones <NUM>, <NUM>, and <NUM> (see <FIG>). For example, the PC <NUM> changes the color of the image Ca20 to green when the microphone <NUM> is in the mute-off state. The talkers U20, U21, and U22, by recognizing that the color of the image Ca20 is green, can know that the microphone <NUM> is in the mute-off state. As a result, the talkers U20, U21, and U22 can enjoy the same customer experience as the customer experience of the management apparatus <NUM>.

The management apparatus 10c displays on the menu screen MN1 the state of all the microphones (the microphones <NUM>, <NUM>, and <NUM>) connected to the management apparatus 10c. The talker U20, by looking at the menu screen MN1, can know not only the state of the microphone <NUM> using currently but also the state of each of the microphones <NUM> and <NUM>. Therefore, the talker U20 can determine whether or not a microphone being muted off is present in the own vicinity. Accordingly, the talker U20 does not carelessly conduct the conversation desired not to be heard by the telephone call partner and can enjoy customer experience to smoothly talk on the telephone. In a similar manner, the talkers U21 and U22 can determine whether or not a microphone being muted off is present in each vicinity of the talkers U21 and U22.

It is to be noted that, in the present modification, the PC <NUM> does not necessarily have to display the state of the microphones <NUM> to <NUM>. The management apparatus 10c is connected to a smartphone (an example of the information processing apparatus connected to the microphone state display apparatus) that has the same function as the PC <NUM>, for example, and the display included in the smartphone may display the state of the microphones <NUM> to <NUM>.

Hereinafter, a management apparatus 10d according to Modification <NUM> will be described with reference to the drawings. It is to be noted that, since the configurations other than the processor 105d in the management apparatus 10d are the same or substantially the same as the configurations of the management apparatus <NUM>, the illustration of the management apparatus 10d is omitted.

The management apparatus 10d is different from the management apparatus <NUM> in that the display of the display <NUM> is changed based on an image obtained by a camera (hereinafter, referred to as a capturing camera). In the present modification, the capturing camera is connected to the management apparatus 10d.

The capturing camera obtains an image, for example, by capturing a space in which the capturing camera is placed. For example, the capturing camera is placed in a space (inside of a conference room, or the like) in which the talker U20 makes a remote telephone call. The microphone <NUM> that the talker U20 uses to make a telephone call is placed in the space.

The processor 105d (not shown) included in the management apparatus 10d receives an image from the capturing camera. The processor 105d, by performing analysis processing of a received image, determines whether or not a microphone other than the microphone <NUM> is captured in the image. In other words, the processor 105d determines whether or not a microphone other than the microphone <NUM> that the talker U20 uses is present in the space in which the talker U20 is present. It is to be noted that the analysis processing is, for example, analysis processing by artificial intelligence such as a neural network (DNN (Deep Neural Network), for example) or analysis processing by pattern matching using template data.

Even when the microphones <NUM> and <NUM> are muted off, in a case in which the microphones <NUM> and <NUM> (the microphones other than the microphone <NUM> that the talker U20 uses) are not present in the space in which the talker U20 is present, the voice of the talker U20 is not collected by the microphones <NUM> and <NUM>. Accordingly, the conversation that the talker U20 desires not to be heard by a telephone call partner may not be heard by the telephone call partner through the microphone other than the microphone <NUM>. Accordingly, in the present modification, the processor 105d, in a case of determining that no microphone other than the microphone <NUM> is present in the space in which the talker U20 is present, causes the display <NUM> to display the state of the microphone <NUM> as the third state. The talker U20, by looking at the display of the microphone <NUM>, can know that the own conversation is not heard by a telephone call partner, and thus can enjoy customer experience to smoothly talk on the telephone.

On the other hand, the processor 105d, in a case of determining that a microphone other than the microphone <NUM> is present in the space in which the talker U20 is present, performs the same processing (the processing of Steps S11 to S14 or the processing of Steps S21 to S24) as the processor <NUM>.

It is to be noted that, in place of the management apparatus 10d, the capturing camera may be connected to the PC <NUM>. In such a case, the management apparatus 10d causes the display <NUM> to display the state of the microphones <NUM>, <NUM>, and <NUM>, based on the image obtained by the camera connected to the PC <NUM>.

Hereinafter, Application Example <NUM> of a management apparatus 10d will be described. In the present application example, the management apparatus 10d performs processing (superimposition) to superimpose an image that shows the state of the microphones <NUM>, <NUM>, and <NUM> on an image obtained by the capturing camera. For example, the capturing camera captures the face of the talker U20 and obtains an image in which the face of the talker U20 is captured. The management apparatus 10d, by superimposing the image that shows the state of the microphone <NUM> on the image in which the face of the talker U20 is captured, generates an image (hereinafter, referred to as a first image) that associates the talker U20 with the state of the microphone <NUM>. Each PC that the talkers U20, U21, and U22 use receives the first image from the management apparatus 10d and displays the first image. The talkers U20, U21, and U22, by looking at the first image displayed on each PC, can know the state of the microphone <NUM> that the talker U20 uses. As a result, the talkers U20, U21, and U22, when the microphone <NUM> is muted off, does not carelessly conduct the conversation desired not to be heard by the telephone call partner and can enjoy customer experience to smoothly talk on the telephone.

Hereinafter, Application Example <NUM> of a management apparatus 10d will be described with reference to the drawings. <FIG> is a view showing an example of an image CA1 that the management apparatus 10d has obtained from a capturing camera. <FIG> is a view showing an example of an image CA2 that the management apparatus 10d has generated.

In the present application example, the management apparatus 10d obtains an image captured by the capturing camera. Then, the management apparatus 10d, by performing analysis processing (analysis processing by artificial intelligence, or pattern matching using template data) on an obtained image, determines whether or not the microphones <NUM>, <NUM>, and <NUM> are captured in the image. The management apparatus 10d, in a case of determining the microphones <NUM>, <NUM>, and <NUM> are captured in the image, specifies a part in which the microphones <NUM>, <NUM>, and <NUM> are captured in the image. Then, the management apparatus 10d, by changing the color of the part in which the microphones <NUM>, <NUM>, and <NUM> are captured in the image according to the state of the microphones <NUM>, <NUM>, and <NUM>, generates an image CA2 that shows the state of the microphones <NUM>, <NUM>, and <NUM>.

For example, as shown in <FIG>, the management apparatus 10d receives the image CA1 from the capturing camera, and performs analysis processing on the image CA1. The microphones <NUM> and <NUM> are captured in the image CA1 shown in <FIG>. Accordingly, the management apparatus 10d determines that "the microphones <NUM> and <NUM> are captured in the image CA1. " The management apparatus 10d specifies the part (a region of <NUM>×<NUM> pixels, for example) in which the microphones <NUM> and <NUM> are captured in the image CA1.

The management apparatus 10d, for example, when the microphone <NUM> is in the mute-off state and when the microphone <NUM> is in the mute-on state, by changing the color of the part in which the microphone <NUM> is captured in the image CA1 to green, and changing the color of the part in which the microphone <NUM> is captured in the image CA1 to orange, generates the image CA2 that shows the state of the microphones <NUM> and <NUM> (see <FIG>). The management apparatus 10d causes a display included in the PC <NUM> or the like to display the image CA2. The talkers U20 and U21, by looking at the image CA2, can determine whether or not the own conversation may be heard by a telephone call partner. As a result, the talkers U20 and U21 can enjoy the same customer experience as the customer experience of the management apparatus <NUM>.

It is to be noted that, in the example shown in <FIG>, the capturing camera is placed on a table, for example, in a room. However, in the room, the capturing camera does not necessarily need to be placed on the table. The capturing camera may be placed on a wall or a ceiling in the room, for example.

It is to be noted that the management apparatus 10d may generate a simple image (hereinafter, referred to as a second image) that simulates the room and the microphones <NUM> and <NUM> based on the image CA1, and may cause a display included in the PC <NUM> to display the second image.

It is to be noted that the management apparatus 10d does not necessarily have to specify the part in which the microphones <NUM> and <NUM> are captured by performing analysis processing on the image CA1. For example, the flash memory <NUM> of the management apparatus 10d stores in advance information (hereinafter, referred to as position information) according to positions in which the microphones <NUM> and <NUM> are placed. Then, the management apparatus 10d may generate the image CA2, based on the position information.

Claim 1:
A microphone state display method comprising:
receiving a mute-on or a mute-off operation by each of a plurality of microphones (<NUM>, <NUM>, <NUM>);
displaying a state of a microphone (<NUM>) that has received the mute-off operation as a first state on a display (<NUM>);
when receiving the mute-on operation, in a case in which at least one microphone (<NUM>) among the plurality of microphones (<NUM>, <NUM>, <NUM>) is in a mute-off state, displaying a state of a microphone (<NUM>) that has received the mute-on operation as a second state on the display (<NUM>); and
when receiving the mute-on operation, in a case in which all of the plurality of microphones (<NUM>, <NUM>, <NUM>) are in a mute-on state, displaying the state of a microphone (<NUM>) that has received the mute-on operation as a third state on the display (<NUM>) .