Patent Publication Number: US-11651779-B2

Title: Voice processing system, voice processing method, and storage medium storing voice processing program

Description:
INCORPORATION BY REFERENCE 
     This application is based upon and claims the benefit of priority from the corresponding Japanese Patent Application No. 2020-082358 filed on May 8, 2020, the entire contents of which are incorporated herein by reference. 
     BACKGROUND OF THE INVENTION 
     Field of the Invention 
     The present disclosure relates to a voice processing system, a voice processing method, and a storage medium storing a voice processing program. 
     Description of the Background Art 
     Conventionally, a conferencing system has been proposed in which voice, video, files, and the like are transmitted and received via a network at locations separated from each other. For example, Japanese Patent No. 6463825 discloses a technique for displaying text recognizing voice of a speaker and a video of the speaker on a display unit in a conferencing system. 
     However, in a conventional conferencing system, trouble with the voice, such as interruption of a voice call, may occur due to a network bandwidth shortage, latency, or a malfunction of a microphone or a speaker. Further, when trouble with the voice occurs, it is difficult to specify the cause of the trouble with the voice corresponding to the trouble with the voice occurs is delayed, which is a problem. 
     SUMMARY OF THE INVENTION 
     An object of the present disclosure is to provide a voice processing system, a conferencing system, a voice processing method, and a storage medium storing a voice processing program capable of detecting trouble with the voice and presenting a troubleshooting approach for the trouble with the voice. 
     A voice processing system according to an embodiment of the present disclosure transmits and receives voice spoken by users in a first base and a second base connected via a network. The voice processing system includes a voice receiver that receives the voice, a voice recognition unit that recognizes the voice received by the voice receiver, a voice determination unit that determines a state of transmission and reception of the voice between a first base and a second base, based on a recognition result of the first voice received from the first base and a recognition result of the second voice received from the second base, and an information presenting unit that presents specific information for resolving an abnormal state of transmission and reception when it is determined by the voice determination unit that the state of transmission and reception is abnormal. 
     A voice processing method according to another embodiment of the present disclosure is a voice processing method by which voice spoken by users is transmitted and received in a first base and a second base connected via a network, the voice processing method, by one or more processors, being to: receive the voice; recognize the voice received; determine a state of transmission and reception of the voice between the first base and the second base based on a recognition result of a first voice received from the first base and a recognition result of a second voice received from the second base; and when it is determined that the state of transmission and reception is abnormal, present specific information for resolving the abnormal state of transmission and reception. 
     A storage medium according to another embodiment of the present disclosure is a storage medium storing a voice processing program by which voice spoken by users is transmitted and received in a first base and a second base connected via a network, the voice processing program, by one or more processors, being to: receive the voice, recognize the voice received, determine a state of transmission and reception of the voice between the first base and the second base based on a recognition result of a first voice received from the first base and a recognition result of a second voice received from the second base, and when it is determined that the state of transmission and reception is abnormal, present specific information for resolving the abnormal state of transmission and reception. 
     In the present disclosure, a voice processing system, a voice processing method, and a storage medium storing a voice processing program capable of detecting trouble with the voice and presenting a troubleshooting approach for the trouble with the voice is provided. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG.  1    is a diagram showing a schematic configuration of a conferencing system according to an embodiment of the present disclosure. 
         FIG.  2    is a functional block diagram illustrating a configuration of a conferencing system according to an embodiment of the present disclosure. 
         FIG.  3    is a table showing an example of keyword information used in the conferencing system according to an embodiment of the present disclosure. 
         FIG.  4    is a diagram showing an example of determination information used in the conferencing system according to an embodiment of the present disclosure. 
         FIG.  5    is a diagram showing an example of feedback information used in the conferencing system according to an embodiment of the present disclosure. 
         FIG.  6    is a diagram showing an example of a display screen displayed on a display device of a conferencing system according to an embodiment of the present disclosure. 
         FIG.  7    is a diagram showing an example of a display screen displayed on a display device of a conferencing system according to an embodiment of the present disclosure. 
         FIG.  8    is a diagram showing an example of a display screen displayed on a display device of a conferencing system according to an embodiment of the present disclosure. 
         FIG.  9    is a flowchart for explaining an example of a procedure of information presentation processing in the conferencing system according to the embodiment of the present disclosure. 
         FIG.  10    is a flowchart for explaining an example of a procedure of information presentation processing in the conferencing system according to the embodiment of the present disclosure. 
         FIG.  11    is a diagram showing another schematic configuration of a conferencing system according to an embodiment of the present disclosure. 
     
    
    
     DESCRIPTION OF THE PREFERRED EMBODIMENTS 
     Hereinafter, embodiments of the present disclosure will be explained with reference to the accompanying drawings. The following embodiment represents an example of an implementation of the present disclosure, and does not limit the technical scope of the present disclosure. 
     The voice processing system according to the present disclosure can be applied to a remote conference in which a plurality of bases (areas) are connected to a network and a plurality of users participate. For example, the voice processing system transmits and receives voice spoken by users in a first base and a second base connected via a network. Further, the voice processing system according to the present disclosure may also have a function that executes a voice command and a call function (telephone function, videophone function, etc.) capable of making a call between users via a network. In addition, the voice processing system according to the present disclosure includes one or more voice processing devices that transmit and receive voice of the conference participants. 
     In the following embodiment, a case where the voice processing system is applied to a remote conference (conferencing system) will be explained as an example. That is to say, a conferencing system according to the present embodiment is an example of the voice processing system according to the present disclosure. For example, in the conferencing system according to the present embodiment, by placing a voice processing device in each base (conference room), and causing the voice processing device in one conference room to receive voice spoken by a user and then transmit the audio to the voice processing device in the other conference rooms, a conversation between users in various conference rooms is made possible. Further, the conferencing system includes a display device that displays the content of the conversation (text information), materials for the conference, and the like. Further, the conferencing system includes a cloud server that analyzes voice of a user received from the voice processing device and specifies commands. 
     Conference System  100   
       FIG.  1    is a diagram showing a schematic configuration of a conferencing system according to an embodiment of the present disclosure. The conferencing system  100  includes a voice processing device  1  and a display device  2  at each base (conference room). Voice processing devices  1 A and  1 B are each a microphone-speaker device including a microphone and a speaker, such as an AI speaker or a smart speaker. Here, the voice processing device  1 A installed in a conference room A and the voice processing device  1 B installed in a conference room B are shown. Display devices  2 A, and  2 B include a display unit that displays various information. Here, the display device  2 A installed in a conference room A and the display device  2 B installed in a conference room B are shown. The voice processing device  1 A and the display device  2 A, as well as the voice processing device  1 B and the display device  2 B are connected to each other via the network N 1 . The network N 1  is a communications network such as the Internet, LAN, WAN, or public telephone line. Each of the voice processing devices  1 A and  1 B is an example of the voice processing device of the present disclosure. The display devices  2 A and  2 B are each an example of a display device of the present disclosure. Further, the display device  2 B is an example of the first display panel of the present disclosure, and the display device  2 A is an example of the second display panel of the present disclosure. 
     The conferencing system  100 , for example, receives voice spoken by a user of the conference room A from the voice processing device  1 A, and communicates the voice received from the voice processing device  1 A via a network N 1  to the voice processing device  1 B of the conference room B. The voice processing device  1 B outputs the voice received from the voice processing device  1 A from the speaker and displays the content of the voice (text information) on the display device  2 B. In the same way, for example, voice spoken by a user of the conference room B is received by the voice processing device  1 B and the voice received by the voice processing device  1 B is communicated via the network N 1  to the voice processing device  1 A of the conference room A. The voice processing device  1 A outputs the voice received from the voice processing device  1 B from the speaker, and causes the display device  2 A to display the content of the relevant voice (text information). In this way, the users of each of the conference rooms A and B are able to have a conversation. 
     Here, in the conferencing system  100 , trouble with the voice, such as interruption of a voice call, may occur due to a network bandwidth shortage, latency, or a malfunction of a microphone or a speaker. When trouble with the voice occurs, the conferencing system  100  can detect the trouble with the voice and present a troubleshooting approach for the trouble with the voice. Hereinafter, a specific configuration of the conferencing system  100  will be explained. In the following description, when the voice processing devices  1 A, and  1 B are not distinguished, they are referred to as “voice processing devices  1 ”. 
     Voice Processing Devices  1   
     The voice processing devices  1  placed in each base (here, conference rooms A and B) have the same configuration. As shown in  FIG.  2   , the voice processing device  1  includes a controller  11 , a storage unit  12 , a speaker  13 , a microphone  14 , a communications interface  15 , and the like. The voice processing device  1  may be a device such as an AI speaker or a smart speaker. The voice processing device  1  is, for example, placed on a desk in a conference room, acquires voice of a user participating in a conference via the microphone  14 , and outputs (relays) voice to the relevant user from the speaker  13 . 
     The communications interface  15  connects a voice processing device  1  by wire or wirelessly to a network N 1 , and connects with another device (for example, another voice processing device  1 , a display device  2 , a cloud server, etc.) via the network N 1 , and is a communications interface for executing data communication between the communications interface  15  and the other device according to a predetermined communication protocol. 
     The storage unit  12  is a non-transitory (non-volatile) storage unit such as flash memory storing various type of information. In the storage unit  12 , a control program such as an information presentation processing program is stored that causes the controller  11  to perform information presentation processing (see  FIG.  9   ). For example, the information presentation processing program is distributed from an external server and stored. For example, the information presentation processing program may be recorded non-temporarily on a computer-readable recording medium such as a CD or a DVD, read by a reading device (not illustrated) such as a CD drive or a DVD drive provided in the voice processing device  1 , and stored in the storage unit  12 . 
     Further, in the storage unit  12 , data such as keyword information D 1 , determination information D 2 , and troubleshooting information D 3  is stored.  FIG.  3    is a diagram showing an example of the keyword information D 1 .  FIG.  4    is a diagram showing an example of the determination information D 2 .  FIG.  5    is a diagram showing an example of the troubleshooting information D 3 . 
     A specific keyword set in advance (corresponding to a specific word in the present disclosure) is registered in the keyword information D 1 . Specifically, the keyword is a phrase meaning there is difficulty in hearing or understanding voice spoken in a remote area. For example, the keywords include phrases such as “can&#39;t hear”, “intermittent”, and “hello?”. Phrases with the same meaning, synonyms, and the like, of the term may be registered in the keywords. For example, phrases such as “I didn&#39;t get that” and “it is hard to hear” corresponding to “can&#39;t hear” may be registered in the keywords. The keyword is registered in the keyword information D 1  in advance. 
     For when the trouble with the voice occurs, information for specifying a troubleshooting approach for the trouble with the voice is recorded in the determination information D 2 . Specifically, the determination information D 2  includes the recognition result of the voice received from another base (“normal” or “abnormal”), information on whether the keyword is detected at its own base (presence or absence detected), speaker sound volume at its own base {“high” (set value greater than or equal to 50% of the maximum sound volume value) or “low” (set value is less than 50% of the maximum sound volume value)”}, network bandwidth status between its own base and another base {“sufficient” (1.5 Mbps or more) or “strained” (less than 1.5 Mbps)}, noise level {“high” (SNR, signal to noise ratio, is less than 0 dB) or “low” (SNR is greater than or equal to 0 dB)”}, hearing state (“intermittent” or “cannot hear at all”), identifying information of the troubleshooting information related to the troubleshooting method (troubleshooting information  1  to  8 ). The determination information D 2  includes this information and the like, registered in association with one another. 
     Specific content is registered in the troubleshooting information D 3  for the troubleshooting information  1  to  8 , which are registered in the determination information D 2 . Each piece of troubleshooting information includes at least a troubleshooting message presented (notified) in another base. The troubleshooting message has content relating to a troubleshooting approach (solution) for resolving the trouble with the voice. In this way, in the storage unit  12 , a troubleshooting message related to a status for each item included in the determination information D 2  (an example of the specific information of the present disclosure) is stored in advance. 
     The controller  11  includes control devices such as a CPU, ROM, and RAM. The CPU is a processor that executes various types of arithmetic processes. The ROM includes a control program stored in advance, such as BIOS and OS for causing the CPU to execute various types of processes. The RAM stores various information and is used as temporary storage memory (work area) for the various processing executed by the CPU. The controller  11  controls the voice processing device  1  by causing the CPU to execute various types of control programs stored in advance in the ROM or the storage unit  12 . 
     Specifically, the controller  11  includes various processing units such as a voice receiver  111 , a voice transmitter  112 , a voice recognition unit  113 , a voice determination unit  114 , and an information presenting unit  115 . The controller  11  functions as the various types of processing units by causing the CPU to execute various types of processes according to the control program. Furthermore, some or all of the processing units included in the controller  11  may be configured by an electronic circuit. The information presentation processing program may be a program for causing a plurality of processors to function as the various types of processing units. 
     The voice receiver  111  receives the voice (voice data) spoken by the user who uses the voice processing device  1 . The voice receiver  111  is an example of a voice receiver of the present disclosure. For example, the voice receiver  111  of the voice processing device  1 A receives the voice spoken by the user of the conference room A, and the voice receiver  111  of the voice processing device  1 B receives the voice spoken by the user of the conference room B. 
     The voice transmitter  112  transmits the voice (voice data) received from the voice receiver  111  to a remote area (another base). For example, the voice transmitter  112  of the voice processing device  1 A transmits the voice spoken by the user of the conference room A to the voice processing device  1 B of the conference room B, and the voice transmitter  112  of the voice processing device  1 B transmits the voice spoken by the user of the conference room B to the voice processing device  1 A in the conference room A. 
     The voice recognition unit  113  recognizes voice received from the voice receiver  111 . The voice recognition unit  113  is an example of the voice recognition unit of the present disclosure. For example, the voice recognition unit  113  of the voice processing device  1 A recognizes the voice spoken by the user of the conference room B received by the voice receiver  111  of the voice processing device  1 A and converts the voice into text data. As a further example, the voice recognition unit  113  of the voice processing device  1 B recognizes the voice spoken by the user of the conference room A received by the voice receiver  111  of the voice processing device  1 B and converts the voice into text data. 
     Here, the voice recognition unit converts the voice data of voice spoken by a user into to character string. Further, the voice recognition may include processing of pattern matching of the converted character string and words registered in a dictionary database. 
     Further, the voice recognition unit  113  causes the voice to be output from the speaker  13 . For example, the voice recognition unit  113  of the voice processing device  1 A outputs the voice spoken by the user of the conference room B from the speaker  13  of the conference room A. As another example, the voice recognition unit  113  of the voice processing device  1 B outputs the voice spoken by the user of the conference room A from the speaker  13  of the conference room B. 
     Further, the voice recognition unit  113  causes the text information corresponding to the text data to display on the display device  2 . For example, the voice recognition unit  113  of the voice processing device  1 A causes text information corresponding to the voice spoken by the user of the conference room B to be displayed on the display device  2 A of the conference room A As a further example, the voice recognition unit  113  of the voice processing device  1 B causes text information corresponding to the voice spoken by the user of the conference room A to be displayed on the display device  2 B of the conference room B. 
     The voice determination unit  114  determines the state of transmission and reception of the voice of the first base and the second base based on the recognition result of the first voice received from the first base and the recognition result of the second voice received from the second base. Specifically, the voice determination unit  114  determines the state of transmission and reception of the voice between the conference room A and the conference room B based on the recognition result of the voice spoken by a user of the conference room A and the recognition result of the voice spoken by the user of the conference room B. 
     For example, the voice determination unit  114  of the voice processing device  1 A determines that the state of transmission and reception is abnormal when one word corresponding to voice from the user of conference room B is recognized by the voice recognition unit  113 , and when a specific keyword set in advance (see  FIG.  3   ) corresponding to the voice of the user of the conference room A by the voice recognition unit  113  is recognized. For example, as shown in  FIG.  6   , the user of the conference room B says “Good afternoon” (the first word) and the user of the conference room A says “can&#39;t hear” (the keyword), and when the voice recognition unit  113  of the voice processing device  1 A recognizes the first word and the keyword, the voice determination unit  114  determines that the state of transmission and reception is abnormal. In this case, for example, in the conference room A, a problem occurs in that the first word “Good afternoon” is displayed as text information on the display device  2 A, and the first word is not output from the speaker  13  as normal. 
     Further, the voice determination unit  114  determines the state of transmission and reception is abnormal when, without recognizing one word corresponding to the voice of the user of the conference room B by the voice recognition unit  113 , a specific keyword set in advance (see  FIG.  3   ) corresponding to the voice of the user of the conference room A by the voice recognition unit  113  is recognized. For example, as shown in  FIG.  6   , the user of the conference room B says “Good afternoon” (the first word) and the user of the conference room A says “can&#39;t hear” (the keyword), and when the voice recognition unit  113  of the voice processing device  1 A cannot recognize the first word and does recognize the keyword, the voice determination unit  114  determines that the state of transmission and reception is abnormal. In this case, for example, in the conference room A, a problem occurs in that the first word “Good afternoon” is not displayed as text information on the display device  2 A, and the first word is not output from the speaker  13  as normal. 
     Here, from whether voice recognition unit  113  has converted the voice data of the voice spoken by the user into a character string, the voice determination unit  114  determines whether the voice was recognized. The voice determination unit  114  determines that the voice can be recognized when the voice data is converted into a character string. Further, the voice determination unit  114  may determine that the voice can be recognized when the converted character string makes a word that is registered in the dictionary database. 
     Further, the voice determination unit  114  determines the volume of the speaker  13  of its own base (volume setting), the network bandwidth status between its own base and another base, the amount of noise in the voice received from the other base, and the hearing state of the voice received from the other base. For example, the voice determination unit  114  determines whether or not the set sounds volume of the speaker  13  of the voice processing device  1 A is 50% or more of the maximum value. Further, the voice determination unit  114  determines whether the network bandwidth between the conference room A and the conference room B is sufficient (the transmitted and received data amount is greater than or equal to 1.5 Mbps). Further, the voice determination unit  114  determines whether the amount of noise in the voice received from the conference room B is high (SNR is less than 0 dB). Further, the voice determination unit  114  determines whether the hearing state of the voice received from the conference room B is “intermittent” or “cannot hear at all”. 
     Here, for example, when the voice recognition unit  113  converts the voice data of the voice spoken by the user into a character string and the converted character string is not registered in a dictionary database, the voice determination unit  114  may determine that the hearing state is “intermittent”. For example, when the voice recognition unit  113  has recognized “good” and “af”, in the converted voice data, these character strings are not registered the dictionary database. Further, based on “good” and “af” the voice determination unit  114  is able to predict “good afternoon” by referring to the dictionary database. In this way, the voice determination unit  114  determines that the hearing state is “intermittent” when a part is not recognized of a predicted word based on a character string recognized from the voice. 
     When the voice determination unit  114  determines that the state of transmission and reception is abnormal, the information presenting unit  115  presents a troubleshooting message (specific information) for resolving the abnormal state of transmission and reception. Specifically, the information presenting unit  115  refers to the determination information D 2 , specifies the troubleshooting information corresponding to the determination result of the voice determination unit  114 , further refers to the troubleshooting information D 3 , and acquires and presents a troubleshooting message corresponding to the troubleshooting information to the user. 
     For example, the information presenting unit  115  of the voice processing device  1 A presents a troubleshooting message in the conference room based on the sound volume of the speaker  13  of the voice processing device  1 A and the amount of noise in the voice of the user in the conference room B received by the voice processing device  1 A. For example, the information presenting unit  115  of the voice processing device  1 A presents, in the conference room B, a troubleshooting message based on at least either of the sound volume of the speaker  13  of the voice processing device  1 A and the amount of noise in the voice of the user in the conference room B received by the voice processing device  1 A. 
     As a further example, the information presenting unit  115  of the voice processing device  1 A presents a troubleshooting message in the conference room B based on the network bandwidth status between the conference room A and conference room B, and the amount of noise in the voice of the user of the conference room B received by the voice processing device  1 A. The information presenting unit  115  of the voice processing device  1 A may present, in the conference room B, a troubleshooting message based on at least either of the network bandwidth status between the conference room A and conference room B, and the amount of noise in the voice of the user of the conference room B received by the voice processing device  1 A. 
     The information presenting unit  115  causes the troubleshooting message to display on the display device  2 B provided in the conference room B. Further, the information presenting unit  115  may cause the same troubleshooting message or a different troubleshooting message as the display device  2 B provided in the conference room B to display on the display device  2 A provided in the conference room A. 
     Information Presentation Processing 
     Hereinafter, with reference to  FIG.  9   , an example of the procedure of the information presentation processing performed by the controller  11  of the voice processing device  1  will be described. Here, in the conferencing system  100  shown in  FIG.  1   , the information presentation processing performed by the controller  11  of the voice processing device  1 A will be described. For example, the controller  11  of the voice processing device  1 A starts the execution of the information presentation processing program by starting the conferencing system, thereby starting the information presentation processing. The information presentation processing is executed individually and in parallel in each of the voice processing devices  1 A, and  1 B. 
     The present disclosure can be regarded as a disclosure of a voice processing method in which one or more steps included in information presentation processing are performed. Further, one or more steps included in the information presentation processing described here may be omitted where appropriate. Again, each of the steps in the information presentation processing may be executed in a different order as long as a similar operation and effect is obtained. Additionally, though in the example described here, each step in the information presentation processing is executed by the controller  11 , in another embodiment, each step in the information presentation processing may be divided and processed by one or a plurality of processors. 
     In step S 11 , the controller  11  of the voice processing device  1 A determines whether the voice spoken by the user of the conference room B is recognized. When the controller  11  recognizes the voice of the user in the conference room B (S 11 : YES), the process proceeds to step S 12 . When the controller  11  cannot recognize the voice of the user in the conference room B (S 11 : NO), the process proceeds to step S 21  (see  FIG.  10   ). Step S 11  is one example of the voice recognition step of the present disclosure. 
     In step S 12 , the controller  11  of the voice processing device  1 A determines whether the keyword, registered in the keyword information D 1  (see  FIG.  3   ), from the user in the conference room A has been recognized (detected). If the controller  11  does not acquire a keyword (S 12 : NO), the processing proceeds to step S 13 . If the controller  11  does acquires a keyword (S 12 : YES), the processing proceeds to step S 14 . That is, when the controller  11  does not recognize the keyword (S 12 : NO), the controller  11  determines that the state of transmission and reception of the voice between the conference room A and the conference room B is normal, and when the controller  11  recognizes the keyword (S 12 : YES), the controller  11  determines that the state of transmission and reception of the voice between the conference room A and the conference room B is abnormal. 
     In step S 13 , the controller  11  of the voice processing device  1 A determines that the state of transmission and reception of the voice between the conference room A and the conference room B is normal, and does not perform the information presentation processing for the troubleshooting message. In this case, the voice of the conference room A and the voice of the conference room B are being sent and received normally. 
     In step S 14 , the controller  11  of the voice processing device  1 A determines whether the set sound volume of the speaker  13  of the voice processing device  1 A is greater than or equal to a threshold value (for example, 50% of the maximum value). When the set sound volume is greater than or equal to the threshold value (S 14 : YES), the process proceeds to step S 15 . When the set sound volume is less than the threshold value (S 14 : NO), the process proceeds to step S 16 . 
     In step S 15 , the controller  11  of the voice processing device  1 A determines whether the noise in the voice (SNR) received from the conference room B is less than a threshold value (for example, 0 dB). When the noise (SNR) is less than the threshold value (0 dB) (S 15 : YES), the process proceeds to step S 17 . When the noise (SNR) is greater than or equal to the threshold value (0 dB) (S 15 : NO), the process proceeds to step S 18 . 
     In step S 16 , the controller  11  of the voice processing device  1 A determines in the same way as in step S 15  whether the noise in the voice (SNR) received from the conference room B is less than a threshold value (0 dB). When the noise (SNR) is less than the threshold value (0 dB) (S 16 : YES), the process proceeds to step S 19 . When the noise (SNR) is greater than or equal to the threshold value (0 dB) (S 16 : NO), the process proceeds to step S 20 . Steps S 12  to S 16  are examples of the voice determination step of the present disclosure. 
     In steps S 17  to S 20 , the controller  11  of the voice processing device  1 A presents a troubleshooting message for resolving the abnormal state of transmission and reception of voice between the conference room A and the conference room B. Steps S 17  to S 20  are examples of the information presentation steps of the present disclosure. 
     For example, in step S 17 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 B of the conference room B to display a troubleshooting message M 1  corresponding to the troubleshooting information  1  (see  FIG.  6   ). 
     For example, in step S 18 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 A of the conference room A and the display device  2 B of the conference room B to display a troubleshooting message M 2  corresponding to the troubleshooting information  2  (see  FIG.  7   ). 
     For example, in step S 19 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 A of the conference room A and the display device  2 B of the conference room B to display a troubleshooting message corresponding to the troubleshooting information  3 . 
     For example, in step S 20 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 A of the conference room A and the display device  2 B of the conference room B to display a troubleshooting message corresponding to the troubleshooting information  4 . 
     Here, in step S 11 , when the controller  11  of the voice processing device  1 A cannot recognize the voice of the user of the conference room B (S 11 : NO), in step S 21  (see  FIG.  10   ) the controller  11  of the voice processing device  1 A determines whether the keyword the keyword registered the keyword information D 1  (see  FIG.  3   ) from the user in the conference room A has been recognized (detected). If the controller  11  does not acquire a keyword (S 21 : NO), the processing proceeds to step S 22 . If the controller  11  does acquires a keyword (S 21 : YES), the processing proceeds to step S 23 . The controller  11  does not present a troubleshooting message when a keyword is not recognized (S 21 : NO), since it is difficult to specify the cause of the trouble with the voice. In this case, the controller  11  may display a message on the display device  2 A of the conference room A and the display device  2 B of the conference room B indicating that trouble with the voice has occurred. 
     In step S 23 , the controller  11  of the voice processing device  1 A determines whether the network bandwidth (transmitted and received data amount) between the conference room A and the conference room B is greater than or equal to a threshold value (for example, 1.5 Mbps) When the network bandwidth (transmitted and received data amount) is greater than or equal to the threshold value (S 23 : YES), the process proceeds to step S 24 . When the network bandwidth (transmitted and received data amount) is greater than or equal to the threshold value (S 23 : NO), the process proceeds to step S 25 . 
     In step S 24 , the controller  11  of the voice processing device  1 A determines in the same way as in step S 15  whether the noise in the voice (SNR) received from the conference room B is less than a threshold value (0 dB). When the noise (SNR) is less than the threshold value (0 dB) (S 24 : YES), the process proceeds to step S 26 . When the noise (SNR) is greater than or equal to the threshold value (0 dB) (S 24 : NO), the process proceeds to step S 26 . 
     In step S 25 , the controller  11  of the voice processing device  1 A determines whether or not the hearing state of received sound of the state of voice received from the conference room B is “intermittent” or “cannot hear at all”, for example, the controller  11  determines if received vocal data exists. When received voice data from the conference room B exists, (when the hearing condition is “intermittent”), the process proceeds to step S 28 . When no received voice data from the conference room B exists, (when the hearing state is “cannot hear at all”), the process proceeds to step S 29 . Steps S 21  to S 25  are examples of the voice determination steps of the present disclosure. 
     In steps S 26  to S 29 , the controller  11  of the voice processing device  1 A presents a troubleshooting message for resolving the abnormal the state of transmission and reception of voice between the conference room A and the conference room B. Steps S 26  to S 29  are examples of the information presentation steps of the present disclosure. 
     For example, in step S 26 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 B of the conference room B to display a troubleshooting message corresponding to the troubleshooting information  5 . 
     For example, in step S 27 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 B of the conference room B to display a troubleshooting message corresponding to the troubleshooting information  6 . 
     For example, in step S 28 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 A of the conference room A and the display device  2 B of the conference room B to display a troubleshooting message corresponding to the troubleshooting information  7 . 
     For example, in step S 29 , the controller  11  of the voice processing device  1 A refers to the determination information D 2  and the troubleshooting information D 3 , and causes the display device  2 A of the conference room A and the display device  2 B of the conference room B to display a troubleshooting message corresponding to the troubleshooting information  8 . 
     The conferencing system  100  executes the information presentation processing in the manner described above. As described above, the conferencing system  100  according to the present embodiment determines the state of transmission and reception of the voice between the first base and the second base based on the recognition result of the first voice received from the first base and the recognition result of the second voice received from the second base, and when the state of transmission and reception is abnormal, the conferencing system  100  presents specific information for resolving the abnormal state of transmission and reception. Specifically, the conferencing system  100  presents specific information according to a combination of the result showing whether the first voice was recognized and the content of an acquired word by recognizing the second voice. As a result, when trouble with the voice, such as interruption of a voice call, occurs due to a network bandwidth shortage, latency, a malfunction of a microphone or a speaker, or the like, the cause of the trouble with the voice can be specified and specific information is presented to the user for solving the trouble with the voice. The user acquires the specific information and performs operations to solve the trouble with the voice. Therefore, it is possible to solve the trouble with the voice quickly. 
     Here, the specific information of the present disclosure is not limited to a troubleshooting message (see  FIG.  5   ). For example, as shown in  FIG.  8   , the information presenting unit  115  may display an object image P 2  based on which it is capable of identifying what is abnormal in the state of transmission and reception, on the display device  2 . For example, when the set value of the microphone  14  of the voice processing device  1 B is the cause of the trouble with the voice, the information presenting unit  115  of the voice processing device  1 A causes the display device  2 B to display the object image P 2  (see  FIG.  8   ) showing the microphone  14 . In addition, the information presenting unit  115  may display, for emphasis, the object image P 2  with highlighting or blinking. The object image P 2  may be any image as long as it is capable of identifying what is abnormal in the state of transmission and reception based on the image, and examples thereof include an image showing a microphone, a speaker, a video, a network, and the like. 
     According to the above configuration, the user of the conference room B can easily recognize that the microphone  14  of the voice processing device  1 B is the cause of the trouble with the voice. 
     Also, the voice processing system of the present disclosure can be realized by including a server. For example, as shown in  FIG.  11   , the conferencing system  100  may include a server  10 , a display device  2 A, a microphone  3 A, and a speaker  4 A installed in the conference room A, and a display device  2 B, a microphone  3 B, and a speaker  4 B installed in the conference room B. The server  10  includes a controller  11 , a storage unit  12 , a communications interface  15 , and the like within the voice processing device  1  (see  FIG.  2   ). 
     The server  10  determines the state of transmission and reception of the voice between the conference room A and the conference room B based on a recognition result of the first voice received from the conference room A and a recognition result of the second voice received from the conference room B, and when the server  10  determines that the state of transmission and reception is abnormal, the server  10  presents specific information to resolve the abnormal state of transmission and reception on the display devices  2 A,  2 B, and the like. That is, the server  10  shown in  FIG.  11    is an example of the voice processing system of the present disclosure. 
     The voice processing system according to the present disclosure may freely combine the embodiments described above within the scope of the disclosure set forth in the claims, or may be configured by appropriately modifying or omitting parts of the embodiments.