Patent ID: 12260876

DETAILED DESCRIPTION OF THE INVENTION

Although the present invention is explained by using an embodiment of the invention below, the following embodiment does not limit the invention according to claims, and all combinations of features explained in the embodiment are not necessarily essential for solutions according to the invention.

[Overview of Voice Conference System S]

FIG.1is a schematic diagram of a voice conference system S according to the present embodiment. The voice conference system S includes a voice conference apparatus1, a plurality of user terminals2and an administrator terminal3. The numbers of user terminals2and administrator terminals3included in the voice conference system S are not limited. The voice conference system S may include other equipment such as servers or terminals.

The voice conference apparatus1is a computer that provides a plurality of voice conferences via a network. In a voice conference, sounds are exchanged between a plurality of user terminals2. In a voice conference, in addition to sounds, images (the images may be still images or moving images) and/or texts may be exchanged between a plurality of user terminals2. In addition, the voice conference apparatus1analyzes sounds generated in voice conferences, and displays analysis results on the user terminals2and the administrator terminal3.

For example, the voice conference apparatus1includes a single computer or a cloud which is a set of computer resources. The voice conference apparatus1is connected by a cable or wirelessly to the user terminals2or the administrator terminal3via a network such as a local area network or the Internet.

The user terminals2are information terminals used by users (students, employees, etc.) participating in voice conferences provided by the voice conference system S. For example, the user terminals2are personal computers, smartphones, tablet terminals and the like. In addition, the user terminals2may be wearable terminals that are worn by the users, and receive input of sounds and images, and output sounds and images. The user terminals2accept input of sounds of the users, and transmit them to the voice conference apparatus1, and also receive sounds input at other user terminals2from the voice conference apparatus1, and output them. Whereas one user uses one user terminal2in an example explained in the present embodiment, a plurality of users may use one user terminal2.

The administrator terminal3is an information terminal used by an administrator (a teacher, a boss or the like who is at the position of administering users) who administers one or more voice conferences provided by the voice conference system S. For example, the administrator terminal3is a personal computer, a smartphone, a tablet terminal or the like. In addition, the administrator terminal3may be a wearable terminal that is worn by the administrator, and receives input of sounds and images, and outputs sounds and images. The administrator terminal3displays results of sound analysis by the voice conference apparatus1, and also accepts interventions in voice conferences by the administrator.

In the voice conference system S according to the present embodiment, the voice conference apparatus1analyzes sounds generated in each of a plurality of voice conferences, and causes the administrator terminal3to display results of the sound analysis in association with the corresponding one of the plurality of voice conferences. Thereby, the voice conference system S can give the administrator an overall perspective of the situations of the plurality of voice conferences, and allow the administrator to easily know the situations of the plurality of voice conferences.

[Configuration of Voice Conference System S]

FIG.2is a block diagram of the voice conference system S according to the present embodiment. InFIG.2, arrows represent major data flows, and there may be data flows not depicted inFIG.2. InFIG.2, blocks represent not configuration in hardware (apparatus) units, but configuration in functional units. Accordingly, blocks depicted inFIG.2may be implemented in a single apparatus, or may be implemented separately in a plurality of apparatuses. Data exchange between blocks may be performed via any means such as a data bus, a network or a portable storage medium.

The voice conference apparatus1has a storage section11and a control section12. The control section12has a voice conference section121, a sound analyzing section122, a suggesting section123and a display control section124. The storage section11is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive and the like. On the storage section11, a program to be executed by the control section12is stored in advance. The storage section11may be provided outside the voice conference apparatus1, and, in that case, may perform data exchange with the control section12via a network.

For example, the control section12is a processor such as a CPU (Central Processing Unit), and executes the program stored on the storage section11to thereby function as the voice conference section121, the sound analyzing section122, the suggesting section123and the display control section124. At least some of the functionalities of the control section12may be executed by an electrical circuit. In addition, at least some of the functionalities of the control section12may be executed by a program executed through a network.

The voice conference section121executes a plurality of voice conferences by transmitting and receiving sounds to and from the plurality of user terminals2. The voice conference section121transmits and receives sounds generated in voice conferences (i.e. sounds input to sound input/output sections22) to and from a plurality of user terminals2used by a plurality of users participating in the voice conferences. In addition, the voice conference section121transmits and receives captured images of users participating in voice conferences (i.e. captured images captured by image capturing sections23) to and from a plurality of user terminals2used by a plurality of users participating in the voice conferences. In addition, the voice conference section121transmits and receives content input by a plurality of users participating in voice conferences (input texts, actions, etc.) to and from a plurality of user terminals2used by the users participating in the voice conferences.

Thereby, the voice conference section121can cause sounds, captured images and input content to be shared among a plurality of user terminals2, and execute voice conferences. In order to execute the voice conferences, the voice conference section121can use not only a specific method depicted here, but known methods.

In addition, the voice conference section121may accept an intervention of the administrator terminal3by using a text or a sound in a voice conference for which the suggesting section123suggests the intervention, or intervene in the voice conference by using a text or a sound automatically. For example, the intervention in the voice conference is made by outputting, to a user terminal2of each user participating in the voice conference, at least one of a text, a sound and an image input to the administrator terminal3by the administrator or by outputting, to a user terminal2of each user participating in the voice conference, at least one of a text, a sound and an image generated by the voice conference section121.

For example, in a case that an operation of selecting an intervention button314corresponding to any of voice conferences is performed on an operation section34of the administrator terminal3, the voice conference section121starts transmission and reception of a sound and/or a text between the administrator terminal3and a plurality of user terminals2participating in the voice conference, to thereby enable an intervention in the voice conference from the administrator terminal3. The voice conference section121may transmit and receive a sound and/or a text to and from only some user terminals2that are included in a plurality of user terminals2, and selected by the administrator terminal3. In addition, in addition to or instead of a sound and/or a text, as an intervention, the voice conference section121may transmit and receive images specified by user terminals2(the images may be still images or moving images) and images specified by the administrator terminal3.

The sound analyzing section122analyzes sounds generated in each of a plurality of voice conferences. For example, in association with each of the plurality of voice conferences, the sound analyzing section122calculates the utterance amount of each of a plurality of users, and also calculates the level of communication between a plurality of users (transitions of speakers).

First, on the basis of sounds acquired by the voice conference section121, the sound analyzing section122decides which user uttered (spoke), at temporal intervals (e.g. every 10 milliseconds to 100 milliseconds) in a voice conference. In a case that sounds of one user are input to each user terminal2, the sound analyzing section122decides which user uttered on the basis of a user terminal2from which sounds are acquired. In a case that sounds of a plurality of users are input to each user terminal2, the sound analyzing section122executes a known speaker separation process on sounds acquired from one user terminal2to thereby decide which user uttered.

The sound analyzing section122identifies, as an utterance period, a continuous period from the start of an utterance of one user until the end of the utterance, and stores the utterance period on the storage section11. In addition, the sound analyzing section122calculates an utterance amount of each user in each time unit, and stores the utterance amount on the storage section11. For example, the sound analyzing section122calculates, as an utterance amount in each time unit, a value obtained by dividing the length of time during which a user uttered in a certain time window (e.g. five seconds) by the length of the time window.

From the start time of a voice conference until the current time (the end time in a case of analysis after the end of the voice conference), the sound analyzing section122repeats calculations of the utterance amount of each user in each time window while shifting the time window every predetermined length of time (e.g. one second). Then, in a case that another utterance period starts after an utterance period, the sound analyzing section122senses a transition from one speaker to another speaker. The sound analyzing section122totals the time of occurrence of a transition sensed in an analysis-subject discussion, a user who is a speaker before the transition and a user who is a speaker after the transition, and stores them on the storage section11in association with each other.

Furthermore, the sound analyzing section122may perform analysis by comparing sounds generated in each of a plurality of voice conferences with previously acquired sound patterns or model sound patterns. In this case, the storage section11stores in advance the previously acquired sound patterns or the model sound patterns. For example, the model sound patterns are time-series data of utterance amounts of model humans that is created in advance by acquiring sound patterns in voice conferences in which model humans participated, and so on.

For example, a previously acquired sound pattern or a model sound pattern is defined for each purpose of voice conferences (the use of a voice conference, the type of users of a voice conference) such as education, sales or interviews. The sound analyzing section122accepts, in advance, selection of the purpose of a voice conference from a user terminal2or the administrator terminal3, and compares the utterance amount of each user calculated from sounds in the voice conference with a sound pattern specific to the purpose.

In addition, for example, the sound patterns may each be defined for a period in a voice conference. The sound analyzing section122accepts, in advance, specification of scheduled time (e.g. one hour) of a voice conference from a user terminal2or the administrator terminal3, and compares the utterance amount of each user calculate from sounds in the voice conference with a sound pattern specific to a period (the first period, intermediate period, last period, etc.) in the scheduled time.

Regarding a case that a comparison with a model sound pattern is performed, for example, in a case that all users in a voice conference for an educational purpose are students (typically, in a case that the system is used for a debate among students), it can be said that it is desirable if the utterance amounts of users are as uniform as possible in any period in the scheduled time, so the model sound pattern used for the comparison is one that reflects such a tendency. In addition, even in a voice conference for an educational purpose, if there is someone whose role is to give instructions in users in the voice conference (typically, in a case that the system is used for an English-conversation class including one lecturer and one or more students at an English-conversion school or the like), it can be said that it is desirable if the utterance amounts of the students are greater than the utterance amount of the lecturer, and it is desirable if the utterance amounts of the students are as uniform as possible in a case that there are a plurality of students, so a model sound pattern used for the comparison is one that reflects such a tendency. Furthermore, in a case of a voice conference for a sales purpose (typically, in a case that the system is used for a conference for sales to a customer), it can be said that the utterance amount of a salesperson may be allowed to be great for explanation of products or services that she/he is selling from the first to intermediate periods in the scheduled time, but it is desirable if the utterance amount of the customer increases such that the salesperson can hear reactions from the customer from the intermediate to last periods, so a model sound pattern used for the comparison is one that reflects such a tendency.

As comparison results, the sound analyzing section122calculates the level of a difference between the utterance amount of a user and time-series data of an utterance amount represented by a sound pattern (e.g. the cumulative value of differences between an utterance amount in the sound pattern and the utterance amount of the user), and causes the storage section11to store the comparison results.

On the basis of results of sound analysis by the sound analyzing section122, the suggesting section123suggests, to the administrator terminal3, an intervention in any of a plurality of voice conferences. Interventions to voice conferences mean participation in the voice conferences by the administrator using a text and/or a sound on the administrator terminal3. For example, in a case that results of analysis of one voice conference by the sound analyzing section122satisfy a predetermined condition, the suggesting section123identifies the voice conference as an intervention subject, and causes the display control section124to notify the identified intervention-subject voice conference to the administrator terminal3. For example, in a case that there is a user whose utterance amount is equal to or smaller than a predetermined value in a voice conference, in a case that the total utterance amount of a plurality of users participating in a voice conference is equal to or smaller than a predetermined value, or in other cases, the suggesting section123suggests the voice conference as an intervention subject.

On the basis of analysis by the sound analyzing section122, the display control section124causes a user terminal2and the administrator terminal3to display the situation of a voice conference and analysis results. Specific display content of the display control section124is mentioned later by usingFIG.3toFIG.6.

Each user terminal2has a display section21, the sound input/output section22, an image capturing section23and an operation section24. The administrator terminal3has a display section31, a sound input/output section32, an image capturing section33and an operation section34. The display sections21and31include liquid crystal displays or the like that can display information. The sound input/output sections22and32include microphones or the like for inputting sounds, and speakers or the like for outputting sounds. In a case that sounds of a plurality of users are input to one user terminal2, the sound input/output section22may include a plurality of microphones, a microphone array or the like in accordance with speaker separation processes to be performed at the sound analyzing section122. The image capturing sections23and33include cameras or the like that output captured images obtained by capturing images of users or the administrator. The operation sections24and34include buttons, switches, touch panels or the like that can accept operation by humans.

The configuration of the voice conference apparatus1, user terminals2and administrator terminal3according to the present embodiment is not limited to specific configuration depicted inFIG.2. The numbers of apparatuses for the voice conference apparatus1, user terminal2and administrator terminal3are not limited to one, but each of them may be configured by connecting two or more physically separate apparatuses by a cable or wirelessly.

[Explanation of Voice Conference Method]

(Display Screen of User Terminal2)

First, a process in which the voice conference apparatus1causes a user terminal2to display information about a voice conference is explained below. In the voice conference apparatus1, the display control section124causes the user terminal2to display a voice conference list screen including information about a plurality of voice conferences in which users can participate.

The following explanation is about a case that a plurality of users participating in voice conferences held for the purpose of a predetermined voice conference or the like are grouped into a plurality of groups each allocated with one of a plurality of rooms (virtual rooms), and voice conferences are held. That is, the following explanation is about a case that rooms (virtual rooms) are provided in a voice conference (an upper-layer voice conference) held for the purpose of a predetermined voice conference or the like, and a plurality of lower-layer voice conferences are held in the rooms (virtual rooms).

FIG.3is a schematic diagram of a user terminal2displaying an exemplary voice conference list screen. Under the control of the voice conference apparatus1, the user terminal2is displaying a voice conference list screen on the display section21. The voice conference list screen represents voice conference information211and an entry buttons212in association with each of a plurality of voice conferences (rooms). The voice conference information211represents the number of users participating in a voice conference. In addition, the voice conference information211may represent the names of users participating in a voice conference, the purpose of the voice conference or the like.

In a case that operation is performed to select any of the entry buttons212on the operation section24of the user terminal2, the voice conference section121allows a user of the user terminal2to participate in the voice conference (room) corresponding to the selected entry button212, and starts the voice conference. In addition, the voice conference section121may allow the user of the user terminal2to automatically participate in a voice conference (room) allocated in advance.

The display control section124causes a user terminal2to display a voice conference screen including information about a voice conference in which the user is participating.FIG.4is a schematic diagram of a user terminal2displaying an exemplary voice conference screen. Under the control of the voice conference apparatus1, the user terminal2is displaying a voice conference screen on the display section21.

About the voice conference (room) in which the user of the user terminal2is participating, the voice conference screen displays user images213, text information214, an input field215, an action field216and an analysis result217. The user images213are captured images of users obtained by capturing images by using the image capturing sections23of a plurality of user terminals2. In a case that a captured image cannot be acquired from a user terminal2or in a case that a user does not want her/his captured image to appear on screen, a predetermined image or text (the name of the user, etc.) may be displayed at the position of the user image213.

The text information214represents a message input on the operation section24of each of the plurality of user terminals2. In addition, the text information214may represent a message generated by the voice conference apparatus1(e.g. an automatic intervention message mentioned later).

The input field215is an area for a user to input a comment (e.g. a thought or an annotation) during the voice conference. The comment input to the input field215is stored on the storage section11of the voice conference apparatus1in association with the time of input. The action field216is an area for a user to input an action during the voice conference. For example, the action field216includes a plurality of buttons (icons) corresponding to a plurality of actions such as like, handclap, smile and the like. An action input in the action field216is stored on the storage section11of the voice conference apparatus1in association with the time of input.

The analysis result217represents results of sound analysis in a voice conference by the voice conference apparatus1while the voice conference is underway. While a voice conference is underway, on the basis of results of analysis by the sound analyzing section122, the display control section124displays, as the analysis result217and about each pair of users, arrow symbols representing the number of times of transition (i.e. the level of communication among a plurality of users) that has occurred from the start time until the current time in the voice conference. The thicknesses of the displayed arrow symbols of the analysis result217increase as the number of times of transition increases, and decrease as the number of times of transition decreases. Thereby, while the voice conference is underway, the voice conference system S can visually notify a user of the level of communication among users in the voice conference.

In addition, while a voice conference is underway, the display control section124changes the display mode of a user image213in accordance with the utterance amount of the user on the basis of results of analysis by the sound analyzing section122. The display control section124totals the utterance amount of each user from the start time of the voice conference until the current time. Then, in a case that the utterance amount of one user (or the ratio of utterance compared to other users) is equal to or smaller than a predetermined value, the display control section124makes different the color, size, shape, frame line or the like of the user image213of the user from those of the user images213of other users. Thereby, the voice conference system S can encourage users who utter less to utter more.

In addition, the display control section124may switch whether to or not to display the analysis result217on each of the plurality of user terminals2. For example, the display control section124switches whether to or not to display the analysis result217in accordance with the purpose of a voice conference. In addition, the display control section124may acquire information representing the degree of proficiency or personality of a user stored on the storage section11in advance, and display the analysis result217only on the user terminal2of a user whose acquired degree of proficiency or personality satisfies a predetermined condition (e.g. that the user is a highly proficient user or has a personality favoring discussions). In addition, the display control section124may display the analysis result217only on the user terminal2of a user specified by the administrator. In addition, the display control section124may acquire the line-of-sight direction of a user by a known line-of-sight sensing method, and display the analysis result217only on the user terminal2of a user whose acquired line-of-sight direction satisfies a predetermined condition (e.g. the user has not gazed at the analysis result217for a predetermined length of time or longer).

Next, a process in which the voice conference apparatus1causes the administrator terminal3to display information about a voice conference is explained below. In the voice conference apparatus1, the display control section124causes the administrator terminal3to display a voice conference list screen including information about a plurality of voice conferences administered by the administrator.

(Display Screen of Administrator Terminal3)

The following explanation also is about a case that a plurality of users participating in voice conferences held for the purpose of a predetermined voice conference or the like are grouped into a plurality of groups each allocated with one of a plurality of rooms (virtual rooms), and voice conferences are held. That is, the following explanation is about a case that rooms (virtual rooms) are provided in a voice conference (an upper-layer voice conference) held for the purpose of a predetermined voice conference or the like, and a plurality of lower-layer voice conferences are held in the rooms (virtual rooms).

Note that in a case that the administrator is administering a plurality of upper-layer voice conferences, it may be made possible to cause the administrator terminal3to display a voice conference list screen including information about the plurality of upper-layer voice conferences even in a case that a plurality of lower-layer voice conferences are being held. In this case, as the information about the upper-layer voice conferences, information about all the voice conferences being held in the upper-layer voice conferences may be displayed without making distinctions between the lower-layer voice conferences. Alternatively, it may be made possible to display information about particular lower-layer voice conferences in upper-layer voice conferences selectively such that information about a particular lower-layer voice conference in one upper-layer voice conference, and information about a lower-layer voice conference in another upper-layer voice conference can be displayed.

FIG.5AandFIG.5Bare schematic diagrams of the administrator terminal3displaying exemplary voice conference list screens. Under the control of the voice conference apparatus1, the administrator terminal3is displaying a voice conference list screen on the display section31. The voice conference list screen displays voice conference information311and an analysis result312in association with each of a plurality of lower-layer voice conferences (rooms) included in an upper-layer voice conference administered by the administrator. The voice conference information311represents the names of users participating in voice conferences. The voice conference information311may represent the numbers of users participating in a voice conference, the purposes of the voice conferences and the like. The analysis result312represents results of analysis of the voice conferences by the sound analyzing section122. In addition, the voice conference list screen includes suggestion information313, intervention buttons314, comparison information315and a regroup button316that are mentioned later.

The display control section124causes the administrator terminal3to display the analysis result312of analysis, by the sound analyzing section122, of sounds generated in each of a plurality of voice conferences (rooms), in association with the voice conference. It is desirable if, while the plurality of voice conferences are underway, the display control section124causes the administrator terminal3to display analysis results in association with each of the plurality of voice conferences. Thereby, the voice conference system S can notify the administrator of the situations of the plurality of voice conferences being held currently, and make it easier for the administrator to determine whether or not it is necessary to intervene in the plurality of voice conferences.

For example, on the basis of results of analysis by the sound analyzing section122, the display control section124displays, as the analysis result312and about each pair of users participating in one voice conference, arrow symbols representing the number of times of transition (i.e. the level of communication among a plurality of users) that has occurred from the start time until the current time in the voice conference. The thicknesses of the displayed arrow symbols of the analysis result312increase as the number of times of transition increases, and decrease as the number of times of transition decreases. Thereby, while the voice conferences are underway, the voice conference system S can visually notify the administrator of the levels of communication among users in the voice conferences.

For example, on the basis of results of analysis by the sound analyzing section122, the display control section124displays, as the analysis result312, a line graph representing temporal changes of the utterance amount of each of a plurality of users participating in one voice conference (room). Using a line graph having a longitudinal axis representing the utterance amount, and a horizontal axis representing time, the display control section124displays the utterance amount of each user at each time point represented by analysis results. At this time, the display control section124stacks up the utterance amounts of users at each time point one on another, that is, displays the total value of the utterance amounts of the users in order along the longitudinal axis. Thereby, while the voice conferences are underway, the voice conference system S can visually notify the administrator of the overall utterance amounts of voice conferences, in addition to the utterance amount of each user participating in a voice conference.

For example, on the basis of results of analysis by the sound analyzing section122, the display control section124displays, as the analysis result312, a bar graph representing the total value of the utterance amount of each of a plurality of users participating in one voice conference. Thereby, while the voice conferences are underway, the voice conference system S can visually notify the administrator of the total value of the utterance amount of each user.

In a case that operation is performed to select an arrow symbol, a line graph or a bar graph included in the analysis result312on the operation section34of the administrator terminal3, the display control section124may expand the selected arrow symbol, line graph or bar graph to display details of the selected arrow symbol, line graph or bar graph. As the analysis result312, the display control section124may not necessarily display arrow symbols, line graphs and bar graphs, but display other analysis results obtained by analyzing sounds, in association with each of a plurality of voice conferences (rooms).

The display control section124causes the administrator terminal3to display information representing a voice conference (room) for which the suggesting section123is suggesting an intervention. As depicted inFIG.5A, the display control section124causes the voice conference list screen being displayed by the administrator terminal3to display the suggestion information313representing a voice conference for which the suggesting section123is suggesting an intervention. For example, the suggestion information313caused to be displayed by the display control section124include a text that can identify a voice conference (room) for which the suggesting section123is suggesting an intervention, as well as a text explaining a reason why the intervention is necessary.

In addition, the display control section124makes different the display mode of the voice conference information311corresponding to a voice conference for which the suggesting section123is suggesting an intervention in a plurality of voice conferences included in the voice conference list screen being displayed by the administrator terminal3from the display modes of the voice conference information311corresponding to the other voice conferences. Whereas the display control section124changes the display mode of the voice conference information311by using a different frame line in the example inFIG.5A, the color, size, shape or the like of the voice conference information311may be changed.

As depicted inFIG.5B, the display control section124may cause the comparison information315representing comparison results calculated by the sound analyzing section122to be displayed. For example, the suggestion information313caused to be displayed by the display control section124includes a text that can identify a voice conference for which a comparison with a sound pattern was performed, as well as a text explaining the comparison results. In addition, the display control section124may cause not only the administrator terminal3, but also a user terminal2to display results of a comparison of sounds with a sound pattern. Thereby, the voice conference system S can present, to the administrator, results of sound analysis relative to a sound pattern acquired in advance, and make it easier for the administrator or a user to interpret the analysis results.

On the voice conference list screen being displayed by the administrator terminal3, the display control section124may display an action and a comment input by a user while a voice conference is underway, in addition to results of analysis by the sound analyzing section122. As mentioned above, the action is any of a plurality of actions such as like, handclap or smile input by the user on the user terminal2during the voice conference, and is stored on the storage section11in association with the time of input. The comment is a thought, an annotation or the like input by the user on the user terminal2during the voice conference, and is stored on the storage section11in association with the time of input.

FIG.6is a schematic diagram for explaining a method of displaying actions and comments on analysis results. For example, the display control section124causes the analysis result312included in the voice conference list screen to display a text representing the content of an action and a comment at positions corresponding to the times of input of the action and the comment above the line graph representing temporal changes of utterance amounts. In addition, the display control section124may cause not only the administrator terminal3, but also a user terminal2to display an action and a comment. Thereby, the voice conference system S can present analysis results along with an action and a comment of a user input during a voice conference, and make it easier for the administrator or a user to interpret analysis results.

In addition, while a voice conference is underway, the display control section124may cause one user terminal2to display information representing an action input on another user terminal2. Thereby, a user can notify another user of her/his opinion such as an agreement without interrupting an ongoing conversation.

(User Grouping Process)

In a case that operation is performed to select the regroup button316included in the voice conference list screen depicted inFIG.5AandFIG.5Bon the operation section34of the administrator terminal3, in the voice conference apparatus1, the sound analyzing section122may group a plurality of users into a plurality of groups for executing a plurality of voice conferences on the basis of analysis results of a plurality of voice conferences. That is, on the basis of the analysis results, the sound analyzing section122suggests a plurality of groups that are preferable for executing voice conferences in the future.

FIG.7is a schematic diagram for explaining a method of grouping a plurality of users into a plurality of groups on the basis of analysis results. It is supposed that the sound analyzing section122has stored, on the storage section11, analysis results of analysis of sounds of each of two voice conferences corresponding to groups G1and G2into which the plurality of users are grouped. On the basis of the analysis results stored on the storage section11, the sound analyzing section122groups the plurality of users into new groups G1′ and G2′.

Note that whereas regrouping in the explanation here means regrouping into rooms (virtual rooms) (into lower-layer voice conferences) to group users in the groups G1and G2into the new groups G1′ and G2′, regrouping may include content meaning division of a voice conference in a room (virtual room) into smaller lower-layer voice conferences.

For example, on the basis of the analysis results, the sound analyzing section122groups the plurality of users into a plurality of groups such that the utterance amounts or utterance tendencies of a plurality of users belonging to one group are similar to each other. In this case, the sound analyzing section122clusters the utterance amounts of the plurality of users by using a known method, and sets each cluster as a group.

In addition, for example, the sound analyzing section122may group, into the same group, users having the utterance tendency of interrupting utterances of others in a voice conference in the middle often, the utterance tendency of uttering in any of the first period, the intermediate period and the last period in a voice conference often or another utterance tendency. On the other hand, the sound analyzing section122may group a plurality of users into a plurality of groups such that the utterance amounts or utterance tendencies of a plurality of users belonging to one group are not similar to each other.

In addition, the sound analyzing section122may group a plurality of users into a plurality of groups on the basis of an attribute of each of the plurality of users, in addition to analysis results. For example, the attributes of users are grades of the users at school or results of personality diagnosis implemented in advance on the users. In this case, the sound analyzing section122groups the plurality of users into a plurality of groups such that the attributes of a plurality of users belonging to each group are similar to or not similar to each other.

The voice conference section121automatically starts voice conferences in which a plurality of users included in each of a plurality of groups generated by the sound analyzing section122participate. In addition, by displaying information representing a voice conference corresponding to a group including users on the voice conference list screen displayed by the user terminal2inFIG.3, the display control section124may notify a user of a voice conference in which the user should participate.

In this manner, the voice conference system S can make it possible to efficiently perform learning or evaluation of users by suggesting groups for holding voice conferences each with similar users or dissimilar users.

(Automatic Intervention Based on Sound Analysis Results)

By using a sound and/or a text, the voice conference section121may automatically intervene in a voice conference (room) for which the suggesting section123is suggesting an intervention. In this case, the voice conference section121decides intervention content on the basis of results of analysis by the sound analyzing section122. For example, in a case that there is a user whose utterance amount is equal to or smaller than a predetermined value in a voice conference, the voice conference section121decides intervention content to encourage the user to utter more. In addition, for example, in a case that the total utterance amount of a plurality of users participating in a voice conference is equal to or smaller than a predetermined value, the voice conference section121decides intervention content to encourage all of them to utter more.

Then, the voice conference section121generates an automatic sound (mechanical sound) representing intervention content, and causes the plurality of user terminals2participating in the voice conference to output the automatic sound, or generates a text representing intervention content, and causes the plurality of user terminals2participating in the voice conference to display the text. Thereby, on the basis of results of sound analysis, the voice conference system S can automatically intervene in a voice conference that requires an intervention, and facilitate the proceedings of the voice conference while reducing a burden on the administrator. The voice conference section121may automatically intervene only in some user terminals2that are included in the plurality of user terminals2, and selected on the basis of a predetermined condition. In this case, for example, as an intervention subject, the voice conference section121selects the user terminal2of a user whose utterance amount is equal to or smaller than a predetermined value.

Note that, as mentioned above, in addition to or instead of a sound and/or a text, as an intervention, the voice conference section121may transmit and receive an image specified by a user terminal2(the image may be a still image or a moving image) and an image specified by the administrator terminal3.

[Procedure of Voice Conference]

FIG.8is a figure depicting a flowchart of a voice conference method executed by the voice conference apparatus1. In the voice conference apparatus1, the display control section124causes a user terminal2to display a voice conference list screen including information about a plurality of voice conferences in which a user can participate.

In accordance with operation on the operation section24of the user terminal2, the voice conference section121accepts participation of the user in any of the voice conferences (S11). By starting exchange of sounds between a plurality of user terminals2of a plurality of users participating in the voice conference, the voice conference section121starts the voice conference (S12).

The sound analyzing section122analyzes sounds generated in each of a plurality of voice conferences (S13). For example, in association with each of the plurality of voice conferences, the sound analyzing section122calculates the utterance amount of each of a plurality of users, and also calculates the level of communication between a plurality of users (transitions of speakers).

The display control section124causes the user terminal2to display results of analysis by the sound analyzing section122(S14). For example, while the voice conference is underway, on the basis of the results of analysis by the sound analyzing section122, the display control section124causes the user terminal2to display arrow symbols representing the levels of communication between a plurality of users. In addition, for example, while the voice conference is underway, the display control section124changes the display mode of a user image in accordance with the utterance amount of the user on the basis of the results of analysis by the sound analyzing section122.

The display control section124causes the administrator terminal3to display the analysis result312of analysis, by the sound analyzing section122, of sounds generated in each of a plurality of voice conferences, in association with the voice conference (S15). For example, while the voice conference is underway, on the basis of the results of analysis by the sound analyzing section122, the display control section124causes the administrator terminal3to display arrow symbols representing the levels of communication between a plurality of users.

In addition, for example, while the voice conference is underway, on the basis of the results of analysis by the sound analyzing section122, the display control section124causes the administrator terminal3to display a line graph representing temporal changes of the utterance amount of each of the plurality of users participating in the one voice conference. In addition, for example, while the voice conference is underway, on the basis of the results of analysis by the sound analyzing section122, the display control section124causes the administrator terminal3to display a bar graph representing the total value of the utterance amount of each of the plurality of users participating in the one voice conference.

Advantages of Present Embodiment

According to the voice conference system S according to the present embodiment, the voice conference apparatus1analyzes sounds generated in each of a plurality of voice conferences, and causes the administrator terminal3to display results of the sound analysis in association with the corresponding one of the plurality of voice conferences. Thereby, the voice conference system S makes it possible to give the administrator an overall perspective of the situations of the plurality of voice conferences, and allow the administrator to easily know the situations of the plurality of voice conferences.

Although the present invention has been explained above by using an embodiment, the technical scope of the present invention is not limited to the scope of description of the embodiment described above, but can be modified and changed variously within the scope of its gist. For example, the whole or part of an apparatus can be configured in a functionally or physically distributed or integrated manner in any units. In addition, a new embodiment generated by any combination of a plurality of embodiments is also included in embodiments of the present invention. Advantages of the new embodiment generated by the combination include advantages of the original embodiments.

The processor of the voice conference apparatus1is the main one that performs each step (step) included in the voice conference method depicted inFIG.8. That is, the processor of the voice conference apparatus1reads out, from the storage section11, a program for executing the voice conference method depicted inFIG.8, and executes the program to control each section of the voice conference apparatus1, to thereby execute the voice conference method depicted inFIG.8. Some of the steps included in the voice conference method depicted inFIG.8may be omitted, the order of the steps may be changed, and a plurality of steps may be performed in parallel.