Source: https://patents.google.com/patent/JP6401079B2/en
Timestamp: 2019-09-19 18:21:35
Document Index: 489757338

Matched Legal Cases: ['art 16', 'art 11', 'art 12', 'art 13', 'art 14', 'art 15', 'art 16', 'art 17']

JP6401079B2 - Apparatus and program for estimating activation of discussion for each group - Google Patents
Apparatus and program for estimating activation of discussion for each group Download PDF
JP6401079B2
JP6401079B2 JP2015042285A JP2015042285A JP6401079B2 JP 6401079 B2 JP6401079 B2 JP 6401079B2 JP 2015042285 A JP2015042285 A JP 2015042285A JP 2015042285 A JP2015042285 A JP 2015042285A JP 6401079 B2 JP6401079 B2 JP 6401079B2
JP2015042285A
JP2016162339A (en
2015-03-04 Application filed by Kddi株式会社, Ｋｄｄｉ株式会社 filed Critical Kddi株式会社
2015-03-04 Priority to JP2015042285A priority Critical patent/JP6401079B2/en
2016-09-05 Publication of JP2016162339A publication Critical patent/JP2016162339A/en
2018-10-03 Publication of JP6401079B2 publication Critical patent/JP6401079B2/en
The present invention relates to a technique for analyzing speech (voice data) by a large number of users.
Conventionally, in order to estimate the activity of group discussion, there is a technique of analyzing the time transition of utterance interaction and analyzing the degree of participation of each member in conversation (for example, see Non-Patent Document 1).
There is also a technique for recognizing the degree of excitement for each conference hall for a remote conference between a plurality of conference halls (see, for example, Patent Document 1). According to this technology, it is possible to acquire information on a participant's speech operation at each conference hall and share the degree of excitement among sites.
In addition, there is a technique for determining an average brain activity level of a large number of people based on uttered speech and evaluating the activity level of work in a team composed of the large number of people (see, for example, Patent Document 2).
Further, there is a technique for calculating the participation attitude value of each participant with respect to the conference (see, for example, Patent Document 3). According to this technology, the participation attitude value is obtained based on the participant parameters related to the number of utterances, the utterance time and / or energy, and the weighting coefficient of each participant parameter, by acquiring the volume and acceleration of the participant's voice. Is done.
Further, there is a conference system technology that creates a drawing event from posture information of a mobile terminal and user operation information (see, for example, Patent Document 4). According to this technique, it is possible to grasp the content of the conference at a low cost based on the drawing event and the conference material.
JP 2006-302047 A JP 2007-267965 A JP 2012-113442 A JP 2014-103451 A
Yuri Moriya, Takaaki Tanaka, Toshimitsu Miyajima, Shinya Fujita, "A Study on Estimating Conversation Activity Based on Voice Information during Voice Chat", Journal of Human Interface Society Vol.14, No.3, pp.57-66 , 2012, [online], [Search on February 11, 2015], Internet <URL: http://reality.ei.tuat.ac.jp/papers/HI14-3.pdf> Yuki Hayashi, Hiroshi Ogawa, Yukiko Nakano, "Visualization of learning attitudes based on non-linguistic information in collaborative learning", IPSJ Transactions, Vol.55 No.1, pp.189-198, 2014, [online], [Heisei Search on February 11, 2015], Internet <URL: http://ci.nii.ac.jp/naid/110009660247> Mayumi Bono, Noriko Suzuki, Tomohiro Katagiri, "Participation Structure Analysis in Multi-person Conversation: Extracting Interests from Interaction Behavior", Cognitive Science Vol. 11 No. 3 pp. 214-227, 2004, [online], [Heisei Search on February 11, 2015], Internet <URL: https://www.jstage.jst.go.jp/article/jcss/11/3/11_3_214/_article/-char/ja/>
Participants are expected to discover learning effects and ideas through discussions about group learning in classrooms and other group discussions in company training. However, according to the above-described prior art, the individual speech activity level within one group is merely estimated according to the number of utterances and the degree of concentration. On the other hand, a facilitator who teaches the entire group can act to increase its activity if it can recognize a group in which no active interaction has occurred.
On the other hand, can the inventors of the present application effectively transmit the active state of each group to the progressors who simultaneously teach a plurality of groups? I thought. In other words, is it possible to support group discussion by visually indicating the results of estimating the activity of group discussion to the progressors (administrators) and users as appropriate? I thought.
Accordingly, the present invention estimates the activation of discussion for each group, and an object thereof is to provide an apparatus and program capable of clearly the situation with respect to the traveling person.
According to the present invention, for each group composed of a plurality of members participating in the discussion, an apparatus for estimating the activation of the discussion,
Utterance storage means for storing the utterance time and utterance time length of each utterance by recognizing the utterance of each member belonging to the group collected using one or more microphones for each group ;
Group utterance classification means for classifying the utterance time and utterance time length of each member for each group;
For each group, an utterance density contribution rate calculating means for calculating an utterance density contribution rate representing the ratio of the utterance time length of each member to the overall utterance time length;
Each group has group graph generation means for generating a graph in which the utterance density contribution rate of each member is drawn, and the graph is clearly shown to the user.
Further comprising a group utterance activity calculation means for calculating a group utterance activity level representing a ratio of the utterance time length of the group to the average value of the utterance time lengths of all groups ;
The group graph generation means generates a graph in which the group utterance activity of each group is further drawn.
Also it preferred a call.
Group graph generating means, for each group a graph of radar chart-like or rod and each member element, preferably also simultaneously generated to Turkey in multiple groups.
For each group, for each member, an overlap time length between the utterance time length of the member and the utterance time length of the other member is detected, and an overlap rate representing the overlap time length with respect to the utterance time length of the member is calculated. It further has an overlap rate calculation means ,
The group graph generation means generates a graph in which the overlap rate of each member is further drawn for each group.
The group graph generation means generates a graph visually highlighting members whose utterance density contribution rate belongs to the first predetermined condition range and whose overlap rate belongs to the second predetermined condition range for each group. the preferred also to Turkey.
A support message representing the member characteristic is associated with each predetermined range of the utterance density contribution rate and / or every predetermined range of the overlap rate and stored in advance, and the utterance density contribution rate of the graph It is also preferable to further include assistance message selection means for selecting an assistance message according to the overlap rate, and to further clarify the selected assistance message to the user.
According to the present invention, a program for causing a computer to function as each unit of the above-described apparatus may be used.
According to the program, terminal, and system of the present invention, activation of discussion for each group can be estimated, and the situation can be clearly shown to the progressor.
It is a 1st system block diagram in this invention. It is a 2nd system block diagram in this invention. It is a function block diagram of the terminal in this invention. It is explanatory drawing showing the example of the utterance density and overlap rate in a group and a member. It is a graph showing group activation in this invention. It is a graph showing the group speech activity according to time passage.
FIG. 1 is a first system configuration diagram according to the present invention.
According to FIG. 1, a large number of members are classified into a plurality of groups. Each user who becomes a member possesses a terminal such as a smartphone or a wearable device. Each terminal can communicate with a management terminal (another user terminal) of a progressor or a management apparatus on the Internet via, for example, a wireless LAN. Each terminal is equipped with a microphone, collects the utterance voice of each member, and immediately transmits the utterance time and the utterance time length detected from the utterance voice to the management terminal or the management apparatus. The management device or the management terminal estimates activation of discussion for each group and clearly indicates the situation to the user (progressor).
Of course, the terminals may mutually transmit and receive the utterance time and the utterance time length. In this case, each terminal is installed with an application executed on the management terminal or the management apparatus. Each terminal can also estimate the activation of discussion for each group and make the situation clear to the members.
FIG. 2 is a second system configuration diagram according to the present invention.
According to FIG. 2, for each group, a member's speech is always collected by a microphone. The utterance voice data is immediately transmitted to the management apparatus 1. The management device 1 classifies the uttered voice collected by each microphone by speaker recognition (voice recognition) for each member. In this case, it is necessary to register each member's voiceprint in advance. And the management apparatus 1 acquires the utterance time and utterance time length detected from the utterance voice of each member. Of course, the microphone may be a pin microphone that is attached to each member instead of the collective microphone, and may collect only the utterance voice unique to the member and transmit the utterance voice to the management apparatus 1.
FIG. 3 is a functional configuration diagram of the terminal in the present invention.
According to FIG. 3, the terminal 1 estimates activation of discussion for each group, and clearly indicates the situation to the user (progressor). The terminal 1 includes an utterance voice acquisition unit 10, an utterance storage unit 11, a group utterance classification unit 12, an utterance density contribution rate calculation unit 13, a group utterance activity level calculation unit 14, an overlap rate calculation unit 15, A group graph generation unit 16 and a support message selection unit 17 are included. These functional components can be realized by executing a program that causes a computer installed in the terminal to function.
[Speech voice acquisition unit 10]
The utterance voice acquisition unit 10 causes the utterance storage unit 11 to store the utterance time and utterance time length of the member detected from the utterance voice of the member collected by the microphone. The utterance time length may be measured in units of 3 seconds, for example. The utterance time length is divided every time a silent section of 3 seconds or longer is detected.
[Speech storage unit 11]
The utterance storage unit 11 stores the utterance time and the utterance time length when each member utters. The utterance time and the utterance time length are extracted from each member's utterance voice, not the voice data itself.
[Group utterance classification unit 12]
The group utterance classification unit 12 uses the utterance storage unit 11 to classify the utterance time and utterance time length of each member in time series for each group.
FIG. 4 is an explanatory diagram showing an example of speech density and overlap rate in groups and members.
According to FIG. 4, it is assumed that four groups of five members are discussing simultaneously in parallel. Of course, the number of members constituting each group may be different for each group. FIG. 4 shows the duration of the utterance in units of 3 seconds for a discussion time of 1800 seconds (30 minutes), for example.
[Speech density contribution rate calculation unit 13]
The utterance density contribution rate calculation unit 13 calculates, for each group, an “utterance density contribution rate” that represents the ratio of the utterance time length of the member to the utterance time length of all members. For example, according to FIG.
Speech density contribution rate U A1 of member A1
= Total utterance time length of member A1 (U A1 ) / Total utterance time length (Σ A = A1 to A5 U A )
= 600/1370
Speech density contribution rate U A2 of member A2 = 90/1370 = 0.066
Speech density contribution rate of member A3 U A3 = 500/1370 = 0.365
Speech density contribution rate U A4 of member A4 = 120/1370 = 0.088
Speech density contribution rate U A5 of member A5 = 60/1370 = 0.044
[Group utterance activity calculation unit 14]
The group utterance activity level calculation unit 14 calculates “group utterance activity level” representing the ratio of the utterance time length of the group to the average value of the utterance lengths of all groups. For example, according to FIG.
Group A speech activity UG A
= Average Group A total speech duration / total group speech time length = (Σ A = A1~A5 U A ) / ((Σ g = A~D UG g) / the number of groups)
= 1370/915
= 1.497
Group B speech activity UG B = 1650/915 = 1.803
Speech activity of group C UG C = 210/915 = 0.230
Group D speech activity UG D = 430/915 = 0.470
[Overlap rate calculation unit 15]
The overlap rate calculation unit 15 detects, for each group, the “overlap time length” between the utterance time of the member and the utterance time of the other member for each member, and the overlap time length with respect to the utterance time length of the member The overlap ratio representing is calculated. The overlap (when one member is speaking and the other member also speaks) can be detected from the speaking time and speaking time length between the members. For example, according to FIG.
Overlap rate OL A1 of member A1
= Overlap time length / Speech time length = 240/600
Overlap ratio of the member A2 OL A2 = 36/90 = 0.4
Overlap ratio of member A3 OL A3 = 100/500 = 0.2
Overlap ratio of the member A4 OL A4 = 24/120 = 0.2
Overlap ratio of members A5 OL A5 = 0/60 = 0
The overlap rate calculation unit 15 calculates the ratio of the total overlap time length to the utterance time length of all members for each group.
Group A overlap rate OL A
= Total overlap time length / Speech time length of all members = Σ A = A1 to A5 OL A / Σ A = A1 to A5 U A
= 400/1370
Group B overlap rate OL B = 880/1650 = 0.533
Group C overlap rate OL C = 55/210 = 0.262
Group D overlap rate OL D = 95/430 = 0.221
The “individual activity level” of the member shown in FIG. 4 is calculated as follows.
Individual activity = utterance density contribution rate + overlap rate
[Group Graph Generation Unit 16]
The group graph generation unit 16 generates a graph in which the utterance density contribution rate and the overlap rate of each member are drawn for each group. The progressor can visually recognize the activity level of each group under the situation where the discussion is performed in parallel in a plurality of groups. This graph is in the form of a radar chart or a bar having each member as an element for each group, and is generated simultaneously in a plurality of groups. For each group, the progress can be confirmed in a state such as being entirely uplifted / partially biased / low activity / average, etc., and it is possible to identify group members to be instructed. it can. In addition, it is also preferable that the group graph production | generation part 16 produces | generates the graph which further drawn the group speech activity of each group.
FIG. 5 is an explanatory diagram showing a group graph.
According to FIG. 5, the utterance density contribution rate and the overlap rate of each member are shown in parallel for each group. In particular, in the case of a radar chart, the degree of activity for each group can be compared at a glance mainly from the way in which the figures spread. According to FIG. 5, it is recognized that the activities of groups C and D are lower than those of groups A and B. These group graphs are preferably updated almost in real time (for example, every 30 seconds).
In the case of a bar graph, the utterance density contribution rate and the overlap rate between members in each group can be compared as relative trends. For example, it is possible to instruct the replacement of a member between a group C in which a plurality of members with low activity exist and a group B in which there are many active members. This can mitigate the unevenness of activity between groups.
Further, the group graph generation unit 16 visually highlights, for each group, members whose utterance density contribution rate belongs to the first predetermined condition range and whose overlap rate belongs to the second predetermined condition range. A graph can also be generated. Thereby, for example, a member (for example, A3) having a relatively high speech density contribution rate and a low overlap rate can be found at a glance. Such members are observing the manners and can be considered leader candidates for group activities.
[Support message selection unit 17]
The support message selection unit 17 stores in advance a support message representing the member characteristics in association with each predetermined range of the utterance density contribution rate and / or for every predetermined range of the overlap rate. . Then, the support message selection unit 17 selects a support message according to the utterance density contribution rate and / or the overlap rate of the graph. The selected assistance message is further revealed to the user. By clearly indicating a support message about points to be noted with priority, information that is helpful for activating the discussion can be quickly alerted regardless of the experience of the progressors themselves.
The above-described support message as shown in FIG. 5 can explicitly express group members to which the progressor should pay attention.
(1) When there are a plurality of members having a group activity level of 0.7 or less and an individual activity level of 0, according to FIG.
Message: “Group C has low activity and needs attention”
(2) In addition to the condition (1), when there is a group whose group activity exceeds 1.5 and does not include a member whose personal activity is 0, group B is selected according to FIG.
The member C3 having the lowest individual activity in the group C is selected.
The member B4 having the highest individual activity in the group B is selected.
Message: “Replace group C member C3 with group B member B4”
(3) When there is a member having an utterance density contribution ratio of 0.3 or more and an overlap ratio exceeding 70%, according to FIG. 4, member A1 of group A is selected.
Message: “Member A1 is active but seems to have many interruptions”
(4) When there is a member having an utterance density contribution rate of 0.3 or more and an overlap rate of 20% or less, according to FIG. 4, member A3 of group A is selected.
Message: “Member A3 is an active example that protects the manners”
FIG. 6 is a graph showing the group utterance activity according to the passage of time.
According to FIG. 6, the group utterance activity is represented by a line graph corresponding to the passage of time. The support message selection unit 17 may further select a support message according to the group utterance activity level corresponding to the passage of time.
(1) When the group utterance activity level rises within a specified range over time Message: “Group x is gradually rising”
(2) When the group utterance activity level rises or falls within a specified range over time Message: “Group x seems to change drastically”
(3) When the group utterance activity level falls within the specified range over time Message: “Group x is gradually sinking”
According to FIG. 1 described above, the group graph and the support message are clearly shown to the management terminal. These graphs and messages may be generated by the management terminal itself, or may be received from the management apparatus. Further, the management device may transmit a graph and a message to a terminal possessed by a member, or may be generated by the member terminal itself. As a result, the activity level of the group discussion can be visually confirmed by the progressors and members themselves.
As described above in detail, the apparatus and program of the present invention estimates the activation of discussion for each group, it is possible to clearly show the situation with respect to the traveling person. In particular, the contribution of the discussion within the group to the activity varies depending on the member. According to the present invention, support is provided by finding a leader-like member in the group or a member with a low contribution degree from the bias of the member characteristics in the group and feeding back to the progressor. This allows the facilitator to instruct to increase / maintain the activity of the entire group according to the situation of the discussion.
DESCRIPTION OF SYMBOLS 1 Terminal, smart phone 10 Utterance voice acquisition part 11 Utterance storage part 12 Group utterance classification part 13 Utterance density contribution rate calculation part 14 Group utterance activity calculation part 15 Overlap rate calculation part 16 Group graph generation part 17 Support message selection part
A device for estimating the activation of a discussion for each group composed of a plurality of members participating in the discussion,
Group utterance classifying means for classifying the utterance time and the utterance time length of each member for each group;
A group graph generation means for generating a graph in which the utterance density contribution rate of each member is drawn for each group, and the apparatus clearly shows the graph to the user.
Further comprising a group utterance activity calculation means for calculating a group utterance activity level representing a ratio of the utterance time length of the group to the average value of the utterance time lengths of all groups;
The apparatus according to claim 1, wherein the group graph generation unit generates a graph in which the group utterance activity of each group is further drawn.
3. The apparatus according to claim 1, wherein the group graph generation unit simultaneously generates a radar chart-shaped or bar-shaped graph having each member as an element for each group in a plurality of groups simultaneously.
For each group, for each member, an overlap time length between the utterance time length of the member and the utterance time length of the other member is detected, and an overlap rate representing the overlap time length with respect to the utterance time length of the member is calculated. It further has an overlap rate calculation means,
The apparatus according to claim 1, wherein the group graph generation unit generates a graph in which the overlap rate of each member is further drawn for each group.
The group graph generation means visually highlights, for each group, members whose utterance density contribution rate belongs to the first predetermined condition range and whose overlap rate belongs to the second predetermined condition range. The apparatus according to claim 4, wherein the apparatus generates a graph.
A support message representing the member characteristic is stored in advance in association with each predetermined range of the utterance density contribution rate and / or for every predetermined range of the overlap rate, and the utterance density of the graph 6. The support message selecting means for selecting the support message according to a contribution rate and / or an overlap rate is further provided, and the selected support message is further clearly indicated to a user. The device described.
The program for functioning a computer as each means of any one of Claim 1 to 6 .
JP2015042285A 2015-03-04 2015-03-04 Apparatus and program for estimating activation of discussion for each group Active JP6401079B2 (en)
JP2015042285A JP6401079B2 (en) 2015-03-04 2015-03-04 Apparatus and program for estimating activation of discussion for each group
JP2016162339A JP2016162339A (en) 2016-09-05
JP6401079B2 true JP6401079B2 (en) 2018-10-03
ID=56845190
JP2015042285A Active JP6401079B2 (en) 2015-03-04 2015-03-04 Apparatus and program for estimating activation of discussion for each group
JP (1) JP6401079B2 (en)
JP2006208482A (en) * 2005-01-25 2006-08-10 Sony Corp Device, method, and program for assisting activation of conference, and recording medium
2015-03-04 JP JP2015042285A patent/JP6401079B2/en active Active
JP2016162339A (en) 2016-09-05
Anderson et al. 2006 How ethnic and linguistic heterogeneity influence the prospects for civil society: A comparative study of citizenship behavior
JP5055781B2 (en) 2012-10-24 Conversational speech analysis methods, and, conversational speech analyzer
Smeds et al. 2015 Estimation of signal-to-noise ratios in realistic sound scenarios
US20070165820A1 (en) 2007-07-19 Sorting Speakers in a Network-Enabled Conference
US10038784B2 (en) 2018-07-31 System and method for providing agent guidance
2018-07-27 A131 Notification of reasons for refusal
2018-08-22 A131 Notification of reasons for refusal
Ref document number: 6401079