Patent ID: 11972172
Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A display information generation device comprising:
a processor; and
a storage medium having computer program instructions stored thereon, when executed by the processor, perform to:
receive at least one first speaker object for at least one first speaker, a plurality of second speaker objects for a plurality of second speakers having a conversation with the at least one first speaker, and a plurality of annotations with respect to each object generated for the at least one first speaker object and the plurality of second speaker objects to calculate importance of the conversation between the at least one first speaker and each of the plurality of second speakers based on at least one of the plurality of second speaker objects or the plurality of annotations; and
determine a display form of each of the plurality of annotations generated with respect to the plurality of second speaker objects based on the importance of the conversation, and generate display information on the plurality of annotations, where size of display area for each of the plurality of annotations is directly proportional to the importance of the conversation associate with the annotation;
wherein the at least one first speaker object includes a speech object about speech made by the at least one first speaker,
the plurality of second speaker objects each include at least one of a speech object about speech made by each of the second speakers or the speech object about speech made by each of the second speakers and a camera data object imaging the plurality of second speakers,
the plurality of annotations each include at least one of character string of a speech recognition result from the speech object or a speech translation result acquired by translating the speech recognition result,
wherein the computer program instructions further perform to
calculates the importance of the conversation based on at least one of:
a ratio of an image of each of the second speakers in the camera data object;
dialog continuation utilizing dialog breakdown level detected from a character string of the speech recognition result corresponding to the at least one first speaker object or a character string of at least one of the speech recognition result or the speech translation result corresponding to each of the plurality of second speaker objects; and
scores of the previously scored second speakers using face recognition.