Patent ID: 11875796
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 8:
9. A machine-readable storage device having instructions for execution by a processor of a machine to cause the processor to perform operations to perform a method, the operations comprising:
receiving information streams on a meeting server from a set of multiple distributed devices included in a meeting;
receiving audio signals representative of overlapped speech by at least two users in at least two of the information streams wherein at least one of the received audio signals received from the set of multiple distributed devices is from a first mobile device of a first user;
receiving at least one video signal of at least one user in the information streams;
associating specific users with their respective speech in the received audio signals as a function of the received audio and video signals by providing a fusion of the audio signals and video signal to a model to generate speaker and word hypotheses for each audio signal and use such hypotheses to provide separate audio streams for each user, each separate audio stream containing only speech from one of the users with a user ID; and
generating a transcript of the meeting from the separate audio streams with an indication of the specific users associated with the overlapped speech.