Patent ID: 11936467
Assignee: ROKU, INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC A  H  G | IPC A  G  H

Claim 0:
1. A method of detecting and responding to playing of a video game, wherein the video game is rendered in real-time by a video display unit, and wherein the video game includes (i) cutscene video segments that do not vary based on user-interaction during the rendering, and (ii) interactive video segments that vary based on user-interaction during the rendering, the method comprising:
obtaining by a computing system a query fingerprint generated in real-time during the rendering as a representation of the video game being played, wherein the query fingerprint includes (i) a first portion representing a first cutscene video segment, (ii) a second portion representing a first interactive video segment, and (iii) a third portion representing a second cutscene video segment;
detecting by the computing system a first match between the first portion of the query fingerprint and a first reference fingerprint that represents the first cutscene video segment and, based on the first match, identifying by the computing system the video game being rendered;
after identifying by the computing system the video game being rendered, applying by the computing system a trained neural network to at least the second portion of the query fingerprint to detect continued rendering of the video game; and
after detecting by the computing system the continued rendering of the video game, detecting by the computing system a second match between the third portion of the query fingerprint and a second reference fingerprint that represents the second cutscene video segment, and determining by the computing system a duration of the rendering of the video game between the first cutscene video segment and the second cutscene video segment.