Patent ID: 11936467
Assignee: ROKU, INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC A  H  G | IPC A  G  H

Claim 14:
15. A computing system comprising:
at least one network communication interface;
at least one processor;
non-transitory data storage; and
program instructions stored in the non-transitory data storage and executable by the at least one processor to carry out operations for detecting and responding to playing of a video game, wherein the video game is rendered in real-time by a video display unit, wherein the video game includes (i) cutscene video segments that do not vary based on user-interaction during the rendering and (ii) interactive video segments that vary based on user-interaction during the rendering, and wherein the operations include:
obtaining a query fingerprint generated in real-time during the rendering as a representation of the video game being played, wherein the query fingerprint includes (i) a first portion representing a first cutscene video segment, (ii) a second portion representing a first interactive video segment, and (iii) a third portion representing a second cutscene video segment,
detecting a first match between the first portion of the query fingerprint and a first reference fingerprint that represents the first cutscene video segment and, based on the first match, identifying the video game being rendered,
after identifying the video game being rendered, applying a trained neural network to at least the second portion of the query fingerprint to detect continued rendering of the video game, and
after detecting the continued rendering of the video game, detecting a second match between the third portion of the query fingerprint and a second reference fingerprint that represents the second cutscene video segment, and determining a duration of the rendering of the video game between the first cutscene video segment and the second cutscene video segment.