Patent Document ID: 9842402
Application ID: 14976460
Patent Status: 1

Claim One:
1. A method of detecting foreground regions in a panoramic frame, the method comprising: receiving, by a computing device, panoramic video data comprising a plurality of panoramic frames and video frame sequence data indicating a video frame sequence for the plurality of panoramic frames, wherein a subject panoramic frame of the plurality of panoramic frames comprises a plurality of pixel values and spatial data describing a spatial arrangement of the plurality of pixel values on a two-dimensional grid described by an X-axis and a Y-axis; selecting, by the computing device and from the subject panoramic frame, a plurality of scene point locations positioned on the two-dimensional grid, wherein a first scene point location of the plurality of scene point locations depicts a first scene point from a scene shown by a panoramic video depicted by the panoramic video data, and wherein the first scene point location is positioned on the two-dimensional grid at a first location corresponding to a location of a first pixel value of the plurality of pixel values; identifying, by the computing device, a second scene point location depicting the first scene point at a second panoramic frame that is before the subject panoramic frame in the video frame sequence; determining, by the computing device, a Y-axis displacement for the first scene point by determining a distance on the Y-axis between the second scene point location and the first scene point location; determining, by the computing device, a plurality of columns from the subject panoramic frame, where each of the plurality of columns is characterized by a column position on the X-axis, and wherein the first scene point location is in a first column of the plurality of columns; determining, by the computing device, an average Y-axis displacement for scene point locations from the plurality of scene point locations in the first column; fitting, by the computing device, a sinusoidal function to a distribution of average Y-axis displacements of scene points by column position on the X-axis, wherein the sinusoidal function maps position on the X-axis to Y-axis displacement; determining, by the computing device, that the Y-axis displacement of the first scene point differs from an output of the sinusoidal function at an X-axis position of the first scene point by more than a threshold distance; and writing, by the computing device, an indication of the first pixel value to a listing of foreground pixel values.