Patent Document ID: 20160247290
Application ID: 14628808
Patent Status: 0

Claim One:
1. A method for labeling an image of a street view, wherein the image includes a set of columns of pixels, comprising the steps of: employing at least one processor executing computer executable instructions stored on at least one computer readable memory to facilitate performing the steps of: receiving the image having image pixels including respective two-dimensional features; receiving image data points corresponding to the image, the image data points including respective three-dimensional image features; extracting, for each pixel, an appearance feature from the image pixels; extracting, for each pixel, a depth feature from the image data points; and applying a column-wise labeling procedure to jointly determine a semantic label and a depth label for each pixel for each column of pixels from the set of columns of pixels of the image using both the appearance features and the depth features from their respective column of pixels, and wherein the column-wise labeling procedure is according to a model of the street view, wherein each column of pixels of the set of columns of pixels includes at most four ordered layers from a top layer or a fourth layer to a first layer or a bottom layer; processing, the column-wise labeling procedure subject to the at most four ordered layers to produce the labeled image, and the steps are performed in the processor.