Patent ID: 11948310
Assignee: TOYOTA RESEARCH INSTITUTE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 2:
3. The system of claim 1, wherein the instructions in the depth and scene flow estimation module to process the pair of temporally adjacent monocular image frames using the second neural network structure to produce the estimated depth map and the estimated scene flow include instructions that when executed by the one or more processors cause the one or more processors to:
extract a set of encoded image context features from at least one image frame in the pair of temporally adjacent monocular image frames using a Red-Green-Blue (RGB) context encoder; and
refine iteratively an initial estimate of depth and an initial estimate of scene flow based, at least in part, on the set of encoded image context features using a Gated-Recurrent-Units-based update operator.