Patent ID: 11948310
Assignee: TOYOTA RESEARCH INSTITUTE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 1:
2. The system of claim 1, wherein the instructions in the optical flow estimation module to process the pair of temporally adjacent monocular image frames using the first neural network structure to produce the first optical flow estimate include instructions that when executed by the one or more processors cause the one or more processors to:
extract a set of encoded image features from the pair of temporally adjacent monocular image frames using a Red-Green-Blue (RGB) encoder;
process the set of encoded image features using a correlation layer to generate a correlation volume;
extract a set of encoded image context features from at least one image frame in the pair of temporally adjacent monocular image frames using a RGB context encoder; and
refine iteratively an initial estimate of optical flow based, at least in part, on the set of encoded image context features using a Gated-Recurrent-Units-based update operator and the correlation volume.