Patent ID: 11948310
Assignee: TOYOTA RESEARCH INSTITUTE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. The method of claim 14, wherein the processing the pair of temporally adjacent monocular image frames using the first neural network structure to produce the first optical flow estimate includes:
extracting a set of encoded image features from the pair of temporally adjacent monocular image frames using a Red-Green-Blue (RGB) encoder;
processing the set of encoded image features using a correlation layer to generate a correlation volume;
extracting a set of encoded image context features from at least one image frame in the pair of temporally adjacent monocular image frames using a RGB context encoder; and
refining iteratively an initial estimate of optical flow based, at least in part, on the set of encoded image context features using a Gated-Recurrent-Units-based update operator and the correlation volume.