Patent ID: 11869230
Assignee: RIMAC AUTOMOBILES LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 12:
13. A vehicle component, comprising a processor and a memory having access to instruction that when provided to the processor, causes the processor to simultaneously execute a method for single-frame prediction and a method for dense semantic forecasting of at least one future frame, wherein:
the method for single-frame prediction comprises:
receiving the input frame from a camera up to a predetermined time,
processing the input frame via a down-sampling module of a neural network to receive a corresponding feature tensor, and
caching the feature tensors for later use, and processing the corresponding feature tensor via an up-sampling module of the neural network to receive the semantic output; and

the method for dense semantic forecasting comprises of:
retrieving a plurality of cached feature tensors up to the predetermined time,
determining spatio-temporal correlations between the plurality of feature tensors,
processing the plurality of cached feature tensors and the spatio-temporal correlations to receive at least one forecasted feature tensor, and
processing via an up-sampling module of the neural network the at least one forecasted feature tensor to receive at least one forecasted semantic output for a time larger than the predetermined time;

wherein the processing of the plurality of cached feature tensors and the spatio-temporal correlations to receive the at least one forecasted feature tensor, the at least one forecasted feature tensor is received by direct regression based on the plurality of cached feature tensors and the spatio-temporal correlations.