Patent ID: 11921817
Assignee: ROBERT BOSCH GMBH
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 12:
13. A system for extracting a feature representation from a video sequence, the system comprising:
a data interface configured to access model data representing a trained video feature extractor, the video feature extractor being trained by:
accessing training data representing multiple training video sequences, and model data representing a set of parameters of the video feature extractor;
training the video feature extractor by:
selecting from a training video sequence of the multiple training video sequences: a current subsequence, a preceding subsequence preceding the current subsequence; and a succeeding subsequence succeeding the current subsequence;
applying the video feature extractor to the current subsequence to extract a current feature representation of the current subsequence;
deriving a training signal from a joint predictability of the preceding and succeeding subsequences given the current feature representation, wherein deriving the training signal includes extracting a positive comparative example from the preceding subsequence followed by the succeeding subsequence, extracting a negative comparative example from the succeeding subsequence followed by the preceding subsequence, and determining a contrastive loss based on comparing the current feature representation to the positive and negative comparative examples;
updating the set of parameters of the video feature extractor based on the training signal;

outputting the trained video feature extractor;

a video interface configured to obtain a video sequence captured by a camera;
a processor subsystem configured to, via the video interface, obtain the video sequence; apply the video feature extractor to the video sequence to extract the feature representation; and output the feature representation.