Patent ID: 11882299
Assignee: NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  Y | IPC G  H

Claim 1:
2. The predictive contrastive representation method according to claim 1,
wherein the coding situational data comprises a plurality of pieces of single-frame coding situational data; the single-frame coding situational data comprises vectorial information and image-based information; and
the step of encoding the coding situational data by using the fully connected network and the CNN to obtain the single-frame coding information comprises:
encoding the vectorial information by using the fully connected network to obtain single-frame vector coding information at the current moment;
encoding the image-based coding information by using the CNN to obtain single-frame image-based coding information at the current moment; and
splicing the single-frame vector coding information and the single-frame image-based coding information to obtain the single-frame coding information at the current moment.