Patent ID: 11954916
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  B | IPC B  G

Claim 0:
1. An automated driving system (ADS) of an autonomous vehicle including an object detection system, comprising:
a neural network image encoder configured to generate image embeddings associated with at least a portion of an image generated by a vehicle sensor system, the at least the portion of the image including an object;
a neural network text encoder configured to generate concept embeddings associated with each of a plurality of concepts, each of the plurality of concepts being associated with one of at least two object classes;
a confidence score module configured to generate a confidence score for each of the plurality of concepts based on the image embeddings and the concept embeddings associated with the concept;
an object class prediction module configured to generate a predicted object class of the object based on an association between a set of concepts of the plurality of concepts having at least two of the highest values of the generated confidence scores and the one of the at least two object classes associated with a majority of the set of concepts; and
a processor configured to manage performance of the autonomous vehicle based in part on the predicted object class of the object.