Patent ID: 11954916
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  B | IPC B  G

Claim 14:
15. A method of classifying a detected object in an image at an automated driving system (ADS) of an autonomous vehicle comprising:
generating image embeddings associated with at least a portion of an image generated by a vehicle sensor system at a neural network image encoder, the at least the portion of the image including an object;
generating concept embeddings associated with each of a plurality of concepts at a neural network text encoder, each of the plurality of concepts being associated with one of at least two object classes;
generating a confidence score for each of the plurality of concepts based on the image embeddings and the concept embeddings associated with the concept at a confidence score module;
generating a predicted object class of the object based on an association between a set of concepts of the plurality of concepts having at least two of the highest values of the generated confidence scores and the one of the at least two object classes associated with a majority of the set of concepts at an object class prediction module; and
managing performance of the autonomous vehicle based in part on the predicted object class of the object at a controller.