Patent ID: 11893801
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Field: Chemical engineering (Chemistry)
Classification: CPC G  A  B  F | IPC A  B  F  G

Claim 0:
1. A method of operating a vehicle based on a gesture made by a traffic director, comprising:
inputting an image of the traffic director into at least one neural network, wherein the traffic director is using a traffic prop;
generating a skeleton of the traffic direction from the image;
locating a hand of the traffic director in the image from a ray drawn through an elbow key point of the skeleton and a wrist key point of the skeleton;
locating a bounding box in the image that indicates the traffic prop;
generating, at the at least one neural network, an encoded hand vector based on a configuration of the hand of the traffic director from the image;
combining, at the at least one neural network, the skeleton of the traffic director in the bounding box, and the encoded hand vector to generate a representation vector;
predicting, at the at least one neural network, the gesture from the representation vector; and
operating the vehicle based on the meaning of the gesture.