Patent ID: 11893801
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Field: Chemical engineering (Chemistry)
Classification: CPC G  A  B  F | IPC A  B  F  G

Claim 5:
6. A system for operating a vehicle, comprising:
a camera for obtaining an image of a traffic director, wherein the traffic director is using a traffic prop; and
at least one neural network configured to:
generate a skeleton of the traffic direction from the image;
determine a location of a hand of the traffic director in the image from a ray drawn through an elbow key point of the skeleton and a wrist key point of the skeleton;
locate a bounding box in the image that indicates the traffic prop;
generate an encoded hand vector based on a configuration of a hand of the traffic director from the image;
combine a skeleton of the traffic director generated from the image and the encoded hand vector to generate a representation vector; and
predict a gesture of the traffic director from the representation vector.