Patent ID: 11915371
Assignee: OOOK (BEIJING) EDUCATION AND TECHNOLOGY CO., LTD
Field: Computer technology (Electrical engineering)
Classification: CPC G  A | IPC G

Claim 4:
5. An apparatus of constructing a chess playing model, comprising:
an information acquisition unit configured to acquire a video image of each chess player at a time point and a distribution relationship information between a chess piece and a chessboard in a chess game at the time point;
an information determination unit configured to determine a two-dimensional position information for a first expression characterization point in the video image and a marking information for a facial structure characterization point in the first expression characterization point, wherein the first expression characterization point is marked in a facial region of the chess player in the video image;
a rotation determination unit configured to determine a rotation information for each chess player in a specified direction based on a two-dimensional position information for the facial structure characterization point and the marking information for the facial structure characterization point of the chess player;
a face reconstruction unit configured to reconstruct a three-dimensional reference face model of each chess player according to the two-dimensional position information for the first expression characterization point and the rotation information for the chess player, so as to generate a three-dimensional target face model of the chess player;
a chess player reconstruction unit configured to reconstruct a three-dimensional target chess player model of the chess player based on the target face model of the chess player and a three-dimensional reference body posture model of the chess player;
a chess game reconstruction unit configured to reconstruct a three-dimensional target chess game model according to the distribution relationship information and a three-dimensional reference chess set model; and
a chess playing reconstruction unit configured to reconstruct a three-dimensional target chess playing model according to the target chess player model, the target chess game model and a reference position relationship simulating a real chess playing scene,
wherein the rotation determination unit comprises:
a facial grid acquisition sub-unit configured to obtain, in a facial region of the video image, a facial grid information by using each two-dimensional position information as a vertex position information, according to a connection relationship rule for the marking information; and
a rotation determination sub-unit configured to input a reference grid information for the chess player and the facial grid information for the chess player into a trained neural network model so as to acquire the rotation information for the chess player in the specified direction, wherein the reference grid information is obtained based on a two-dimensional position information for a facial structure characterization point in a reference image of the chess player and a marking information for the facial structure characterization point in the reference image of the chess player, and the facial structure characterization point in the video image and the facial structure characterization point in the reference image have a corresponding relationship in a face position of the chess player.