Patent ID: 8021160
Filing Date: 2011-09-20
Classification: G09B

Abstract:
1. A method using a synthesized virtual tutor in a learning assessment device for providing performance assessment of a subject performing an action imitation task, comprising the steps of: using at least a video action acquisition and analysis module to acquire a first action video of a first target for analyzing a first action-feature of said first target performing a first action; using said at least a video action acquisition and analysis module to acquire a second action video of a second target for analyzing a second action-feature of said second target performing a second action imitating said first action; establishing an intrinsic model of said second target by using reference data of said second target, said intrinsic model being constructed with a multidimensional morphable model by using image textures and motion flows of said second target; generating a synthetic video with a virtual tutor having said image textures and motion flows of said second target but exhibiting a synthesized action-feature with behavior similar to said first action-feature based on a behavior model of said first target, said behavior model being constructed by using a set of reference data of said first target with a model transfer process and a model adaptation process, said model transfer process being composed of image texture matching and motion flow matching procedures for finding a set of prototype images for said first target with a matching-by-synthesis approach; and assessing image texture and motion flow differences between said second action-feature and said synthesized action-feature through a learning assessment module; wherein said image textures and motion flows of said second target are trained from a set of prototype images selected from said reference data of said second target with said multidimensional morphable model, and said synthetic video with said virtual tutor is generated by compositing said image textures and motion flows of said second target using said intrinsic model of said second target to form each frame of said synthetic video by warping and combining said prototype images with parameters generated according to said behavior model of said first target; and wherein said model transfer process adopts said matching-by-synthesis approach further comprising the steps of: