Abstract. In this paper, we describe a dynamic texture overlay method from monocular images for real-time visualization of garments in a virtual mirror environment. Similar to looking into a mirror when trying on clothes, we create the same impression but for virtually textured garments. The mirror is replaced by a large display that shows the mirrored image of a camera capturing e.g. the upper body part of a person. By estimating the elastic deformations of the cloth from a single camera in the 2D image plane and recovering the illumination of the textured surface of a shirt in real time, an arbitrary virtual texture can be realistically augmented onto the moving garment such that the person seems to wear the virtual clothing. The result is a combination of the real video and the new augmented model yielding a realistic impression of the virtual piece of cloth.
For example, Hilsmann and Eisert proposed a real-time system that tracks clothes and overlays a texture on them by estimating the elastic deformations of the clothes from a single camera in the 2D image plane REF .
Tracking and Retexturing Cloth for RealTime Virtual Clothing Applications
In Computer Vision/Computer Graphics Collaboration Techniques (MIRAGE
Computer Science