The Virtual Mirror enhances the visualization of customized consumer articles. Instead of viewing yourself in a real mirror, highly sophisticated 3D image processing techniques are used to verify the appearance of new models. A camera captures the real world and outputs the mirrored images onto a large display which replaces a real mirror. The 3D motion is tracked in real-time and computer graphics models of the consumer articles are augmented into the video such that the person seems to wear the virtual objects.
Virtual Mirror for Shoe Configuration
A camera captures the customer wearing fitting boots with a standard design. A display replaces a real mirror and outputs the horizontally flipped camera image. The display is mounted such that the person appears at the same position, where the user would expect to see himself when looking into a real mirror. In order to enhance the virtual feeling of the framework, the background is segmented and replaced by a synthetic environment. A novel 3D motion tracker estimates the position and orientation for each foot using a model-based approach that is very robust and can easily be adapted to new shoe models. Once the exact foot position in 3D space is known, the computer graphics models, that have been configured and colored according to the customer's wishes, are rendered and integrated into the video stream such that the real shoes are replaced by the virtual ones. Special care has to be taken for this augmentation, since the real scene in the 2D video can occlude parts of the virtual 3D scene. Therefore, visibility for all parts of the shoe has to be computed for a given position. Since all algorithms have been implemented with real-time constraints, the customer can move freely and watch himself/herself with the new shoes that have been designed just some minutes earlier.
Publications and Info Material
Flyer Virtual Mirror (PDF/306KB)
- Dr. Peter Eisert
- Fraunhofer Institute for Telecommunications