Multi-Garment Net: Learning to Dress 3D People From Images
TL
TL;DR
Multi-Garment Network is presented, a method to predict body shape and clothing, layered on top of the SMPL model from a few frames of a video, allowing to predict garment geometry, relate it to the body shape, and transfer it to new body shapes and poses.
Abstract
We present Multi-Garment Network (MGN), a method to predict body shape and clothing, layered on top of the SMPL model from a few frames (1-8) of a video. Several experiments demonstrate that this representation allows higher level of control when compared to single mesh or voxel representations of shape. Our model allows to predict garment geometry, relate it to the body shape, and transfer it to new body shapes and poses. To train MGN, we leverage a digital wardrobe containing 712 digital garments in correspondence, obtained with a novel method to register a set of clothing templates to a dataset of real 3D scans of people in different clothing and poses. Garments from the digital wardrobe, or predicted by MGN, can be used to dress any body shape in arbitrary poses. We will make publicly available the digital wardrobe, the MGN model, and code to dress SMPL with the garments at https://virtualhumans.mpi-inf.mpg.de/mgn
References67 items
1
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
2
Tex2Shape: Detailed Full Human Body Geometry From a Single Image
3
Learning‐Based Animation of Clothing for Virtual Try‐On
4
SimulCap : Single-View Human Performance Capture With Cloth Simulation
5