Abstract: Parts-based blendshape generation involves establishing a 4D capture sequence. A face, hands and legs are able to be established for the meshes using a template to generate tracked and templated meshes. Specific muscle deformations are extracted. Pose-specific spatial deformations are integrated into a pose to generate specific flesh deformations. A muscle deformation method enables muscle part-based approach deformation (e.g., just biceps if flexing arms). The muscle deformation also enables generating a novel pose not captured.

Abstract: An integrated photo-video volumetric capture system for 3D/4D scanning acquires 3D scans and 4D scans by acquiring images and videos simultaneously. The volumetric capture system for high-quality 4D scanning and mesh-tracking is used to establish topology correspondences across a 4D scanned mesh sequence for generating corrective shapes which will be used in shape interpolation and skeleton driven deformation. The volumetric capture system aids mesh-tracking for maintaining mesh registration (topology consistency) along with ease of extreme pose modeling. Major upper body and lower body joints are able to be identified that are important for generating deformation and capturing the same using a wide range of motion for all movement types across all joint categories. By using the volumetric capture system and mesh tracking, the topology changes are tracked. Each pose captured will have the same topology which makes blending between multiple poses easier and more accurate.

Abstract: An integrated photo-video volumetric capture system for 3D/4D scanning acquires 3D scans and 4D scans by acquiring images and videos simultaneously. The volumetric capture system for high-quality 4D scanning and mesh-tracking is used to establish topology correspondences across a 4D scanned mesh sequence for generating corrective shapes which will be used in shape interpolation and skeleton driven deformation. The volumetric capture system aids mesh-tracking for maintaining mesh registration (topology consistency) along with ease of extreme pose modeling. Major upper body and lower body joints are able to be identified that are important for generating deformation and capturing the same using a wide range of motion for all movement types across all joint categories. By using the volumetric capture system and mesh tracking, the topology changes are tracked. Each pose captured will have the same topology which makes blending between multiple poses easier and more accurate.