Abstract: Systems and techniques for reconstructing one or more surfaces of an object including one or more opaque surfaces behind one or more refractive surfaces are provided. The systems and techniques may include obtaining one or more images of the object including an opaque surface located behind a refractive surface and determining one or more refractive surface constraints using the one or more images. The one or more refractive surface constraints constrain one or more characteristics of the refractive surface. The systems and techniques may further include reconstructing an opaque surface representation or a refractive surface representation using the one or more refractive surface constraints, the opaque surface representation representing the opaque surface of the object, and the refractive surface representation representing the refractive surface of the object.

Abstract: There is provided a method for use by a system including a hardware processor and a memory storing a three-dimensional (3D) character data having a topology mesh describing a character. The method includes stabilizing the 3D character data by removing a translational motion and a rotational motion from the 3D character data, determining a range of motion of a plurality of points of the topology mesh describing the character, identifying a plurality of poses for generating an animation, where each of the plurality of poses includes a unique configuration of the plurality of points of the topology mesh, and creating an animatronic including a plurality of actuators configured to instantiate the plurality of poses for generating the animation.

Abstract: Techniques and systems are described for generating an anatomically-constrained local model and for performing performance capture using the model. The local model includes a local shape subspace and an anatomical subspace. In one example, the local shape subspace constrains local deformation of various patches that represent the geometry of a subject's face. In the same example, the anatomical subspace includes an anatomical bone structure, and can be used to constrain movement and deformation of the patches globally on the subject's face. The anatomically-constrained local face model and performance capture technique can be used to track three-dimensional faces or other parts of a subject from motion data in a high-quality manner. Local model parameters that best describe the observed motion of the subject's physical deformations (e.g., facial expressions) under the given constraints are estimated through optimization.

Abstract: Techniques and systems are described for generating an anatomically-constrained local model and for performing performance capture using the model. The local model includes a local shape subspace and an anatomical subspace. In one example, the local shape subspace constrains local deformation of various patches that represent the geometry of a subject's face. In the same example, the anatomical subspace includes an anatomical bone structure, and can be used to constrain movement and deformation of the patches globally on the subject's face. The anatomically-constrained local face model and performance capture technique can be used to track three-dimensional faces or other parts of a subject from motion data in a high-quality manner. Local model parameters that best describe the observed motion of the subject's physical deformations (e.g., facial expressions) under the given constraints are estimated through optimization.

Abstract: Techniques and systems are described for generating an anatomically-constrained local model and for performing performance capture using the model. The local model includes a local shape subspace and an anatomical subspace. In one example, the local shape subspace constrains local deformation of various patches that represent the geometry of a subject's face. In the same example, the anatomical subspace includes an anatomical bone structure, and can be used to constrain movement and deformation of the patches globally on the subject's face. The anatomically-constrained local face model and performance capture technique can be used to track three-dimensional faces or other parts of a subject from motion data in a high-quality manner. Local model parameters that best describe the observed motion of the subject's physical deformations (e.g., facial expressions) under the given constraints are estimated through optimization.

Abstract: Methods and systems of reconstructing an eyelid are provided. A method of reconstructing an eyelid includes obtaining one or more images of the eyelid, generating one or more image input data for the one or more images of the eyelid, generating one or more reconstruction data for the one or more images of the eyelid, and reconstructing a spatio-temporal digital representation of the eyelid using the one or more input image data and the one or more reconstruction data.

Abstract: A method of transferring a facial expression from a subject to a computer-generated character and a system and non-transitory computer-readable medium for the same. The method can include receiving an input image depicting a face of a subject; matching a first facial model to the input image; generating a displacement map representing of finer-scale details not present in the first facial model using a regression function that estimates the shape of the finer-scale details. The displacement map can be combined with the first facial model to create a second facial model that includes the finer-scale details, and the second facial model can be rendered, if desired, to create a computer-generated image of the face of the subject that includes the finer-scale details.

Abstract: Systems and techniques for performing automatic rigid stabilization of facial expressions are provided. The systems and techniques may include obtaining one or more shapes, the one or more shapes including one or more facial expressions of a subject. The systems and techniques may further include generating a subject-specific skull representation, and performing rigid stabilization of the one or more facial expressions by fitting the subject-specific skull with the one or more facial expressions of the subject.

Abstract: Systems and techniques for reconstructing one or more surfaces of an object including one or more opaque surfaces behind one or more refractive surfaces are provided. The systems and techniques may include obtaining one or more images of the object including an opaque surface located behind a refractive surface and determining one or more refractive surface constraints using the one or more images. The one or more refractive surface constraints constrain one or more characteristics of the refractive surface. The systems and techniques may further include reconstructing an opaque surface representation or a refractive surface representation using the one or more refractive surface constraints, the opaque surface representation representing the opaque surface of the object, and the refractive surface representation representing the refractive surface of the object.

Abstract: A process, computer program product, and apparatus provide color and shape stylization for a captured hairstyle. The process, computer program product, and apparatus receive a plurality of images of a hairstyle in an n dimensional space at a plurality of different angles. Further, the process, computer program product, and apparatus generate a mesh surface in an n?1 dimensional space. In addition, the process, computer program product, and apparatus combine color data from the plurality of images at the plurality of different angles with mesh geometry data of the mesh surface. The process, computer program product, and apparatus also stylize the color data with an n dimensional filter that projects the color data to the n?1 dimensional space of the mesh surface. The process, computer program product, and apparatus may also stylize the geometric shape details in a coherent manner with the color.

Abstract: Systems and techniques for performing automatic rigid stabilization of facial expressions are provided. The systems and techniques may include obtaining one or more shapes, the one or more shapes including one or more facial expressions of a subject. The systems and techniques may further include generating a subject-specific skull representation, and performing rigid stabilization of the one or more facial expressions by fitting the subject-specific skull with the one or more facial expressions of the subject.

Abstract: High-quality passive performance capture using anchor frames derives in part from a robust tracking algorithm. Tracking is performed in image space and uses an integrated result to propagate a single reference mesh to performances represented in the image space. Image-space tracking is computed for each camera in multi-camera setups. Thus, multiple hypotheses can be propagated forward in time. If one flow computation develops inaccuracies, the others can compensate. This yields results superior to mesh-based tracking techniques because image data typically contains much more detail, facilitating more accurate tracking. Moreover, the problem of error propagation due to inaccurate tracking in image space can be dealt with in the same domain in which it occurs. Therefore, there is less complication of distortion due to parameterization, a technique used frequently in mesh processing algorithms.

Abstract: Methods and systems of equalizing spatial frequency signals for images are provided. Images distorted through defocus, motion blur, under-sampling or other reasons may be equalized. Equalized spatial frequency signals may be used to determine correspondence matching between images. Image patches from two or more image signals may be identified and analyzed to determine image patches that contain similar representations of the real scene, with sufficient local details for accurately computing cross-correlation.

Abstract: A cervical tenaculum device is disclosed that grasps the cervix in a manner to reduce trauma to the tissue, while providing unimpeded visual access and instrument access to the cervical os. The disclosed embodiments may include a bell configured to engage a vaginal portion of a cervix and create an annular suction chamber against a surface of the vaginal portion the cervix. The suction chamber encircles the external os and uniformly distributes negative pressure in the suction chamber around the engaged surface of the cervix. An opening through a middle portion of the bell allows access to the external os when the bell is engaged, such that the external os remains unobstructed. A method of grasping and manipulating the cervix to perform a gynecological procedure on a subject, using the embodiments of the disclosed cervical tenaculum device is also disclosed.