Abstract: A method for locating and tracking facial features in an unconstrained video sequence includes: in a face-detecting process, delineating, with region-bounding coordinates, the face of the subject within an image selected from the sequence; detecting, in the selected image, a small set of landmarks, corresponding to the face of the subject, using a convolutional neural network, trained to take as input an image region corresponding to the face of the—subject and to return a set of coordinates at computational speeds approximating real time; projectively fitting a three-dimensional character model to the detected landmarks, and using the fitted model to estimate physical locations of additional landmarks, so as to provide a complete hypothesized set of facial landmarks; and in a feature tracker process, updating the hypothesized set of facial landmarks to improve convergence between predicted feature locations and their actual physical locations based on data sampled from the selected image.

Abstract: Computer-implemented methods and computer program products for automatically transferring expressions between rigs with consistent joint structure, and for automatically transferring skin weights between different skin meshes based on joint positioning. A method is provided for transferring an expression between a plurality of source rigs and a target rig, where each rig characterizes an animated character, and each rig, in turn, is characterized by a set of joints and a skin mesh having a plurality of vertices, with each vertex characterized by a matrix of weights relating a response of the vertex to movement of associated joints. A set of offsets is calculated of joint positions of a goal expression of each source rig relative to a neutral expression of the source rig. A scaling transformation is then applied to the set of offsets to produce a scaled set of offsets, which are added, in turn, to a neutral expression of the target rig.

Abstract: Computer-implemented methods and computer program products for automatically transferring expressions between rigs with consistent joint structure, and for automatically transferring skin weights between different skin meshes based on joint positioning. A method is provided for transferring an expression between a source rig and a target rig, where each rig characterizes an animated character, and each rig, in turn, is characterized by a set of joints and a skin mesh having a plurality of vertices, with each vertex characterized by a matrix of weights relating a response of the vertex to movement of associated joints. A set of offsets is calculated of joint positions of a goal expression of the source rig relative to a neutral expression of the source rig. A scaling transformation is then applied to the set of offsets to produce a scaled set of offsets, which are added, in turn, to a neutral expression of the target rig.