Abstract: In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject's face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.

Abstract: In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject's face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.

Abstract: Methods for coding a time-dependent geometry stream include a basis decomposition coder and a column/row prediction coder. The basis decomposition coder uses principal component analysis to decompose a time dependent geometry matrix into basis vectors and weights. The weights and basis vectors are coded separately. Optionally, the residual between a mesh constructed from the weights and basis vectors and the original mesh can be encoded as well. The column/row predictor exploits coherence in a matrix of time dependent geometry by encoding differences among neighboring rows and columns. Row and column sorting optimizes this form of coding by re-arranging rows and columns to improve similarity among neighboring rows/columns.

Abstract: A method and system which simplifies the process of constructing new basis motions and transitions between them for animation of articulated figures with many degrees of freedom using existing basis motion data. The system uses an interpreter of a motion expression language called motion algebra to allow a user to manipulate basis motion data, break it into components, and reassemble it into new, more complex motions. The system provides two methods for generating motion: motion transition generation and cyclification. Motion transition generation uses a combination of space/time constraints and inverse kinematic constraints to generate transitions between basis motions. These transitions minimize the torque required while maintaining kinematic constraints. A fast dynamics formulation makes it possible to use spacetime constraints on systems with many degrees of freedom. Cyclification helps to eliminate discontinuities in cyclic motions and distributes the discontinuity error over an entire time interval.

Abstract: A computer-implemented shading system includes a geometric renderer which renders a computer generated image to produce geometric image information for an object in a scene, and a user interface which permits a user to selectively vary a designated parameter(s) to affect how that object is shaded. The system also includes a specialized shader to shade the object in the scene according to the designated parameter(s) and other shading parameters. The specialized shader is created from the user's original shader. The specialized shader has a cache loader which contains all of the terms of the user's original shader, plus load operations to load values from computations that do not depend from the designated parameter(s). The specialized shader also has a cache reader which contains a reduced set of terms from the original shader that depend on the designated parameter(s), plus read operations to read the values of the non-variant terms from the cache.