Abstract: Any image capturing system, and a method to use same, that includes one or more image capturing devices that have known and fixed positions relative to one another and the eye of a subject, wherein the image capturing devices capture a plurality of images of eye of a subject during a performance is disclosed. The images of the eye, along with the known and fixed relative positions of the image capturing devices are used define eye-lines for the eye of the subject. The eye-lines can then be used to manually or automatically retarget the eye of a rendered or animated figure based on the performance of the subject to retarget the gaze intent of the rendered or animated figure within a scene.

Abstract: A method for rendering an image on computer system including a display includes determining a first displacement map associated with a surface material and a first input parameter, determining a second displacement map associated with the surface material and a second input parameter. determining a three-dimensional displacement data structure in response to the first displacement map, the first input parameter, the second displacement map and the second input parameter in the computer system, receiving a third input parameter, determining a third displacement map associated with the surface material in response to the three-dimensional displacement data structure and the third input parameter in the computer system, rendering an image of an object in the computer system, wherein an appearance of a surface of the object is determined in response to the third displacement map, and displaying the image on the display to a user.

Abstract: Any image capturing system, and a method to use same, that includes one or more image capturing devices that have known and fixed positions relative to one another and the eye of a subject, wherein the image capturing devices capture a plurality of images of eye of a subject during a performance is disclosed. The images of the eye, along with the known and fixed relative positions of the image capturing devices are used define eye-lines for the eye of the subject. The eye-lines can then be used to manually or automatically retarget the eye of a rendered or animated figure based on the performance of the subject to retarget the gaze intent of the rendered or animated figure within a scene.

Abstract: A method for a computer system comprising receiving a displacement for a first object model surface from a user determined in response to a first physical motion captured pose, determining a weighted combination of a first displacement group and a second displacement group from the displacement, wherein the first displacement group is determined from displacements between the first object model surface and a second object model surface, wherein the second object model surface is determined from displacements between a second physical motion captured pose, wherein the second displacement group is determined from displacements between the first object model surface and a third object model surface, wherein the third object model surface is determined from a third physical motion captured pose, determining a fourth object model surface from the first object model surface and the weighted combination, and displaying the fourth object model surface to the user on a display.

Abstract: A method for efficiently manipulating 3D scenes recorded by a virtual camera using a computer system comprised of projectors, graphics accelerators, one or more CPUs, instances of 3D rendering software, and a MIDI interface, includes receiving from the MIDI controller camera parameters, defining left camera and right camera parameters based on the camera parameters, determining left and right images based upon left and right camera parameters, projecting left and right images, viewing left and right images, integrating left and right images to represent a 3D scene, manipulating the 3D scene until the user is satisfied, and storing the left and right camera parameters, and storing the left and right images.

Abstract: A method for a computer system includes receiving a first camera image of a 3D object having sensor markers, captured from a first location, at a first instance, receiving a second camera image of the 3D object from a second location, at a different instance, determining points from the first camera image representing sensor markers of the 3D object, determining points from the second camera image representing sensor markers of the 3D object, determining approximate correspondence between points from the first camera image and points from the second camera image, determining approximate 3D locations some sensor markers of the 3D object, and rendering an image including the 3D object in response to the approximate 3D locations.

Abstract: The present invention relates to computer capture of object motion. More specifically, embodiments of the present invention relate to capturing of facial movement or performance of an actor. Embodiments of the present invention provide a mounting bracket for a head-mounted motion capture camera system. In many embodiments, the mounting bracket includes a helmet that is positioned on the actor's head and mounting rods on either side of the helmet that project toward the front of the actor that may be flexibly repositioned. Cameras positioned on the mounting rods capture images of the actor's face.

Abstract: The present invention relates to computer capture of object motion. More specifically, embodiments of the present invention relate to capturing of facial movement or performance of an actor. Embodiments of the present invention provide a head-mounted camera system that allows the movements of an actor's face to be captured separately from, but simultaneously with, the movements of the actor's body. In some embodiments of the present invention, a method of motion capture of an actor's performance is provided. A self-contained system is provided for recording the data, which is free of tethers or other hard-wiring, is remotely operated by a motion-capture team, without any intervention by the actor wearing the device. Embodiments of the present invention also provide a method of validating that usable data is being acquired and recorded by the remote system.

Abstract: The present invention relates to computer capture of object motion. More specifically, embodiments of the present invention relate to capturing of facial movement or performance of an actor. Embodiments of the present invention provide a head-mounted camera system that allows the movements of an actor's face to be captured separately from, but simultaneously with, the movements of the actor's body. In many embodiments, multiple cameras are provided mounted on a bracket for placement on the head of an actor. In some embodiments, the cameras record grayscale images of an actor's face, which has been marked with dots of makeup. In many embodiments, the cameras record images of an actor's face from at least two angles.