Abstract: Systems and methods for controlling performance of a digital character depicted at a display device are disclosed. According to at least one embodiment, a method for controlling performance of a digital character depicted at a display device includes: determining a presence of a person located in a physical environment; and in response to determining the presence of the person, facilitating control of the performance of the digital character depicted at the display device by a human operator, by an artificial intelligence (AI) game-engine, or by a combination thereof.

Abstract: Systems and methods for controlling performance of a digital character depicted at a display device are disclosed. According to at least one embodiment, a method for controlling performance of a digital character depicted at a display device includes: determining a presence of a person located in a physical environment; and in response to determining the presence of the person, facilitating control of the performance of the digital character depicted at the display device by a human operator, by an artificial intelligence (AI) game-engine, or by a combination thereof.

Abstract: Systems and methods for controlling performance of a digital character depicted at a display device are disclosed. According to at least one embodiment, a method for controlling performance of a digital character depicted at a display device includes: determining a presence of a person located in a physical environment; and in response to determining the presence of the person, facilitating control of the performance of the digital character depicted at the display device by a human operator, by an artificial intelligence (AI) game-engine, or by a combination thereof.

Abstract: A method for evaluating a facial performance using facial capture of two users includes obtaining a reference set of facial performance data representing a first user's facial capture; obtaining a facial capture of a second user; extracting a second set of facial performance data based on the second user's facial capture; calculating at least one matching metric based on a comparison of the reference set of facial performance data to the second set of facial performance data; and displaying an indication of the at least one matching metric on a display.

Abstract: A method for evaluating a facial performance using facial capture of two users includes obtaining a reference set of facial performance data representing a first user's facial capture; obtaining a facial capture of a second user; extracting a second set of facial performance data based on the second user's facial capture; calculating at least one matching metric based on a comparison of the reference set of facial performance data to the second set of facial performance data; and displaying an indication of the at least one matching metric on a display.

Abstract: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.

Abstract: Motion capturing markers coupled to at least one motion capture object, comprising: generating a plurality of Configurations, each Configuration including partitioning parameters; partitioning a motion capture beat into beat partitions using the plurality of Configurations; reconstructing the beat partitions, wherein each beat partition is reconstructed using each Configuration and corresponding motion capture camera calibration information to generate point data representing a marker; and merging the point data to form at least one master point file.

Abstract: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.

Abstract: Capturing a surface in motion picture, including: covering a surface with a pattern formed of a marking material; acquiring a sequence of image frames, each image frame of the sequence including a plurality of images of the pattern covering the surface; deriving a mesh object from the plurality of images for the each image frame; tracking the mesh object in each frame through the sequence of frames; and generating animation data modeling a characteristic of the surface using the tracked mesh object.

Abstract: Tracking a group of motion capture markers in a sequence of frames, comprising: establishing a group relationship among a plurality of motion capture markers in a current frame; and labeling the plurality of motion capture markers in the current frame using the group relationship.

Abstract: Capturing and processing facial motion data includes: coupling a plurality of sensors to target points on a facial surface of an actor; capturing frame by frame images of the plurality of sensors disposed on the facial surface of the actor using at least one motion capture camera disposed on a head-mounted system; performing, in the head-mounted system, a tracking function on the frame by frame images of the plurality of sensors to accurately map the plurality of sensors for each frame; and generating, in the head-mounted system, a modeled surface representing the facial surface of the actor.

Abstract: Capturing motion, including: coupling at least one body marker on at least one body point of at least one actor; coupling at least one facial marker on at least one facial point of the at least one actor; arranging a plurality of motion capture cameras around a periphery of a motion capture volume, the plurality of motion capture cameras is arranged such that substantially all laterally exposed surfaces of the at least one actor while in motion within the motion capture volume are within a field of view of at least one of the plurality of motion capture cameras at substantially all times; attaching at least one wearable motion capture camera to the at least one actor, wherein substantially all of the at least one facial marker and the at least one body marker on the at least one actor are within a field of view of the at least one wearable motion capture camera.

Abstract: Capturing the motion of a target. One method includes: coupling a plurality of primary markers to the target; coupling at least one secondary marker to the target; capturing a plurality of primary marker data points, wherein each primary marker data point corresponds to one primary marker of the plurality of primary markers; capturing at least one secondary marker signature, each secondary marker signature corresponding to and uniquely identifying each secondary marker of said at least one secondary marker; and identifying the plurality of primary markers using said at least one secondary marker signature.

Abstract: Capturing motion using motion capture cameras comprises: coupling a plurality of markers to an actor; allowing a material to be positioned between the actor and the motion capture cameras, wherein the material is selected to allow the motion capture cameras to capture motion of the plurality of markers while the actor interacts with the material; and capturing the motion of the markers.

Abstract: Labeling motion capture volume data includes: receiving a motion capture beat, the motion capture beat including unlabeled body points and unlabeled face points; labeling the unlabeled body points which have a valid fit to a predetermined body model template; verifying the labeled body points using stretch analysis; labeling unlabeled body points using a kinematic skeleton analysis; isolating the unlabeled face points; stabilizing the unlabeled face points; labeling the unlabeled face points; and merging the labeled face points and labeled body points.

Abstract: A method of cleaning facial marker data, the method comprising: decimating frames of survey facial marker data into representative frames of key facial poses; generating a facial pose matrix using the representative frames of key facial poses; and cleaning incoming frames of facial marker data using the facial pose matrix.

Abstract: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.

Abstract: Capturing motion, including: coupling at least one body marker on at least one body point of at least one actor; coupling at least one facial marker on at least one facial point of the at least one actor; arranging a plurality of motion capture cameras around a periphery of a motion capture volume, the plurality of motion capture cameras is arranged such that substantially all laterally exposed surfaces of the at least one actor while in motion within the motion capture volume are within a field of view of at least one of the plurality of motion capture cameras at substantially all times; attaching at least one wearable motion capture camera to the at least one actor, wherein substantially all of the at least one facial marker and the at least one body marker on the at least one actor are within a field of view of the at least one wearable motion capture camera.

Abstract: A method including: applying a marking material having a known pattern to a body and a face of an actor; configuring at least one first video motion capture camera to capture the marking material on the body of the actor; configuring at least one second video motion capture camera to capture the marking material on the face of the actor; substantially simultaneously capturing body motion data using the at least one first video motion capture camera and facial motion data using the at least one second video motion capture camera; and integrating the body motion data and the facial motion data.

Abstract: A system for capturing motion comprises: a motion capture volume configured to include at least one moving object having markers defining a plurality of points on the at least one moving object; at least one mobile motion capture camera, the at least one mobile motion capture camera configured to be moveable within the motion capture volume; and a motion capture processor coupled to the at least one mobile motion capture camera to produce a digital representation of movement of the at least one moving object.