Abstract: An achromatized metasurface lens that includes a color filter array and a metasurface lens located proximate to the color filter array. The color filter array includes a plurality of color filter elements for different colors of light. The metasurface lens includes a corresponding plurality of subsets of nanostructures based on the color filter array. Each respective subset of nanostructures is optically aligned with a corresponding color filter element. For example, a subset of nanostructures configured to modify a particular color of light may be optically aligned with a color filter element that filters light of the same particular color. The achromatized metasurface lens may be incorporated into a display system, such as a head-mounted-display. The display system may also include a narrowband display source tuned to the color filter elements in the color filter array.

Abstract: An achromatized metasurface lens that includes a color filter array and a metasurface lens located proximate to the color filter array. The color filter array includes a plurality of color filter elements for different colors of light. The metasurface lens includes a corresponding plurality of subsets of nanostructures based on the color filter array. Each respective subset of nanostructures is optically aligned with a corresponding color filter element. For example, a subset of nanostructures configured to modify a particular color of light may be optically aligned with a color filter element that filters light of the same particular color. The achromatized metasurface lens may be incorporated into a display system, such as a head-mounted-display. The display system may also include a narrowband display source tuned to the color filter elements in the color filter array.

Abstract: Demosaicing of graphical content is provided. In an illustrative implementation a demosaicing engine executing one or more demosaicing algorithms is employed to operate on graphical content to provide better quality and higher resolution images. In operation, the demosaicing engine operates in two modes, a training/learning mode, and a run time mode. During training, training-images are analyzed to generate a codebook of mosaic filter table entries, such that each table entry has an associated list of similar training pixel blocks and their associated filters. During run time, a run-time image is broken into pixel blocks. Each pixel block is then compared with the entries of the codebook to find the closest match filter. The list associated with the entry is then processed using a least-squares algorithm to locate the optimal mosaic filter. As a result, higher resolution is achieved without requiring more pixels.

Abstract: A complex procedural surface can be expressed based on some constructive solid geometry operations performed on primitive procedural surfaces. The domain based representation of the complex procedural surface includes implicit curves of intersection. During pre-processing, the parts of the domain based representation to be triangulated are first sub-divided into simple triangles not bound on any side by an edge related to the parameterized regions of the implicit curve and curve visibility triangles. The coarse pre-processed triangulated mesh is later refined during runtime by further sub-dividing the coarse mesh to add triangles with curve based edges and non-curve based edges to generate a mesh of sampling triangles. The more refined sampling triangle mesh is further refined by applying geometry instancing to map appropriate instance meshes into the appropriate sampling triangles to create an even more refined triangulated mesh at runtime for rendering.

Abstract: The illustrated and described embodiments describe techniques for capturing data that describes 3-dimensional (3-D) aspects of a face, transforming facial motion from one individual to another in a realistic manner, and modeling skin reflectance.

Abstract: Compact and accurate piecewise parametric representations of implicit curves may be achieved by iteratively selecting ranges of parameterizing regions and testing each for satisfying an intervalized super convergence test. In one aspect, the implicit curves is represented as a compact form of one or more representations of such convergence regions. For memory and bandwidth constrained applications, starting points of convergence regions may not be stored but instead calculated at runtime prior to rendering a point on the implicit curve. Furthermore, not all endpoints relevant convergence regions of a selected implicit curve need be stored. Instead, based on at least one endpoint, the other endpoints can be derived via Newton iterations. To further reduce memory and bandwidth costs, coordinates can be stored in a quantized format and the points reflecting floating point accuracy can be derived at runtime again by Newton iteration.

Abstract: Compact and accurate piecewise parametric representations of implicit functions may be achieved by iteratively selecting ranges of parameterizing regions and testing each for satisfying an intervalized super convergence test. In one aspect, the implicit function is represented as a compact form of one or more representations of such convergence regions. In yet another aspect, iteration is begun with applying the intervalized convergence test to an entire pameterization region. In yet another aspect, the range being tested for super convergence is iteratively sub-divided to generate other ranges for testing. In one aspect, such sub-dividing comprises dividing the selected ranges by half. In one further aspect, Newton iterate steps are applied to selected ranges to change such ranges for further testing of super convergence of such ranges.

Abstract: In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject's face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.

Abstract: In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject's face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.

Abstract: In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject's face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.

Abstract: The illustrated and described embodiments describe techniques for capturing data that describes 3-dimensional (3-D) aspects of a face, transforming facial motion from one individual to another in a realistic manner, and modeling skin reflectance.

Abstract: The method captures a 3D model of a face, which includes a 3D mesh and a series of deformations of the mesh that define changes in position of the mesh over time (e.g., for each frame). The method also builds a texture map associated with each frame in an animation sequence. The method achieves significant advantages by using markers on an actor's face to track motion of the face over time and to establish a relationship between the 3D model and texture. Specifically, videos of an actor's face with markers are captured from multiple cameras. Stereo matching is used to derive 3D locations of the markers in each frame. A 3D scan is also performed on the actor's face with the markers to produce an initial mesh with markers. The markers from the 3D scan are matched with the 3D locations of the markers in each frame from the stereo matching process. The method determines how the position of the mesh changes from frame to frame by matching the 3D locations of the markers from one frame to the next.

Abstract: A system and method are provided to reduce noise in computer generated images. A source object is stochastically sampled to generate a frame image which appears in motion through multiple successive frames. The motion of the frame image is predicted and the samples taken at the predicted location in various projected frames are used to generate an improved, antialiased, noise-reduced image in a single reference frame. By using stochastically obtained samples from multiple frames, the noise reduction technique provides many additional samples without any additional cost of creating them.