Abstract: Systems and techniques for reconstructing one or more eyes using a parametric eye model are provided. The systems and techniques may include obtaining one or more input images that include at least one eye. The systems and techniques may further include obtaining a parametric eye model including an eyeball model and an iris model. The systems and techniques may further include determining parameters of the parametric eye model from the one or more input images. The parameters can be determined to fit the parametric eye model to the at least one eye in the one or more input images. The parameters include a control map used by the iris model to synthesize an iris of the at least one eye. The systems and techniques may further include reconstructing the at least one eye using the parametric eye model with the determined parameters.

Abstract: Methods and systems for generating stereoscopic content with granular control over binocular disparity based on multi-perspective imaging from representations of light fields are provided. The stereoscopic content is computed as piecewise continuous cuts through a representation of a light field, minimizing an energy reflecting prescribed parameters such as depth budget, maximum binocular disparity gradient, desired stereoscopic baseline. The methods and systems may be used for efficient and flexible stereoscopic post-processing, such as reducing excessive binocular disparity while preserving perceived depth or retargeting of already captured scenes to various view settings. Moreover, such methods and systems are highly useful for content creation in the context of multi-view autostereoscopic displays and provide a novel conceptual approach to stereoscopic image processing and post-production.

Abstract: The disclosure provides an approach for estimating depth in a scene. According to one aspect, regions where the depth estimation is expected to perform well may first be identified in full-resolution epipolar-plane images (EPIs) generated from a plurality of images of the scene. Depth estimates for EPI-pixels with high edge confidence are determined by testing a number of discrete depth hypotheses and picking depths that lead to highest color density of sampled EPI-pixels. The depth estimate may also be propagated throughout the EPIs. This process of depth estimation and propagation may be iterated until all EPI-pixels with high edge confidence have been processed, and all EPIs may also be processed in this manner. The EPIs are then iteratively downsampled to coarser resolutions, at which edge confidence for EPI-pixels not yet processed are determined, depth estimates of EPI-pixels with high edge confidence made, and depth estimates propagated throughout the EPIs.

Abstract: Methods and systems of reconstructing an eyelid are provided. A method of reconstructing an eyelid includes obtaining one or more images of the eyelid, generating one or more image input data for the one or more images of the eyelid, generating one or more reconstruction data for the one or more images of the eyelid, and reconstructing a spatio-temporal digital representation of the eyelid using the one or more input image data and the one or more reconstruction data.

Abstract: A method for image processing in video conferencing, for correcting the gaze of an interlocutor in an image or a sequence of images captured by at least one real camera, comprises the steps of the at least one real camera acquiring an original image of the interlocutor; synthesizing a corrected view of the interlocutor's face as seen by a virtual camera, the virtual camera being located on the interlocutor's line of sight and oriented towards the interlocutor; transferring the corrected view of the interlocutor's face from the synthesized view into the original image, thereby generating a final image; at least one of displaying the final image and transmitting the final image.

Abstract: A method is disclosed for applying physics-based simulation to an animator provided rig. The disclosure presents equations of motions for simulations performed in the subspace of deformations defined by an animator's rig. The method receives an input rig with a plurality of deformation parameters, and the dynamics of the character are simulated in the subspace of deformations described by the character's rig. In certain embodiments, the present disclosure provides a method that transforms stiffness values defined on rig parameters to a non-homogeneous distribution of material parameters for the underlying rig.

Abstract: Provided is point-based efficient three-dimensional (3D) information representation from a color image that is obtained from a general Charge-Coupled Device (CCD)/Complementary Metal Oxide Semiconductor (CMOS) camera, and a depth image that is obtained from a depth camera. A 3D image processing method includes storing a depth image associated with an object as first data of a 3D data format, and storing a color image associated with the object as color image data of a 2D image format, independent of the first data.

Abstract: In an object generation system, consumable base materials are characterized in a characterization process wherein an object generation system can use a plurality of so-characterized base materials. User input representing a desired object and set of characteristics for that desired object are processed, using a computer or computing device, to derive a mapping of locations for placement of portions of the plurality of base materials such that when the mapping is provided to an object generator, the generated object approximates the representing a desired object and set of characteristics. The characterization of a base material might include elasticity of the base material, the user input might be a desired shape and elasticity, the object generator might be a 3D multi-material printer and the generated object might at least approximate the desired shape and elasticity as a result of being constructed from the plurality of base materials used by the printer.

Abstract: There are provided an interactive design system and method for character crafting. An example system includes a memory storing a machine software application and a processor configured to execute the machine software application to receive a plurality of components for a character, the plurality of components including at least a first component and a second component, receive a movement for the character, the movement including a first pose for the character and a second pose for the character, calculate a linkage for the first component and the second component based on the movement, and generate an updated character by connecting the second component to the first component using the linkage. The linkage may include at least one of a connector, a trimmer, and a propagation mechanism.

Abstract: A technique for fabricating a highlight hologram based on a digital object performs point sampling on the object and represents each sampled point as a geometric patch. A set of geometric patches corresponding to sampled points from the object are fabricated into a substrate. A paraboloid patch may be used for reflective substrates while a hyperboloid may be used for transmissive substrates. To avoid specifying overlapping patches, which are impractical to fabricate, certain of the sample points may be merged. An output set of grooves is saved and may be used to specify fabrication of a highlight hologram on the physical substrate.

Abstract: Methods and systems of reconstructing an eyelid are provided. A method of reconstructing an eyelid includes obtaining one or more images of the eyelid, generating one or more image input data for the one or more images of the eyelid, generating one or more reconstruction data for the one or more images of the eyelid, and reconstructing a spatio-temporal digital representation of the eyelid using the one or more input image data and the one or more reconstruction data.

Abstract: An image processor inputs a first image and outputs a downscaled second image by upscaling the second image to a third image, wherein the third image is substantially the same size as the first image size with a third resolution, associating pixels in the second image with a corresponding group of pixels from the third set of pixels, sampling a first image area at a first location of the first set of pixels to generate a first image sample, sampling a second image area of the third set of pixels to generate a second image sample, measuring similarity between the image areas, generating a perceptual image value, recursively adjusting values of third set of pixels until the image perception value matches a perceptual standard value, and adjusting pixel values in the second image to a representative pixel value of each of the corresponding group of pixels.

Abstract: A method for synchronizing a basic clock pulse system having a plurality of synchronized components with a higher-ranking clock pulse system includes, in a first step of the synchronization, determining a phase difference between an actual phase of the basic clock pulse system and a nominal phase of the higher-ranking clock pulse system and transmitting the phase difference to the components of the basic clock pulse system and, in a second step of the synchronization, using the determined phase difference as a pilot control for each component, i.e. for the pilot control of a clock pulse generator of each component.

Abstract: A method of animation of surface deformation and wrinkling, such as on clothing, uses low-dimensional linear subspaces with temporally adapted bases to reduce computation. Full space simulation training data is used to construct a pool of low-dimensional bases across a pose space. For simulation, sets of basis vectors are selected based on the current pose of the character and the state of its clothing, using an adaptive scheme. Modifying the surface configuration comprises solving reduced system matrices with respect to the subspace of the adapted basis.

Abstract: In particular embodiments, a 2D representation of an object may be provided. A first method may comprise: receiving sketch input identifying a target position for a specified portion of the object; computing a deformation for the object within the context of a character rig specification for the object; and displaying an updated version of the object. A second method may comprise detecting sketch input; classifying the sketch input, based on the 2D representation, as an instantiation of the object; instantiating the object using a 3D model of the object; and displaying a 3D visual representation of the object.

Abstract: Novel systems and methods are described for creating, compressing, and distributing video or image content graded for a plurality of displays with different dynamic ranges. In implementations, the created content is “continuous dynamic range” (CDR) content—a novel representation of pixel-luminance as a function of display dynamic range. The creation of the CDR content includes grading a source content for a minimum dynamic range and a maximum dynamic range, and defining a luminance of each pixel of an image or video frame of the source content as a continuous function between the minimum and the maximum dynamic ranges. In additional implementations, a novel graphical user interface for creating and editing the CDR content is described.

Abstract: A converter unit includes: a housing with a moulded-on hollow cylinder that extends into the housing; a non-magnetic toroidal core supporting a first secondary winding, contacting the housing bottom concentrically with the hollow cylinder and is embedded in a solid compound; a magnetic toroidal core supporting a second secondary winding, arranged concentrically with the hollow cylinder above the non-magnetic toroidal coil; and a casting compound with which the housing opening is closed. To achieve a compact converter unit, a first planar spacing element is arranged between the first and the second secondary windings, directly contacting the first secondary winding and the second secondary winding. In addition, electrically insulating particles fill out the space between the second secondary winding and the housing wall, and the casting compound extends at least up to the particles, which lie at the top towards the housing opening.

Abstract: The present disclosure generally relates to a projection system with increased spatial resolution. The projection system includes one or more light sources, a spatial light modulator configured to reflect light received from the one or more light sources to generate a plurality of sub-images of a composite image, and an optical system configured to reflect each of the plurality of sub-images the sub-images at a different portion of a projection surface. By projecting the single composite image using a plurality of sub-images projected at different times and/or locations from one another, the composite full image has a higher resolution as compared to the resolution defined by the hardware of the spatial light modulator and light sources.

Abstract: A system includes a memory configured to store a plurality of tools and a processor configured to use the plurality of tools. The processor uses the plurality of tools to retrieve historical information relating to a storyline, retrieve user information relating to user interactions with the storyline, provide the historical information and the user information for incorporating into the content, and generate the content using the historical information and the user information.

Abstract: To generate a pixel-accurate depth map, data from a range-estimation sensor (e.g., a time-of flight sensor) is combined with data from multiple cameras to produce a high-quality depth measurement for pixels in an image. To do so, a depth measurement system may use a plurality of cameras mounted on a support structure to perform a depth hypothesis technique to generate a first depth-support value. Furthermore, the apparatus may include a range-estimation sensor which generates a second depth-support value. In addition, the system may project a 3D point onto the auxiliary cameras and compare the color of the associated pixel in the auxiliary camera with the color of the pixel in reference camera to generate a third depth-support value. The system may combine these support values for each pixel in an image to determine respective depth values. Using these values, the system may generate a depth map for the image.