Abstract: Embodiments provide techniques for creating a composite video stream. Additionally, a first selection of pixels from the first video stream and a second selection of pixels from the second video stream are received. Here, both the first selection of pixels and the second selection of pixels indicate pixels that are to be included in the composite video stream. Embodiments identify a plurality of spatiotemporal seams across the first video stream and the second video stream, based at least in part on the first selection of pixels and the second selection of pixels. The first video stream and the second video stream are then composited into the composite video stream, by joining frames from the first video stream and the second video stream at the identified plurality of spatiotemporal seams.

Abstract: A method for performing light-based calibration of optics with caustic surfaces. The method includes mapping a light detecting device to a programmable light source. Then, the method includes operating a calibration light source to direct light onto one or more caustic surfaces of an optical assembly, e.g., an assembly of one or more lenses, facets, lenticules, and lenslets. The method may then involve, with the light detecting device, capturing an image of a projection surface of the optical assembly, which is opposite the one or more caustic surfaces in the optical assembly, as the projection surface is illuminated by the light from the light source. Further, the method includes processing the captured image, along with the mapping of the light detecting device to the programmable light source, to generate a calibration map of the optical assembly including the caustic surfaces.

Abstract: Rendering 3D paintings can be done by compositing brush strokes embedded in space. Image elements are rendered into an image representable by a pixel array wherein at least some of the image elements correspond to simulated painting strokes. A method may include determining stroke positions in a 3D space, determining stroke orders, and for each pixel to be addressed, determining a pixel color value by determining strokes intersections with a view ray for that pixel, determining a depth order and a stroke order for intersecting fragments, each fragment having a color, alpha value, depth, and stroke order, assigning an intermediate color to each of the fragments, corresponding to a compositing of nearby fragments in stroke order, and assigning a color to the pixel that corresponds to a compositing of the fragments using the intermediate colors assigned to the fragments. The compositing may be done in depth order.

Abstract: Techniques are presented for controlling the amount of temporal noise in certain animation sequences. Sketchy animation sequences are received in an input in a digital form and used to create an altered version of the same animation with temporal coherence enforced down to the stroke level, resulting in a reduction of the perceived noise. The amount of reduction is variable and can be controlled via a single parameter to achieve a desired artistic effect.

Abstract: Estimating a pose of an articulated 3D object model (4) by a computer is done by •obtaining a sequence of source images (10) and therefrom corresponding source image segments (13) with objects (14) separated from the image background; •matching such a sequence (51) with sequences (52) of reference silhouettes (13?), determining one or more selected sequences of reference silhouettes (13?) forming a best match; •for each of these selected sequences of reference silhouettes (13?), retrieving a reference pose that is associated with one of the reference silhouettes (13?); and •computing an estimate of the pose of the articulated object model (4) from the retrieved reference pose or poses. The result of these steps is an initial pose estimate, which then can be used in further steps, for example, for maintaining local consistency between pose estimates from consecutive frames, and global consistency over a longer sequence of frames.

Abstract: A combination converter arrangement and a switching device including such a combination converter arrangement are disclosed. The combination of a current transformer with a core made of ferromagnetic material and a Rogowski coil is referred to as a combination converter, the current transformer being used to supply energy to the electronic tripping unit of the switching device, and the Rogowski coil being used to measure current. In order to make use of the installation space available in the switching device for installing combination converters, a plurality of combination converters are arranged in a common housing to thereby provide a multi-pole combination converter module.

Abstract: Methods and systems for generating stereoscopic content with granular control over binocular disparity based on multi-perspective imaging from representations of light fields are provided. The stereoscopic content is computed as piecewise continuous cuts through a representation of a light field, minimizing an energy reflecting prescribed parameters such as depth budget, maximum binocular disparity gradient, desired stereoscopic baseline. The methods and systems may be used for efficient and flexible stereoscopic post-processing, such as reducing excessive binocular disparity while preserving perceived depth or retargeting of already captured scenes to various view settings. Moreover, such methods and systems are highly useful for content creation in the context of multi-view autostereoscopic displays and provide a novel conceptual approach to stereoscopic image processing and post-production.

Abstract: An image display apparatus includes a display layer and an image separation layer. The image separation layer is adapted to separate a displayed image on the display layer into a first image for a left eye of an observer and into a second image for a right eye of an observer. This renders the image display apparatus autostereoscopic. In order to improve the appearance of the displayed image, the apparatus is adapted to activate the display layer and the image separation layer substantially only within a given two-dimensional silhouette and to remain substantially transparent outside of the silhouette. In other aspects, the apparatus may be adapted to dynamically adjust an observation angle between the first image and the second image by controlling the distance between the display layer and the image separation layer by an actuator. The apparatus may be mounted on a robotic unit.

Abstract: A method for performing light-based calibration of optics with caustic surfaces. The method includes mapping a light detecting device to a programmable light source. Then, the method includes operating a calibration light source to direct light onto one or more caustic surfaces of an optical assembly, e.g., an assembly of one or more lenses, facets, lenticules, and lenslets. The method may then involve, with the light detecting device, capturing an image of a projection surface of the optical assembly, which is opposite the one or more caustic surfaces in the optical assembly, as the projection surface is illuminated by the light from the light source. Further, the method includes processing the captured image, along with the mapping of the light detecting device to the programmable light source, to generate a calibration map of the optical assembly including the caustic surfaces.

Abstract: A method is provided for sketch segmentation via smart scribbles, the results of which are especially suitable for interactive real-time graphics editing applications. A vector-based drawing may be segmented into labels based on input scribbles provided by a user. By organizing the labeling as an energy minimization problem, an approximate solution can be found using a sequence of binary graph cuts for an equivalent graph, providing an optimized implementation in a polynomial time suitable for real-time drawing applications. The energy function may include time, proximity, direction, and curvature between strokes as smoothness terms, and proximity, direction, and oriented curvature between strokes and scribbles as data terms. Additionally, the energy function may be modified to provide for user control over locality control, allowing the selection of appropriately sized labeling regions by scribble input speed or scribble input pressure.

Abstract: A computer-implemented method is provided for physical face cloning to generate a synthetic skin. Rather than attempt to reproduce the mechanical properties of biological tissue, an output-oriented approach is utilized that models the synthetic skin as an elastic material with isotropic and homogeneous properties (e.g., silicone rubber). The method includes capturing a plurality of expressive poses from a human subject and generating a computational model based on one or more material parameters of a material. In one embodiment, the computational model is a compressible neo-Hookean material model configured to simulate deformation behavior of the synthetic skin. The method further includes optimizing a shape geometry of the synthetic skin based on the computational model and the captured expressive poses. An optimization process is provided that varies the thickness of the synthetic skin based on a minimization of an elastic energy with respect to rest state positions of the synthetic skin.

Abstract: A system for augmenting the appearance of an object including a plurality of projectors. Each projector includes a light source and a lens in optical communication with the light source, where the lens focuses light emitted by the light source on the object. The system also includes a computer in communication with the plurality of projectors, the computer including a memory component and a processing element in communication with the memory component and the plurality of projectors. The processing element determines a plurality of images to create an augmented appearance of the object and provides the plurality of images to the plurality of projectors to project light corresponding to the plurality of images onto the object to create the augmented appearance of the object. After the images are projected onto the object, the augmented appearance of the objected is substantially the same regardless of a viewing angle for the object.

Abstract: High-quality passive performance capture using anchor frames derives in part from a robust tracking algorithm. Tracking is performed in image space and uses an integrated result to propagate a single reference mesh to performances represented in the image space. Image-space tracking is computed for each camera in multi-camera setups. Thus, multiple hypotheses can be propagated forward in time. If one flow computation develops inaccuracies, the others can compensate. This yields results superior to mesh-based tracking techniques because image data typically contains much more detail, facilitating more accurate tracking. Moreover, the problem of error propagation due to inaccurate tracking in image space can be dealt with in the same domain in which it occurs. Therefore, there is less complication of distortion due to parameterization, a technique used frequently in mesh processing algorithms.

Abstract: Rendering 3D paintings can be done by compositing strokes embedded in space. Users input strokes and other image elements using an input device that specifies a 2D view of the element, and the system provides the 3D position of the element based on rules and processes, some of which allow for user input of high level parameters, thereby allowing for intuitive and quick entry of 3D elements, and a 3D scalar field. The artist can treat the full 3D space as a canvas. Strokes painted in a 2D viewport window are embedded in 3D space in a way that gives creative freedom to the artist while maintaining an acceptable level of controllability. The canvas need not be tied to any particular object already in a scene, but the canvas can be dependent on, or a function of, another object. An implicit canvas can be defined by the 3D scalar field.

Abstract: Embodiments provide techniques for creating a composite video stream. Additionally, a first selection of pixels from the first video stream and a second selection of pixels from the second video stream are received. Here, both the first selection of pixels and the second selection of pixels indicate pixels that are to be included in the composite video stream. Embodiments identify a plurality of spatiotemporal seams across the first video stream and the second video stream, based at least in part on the first selection of pixels and the second selection of pixels. The first video stream and the second video stream are then composited into the composite video stream, by joining frames from the first video stream and the second video stream at the identified plurality of spatiotemporal seams.

Abstract: Rendering 3D paintings can be done by compositing strokes embedded in space. Users input strokes and other image elements using an input device that specifies a 2D view of the element, and the system provides the 3D position of the element based on rules and processes, some of which allow for user input of high level parameters, thereby allowing for intuitive and quick entry of 3D elements, and a 3D scalar field. The artist can treat the full 3D space as a canvas. Strokes painted in a 2D viewport window are embedded in 3D space in a way that gives creative freedom to the artist while maintaining an acceptable level of controllability. The canvas need not be tied to any particular object already in a scene, but the canvas can be dependent on, or a function of, another object. An implicit canvas can be defined by the 3D scalar field.

Abstract: A method for image processing in video conferencing, for correcting the gaze of an interlocutor in an image or a sequence of images captured by at least one real camera, comprises the steps of the at least one real camera acquiring an original image of the interlocutor; synthesizing a corrected view of the interlocutor's face as seen by a virtual camera, the virtual camera being located on the interlocutor's line of sight and oriented towards the interlocutor; transferring the corrected view of the interlocutor's face from the synthesized view into the original image, thereby generating a final image; at least one of displaying the final image and transmitting the final image.

Abstract: To generate a pixel-accurate depth map, data from a range-estimation sensor (e.g., a time-of flight sensor) is combined with data from multiple cameras to produce a high-quality depth measurement for pixels in an image. To do so, a depth measurement system may use a plurality of cameras mounted on a support structure to perform a depth hypothesis technique to generate a first depth-support value. Furthermore, the apparatus may include a range-estimation sensor which generates a second depth-support value. In addition, the system may project a 3D point onto the auxiliary cameras and compare the color of the associated pixel in the auxiliary camera with the color of the pixel in reference camera to generate a third depth-support value. The system may combine these support values for each pixel in an image to determine respective depth values. Using these values, the system may generate a depth map for the image.

Abstract: A method is provided for an optimized stereoscopic camera with low processing overhead, especially suitable for real-time applications. By constructing a viewer-centric and scene-centric model, the mapping of scene depth to perceived depth may be defined as an optimization problem, for which a solution is analytically derived based on constraints to stereoscopic camera parameters including interaxial separation and convergence distance. The camera parameters may thus be constrained prior to rendering to maintain a desired perceived depth volume around a stereoscopic display, for example to ensure user comfort or provide artistic effects. To compensate for sudden scene depth changes due to unpredictable camera or object movements, as may occur with real-time applications such as video games, the constraints may also be temporally interpolated to maintain a linearly corrected and approximately constant perceived depth range over time.