Abstract: A multi-layer graph for dense stereo dynamic programming can improve synthesis of cyclopean virtual images by distinguishing between stereo disparities causes by occlusion and disparities caused by non-fronto-parallel surfaces. In addition, cyclopean virtual image processing may be combined with simulation of three-dimensional translation of a virtual camera to assist in aligning the user's gaze with the virtual camera. Such translation may include without limitation one or more of the following: horizontal (e.g., left and right) translation of the virtual camera, vertical translation (e.g., up and down) of the virtual camera, and axial translation (e.g., toward the subject and away from the subject) of the virtual camera.

Abstract: An example-based filling system identifies appropriate filling material to replace a destination region in an image and fills the destination region using this material, thereby alleviating or minimizing the amount of manual editing required to fill a destination region in image. Tiles of image data are borrowed from the proximity of the destination region or some other source to generate new image data to fill in the region. Destination regions may be designated by user input (e.g., selection of an image region by a user) or by other means (e.g., specification of a color or feature to be replaced). In addition, the order in which the destination region is filled by example tiles may be configured to emphasize the continuity of linear structures and composite textures using a type of isophote-driven image-sampling process.

Abstract: An electronic stylus system includes an electronic stylus and base receiving unit. The electronic stylus includes a first ultrasonic transmitter, a second ultrasonic transmitter, an electromagnetic transmitter, and a writing tip. The base receiver unit includes a first ultrasonic receiver, a second ultrasonic receiver, and an electromagnetic receiver. The ultrasonic receivers of the base unit are operable to receive signals transmitted by the ultrasonic transmitters of the electronic stylus. Similarly, the electromagnetic receiver of the base unit is operable to receive signals transmitted by the electromagnetic transmitter of the stylus. The location of the tip of the electronic stylus relative to a given reference point is determined using the locations of two ultrasonic transmitters relative to the two ultrasonic receivers.

Abstract: Previously, Poisson blending has been used for image blending including cloning an object onto a target background and blending pairs of source images together. Such Poisson blending works well in many situations. However, whilst this method is always workable, we have found that discolorations sometimes occur. We realized that these discolorations occur when the gradient of the source image is preserved too insistently, at the expense of preserving object and background color. In some situations object outlines become smeared or blurred. We develop a color preservation term and a fragility measure to address these problems. This gives a user additional control to obtain smooth compositions and reduce discoloration artifacts.

Abstract: It is required to provide an automated process for forming a visually appealing digital collage (also referred to as a tapestry or photomontage) from a plurality of input images. Input images and a collage are labeled. Labels in the collage specify which regions of the input images are used to form those collage regions. An energy function is created for the labeling which contains terms that take into account various criteria to produce a collage. For example, those criteria may relate to the amount of information in the images, similarity of the images, entropy in the images or object class information. A multi-stage optimization process is applied to the energy function which is fast and enables large numbers of input images to be used to produce a collage.

Abstract: Images of the same scene from multiple cameras may be use to generate a stereo disparity map. At least a portion of the stereo disparity map may be compared to a kernel image to detect and/or determine the location of an object in the disparity map. The kernel image is an array of pixel values which represent the stereo disparity of an object to be located, more particularly, the kernel image indicates the 3-dimensional surface shape of the object to be located from a point of view. The disparity map containing the located object may be process to manipulate the display of the stereo-based image and/or an input image.

Abstract: A method of labeling pixels in an image is described where the pixel label is selected from a set of three or more labels. The pixel labeling problem is reduced to a sequence of binary optimizations by representing the label value for each pixel as a binary word and then optimizing the value of each bit within the word, starting with the most significant bit. Data which has been learned from one or more training images is used in the optimization to provide information about the less significant bits within the word.

Abstract: An electronic stylus system includes an electronic stylus and base receiving unit. The electronic stylus includes a first ultrasonic transmitter, a second ultrasonic transmitter, an electromagnetic transmitter, and a writing tip. The base receiver unit includes a first ultrasonic receiver, a second ultrasonic receiver, and an electromagnetic receiver. The ultrasonic receivers of the base unit are operable to receive signals transmitted by the ultrasonic transmitters of the electronic stylus. Similarly, the electromagnetic receiver of the base unit is operable to receive signals transmitted by the electromagnetic transmitter of the stylus. The location of the tip of the electronic stylus relative to a given reference point is determined using the locations of two ultrasonic transmitters relative to the two ultrasonic receivers.

Abstract: A method of segmenting image elements into a foreground and background is described, such that only the foreground elements are part of a volume of interest for stereo matching. This reduces computational burden as compared with computing stereo matching over the whole image. An energy function is defined using a probabilistic framework and that energy function approximated to require computation only over foreground disparities. An optimization algorithm is used on the energy function to perform the segmentation.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (?) for each pixel on the set wherein ? is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (?) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: Techniques are disclosed to provide more efficient and improved border matting for extracted foreground images, e.g., without requiring excessive user interaction. Border matting techniques described herein generate relatively continuous transparency (or alpha values) along the boundary of the extracted object (e.g., limiting color bleeding and/or artifacts).

Abstract: A cyclopean virtual imaging system provides a view from a virtual camera placed symmetrically or midway between the calibrated cameras of a physical stereo pair. Such a system may be used in video conferencing applications as well as other stereo image contexts. By combining the left and right stereo images captured by the stereo pair, a virtual image is produced such that the subject appears to be looking into a cyclopean virtual camera, rather than to the left or right of a single physical camera. The cyclopean virtual image is generated by a forward-backward algorithm using a probabilistic distribution of possible disparity families.

Abstract: Existing remote workspace sharing systems are difficult to use. For example, changes made on a common work product by one user often appear abruptly on displays viewed by remote users. As a result the interaction is perceived as unnatural by the users and is often inefficient. Images of a display of a common work product are received from a camera at a first location. These images may also comprise information about objects between the display and the camera such as a user's hand editing a document on a tablet PC. These images are combined with images of the shared work product and displayed at remote locations. Advance information about remote user actions is then visible and facilitates collaborative mediation between users. Depth information may be used to influence the process of combining the images.

Abstract: Systems and methods for object or pattern detection that use a nonlinear support vector (SV) machine are described. In the illustrated and described embodiment, objects or patterns comprising faces are detected. The decision surface is approximated in terms of a reduced set of expansion vectors. In order to determine the presence of a face, the kernelized inner product of the expansion vectors with the input pattern are sequentially evaluated and summed, such that if at any point the pattern can be rejected as not comprising a face, no more expansion vectors are used. The sequential application of the expansion vectors produces a substantial saving in computational time.

Abstract: Systems and methods are provided for interactive construction of an object boundary by minimizing a sum of costs, including costs associated with inconsistency of the image data and costs associated with undesired curve shape properties. A particle filter optimization algorithm is implemented that incorporates a variable strength, intrinsic preference for boundary smoothness. The particle filter generates alternative sequences of random moves, constructed in parallel, to avoid becoming stuck in local minima. Approximate optimization algorithms are utilized, keeping computational burden low, freeing resources to analyze intrinsic costs associated with local curvature. In one embodiment, a user may construct a curve by launching a particle stream, and by choosing visually satisfactory locations on the stream from which to relaunch particles. The user can also provide other input, such as drop down dams to redirect the stream at T-junctions.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (?) for each pixel on the set wherein ? is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (?) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (?) for each pixel on the set wherein ? is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (?) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: Artifacts are detected in a cyclopean virtual image generated from stereo images. A disparity map is generated from the stereo images. Individual projected images are determined based on the disparity map and the corresponding stereo images. A difference map is computed between the individual projected images to indicate the artifacts. A source patch in the virtual image is defined relative to an artifact. A replacement target patch is generated using a split-patch search technique as a composite of a background exemplar patch and a foreground exemplar patch. Each exemplar patch may be identified from an image patch selected from at least one of the stereo images. The source patch of the virtual image is replaced by the replacement target patch to correct the detected artifact.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (?) for each pixel on the set wherein ?is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (?) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: Artifacts are detected in a cyclopean virtual image generated from stereo images. A disparity map is generated from the stereo images. Individual projected images are determined based on the disparity map and the corresponding stereo images. A difference map is computed between the individual projected images to indicate the artifacts. A source patch in the virtual image is defined relative to an artifact. A replacement target patch is generated using a split-patch search technique as a composite of a background exemplar patch and a foreground exemplar patch. Each exemplar patch may be identified from an image patch selected from at least one of the stereo images. The source patch of the virtual image is replaced by the replacement target patch to correct the detected artifact.