Abstract: Systems and methods of visually indicating one or more gestures of a user of a node (22) in the content of a media stream (24) are disclosed. A node (22) configured to transmit a media stream (24) having content to one or more other nodes (22) includes a screen configured to display the content of the media stream, a media device (36) configured to capture an image of one or more gestures of the user of the node (22), wherein the one or more gestures are adjacent to the screen and the media device (36) is positioned to capture the image without capturing more than a peripheral view of the screen in that image; a media analyzer (38) configured to generate a visual representation of the captured one or more gestures; and a compositer (40) configured to composite the visual representation of the captured one or more gestures with the content of the media stream (24).

Abstract: A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. A display pipeline of user-supplied image modification processing modules are reduced by first representing the processing modules as multiple, individual matrix operations. All the matrix operations are then combined with, i.e., multiplied to, the transformation matrix to create a modified transformation matrix. The created transformation matrix is then used in place of the original transformation matrix to simultaneously achieve both image transformation and any pre and post image processing defined by the image modification processing modules.

Abstract: Systems and methods for modifying content of a media stream (24) based on a user's one or more gestures are disclosed.

Abstract: Disclosed are systems and methods for developing robust features for representing data. In embodiments, a linear generative model is computed using data. In embodiments, based upon a robustness measure, a set of features is selected. In embodiments, the set of features may be evaluated to gauge the capacity of the set of features to represent the data. Responsive to the set of features not satisfying an evaluation criterion or criteria, the set of features may be refined until the selected set of features complies with the evaluation criterion or criteria.

Abstract: Embodiments of the present invention enable fault detection in a printed dot-pattern image. Certain applications of the present invention are its use in various embodiments of a system for inspection of a printed circuit board (“PCB”) substrate. In embodiments, a generated distortion map is based on a comparison of a reconstructed dot-pattern image, a simulated reference bitmap, and an error map representing differences between the reconstructed dot-pattern image and the reference bitmap. In embodiments, the pixels of the distortion map are color coded to identify the locations and types of aberrations that were discovered as a result of the comparison.

Abstract: Disclosed herein are multimedia-conferencing systems and methods enabling local participants to hear remote participants from the direction the remote participants are rendered on a display. In one aspect, a method includes a computing device receives a remote participant's image and sound information collected at a remote site. The remote participant's image is rendered on a display at a local site. When the local participant is in close proximity to the display, sounds generated by the remote participant are played over stereo loudspeakers so that the local participant perceives the sounds as emanating from the remote participant's location rendered on the display.

Abstract: A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. A display pipeline of user-supplied image modification processing modules are reduced by first representing the processing modules as multiple, individual matrix operations. All the matrix operations are then combined with, i.e., multiplied to, the transformation matrix to create a modified transformation matrix. The created transformation matrix is then used in place of the original transformation matrix to simultaneously achieve both image transformation and any pre and post image processing defined by the image modification processing modules.

Abstract: Two projected images from two projector-camera systems, each defined by characteristics c1=T1p1 and c2=T2p2, respectively, are used to create mosaic composite of a desired image c. Formulas p1=T1?1(c?T2p2) and p2=T2?1(c?T1p1) are iteratively repeated with p2 initially set to zero until p1 converges to a first mosaic image and p2 converges to a second mosaic image.

Abstract: A method and system for compensating for a moving object placed between a projector and a projection scene is shown. The method/system dividing a movement pattern of the moving object into N discrete position states, and for each of said N position states determining a corresponding view projection matrix. While projecting an image within any of the N position states, multiplying a desired projection image by the corresponding view projection matrix.

Abstract: A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. A display pipeline of user-supplied image modification processing modules are reduced by first representing the processing modules as multiple, individual matrix operations. All the matrix operations are then combined with, i.e., multiplied to, the transformation matrix to create a modified transformation matrix. The created transformation matrix is then used in place of the original transformation matrix to simultaneously achieve both image transformation and any pre and post image processing defined by the image modification processing modules.

Abstract: A method for processing video using depth sensor information, comprising the steps of: dividing the image area into a number of bins roughly equal to the depth sensor resolution, with each bin corresponding to a number of adjacent image pixels; adding each depth measurement to the bin representing the portion of the image area to which the depth measurement corresponds; averaging the value of the depth measurement for each bin to determine a single average value for each bin; and applying a threshold to each bin of the registered depth map to produce a threshold image.

Abstract: A method and system for compensating for a moving object placed between a projector and a projection scene is shown. The method/system dividing a movement pattern of the moving object into N discrete position states, and for each of said N position states determining a corresponding view projection matrix. While projecting an image within any of the N position states, multiplying a desired projection image by the corresponding view projection matrix.

Abstract: Various embodiments of the present invention are directed to video-conferencing systems configured and operated to create eye contact between video conference participants. In one embodiment, video conferencing system includes a display, a video camera positioned to capture a video image of a first video conference participant through the display, and a projector positioned to project a video image of a second video conference participant onto the display screen such that the first participant can view the second participant. The display screen is positioned between the first participant and the video camera. The video camera and the projector can be operated during a video conference to establish eye contact between the first participant and the second participant by creating a line-of-sight that passes through a point of the head of the second participant's image between the video camera and the first participant.

Abstract: An image created by a first projector is recreated using a second projector by relating the two projectors to a common point of view, preferably as viewed from a camera. A first transport matrix T1 is captured to relate the first projector to the camera. A second transport matrix T2 is then capture to relate the second projector to the camera. To have a first image p1, as projected by the first projector, reproduced by the second projector, the second projector projects a distorted image defined as (T2?1)(T1)p1. The inverse of T2, as used in this equation is an estimation defined by first creating an intermediate matrix {hacek over (T)} of equal size as T2. If a column in T2 is denoted as Tr and a corresponding column in {hacek over (T)} is denoted as {hacek over (T)}r, then the construction and population of {hacek over (T)} is defined as {hacek over (T)}r=Tr/(?Tr?)2, and the inverse of T2 is estimated as the transpose of {hacek over (T)}.

Abstract: A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. If the resolution a camera is lower than that of a projector within said projection system, then the transformation matrix will have holes where image data corresponding to a projector pixel will have been lost. In this, case, new image are generated to fill-in the holes.

Abstract: Light distortion due to light noise or light scattering object in the path of a light beam from a projector to a camera's image sensor in projector-camera systems are mitigated, or eliminated, by a simple modification to a light transport matrix T. For each row in light transport matrix T, matrix entries along a common row are compared, and all but the highest valued entry in the row are zeroed out, i.e. nullified. It is preferred that an array and record notation be used in order to reduce the size of the light transport matrix T, and its modified version to two arrays.

Abstract: A first derived matrix of transport coefficients and a second derived matrix of transport coefficients are derived from a primary matrix of transport coefficients Each of the transport coefficients describes transport of a respective image forming element from a first position onto one or more image forming elements at a second position. An approximate inverse of the first derived matrix is ascertained. A modified version of a projection image is determined from the projection image, the approximated inverse of the first derived matrix, and the second derived matrix. The modified version of the projection image is rendered from the first position onto a physical medium at the second position.

Abstract: Various embodiments of the present invention are directed to systems and methods for multimodal object localization using one or more depth sensors and two or more microphones. In one aspect, a method comprises capturing three-dimensional images of a region of space wherein the object is located. The images comprise three-dimensional depth sensor observations. The method collects ambient audio generated by the object, providing acoustic observation regarding the ambient audio time difference of arrival at the audio sensors. The method determines a coordinate location of the object corresponding to the maximum of a joint probability distribution characterizing the probability of the acoustic observations emanating from each coordinate location in the region of space and the probability of each coordinate location in the region of space given depth sensor observations.

Abstract: The present invention describes a visual-collaborative system comprising: a display screen having a first surface and a second surface; a first projector positioned to project images onto a projection surface of the display screen, wherein the projected images can be observed by viewing the second surface; and a first camera system positioned to capture images of objects through the display screen, the first camera system including a first filter disposed between a first camera and the first surface, wherein the first filter passes the light received by the camera but substantially blocks the light produced by the first projector, wherein the first filter is a GMR (Guided Mode Resonance) filter.

Abstract: An alpha matte is generated from image forming elements of an image. For each of one or more of the image forming elements: a respective representative foreground value is determined from one or more of the image forming element values; the respective representative foreground value and the value of the image forming element are normalized with respect to a threshold level; and a respective value of the alpha matte is generated from an evaluation of the normalized image forming element value in relation to the normalized representative foreground value.