Abstract: Producing high quality depth maps. A time of flight camera and stereo cameras of a stereo camera arrangement are mapped into a common coordinate system. A correspondence between an RGB image taken from the time of flight camera and an RGB image taken from a reference stereo camera of the stereo camera arrangement is established. Intensity values of the plurality of pixels of a stereo camera left of the reference stereo camera, a stereo camera right of the reference stereo camera and the reference stereo camera are determined. These intensity values of the stereo camera left of the reference stereo camera and the stereo camera right of the reference stereo camera are compared to the reference camera. Based on the comparing, matching intensity values are determined.

Abstract: Various embodiments of the present invention related to methods for obtaining shadow invariant and shadow-shading invariant images from a single camera image taken with a narrow-band camera sensor and assuming Plankian illuminating conditions.

Abstract: A 3D image is created by using two digital projectors having overlapping projection regions. The two digital projectors both emit polarized light, and are arranged at different angles to each other, such that individual images projected from respective digital projectors can be discerned by the use of polarized eyeglasses. Individualized light transport matrices are used to coordinate together the two digital projectors.

Abstract: Methods and systems that reduce video crosstalk in video streams sent between participants in a video conference are disclosed. In one aspect, a method for reducing video crosstalk in a video stream sent from a local site to a remote site includes projecting a video stream of the remote site onto a screen at the local site. Each image in the video stream is dimmed according to a dimming factor of a dimming sequence. Crosstalk images of the local site are captured through the screen. Each crosstalk image is a blending of the image of the local site captured through the screen with a dimmed image of the remote site projected onto the screen. Images of the local site with reduced crosstalk are computed based on the dimming sequence. A video stream composed of the images of the local site with reduced crosstalk are sent to the remote site.

Abstract: Video conferencing methods and systems that enable shared content to be displayed in a separate window within a screen or in a separate display are described. In one aspect, a method for establishing a video conference with shared content using a computing device includes capturing images of a first participant through a screen using a camera. The screen is located between the first participant and the camera. The method also includes projecting images of a second participant on the screen to be viewed by the first participant using a projector, and displaying shared content separate from the images of the second participant. The shared content is to be presented in different format than the images of the second participant presented on the screen.

Abstract: Embodiments of the present invention disclose a system and method for focus-based touch detection. According to one embodiment, a reference pattern is formed on a surface and an imaging device is configured to detect the reference pattern and the presence of an object within proximity of a contact area of the surface. Furthermore, focus information associated with the reference pattern and/or object is used to determine if the detected object is touching or hovering said contact area.

Abstract: Embodiments of the present invention enable image capture, alignment, and registration. Certain applications of the present invention are its use in various embodiments of a system for inspection of a printed circuit board (“PCB”) substrate. In embodiments, an image capture system comprising a camera and a two-dimensional surface supporting an image may be calibrated based on configuration parameters of an image to be captured and of a simulated reference bitmap based on the image. In embodiments, the position of the image to be captured on the two-dimensional surface is determined based on calibration parameters. In embodiments, a sequence of images may be captured of sections of an image that cannot be captured in a single scan. A scan path across the image may be determined that is based in part on calibration parameters.

Abstract: A system for filtering an image using a bilateral filter includes a receiver and a bilateral filter. The receiver is for receiving an image having a plurality of pixels. The bilateral filter is run in constant time and comprises a pixel value range determinor and a spatial filter. The pixel value range determinor is configured to determine a range of pixel values of the plurality of pixels. The spatial filter is configured to spatially filter at least one of the plurality of pixels. The spatial filter is further configured to perform over a plurality of pixel values in the range of pixel values.

Abstract: Disclosed are embodiments of systems and methods for synthesizing a detailed depth map from a video image. In embodiments, the motion vectors decoded from a video stream may be classified into groups by the application of K-Model clustering techniques based on an affine model. In embodiments, a coarse depth map of the image pixels may be generated using the image segmented according to the motion vector clusters. In embodiments, high resolution gradient maps of the image may be generated using the coarse depth map as well as edge information from the image. In embodiments, a surface reconstruction algorithm, such as the Frankot-Chellappa algorithm, may be applied to the high resolution gradient maps to synthesize a detailed depth map of the image. A detailed depth map of an image may be used to render a three-dimensional surface, for example.

Abstract: A method and system for optimizing a data structure for manipulation of matrices in a parallel environment limits computational branching. The data structure further is further optimized for linear data storage and synchronization among multiple processing threads.

Abstract: Embodiments of the present invention enable fault detection in a printed dot-pattern image. Certain applications of the present invention are its use in various embodiments of a system for inspection of a printed circuit board (“PCB”) substrate. In embodiments, a generated distortion map is based on a comparison of a reconstructed dot-pattern image, a simulated reference bitmap, and an error map representing differences between the reconstructed dot-pattern image and the reference bitmap. In embodiments, the pixels of the distortion map are color coded to identify the locations and types of aberrations that were discovered as a result of the comparison.

Abstract: Disclosed are embodiments of systems and methods for identifying features using color information in an image. The image may be formed from one or more display images comprising color information and features or feature components. Because color information may be used to identify features, more than one feature or feature component may be displayed in a display image. Because a plurality of features may be identified in a calibration image, an image system, such as a projector-camera system, can reduce the number of display images needed to calibrate the system.

Abstract: Disclosed are systems and methods for masking at least a portion of one image with another image. Aspects of the present invention facilitate the placing of a virtual mask onto an item in an image even if that items moves in subsequent images, such as between different image frames in a video.

Abstract: A method and system for compensating for a moving object placed between a projector and a projection scene is shown. The method/system dividing a movement pattern of the moving object into N discrete position states, and for each of said N position states determining a corresponding view projection matrix. While projecting an image within any of the N position states, multiplying a desired projection image by the corresponding view projection matrix.

Abstract: A method for presentation interaction. The method includes, receiving by a computer system an indication of a manual selection of a region proximate to an audience member of an audience wherein the indication is received via an interaction with a displayed image of the audience. The method also includes utilizing a microphone array communicatively coupled with a beam-forming component of the computer system to focus audio pickup from the region proximate to the audience member in response to receiving the indication. The method also includes displaying an enhanced image of the region proximate to the audience member using the computer system in response to receiving the indication.

Abstract: Various embodiments of the present invention are directed to systems and methods for multimodal object localization using one or more depth sensors and two or more microphones. In one aspect, a method comprises capturing three-dimensional images of a region of space wherein the object is located. The images comprise three-dimensional depth sensor observations. The method collects ambient audio generated by the object, providing acoustic observation regarding the ambient audio time difference of arrival at the audio sensors. The method determines a coordinate location of the object corresponding to the maximum of a joint probability distribution characterizing the probability of the acoustic observations emanating from each coordinate location in the region of space and the probability of each coordinate location in the region of space given depth sensor observations.

Abstract: This disclosure is directed to methods and systems for enhancing presentations. In one aspect, a method for enhancing presentations include capturing images of a presenter's hand gestures directed to content in a presentation displayed on a monitor viewed by the presenter and rending virtual shadow representations of the presenter's hand gestures. Composite images of the virtual shadow representations and the presentation are produced and displayed on a screen. The composite images show the virtual shadow representations and the content of the presentation in a manner that does not block the content of the presentation. Viewers can view the content of the presentation and be visually directed by the virtual shadow representations to the content of the presentation pointed to by the presenter on the monitor.

Abstract: A video system comprises a shared media accessor configured to access shared media. The shared media is configured to be displayed on a first display screen and a second display screen. A video accessor configured to access images from a first camera. A field of view of the first camera is oriented such that the first camera can capture the images comprising non-verbal communication of a user associated with the shared media. A video compositor configured to composite the images captured by the first camera and said shared media. The composited images are configured to be displayed on the second display screen.

Abstract: Embodiments of the present invention enable fault detection in a printed dot-pattern image. Certain applications of the present invention are its use in various embodiments of a system for inspection of a printed circuit board (“PCB”) substrate. In embodiments, a generated distortion map is based on a comparison of a reconstructed dot-pattern image, a simulated reference bitmap, and an error map representing differences between the reconstructed dot-pattern image and the reference bitmap. In embodiments, the pixels of the distortion map are color coded to identify the locations and types of aberrations that were discovered as a result of the comparison.

Abstract: A surround visual field that has a characteristic or characteristics that relate to an audio/visual presentation is described. In one embodiment, the surround visual field is projected on an area partially surrounding or surrounding video content being displayed on a device. This surround visual field may be comprised of a plurality of elements that further enhance the visual effect of the content being displayed. For example, one embodiment of the invention provides for elements within the surround visual field to move in relation to motion within the video content being displayed. Other characteristics of the video content may also be supplemented by the surround visual field or the surround visual field may simply be authored to correspond to the content itself.