Abstract: Systems and methods for displaying three-dimensional (3D) images are described. In particular, the systems can include a display block made from a transparent material with optical elements three-dimensionally disposed therein. Each optical element becomes luminous when illuminated by a light ray. The systems can also include a computing device configured to generate two-dimensional (2D) images formatted to create 3D images when projected on the display block, by a video projector coupled to the computing device. The video projector is configured to project the 2D images on the block to create the 3D images by causing a set of the passive optical elements to become luminous. Various other systems and methods are described for displaying 3D images.

Abstract: Methods and systems for creating speech-enabled as avatars are provided in accordance with some embodiments, methods for creating speech-enabled avatars are provided, the method comprising; receiving a single image that includes a face with distinct facial geometry; comparing points on the distinct facial geometry with corresponding points on a prototype facial surface, wherein the prototype facial surface is modeled by a Hidden Markov Model that has facial motion parameters; deforming the prototype facial surface based at least in part on the comparison; in response to receiving a text input or an audio input, calculating the facial motion parameters based on a phone set corresponding to the received input; generating a plurality of facial animations based on the calculated facial motion parameters and the Hidden Markov Model; and generating an avatar from the single image that includes the deformed facial sin face, the plurality of facial animations, and the audio input or an audio waveform corresponding to

Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

Abstract: Systems and methods for displaying three-dimensional (3D) images are described. In particular, the systems can include a display block made from a transparent material with optical elements three -dimensionally disposed therein. Each optical element becomes luminous when illuminated by a light ray. The systems can also include a computing device configured to generate two-dimensional (2D) images formatted to create 3D images when projected on the display block, by a video projector coupled to the computing device. The video projector is configured to project the 2D images on the block to create the 3D images by causing a set of the passive optical elements to become luminous. Various other systems and methods are described for displaying 3D images.

Abstract: Systems and methods for panoramic imaging are disclosed herein. An exemplary system of the disclosed subject matter for panoramic imaging includes a fisheye lens, a mirror optically coupled to the fisheye lens, and a detector for capturing light incident on the fisheye lens and reflected from the mirror. In some embodiments, the mirror is a spherical mirror. In some embodiments, the mirror is positioned coaxially with regard to the fisheye lens.

Abstract: Embodiments of the present invention provide a lensless optical device for acquiring an image. The device can include a light attenuating layer having a plurality of elements, where transmittance of each of the plurality of elements is controllable, and an image detector disposed at a distance from the light attenuating layer, the image detector configured to acquire an image with light that passes through the light attenuating layer. The device also can include a light attenuating layer controller configured to simultaneously control transmittance of each of the plurality of elements independent of each other. Methods of detecting and tracking an object in a scene are also disclosed.

Abstract: Systems and methods for reducing the visibility of rain in acquired images are provided. One or more inputs relating the scene desired to be acquired by the user are used to retrieve camera settings that will reduce the visibility of rain in acquired images. Additionally, features relating to the scene may be automatically determined and used alone, or in combination with user inputs, to retrieve camera settings. The acquired images may be part of a video. Another feature of the invention is its use as a rain gauge. The camera settings are adjusted to enhance the visibility of rain, then one or more images are acquired and analyzed for the amount and size of raindrops. From this analysis the rain rate can be determined.

Abstract: Systems and methods for reducing the visibility of rain in acquired images are provided. One or more inputs relating the scene desired to be acquired by the user are used to retrieve camera settings that will reduce the visibility of rain in acquired images. Additionally, features relating to the scene may be automatically determined and used alone, or in combination with user inputs, to retrieve camera settings. The acquired images may be part of a video. Another feature of the invention is its use as a rain gauge. The camera settings are adjusted to enhance the visibility of rain, then one or more images are acquired and analyzed for the amount and size of raindrops. From this analysis the rain rate can be determined.

Abstract: Systems and methods for displaying three-dimensional (3D) images are described. In particular, the systems can include a display block made from a transparent material with optical elements three-dimensionally disposed therein. Each optical element becomes luminous when illuminated by a light ray. The systems can also include a computing device configured to generate two-dimensional (2D) images formatted to create 3D images when projected on the display block, by a video projector coupled to the computing device. The video projector is configured to project the 2D images on the block to create the 3D images by causing a set of the passive optical elements to become luminous. Various other systems and methods are described for displaying 3D images.

Abstract: The invention presents catadioptric (single-camera) sensors using one or more mirrors to produce rectified stereoscopic images. By combining multiple views (using the mirrors) to form a composite stereo image that is already rectified (i.e., has scan-line correspondence), the invention aids provision of real-time stereo images by avoiding computational cost and image degradation due to computer-rectification-related resampling when rectifying. The invention specifies the number of mirrors that must be used and the geometric/locational constraints on those mirrors that must be substantially satisfied to obtain rectified stereo images with a single camera. The invention also discloses specific configurational techniques for how the mirrors should be placed to minimize sensor size.

Abstract: Systems and methods for displaying three-dimensional (3D) images are described. In particular, the systems can include a display block made from a transparent material with optical elements three-dimensional disposed therein. Each optical element becomes luminous when illuminated by a light ray. The systems can also include a computing device configured to generate two-dimensional (2D) images formatted to create 3D images when projected on the display block, by a video projector coupled to the computing device. The video projector is configured to project the 2D images on the block to create the 3D images by causing a set of the passive optical elements to become luminous. Various other systems and methods are described for displaying 3D images.

Abstract: A method and system marks a scene and images acquired of the scene with tags. A set of tags is projected into a scene while modulating an intensity of each tag according to a unique temporally varying code. Each tag is projected as an infrared signal at a known location in the scene. Sequences of infrared and color images are acquired of the scene while performing the projecting and the modulating. A subset of the tags is detected in the sequence of infrared images. Then, the sequence of color image is displayed while marking a location of each detected tag in the displayed sequence of color images, in which the marked location of the detected tag corresponds to the known location of the tag in the scene.

Abstract: A multispectral imaging method and system is provided. A multispectral imaging method of the present invention includes determining an on-off combination of a plurality of light sources illuminating a scene; illuminating the scene with the light sources according to the on-off combination selected on the basis of a first control signal generated by a microcontroller; capturing an image of the scene by operating a camera on the basis of a second control signal synchronized with the first control signal; determining a plurality of spectral basis functions and weights of the spectral basis functions; and acquiring a continuous spectral reflectance by summing values obtained by multiplying the spectral basis functions and respective weights. The multispectral imaging method of the present invention is practical and efficient in that a continuous spectral reflectance image can be acquired with a minimized number of measurements required for obtaining spectral reflectance.

Abstract: Systems and methods for reducing the visibility of rain in acquired images are provided. One or more inputs relating the scene desired to be acquired by the user are used to retrieve camera settings that will reduce the visibility of rain in acquired images. Additionally, features relating to the scene may be automatically determined and used alone, or in combination with user inputs, to retrieve camera settings. The acquired images may be part of a video. Another feature of the invention is its use as a rain gauge. The camera settings are adjusted to enhance the visibility of rain, then one ore more images are acquired and analyzed for the amount and size of raindrops. From this analysis the rain rate can be determined.

Abstract: In some embodiments, a device includes a light modulator layer having a plurality of elements, each having a controllable transmittance, and a plurality of lenses, wherein each of the plurality of lenses is disposed to receive light independently of each other. The device further includes an image detector disposed at a distance from the light modulator layer and configured to acquire images from light that passes through the light modulator layer. In addition, the device includes a controller configured to control transmittance of the elements of the light modulator layer. Methods of acquiring images are also provided.

Abstract: Systems and methods for providing a substantially de-blurred image of a scene from a motion blurred image of the scene are disclosed. An exemplary system includes a primary detector for sensing the motion blurred image and generating primary image information representing the blurred image, a secondary detector for sensing two or more secondary images of the scene and for generating secondary image information representing the two or more secondary images, and a processor for determining motion information from the secondary image information, estimating a point spread function for the motion blurred image from the motion information, and applying the estimated point spread function to the primary image information to generate information representing the substantially de-blurred image.

Abstract: Systems and methods for displaying three-dimensional (3D) images are described. In particular, the systems can include a display block made from a transparent material with optical elements three-dimensionally disposed therein. Each optical element becomes luminous when illuminated by a light ray. The systems can also include a computing device configured to generate two-dimensional (2D) images formatted to create 3D images when projected on the display block, by a video projector coupled to the computing device. The video projector is configured to project the 2D images on the block to create the 3D images by causing a set of the passive optical elements to become luminous. Various other systems and methods are described for displaying 3D images.

Abstract: In some embodiments, systems for capturing scene images and depth geometry are provided, comprising a projector, an optical sensor, and a digital processing device. The projector is capable of being defocused with respect to a scene and projects light having a shifting periodic illumination pattern on the scene. The optical sensor has a plurality of pixels and detects a portion of the radiance of at least one image of the scene at each of the pixels. The digital processing device is capable of being coupled to the optical sensor and obtains a temporal radiance profile from the radiance over a time period for each of the pixels, determines an amount of projection defocus at each of the of pixels using the temporal radiance profile, and, at each of the pixels, computes a depth to the scene at the pixel using the amount of projection defocus at the pixel.

Abstract: An imager (200) including a spatially varying optical element (204) which moves while the imager records a sequence of images. The optical element (204) can be an intensity reduction filter, a spectral or polarization filter, or a refractive or reflective element. Because the optical element (204) moves between frames, each scene portion is captured under a range of imaging conditions. A spatially varying intensity reduction filter enables imaging of each scene portion using multiple, different exposure to generate a high dynamic range image. A spatially varying spectral or polarization filter enables measurement of the spectral or polarization characteristics of radiation from each scene portion. A refractive or reflective element enables imaging of scene portions under various focal characteristics, thereby providing depth information and producing an image which is focused everywhere.

Abstract: An imager (200) including a spatially varying optical element (204) which moves while the imager records a sequence of images. The optical element (204) can be an intensity reduction filter, a spectral or polarization filter, or a refractive or reflective element. Because the optical element (204) moves between frames, each scene portion is captured under a range of imaging conditions. A spatially varying intensity reduction filter enables imaging of each scene portion using multiple, different exposure to generate a high dynamic range image. A spatially varying spectral or polarization filter enables measurement of the spectral or polarization characteristics of radiation from each scene portion. A refractive or reflective element enables imaging of scene portions under various focal characteristics, thereby providing depth information and producing an image which is focused everywhere.