Abstract: Systems and methods for providing a substantially de-blurred image of a scene from a motion blurred image of the scene are disclosed. An exemplary system includes a primary detector for sensing the motion blurred image and generating primary image information representing the blurred image, a secondary detector for sensing two or more secondary images of the scene and for generating secondary image information representing the two or more secondary images, and a processor for determining motion information from the secondary image information, estimating a point spread function for the motion blurred image from the motion information, and applying the estimated point spread function to the primary image information to generate information representing the substantially de-blurred image.

Abstract: A method and system for accurately imaging scenes having large brightness variations. If a particular object in the scene is of interest, the imager exposure setting is adjusted based on the brightness of that object. For high dynamic range imaging of an entire scene, two imagers with different viewpoints and exposure settings are used, or the exposure setting of a single imager is varied as multiple images are captured. An optical flow technique can be used to track and image moving objects, or a video sequence can be generated by selectively updating only those pixels whose brightnesses are within the preferred brightness range of the imager.

Abstract: Systems and methods for displaying three-dimensional (3D) images are described. In particular, the systems can include a display block made from a transparent material with optical elements three-dimensionally disposed therein. Each optical element becomes luminous when illuminated by a light ray. The systems can also include a computing device configured to generate two-dimensional (2D) images formatted to create 3D images when projected on the display block, by a video projector coupled to the computing device. The video projector is configured to project the 2D images on the block to create the 3D images by causing a set of the passive optical elements to become luminous. Various other systems and methods are described for displaying 3D images.

Abstract: Systems and methods for displaying three-dimensional (3D) images are described. In particular, the systems can include a display block made from a transparent material with optical elements three-dimensional disposed therein. Each optical element becomes luminous when illuminated by a light ray. The systems can also include a computing device configured to generate two-dimensional (2D) images formatted to create 3D images when projected on the display block, by a video projector coupled to the computing device. The video projector is configured to project the 2D images on the block to create the 3D images by causing a set of the passive optical elements to become luminous. Various other systems and methods are described for displaying 3D images.

Abstract: A method generates a high dynamic range image by first acquiring a set of images of a scene illuminated by different lighting conditions. The set of images are then combined to generate a high dynamic range image.

Abstract: A method and apparatus is provided for capturing images using a camera or other imager having imaging sensitivity characteristics which vary across the imager's viewing angle. The imager's characteristics can be non-uniform with respect to exposure, color sensitivity, polarization sensitivity, focal distance, and/or any other aspect of image detection. The imager is rotated or translated in order to capture different portions of the scene being imaged. Because the imager is in multiple positions when the respective scene portions are captured, each scene portion is imaged by multiple portions of the imager's sensitivity profile.

Abstract: Systems and methods for providing methods are provided for deblurring images, which are blurred due to the movement of objects in the imaged scene. The systems and methods involve separating a moving object component from a static or background component of a primary image. The moving object component is deblurred using suitable image processing algorithms, and then superimposed on the static or background component to obtain a deblurred primary image.

Abstract: Methods and systems are provided for displaying 3D images using a display system having multiple physical layers. The physical layers of the display system are controlled (or manufactured) such that the display system produces a desired 4D light field corresponding to a real or synthetic 3D object or scene to be viewed by an observer. This may be accomplished, for example, by determining the transmittance values of one or more points in each physical layer that are required such that the desired 4D light field is produced by the display system. Various alternative embodiments are also disclosed.

Abstract: Methods and systems are provided for displaying 3D images using a display system having multiple physical layers. The physical layers of the display system are controlled (or manufactured) such that the display system produces a desired 4D light field corresponding to a real or synthetic 3D object or scene to be viewed by an observer. This may be accomplished, for example, by determining the transmittance values of one or more points in each physical layer that are required such that the desired 4D light field is produced by the display system. Various alternative embodiments are also disclosed.

Abstract: Catadioptric single camera systems capable of sampling the lightfield of a scene from a locus of circular viewpoints and the methods thereof are described. The epipolar lines of the system are radial, and the systems have foveated vision characteristics. A first embodiment of the invention is directed to a camera capable of looking at a scene through a cylinder with a mirrored inside surface. A second embodiment uses a truncated cone with a mirrored inside surface. A third embodiment uses a first truncated cone with a mirrored outside surface and a second truncated cone with a mirrored inside surface. A fourth embodiment of the invention uses a planar mirror with a truncated cone with a mirrored inside surface. The present invention allows high quality depth information to be gathered by capturing stereo images having radial epipolar lines in a simple and efficient method.

Abstract: A camera is configured to adaptively determine camera settings. The camera includes a plurality of sensors elements configured to acquire a current image of a scene according to a current set of camera settings. A number of sensor elements having a set of desirable properties is measured. Then, a next set of camera settings that maximize an overall number of sensor elements having the set of desirable properties is determined to acquire a next better image.

Abstract: An algorithm is provided for reducing distortion in an image captured by a camera or other imaging system having more than one optical viewpoint. The algorithm can use a captured image, statistical information regarding the depths of scene objects, and information regarding the geometrical characteristics of the imaging system to generate an approximation of a perspective projection representing the scene. The virtual viewpoint of the approximate perspective projection is selected so as to reduce distortion. The resulting image has less distortion than that of an image generated under an assumption that scene objects are infinitely distant. In addition, the parameters of any distortion reducing function can be optimized by minimizing an objective function representing the amount of image distortion.

Abstract: Systems and methods for generating an omnidirectional mosaic image are presented in which a number of images are acquired about an axis of rotational. The images have a large field of view along the axis of rotation and a small field of view or image width in a second direction. The images can be image strips, formed from non-parallel rays directed onto an image sensor (1008), which are formed from a narrow width of parallel rays directed onto imaging sensor (1008). The images are combined to form a spherical mosaic. In the case of overlapping image strips, image combination can be performed by identifying common features in the overlapping regions and aligning consecutive image strips accordingly. A blending algorithm can then be used to improve image fidelity in the overlapping regions.

Abstract: The quality (e.g., resolution) of image data, video data, and sound data representing a scene or signal is enhanced by a quality enhancement function trained on high quality and low quality representations of a portion of the same scene or signal. The enhancement function is thus optimized to the most relevant input. A training algorithm uses low quality image of a scene or scene portion, along with a high quality image of the same scene or scene portion, to optimize the parameters of a quality enhancement function. The optimized enhancement function is then used to enhance other low quality images of the scene or scene portion. Sound data is enhanced by using a low resolution sample of a portion of a signal, and a high resolution sample of the same signal portion, to train a quality enhancement function which is then used to enhance the remainder of the signal.

Abstract: A resolution enhancement algorithm is trained on sample images to obtain a polynomial model mapping of low resolution image data to high resolution image data. The polynomial model mapping is applied to other low resolution images to obtain corresponding higher resolution images. The mapping provides resolution enhancement which is superior to that of conventional image data interpolation techniques.

Abstract: Disclosed are method and apparatus for obtaining relatively high dynamic range images using a relatively low dynamic range image sensor without significant loss of resolution. The image sensor has an array of light-sensing elements with different sensitivity levels in accordance with a predetermined spatially varying sensitivity pattern for the array of light-sensing elements. An image of a scene is captured with the image sensor and stored as brightness values at respective pixel positions in a linear or two-dimensional uniform grid. The brightness values of the captured image at the pixel positions are then used to estimate the brightness values at off-grid positions of a uniform off-grid array located at respective interstices of the pixel position grid.

Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The image of a scene is captured with an image sensor using a spatially varying exposure function. The spatially varying exposure function can be implemented in a number of ways, such as by using as an optical mask with a fixed spatial attenuation pattern or by using an array of light sensing elements having spatially varying photosensitivities. The captured image is then normalized with respect to the spatially varying exposure function. The normalized image data can be interpolated to account for pixels that are either saturated or blackened to enhance the dynamic range of the image sensor.

Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

Abstract: An image-displaying method and apparatus adds, or compensates for, effects associated with environmental lighting shining on the display region, and/or imperfections in the display system hardware or display surface. By detecting the environmental illumination, the system can render an image which simulates 2-d or 3-d content (i.e., objects) as if the content were actually illuminated by the environmental lighting. Information regarding the environmental lighting can also be used to cancel out spurious bright spots caused by environmental lighting patterns shining on the display region. In addition, the image displayed in the display region can be monitored for accuracy, and can be adjusted to correct for errors caused by, e.g., spurious bright spots, imperfections in the display system characteristics, and/or imperfections in or on the surface of the display region.

Abstract: A method and apparatus is provided for capturing images using a camera or other imager having imaging sensitivity characteristics which vary across the imager's viewing angle. The imager's characteristics can be non-uniform with respect to exposure, color sensitivity, polarization sensitivity, focal distance, and/or any other aspect of image detection. The imager is rotated or translated in order to capture different portions of the scene being imaged. Because the imager is in multiple positions when the respective scene portions are captured, each scene portion is imaged by multiple portions of the imager's sensitivity profile.