Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

Abstract: Methods and systems for coded rolling shutter are provided. In accordance with some embodiments, methods and system are provided that control the readout timing and exposure length for each row of a pixel array in an image sensor, thereby flexibly sampling the three-dimensional space-time value of a scene and capturing sub-images that effectively encode motion and dynamic range information within a single captured image.

Abstract: Systems, methods, and media for high dynamic range imaging are provided, the systems comprising: an image sensor; and a hardware processor configured to: cause the image sensor to capture first image data having a first exposure time, second image data having a second exposure time, and third image data having a third exposure time that is substantially equal to the sum of the first exposure time and the second exposure time; generate combined image data using the first image data and the second image data.

Abstract: Systems, methods, and media for performing shape measurement are provided. In some embodiments, systems for performing shape measurement are provided, the systems comprising: a projector that projects onto a scene a plurality of illumination patterns, wherein each of the illumination patterns has a given frequency, each of the illumination patterns is projected onto the scene during a separate period of time, three different illumination patterns are projected with a first given frequency, and only one or two different illumination patterns are projected with a second given frequency; a camera that detects an image of the scene during each of the plurality of periods of time: and a hardware processor that is configured to: determine the given frequencies of the plurality of illumination patterns; and measure a shape of an object in the scene.

Abstract: In some embodiments, systems for capturing scene images and depth geometry are provided, comprising a projector, an optical sensor, and a digital processing device. The projector is capable of being defocused with respect to a scene and projects light having a shifting periodic illumination pattern on the scene. The optical sensor has a plurality of pixels and detects a portion of the radiance of at least one image of the scene at each of the pixels. The digital processing device is capable of being coupled to the optical sensor and obtains a temporal radiance profile from the radiance over a time period for each of the pixels, determines an amount of projection defocus at each of the of pixels using the temporal radiance profile, and, at each of the pixels, computes a depth to the scene at the pixel using the amount of projection defocus at the pixel.

Abstract: Methods and systems for coded rolling shutter are provided. In accordance with some embodiments, methods and system are provided that control the readout timing and exposure length for each row of a pixel array in an image sensor, thereby flexibly sampling the three-dimensional space-time value of a scene and capturing sub-images that effectively encode motion and dynamic range information within a single captured image.

Abstract: Systems, methods, and media for performing shape measurement are provided. In some embodiments, systems for performing shape measurement are provided, the systems comprising: a projector that projects onto a scene a plurality of illumination patterns, wherein each of the illumination patterns has a given frequency, each of the illumination patterns is projected onto the scene during a separate period of time, three different illumination patterns are projected with a first given frequency, and only one or two different illumination patterns are projected with a second given frequency; a camera that detects an image of the scene during each of the plurality of periods of time; and a hardware processor that is configured to: determine the given frequencies of the plurality of illumination patterns; and measure a shape of an object in the scene.

Abstract: Systems for performing machine vision using diffuse structured light comprising: a linear diffuser having an axis of diffusion; a light source that projects an illumination pattern through the linear diffuser and onto a scene, wherein the illumination pattern has transiationai symmetry in a. direction of translation that is aligned with the axis of diffusion; and an image sensor that detects tight reflecting from the scene and that outputs signals corresponding to the detected light. Methods for performing machine vision using diffuse structured light comprising: projecting an illumination pattern from a light source through a linear diffuser and onto a scene, wherein the linear diffuser has an axis of diffusion and the illumination pattern has transiationai symmetry in a direction of translation that is aligned with the axis of diffusion; and detecting light reflecting from, the scene using an image sensor that outputs signals corresponding to the detected light.

Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

Abstract: Systems, methods, and media for providing interactive refocusing are provided, the systems comprising: a lens; an image sensor; and a processor that: causes the image sensor to capture a plurality of images over a predetermined, period of time, wherein each of the plurality of images represents a scene at a different point in time; changes a depth of field between at least a pair of the plurality of images; concatenates the plurality of images to create a duration focal volume in the order in which the images were captured; computes a space-time in-focus image that represents in-focus portions from each of the plurality of images based on the duration focal volume; and computes a space-time index map that identifies an in-focus image for each location of the scene from among the plurality of images based on die duration focal volume and the space-time in-focus image.

Abstract: Generalized assorted pixel camera systems and methods are provided. In accordance with some embodiments, the generalized assorted pixel camera systems include a color filter array, where the color filter array includes a plurality of primary filters and a plurality of secondary filters. Each filter has a particular spectral response and each filter is formed on a corresponding pixel of a plurality of pixels. Each of the plurality of primary filters and the plurality of secondary filters enhances an attribute of image quality and the information obtained using the plurality of primary filters and the plurality of secondary filters is used to balance spectral resolution, dynamic range, and spatial resolution for generating an image of a plurality of image types.

Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

Abstract: Generalized assorted pixel camera systems and methods are provided. In accordance with some embodiments, the generalized assorted pixel camera systems include a color filter array, where the color filter array includes a plurality of primary filters and a plurality of secondary filters. Each filter has a particular spectral response and each filter is formed on a corresponding pixel of a plurality of pixels. Each of the plurality of primary filters and the plurality of secondary filters enhances an attribute of image quality and the information obtained using the plurality of primary filters and the plurality of secondary filters is used to balance spectral resolution, dynamic range, and spatial resolution for generating an image of a plurality of image types.

Abstract: Systems and methods for panoramic imaging are disclosed herein. An exemplary system of the disclosed subject matter for panoramic imaging includes a fisheye lens, a mirror optically coupled to the fisheye lens, and a detector for capturing light incident on the fisheye lens and reflected from the mirror. In some embodiments, the mirror is a spherical mirror.

Abstract: A mirror assembly adapted for use in a panoramic imaging system for capturing a panoramic image includes a mirror for optically coupling to a fisheye lens having a first field of view, the mirror configured for reflecting an image of a second field of view through the fisheye lens. A housing has a first end and a second end, the mirror being secured proximate to the first end, and the second end having an engagement portion for securing the mirror assembly to the panoramic imaging system. When the mirror assembly is secured to the panoramic imaging system, the mirror is optically coupled to the fisheye lens and a detector for capturing a first portion of the panoramic image and a second portion of the panoramic image, the first portion of the panoramic image having a portion overlapping the second portion of the panoramic image.

Abstract: Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.

Abstract: Systems and techniques for panoramic imaging are disclosed herein. Systems for capturing a panoramic image of a panoramic field of view include a fisheye lens having a first field of view, a mirror optically coupled to the fisheye lens for reflecting an image of the a second field of view through the fisheye lens, the second field of view having a portion overlapping the first field of view, and a detector, optically coupled to the fisheye lens and the mirror, for capturing a first portion of the panoramic image corresponding to the first field of view and a second portion of the panoramic image corresponding to the second field of view.

Abstract: Methods, systems, and media for swapping faces in images are provided. In some embodiments, a detected face and face data corresponding to an input image is received. A pose bin associated with the detected face is then identified based on the face data. Next, the detected face is aligned to a generic face associated with the pose bin. At least a portion of a candidate face associated with the pose bin is selected. The at least a portion of the candidate face is then copied to a copy of the input image that is aligned with the generic image to form a swapped-face image. The swapped-face image is next aligned to the input image to form an output image, and then the output image is outputted to a display.

Abstract: Camera systems and methods for gigapixel computational imaging are provided. In some embodiments, the camera system comprises: a ball lens, an array of image sensors disposed at a distance from the ball lens, the array of image sensors configured to acquire images from light that passes through the ball lens; and a processor configured to deblur and stitch the images captured by the array of image sensors to generate a gigapixel image.

Abstract: A system (100) for the adaptive imaging of a scene includes a digital light processing apparatus (150) adapted for controllably reflecting an image of the scene in at least a first direction to thereby reflect an intensity modulated image of the scene along at least the first direction, an image detector (140) for detecting the intensity modulated image of the scene and generating corresponding image data, and an image data processor (154) for processing the image data into control data and providing the control data to the digital light processing (150) apparatus for control thereof.