Abstract: A plurality of images of a scene may be obtained. These images may have been captured by an image sensor, and may include a first image and a second image. A particular gain may have been applied to the first image. An effective color temperature and a brightness of a first pixel in the first image may be determined, and a mapping between pixel characteristics and noise deviation of the image sensor may be selected. The pixel characteristics may include pixel brightness. The selected mapping may be used to map at least the brightness of the first pixel to a particular noise deviation. The brightness of the first pixel and the particular noise deviation may be compared to a brightness of a second pixel of the second image. The comparison may be used to determine whether to merge the first pixel and the second pixel.

Abstract: A plurality of images of a scene may be obtained. These images may have been captured by an image sensor, and may include a first image and a second image. A particular gain may have been applied to the first image. An effective color temperature and a brightness of a first pixel in the first image may be determined, and a mapping between pixel characteristics and noise deviation of the image sensor may be selected. The pixel characteristics may include pixel brightness. The selected mapping may be used to map at least the brightness of the first pixel to a particular noise deviation. The brightness of the first pixel and the particular noise deviation may be compared to a brightness of a second pixel of the second image. The comparison may be used to determine whether to merge the first pixel and the second pixel.

Abstract: Systems, methods, and media for recording an image of a scene are provided. In accordance with some embodiments, systems for recording an image of a scene are provided, comprising: a diffuser that diffuses light representing the scene and that has a scattering function that is independent of aperture coordinates; a sensor that receives diffused light representing the scene and generates data representing an image; and a hardware processor that uses a point spread function to deblur the image.

Abstract: Techniques for generating robust depth maps from stereo images are described. A robust depth map is generated from a set of stereo images captured with and without flash illumination. The depth map is more robust than depth maps generated using conventional techniques because a pixel-matching algorithm is implemented that weights pixels in a matching window according to the ratio of light intensity captured using different flash illumination levels. The ratio map provides a rough estimate of depth relative to neighboring pixels that enables the flash/no-flash pixel-matching algorithm to devalue pixels that appear to be located at different depths than the central pixel in the matching window. In addition, the ratio map may be used to filter the generated depth map to generate a smooth estimate for the depth of objects within the stereo image.

Abstract: Removal of the effects of dust or other impurities on image data is described. In one example, a model of artifact formation from sensor dust is determined. From the model of artifact formation, contextual information in the image and a color consistency constraint may be applied on the dust to remove the dust artifacts. Artifacts may also be removed from multiple images from the same or different cameras or camera settings.

Abstract: Systems, methods, and media for recording an image of a scene ate provided. In accordance with some embodiments, systems for recording an image of a scene are provided. comprising. a diffuser {hat diffuses light representing the scene and that has a scattering function that is independent of aperture coordinates, a sensor that receives diffused light representing the scene and generates data representing an image; and a hardware processes that uses a point spread function to deblur the image.

Abstract: A lens assembly includes a plurality of component lens elements, and a fiber optic face plate having a back surface and a non-planar front surface. The plurality of component lens elements are configured to direct a focused image onto the non-planar front surface of the fiber optic face plate, and the fiber optic face plate is configured to transmit the focused image through the back surface.

Abstract: An example dual imaging system includes a first imaging system that further includes a first image sensor; a first aperture that defines, at least in part, a field of view of the first imaging system; and a first reflector comprising an opening. The first reflector faces the first aperture. The first imaging system further includes a second reflector that faces the first reflector. The second reflector is located between the first aperture and the first reflector. The first image sensor, the first aperture, the first reflector, and the second reflector are all arranged around a common optical axis. The system further includes a second imaging system arranged substantially within the first imaging system. The second imaging system includes a second image sensor, and a second aperture that defines, at least in part, a field of view of the second imaging system.

Abstract: A method is provided that includes operating a first camera to capture a first image stream and operating a second camera to capture a second image stream. The method further includes initially using the first image stream to display a first field of view in a live-view interface of a graphic display and, while displaying the first image stream in the live-view interface, receiving an input corresponding to a zoom command. The method further includes, in response to receiving the input: (a) switching from using the first image stream to display the first field of view in the live-view interface to using a combination of the first image stream and the second stream to display a transitional field of view of the environment in the live-view interface and (b) subsequently switching to using the second image stream to display the second field of view in the live-view interface.

Abstract: An example composite imaging system includes a first imaging system further comprising a first image sensor and a first aperture anterior to the first image sensor. The first aperture (i) is defined by an inner perimeter and an outer perimeter and (ii) defines, at least in part, a field of view of the first imaging system. The first imaging system further includes a plurality of reflectors posterior to the first aperture that are configured to redirect light that crosses the first aperture to the first image sensor. The first image sensor, the first aperture, and the plurality of reflectors are arranged around a common optical axis. The composite imaging system further includes a second imaging system arranged substantially anterior to the first imaging system. The second imaging system is arranged such that the second imaging system is outside a field of view of the first imaging system.

Abstract: The present disclosure provides example methods operable by computing device. An example method can include receiving an image from a camera. The method can also include comparing one or more parameters of the image with one or more control parameters, where the one or more control parameters comprise information indicative of an image from a substantially unobstructed camera. Based on the comparison, the method can also include determining a score between the one or more parameters of the image and the one or more control parameters. The method can also include accumulating, by a computing device, a count of a number of times the determined score image exceeds a first threshold. Based on the count exceeding a second threshold, the method can also include determining that the camera is at least partially obstructed.

Abstract: Imaging systems can often gather higher quality information about a field of view than the unaided human eye. For example, telescopes may magnify very distant objects, microscopes may magnify very small objects, and high frame-rate cameras may capture fast motion. The present disclosure includes devices and methods that provide real-time vision enhancement without the delay of replaying from storage media. The disclosed devices and methods may include a live view display and image and other information enhancements, which utilize in-line computation and constant control. The disclosure includes techniques for enabling push-button slow motion effects through buffer management and the adjustment of a display frame rate.

Abstract: Systems, methods, and media for providing interactive refocusing are provided, the systems comprising: a lens; an image sensor; and a processor that: causes the image sensor to capture a plurality of images over a predetermined, period of time, wherein each of the plurality of images represents a scene at a different point in time; changes a depth of field between at least a pair of the plurality of images; concatenates the plurality of images to create a duration focal volume in the order in which the images were captured; computes a space-time in-focus image that represents in-focus portions from each of the plurality of images based on the duration focal volume; and computes a space-time index map that identifies an in-focus image for each location of the scene from among the plurality of images based on die duration focal volume and the space-time in-focus image.

Abstract: Removal of the effects of dust or other impurities on image data is described. In one example, a model of artifact formation from sensor dust is determined. From the model of artifact formation, contextual information in the image and a color consistency constraint may be applied on the dust to remove the dust artifacts. Artifacts may also be removed from multiple images from the same or different cameras or camera settings.

Abstract: A structure descriptor for an m×n pixel block of an image may be determined. The m×n pixel block may contain a primary pixel having a primary pixel value and a plurality of secondary pixels having respective secondary pixel values. The structure descriptor may include a plurality of structure indicators each associated with a respective secondary pixel. The respective structure indicators may be based on the primary pixel value and the respective secondary pixel value of the associated secondary pixel. Based on the structure descriptor, a structure value for the m×n pixel block may be determined. Based on the structure value, image processing may be applied to the m×n pixel block.

Abstract: Removal of the effects of dust or other impurities on image data is described. In one example, a model of artifact formation from sensor dust is determined. From the model of artifact formation, contextual information in the image and a color consistency constraint may be applied on the dust to remove the dust artifacts. Artifacts may also be removed from multiple images from the same or different cameras or camera settings.

Abstract: A plurality of images of a scene may be obtained. These images may have been captured by an image sensor, and may include a first image and a second image. A particular gain may have been applied to the first image. An effective color temperature and a brightness of a first pixel in the first image may be determined, and a mapping between pixel characteristics and noise deviation of the image sensor may be selected. The pixel characteristics may include pixel brightness. The selected mapping may be used to map at least the brightness of the first pixel to a particular noise deviation. The brightness of the first pixel and the particular noise deviation may be compared to a brightness of a second pixel of the second image. The comparison may be used to determine whether to merge the first pixel and the second pixel.

Abstract: Techniques for generating robust depth maps from stereo images are described. A robust depth map is generated from a set of stereo images captured with and without flash illumination. The depth map is more robust than depth maps generated using conventional techniques because a pixel-matching algorithm is implemented that weights pixels in a matching window according to the ratio of light intensity captured using different flash illumination levels. The ratio map provides a rough estimate of depth relative to neighboring pixels that enables the flash/no-flash pixel-matching algorithm to devalue pixels that appear to be located at different depths than the central pixel in the matching window. In addition, the ratio map may be used to filter the generated depth map to generate a smooth estimate for the depth of objects within the stereo image.

Abstract: Systems, methods, and media for recording an image of a scene ate provided. In accordance with some embodiments, systems for recording an image of a scene are provided. comprising. a diffuser {hat diffuses light representing the scene and that has a scattering function that is independent of aperture coordinates, a sensor that receives diffused light representing the scene and generates data representing an image; and a hardware processes that uses a point spread function to deblur the image.

Abstract: A lens assembly includes a plurality of component lens elements, and a fiber optic face plate having a back surface and a non-planar front surface. The plurality of component lens elements are configured to direct a focused image onto the non-planar front surface of the fiber optic face plate, and the fiber optic face plate is configured to transmit the focused image through the back surface.