Abstract: A method for image enhancement includes capturing multiple input images of a scene, including at least a first input image having a first field of view (FOV) captured with a first focal depth and a second input image having a second FOV captured with a second focal depth. The input images in the sequence are preprocessed so as to align the images. The aligned images are processed in a neural network, which generates an output image having an extended depth of field encompassing at least the first and second focal depths.

Abstract: A three-dimensional image of the eardrum is automatically registered. In one aspect, a three-dimensional image (e.g., depth map) of an eardrum is produced from four-dimensional light field data captured by a light field otoscope. The three-dimensional image is registered according to a predefined standard form. The eardrum is then classified based on the registered three-dimensional image. Registration may include compensation for out-of-plane rotation (tilt), for in-plane rotation, for center location, for translation, and/or for scaling.

Abstract: A procedure to calibrate a depth-disparity mapping for a plenoptic imaging system. In one aspect, one or more test objects located at known field positions and known depths are presented to the plenoptic imaging system. The plenoptic imaging system captures plenoptic images of the test objects. The plenoptic images include multiple images of the test objects captured from different viewpoints. Disparities for the test objects are calculated based on the multiple images taken from the different viewpoints. Since the field positions and depths of the test objects are known, a mapping between depth and disparity as a function of field position can be determined.

Abstract: A multimode fundus camera enables three-dimensional and/or spectral/polarization imaging of the interior of the eye to assist in improved diagnosis. In one aspect, the multimode fundus camera includes a first imaging subsystem, a filter module, and a second imaging subsystem. The first imaging subsystem is positionable in front of an eye to form an optical image of an interior of the eye. The filter module is positioned at a pupil plane of the first imaging subsystem or at a conjugate thereof. The second imaging subsystem include a microimaging array and a sensor array. The microimaging array is positioned at the image plane or a conjugate thereof, and the sensor array is positioned at the pupil plane or a conjugate thereof.

Abstract: Designs for a light field otoscope are disclosed. An example light field otoscope includes an objective lens group, relay optics and a plenoptic sensor (e.g., microlens array and sensor array). The objective lens group images an interior of a human ear and is characterized by a pupil plane and an image plane. The relay optics is positioned between the objective lens group and the plenoptic sensor. It relays the image plane to the microlens array and relays the pupil plane to the sensor array.

Abstract: A system and method that identifies an object and a viewpoint from an image with a probability that satisfies a predefined criterion is described. An active view planning application receives a first image, performs recognition on the first image to determine an object, a viewpoint and a probability of recognition, determines a first expected gain in the probability of recognition when a first action is taken and a second expected gain in the probability of recognition when a second action is taken, and identifies a next action from the first action and the second action based on an increase in expected gains.

Abstract: A three-dimensional image of the eardrum is automatically registered. In one aspect, a three-dimensional image (e.g., depth map) of an eardrum is produced from four-dimensional light field data captured by a light field otoscope. The three-dimensional image is registered according to a predefined standard form. The eardrum is then classified based on the registered three-dimensional image. Registration may include compensation for out-of-plane rotation (tilt), for in-plane rotation, for center location, for translation, and/or for scaling.

Abstract: A collimated object is adjustable to produce collimated light propagating along different propagation directions. The plenoptic imaging system under calibration captures plenoptic images of the object adjusted to different propagation directions. The captured plenoptic images includes superpixels, each of which includes subpixels. Each subpixel captures light from a corresponding light field viewing direction. Based on the captured plenoptic images, a calibration module calculates which propagation directions map to which subpixels. The mapping defines the light field viewing directions for the subpixels. This can be used to improve processing of plenoptic images captured by the plenoptic imaging system.

Abstract: A multimode fundus camera enables three-dimensional and/or spectral/polarization imaging of the interior of the eye to assist in improved diagnosis.

Abstract: A multi-focal display represents a 3-dimensional scene by a series of 2-dimensional images located at different focal planes. The locations of the focal planes are selected based on an analysis of the three-dimensional scene to be rendered by the multi-focal display.

Abstract: A multifocal display for rendering a 3D scene as a series of 2D images. In one aspect, the multifocal display includes a display, an optical imaging system, a refractive focus actuator and a controller. The display renders the 2D images. The optical imaging system is image-side telecentric and creates an image of the display. The refractive focus actuator is positioned at the pupil of the optical imaging system. Thus, adjusting the refractive focus actuator alters a location of the image of the display but does not significantly alter a size of the image. The controller coordinates adjustment of the refractive focus actuator with rendering of the 2D images on the display. The waveform driving the focus actuator is preferably designed to reduce ringing and jitter effects.

Abstract: Multiframe reconstruction combines a set of acquired images into a reconstructed image. Here, which images to acquire are selected based at least in part on the content of previously acquired images. In one approach, a set of at least three images of an object are acquired at different acquisition settings. For at least one of the images in the set, the acquisition setting for the image is determined based at least in part on the content of previously acquired images. Multiframe image reconstruction, preferably via a multi-focal display, is applied to the set of acquired images to synthesize a reconstructed image of the object.

Abstract: The disclosure includes a system and method for identifying an object and a viewpoint from an image with a probability that satisfies a predefined criterion based on deep network learning. An active view planning application receives a first image, performs recognition on the first image to determine an object, a viewpoint and a probability of recognition, determines a first expected gain in the probability of recognition when a first action is taken and a second expected gain in the probability of recognition when a second action is taken, and identifies a next action from the first action and the second action based on an increase in expected gains.

Abstract: A procedure to calibrate a depth-disparity mapping for a plenoptic imaging system. In one aspect, one or more test objects located at known field positions and known depths are presented to the plenoptic imaging system. The plenoptic imaging system captures plenoptic images of the test objects. The plenoptic images include multiple images of the test objects captured from different viewpoints. Disparities for the test objects are calculated based on the multiple images taken from the different viewpoints. Since the field positions and depths of the test objects are known, a mapping between depth and disparity as a function of field position can be determined.

Abstract: Designs for a light field otoscope are disclosed. An example light field otoscope includes an objective lens group, relay optics and a plenoptic sensor (e.g., microlens array and sensor array). The objective lens group images an interior of a human ear and is characterized by a pupil plane and an image plane. The relay optics is positioned between the objective lens group and the plenoptic sensor. It relays the image plane to the microlens array and relays the pupil plane to the sensor array.

Abstract: Designs for a light field otoscope are disclosed. An example light field otoscope includes an objective lens group, relay optics and a plenoptic sensor (e.g., microlens array and sensor array). The objective lens group images an interior of a human ear and is characterized by a pupil plane and an image plane. The relay optics is positioned between the objective lens group and the plenoptic sensor. It relays the image plane to the microlens array and relays the pupil plane to the sensor array.

Abstract: A collimated object is adjustable to produce collimated light propagating along different propagation directions. The plenoptic imaging system under calibration captures plenoptic images of the object adjusted to different propagation directions. The captured plenoptic images includes superpixels, each of which includes subpixels. Each subpixel captures light from a corresponding light field viewing direction. Based on the captured plenoptic images, a calibration module calculates which propagation directions map to which subpixels. The mapping defines the light field viewing directions for the subpixels. This can be used to improve processing of plenoptic images captured by the plenoptic imaging system.

Abstract: A collimated object is adjustable to produce collimated light propagating along different propagation directions. The plenoptic imaging system under calibration captures plenoptic images of the object adjusted to different propagation directions. The captured plenoptic images includes superpixels, each of which includes subpixels. Each subpixel captures light from a corresponding light field viewing direction. Based on the captured plenoptic images, a calibration module calculates which propagation directions map to which subpixels. The mapping defines the light field viewing directions for the subpixels. This can be used to improve processing of plenoptic images captured by the plenoptic imaging system.

Abstract: A multimode fundus camera enables three-dimensional and/or spectral/polarization imaging of the interior of the eye to assist in improved diagnosis. In one aspect, the multimode fundus camera includes a first imaging subsystem, a filter module, and a second imaging subsystem. The first imaging subsystem is positionable in front of an eye to form an optical image of an interior of the eye. The filter module is positioned at a pupil plane of the first imaging subsystem or at a conjugate thereof. The second imaging subsystem include a microimaging array and a sensor array. The microimaging array is positioned at the image plane or a conjugate thereof, and the sensor array is positioned at the pupil plane or a conjugate thereof.

Abstract: Various types of illuminators for plenoptic otoscopes. The illuminators provide illuminating light to image the inside of the ear.