Abstract: Provided herein is a macroscope comprising an objective apparatus comprising a multifocal widefield optics comprising a plurality of optical components configured to focus on a plurality of planes. Also provided herein are methods for analyzing a three-dimensional specimen, the method comprising obtaining, via a macroscope, synchronous multifocal optical images of a plurality of planes of the three-dimensional specimen, wherein the macroscope comprises an objective apparatus comprising a multifocal widefield optics comprising a plurality of optical components configured to focus on a plurality of planes. The three-dimensional specimen can be a biological specimen, such as brain.

Abstract: The disclosure describes aspects of a display processing circuitry. In an aspect, one or more displays that support multiple views include one or more arrays of pixels, one or more backplanes, and a processing circuitry configured to receive one or more data streams, control processing of the data streams based on policies from which to select a mode of operation, each mode of operation defining which rays of light the arrays of pixels in the displays are to contribute to generate a particular view or views and the tasks to be performed by the processing circuitry to modify the data streams accordingly. The processing circuitry further provides signaling representative of the modified data streams to the arrays of pixels through a circuit configuration of the backplanes for the arrays of pixels to contribute the rays that will to generate the particular view or views. A corresponding method is also described.

Abstract: Systems and methods for imaging object velocity are provided. In an embodiment, at least one Time-of-Flight camera is used to capture a signal representative of an object in motion over an exposure time. Illumination and modulation frequency of the captured motion are coded within the exposure time. A change of illumination frequency is mapped to measured pixel intensities of the captured motion within the exposure time, and information about a Doppler shift in the illumination frequency is extracted to obtain a measurement of instantaneous per pixel velocity of the object in motion. The radial velocity information of the object in motion can be simultaneously captured for each pixel captured within the exposure time. In one or more aspects, the illumination frequency can be coded orthogonal to the modulation frequency of the captured motion. The change of illumination frequency can correspond to radial object velocity.

Abstract: A multiview autostereoscopic display includes a display area including an array of angular pixels, an eye tracker, and a processing system. Each angular pixel emits color that varies across a field of view of that angular pixel. The array of angular pixels displays different views in different viewing zones across the field of view of the display. The eye tracker detects the presence of the eyes of at least one viewer within specific viewing zones and produces eye tracking information including locations of the detected eyes within the specific viewing zones. The processing system renders a specific view for each detected eye based upon the location of the detected eye within the viewing zone with detected eyes, and generates control information for the array of angular pixels to cause the specific view for each detected eye to be displayed in the viewing zone in which that eye was detected.

Abstract: The disclosure describes aspects of a display processing circuitry. In an aspect, one or more displays that support multiple views include one or more arrays of pixels, one or more backplanes, and a processing circuitry configured to receive one or more data streams, control processing of the data streams based on policies from which to select a mode of operation, each mode of operation defining which rays of light the arrays of pixels in the displays are to contribute to generate a particular view or views and the tasks to be performed by the processing circuitry to modify the data streams accordingly. The processing circuitry further provides signaling representative of the modified data streams to the arrays of pixels through a circuit configuration of the backplanes for the arrays of pixels to contribute the rays that will to generate the particular view or views. A corresponding method is also described.

Abstract: Systems and methods for compensating for at least one optical aberration in a vision system of a viewer viewing a display. Image data for an image to be displayed is received, at least one parameter related to at least one optical aberration in the vision system of a viewer is received and an aberration compensated image to be displayed is computed based on the at least one received parameter related to the vision system of a viewer and on at least one characteristic of the light field element. The aberration compensated image is displayed on the display medium, such that when a viewer whose vision system has the at least one optical aberration views the aberration compensated image displayed on the display medium through a light field element, the aberration compensated image appears to the viewer with the at least one aberration reduced or eliminated.

Abstract: Embodiments of 3D imaging systems that use a multifunctional, nano structured metalens to replace the conventional microlens array in light field imaging are disclosed. The optical focusing properties of the metalenses provided by gradient metasurface optical elements. The gradient metasurfaces allow the properties of the elements of the metalens array to be changed by tuning the gradient metasurfaces.

Abstract: The disclosure describes aspects of a display processing circuitry. In an aspect, one or more displays that support multiple views include one or more arrays of pixels, one or more backplanes, and a processing circuitry configured to receive one or more data streams, control processing of the data streams based on policies from which to select a mode of operation, each mode of operation defining which rays of light the arrays of pixels in the displays are to contribute to generate a particular view or views and the tasks to be performed by the processing circuitry to modify the data streams accordingly. The processing circuitry further provides signaling representative of the modified data streams to the arrays of pixels through a circuit configuration of the backplanes for the arrays of pixels to contribute the rays that will to generate the particular view or views. A corresponding method is also described.

Abstract: Systems and methods for compensating for at least one optical aberration in a vision system of a viewer viewing a display. Image data for an image to be displayed is received, at least one parameter related to at least one optical aberration in the vision system of a viewer is received and an aberration compensated image to be displayed is computed based on the at least one received parameter related to the vision system of a viewer and on at least one characteristic of the light field element. The aberration compensated image is displayed on the display medium, such that when a viewer whose vision system has the at least one optical aberration views the aberration compensated image displayed on the display medium through a light field element, the aberration compensated image appears to the viewer with the at least one aberration reduced or eliminated.

Abstract: Systems and methods for imaging object velocity are provided. In an embodiment, at least one Time-of-Flight camera is used to capture a signal representative of an object in motion over an exposure time. Illumination and modulation frequency of the captured motion are coded within the exposure time. A change of illumination frequency is mapped to measured pixel intensities of the captured motion within the exposure time, and information about a Doppler shift in the illumination frequency is extracted to obtain a measurement of instantaneous per pixel velocity of the object in motion. The radial velocity information of the object in motion can be simultaneously captured for each pixel captured within the exposure time. In one or more aspects, the illumination frequency can be coded orthogonal to the modulation frequency of the captured motion. The change of illumination frequency can correspond to radial object velocity.

Abstract: Near-eye display systems in accordance with embodiments of the invention enable accommodation-invariant display control. One embodiment includes a near-eye display; a processor; a memory containing a target image and an accommodation-invariant display application; where the processor is configured by the accommodation-invariant display application to calculate an impulse response of the near-eye display; calculate a compensation image by generating a deconvolved color channel of the target image using a ratio of the target image and the impulse response, where the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and display the compensation image on the near-eye display.

Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.

Abstract: Near-eye display systems in accordance with embodiments of the invention enable accommodation-invariant display control. One embodiment includes a near-eye display; a processor; a memory containing a target image and an accommodation-invariant display application; where the processor is configured by the accommodation-invariant display application to calculate an impulse response of the near-eye display; calculate a compensation image by generating a deconvolved color channel of the target image using a ratio of the target image and the impulse response, where the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and display the compensation image on the near-eye display.

Abstract: Embodiments of 3D imaging systems that use a multifunctional, nano structured metalens to replace the conventional microlens array in light field imaging are disclosed. The optical focusing properties of the metalenses provided by gradient metasurface optical elements. The gradient metasurfaces allow the properties of the elements of the metalens array to be changed by tuning the gradient metasurfaces.

Abstract: In exemplary implementations of this invention, light from a light field projector is transmitted through an angle-expanding screen to create a glasses-free, 3D display. The display can be horizontal-only parallax or full parallax. In the former case, a vertical diffuser may positioned in the optical stack. The angle-expanding screen may comprise two planar arrays of optical elements (e.g., lenslets or lenticules) separated from each other by the sum of their focal distances. Alternatively, a light field projector may project light rays through a focusing lens onto a diffuse, transmissive screen. In this alternative approach, the light field projector may comprise two spatial light modulators (SLMs). A focused image of the first SLM, and a slightly blurred image of the second SLM, are optically combined on the diffuser, creating a combined image that has a higher spatial resolution and a higher dynamic range than either of two SLMs.

Abstract: In exemplary implementations of this invention, a light field camera uses a light field dictionary to reconstruct a 4D light field from a single photograph. The light field includes both angular and spatial information and has a spatial resolution equal to the spatial resolution of the imaging sensor. Light from a scene passes through a coded spatial light modulator (SLM) before reaching an imaging sensor. Computer processors reconstruct a light field. This reconstruction includes computing a sparse or compressible coefficient vector using a light field dictionary matrix. Each column vector of the dictionary matrix is a light field atom. These light field atoms each, respectively, comprise information about a small 4D region of a light field. Reconstruction quality may be improved by using an SLM that is as orthogonal as possible to the dictionary.

Abstract: In exemplary implementations of this invention, light from a backlight is transmitted through two stacked LCDs and then through a diffuser. The front side of the diffuser displays a time-varying sequence of 2D images. Processors execute an optimization algorithm to compute optimal pixel states in the first and second LCDs, respectively, such that for each respective image in the sequence, the optimal pixel states minimize, subject to one or more constraints, a difference between a target image and the respective image. The processors output signals to control actual pixel states in the LCDs, based on the computed optimal pixel states. The 2D images displayed by the diffuser have a higher spatial resolution than the native spatial resolution of the LCDs. Alternatively, the diffuser may be switched off, and the device may display either (a) 2D images with a higher dynamic range than the LCDs, or (b) an automultiscopic display.

Abstract: Systems and methods for compensating for at least one optical aberration in a vision system of a viewer viewing a display. Image data for an image to be displayed is received, at least one parameter related to at least one optical aberration in the vision system of a viewer is received and an aberration compensated image to be displayed is computed based on the at least one received parameter related to the vision system of a viewer and on at least one characteristic of the light field element. The aberration compensated image is displayed on the display medium, such that when a viewer whose vision system has the at least one optical aberration views the aberration compensated image displayed on the display medium through a light field element, the aberration compensated image appears to the viewer with the at least one aberration reduced or eliminated.

Abstract: In exemplary implementations of this invention, light from a backlight is transmitted through two stacked LCDs and then through a diffuser. The front side of the diffuser displays a time-varying sequence of 2D images. Processors execute an optimization algorithm to compute optimal pixel states in the first and second LCDs, respectively, such that for each respective image in the sequence, the optimal pixel states minimize, subject to one or more constraints, a difference between a target image and the respective image. The processors output signals to control actual pixel states in the LCDs, based on the computed optimal pixel states. The 2D images displayed by the diffuser have a higher spatial resolution than the native spatial resolution of the LCDs. Alternatively, the diffuser may be switched off, and the device may display either (a) 2D images with a higher dynamic range than the LCDs, or (b) an automultiscopic display.

Abstract: An imaging method comprises acquiring image data in which image components are spatially modulated at distinct spatial frequencies, transforming the image data into the Fourier domain and separating the image components in the Fourier domain. The image components may be transformed into the spatial domain. The image components may comprise different colors. In some embodiments saturated pixels are reconstructed by performing an optimization based on differences between image copies in the Fourier domain. Imaging apparatus may perform the imaging methods.