Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.

Abstract: Embodiments provide a camera design (e.g., an eyeball camera) that mimics a human eye in geometry, optical performance and/or motion. The eyeball camera adopts the same cornea and pupil geometry from the human eye, and has the iris and pupil configured with multiple texture, color or diameter options. The resolution of the eyeball camera is designed to match the acuity of typical 20/20 human vision, and focus is adjusted from 0 to 4 diopters. A pair of eyeball cameras are mounted independently on two hexapods to simulate the human eye gaze and vergence. The perceived virtual and real world are calibrated and evaluated based on eye conditions like pupil location and gaze using the eyeball cameras. The eyeball camera serves as a bridge to combine the data from spatial computing like eye tracking, 3D geometry of the digital world, display color accuracy/uniformity, and display optical quality (sharpness, contrast, etc.).

Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.

Abstract: Multiple cameras are coupled to a camera rig. Multiple diffractive optical elements (DOEs) are coupled to a DOE prop. Each camera is positioned in an eye box of a DOE and takes an image when the cameras are positioned at a first position, a second position and a third position relative to the DOEs. Three images taken by a each camera at each one of the first position, the second position and third position. The images are transmitted to a processor coupled to the camera rig. For each image, the processor identifies data pairs, each data pair including pixel coordinates of an intensity peak in the image and virtual light source produced by the diffractive optical element that corresponds to the intensity peak, and determines extrinsic parameters of the cameras using the identified data pairs for each image.

Abstract: Augmented reality glasses include near eye displays the include sources of imagewise amplitude modulated light optical coupled to spatial phase modulators or active zone plate modulators and optically coupled to eye coupling optics. The sources of imagewise amplitude modulated light can include emissive 2D display panels or light sources coupled to imagewise amplitude modulators. The eye coupling optics can include volume holographic diffraction gratings.

Abstract: An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.

Abstract: An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.

Abstract: A head-mounted display system is configured to project light to an eye of a user wearing the head-mounted display system to display content in a vision field of said user. The head-mounted display system comprises at least one diffusive optical element, at least one out-coupling optical element, at least one mask comprising at least one mask opening, at least one illumination in-coupling optical element configured to in-couple light from at least one illumination source into a light-guiding component, an image projector configured to in-couple an image and an at least one illumination source is configured to in-couple light into at least one illumination in-coupling optical element, an eyepiece, a curved light-guiding component, a light-guiding component comprising a portion of a frame, and/or two light-guiding components disposed on opposite sides of at least one out-coupling optical element.

Abstract: Multiple cameras are coupled to a camera rig. Multiple diffractive optical elements (DOEs) are coupled to a DOE prop. Each camera is positioned in an eye box of a DOE and takes an image when the cameras are positioned at a first position, a second position and a third position relative to the DOEs. Three images taken by a each camera at each one of the first position, the second position and third position. The images are transmitted to a processor coupled to the camera rig. For each image, the processor identifies data pairs, each data pair including pixel coordinates of an intensity peak in the image and virtual light source produced by the diffractive optical element that corresponds to the intensity peak, and determines extrinsic parameters of the cameras using the identified data pairs for each image.

Abstract: An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.

Abstract: Implementations relate to a device and method for barcode scanning and dimensioning. In some implementations, the method includes acquiring a two-dimensional (2D) preview image of an object, and processing the 2D preview image to determine one or more dark areas and to determine a location of a code on the object. The method also includes acquiring a three-dimensional (3D) image of the object based on the one or more dark areas, and processing the 3D image to determine depth data and to determine dimensions of the object. The method also includes acquiring a 2D data capture image of the object based on the depth data in the processed 3D image, where the 2D data capture image captures the code. The method also includes reading the code based on the 2D data capture image.

Abstract: Disclosed herein are methods and systems for highlighting box surfaces and edges in mobile box dimensioning. An embodiment takes the form of a method that includes obtaining a three-dimensional (3D) point cloud from a depth sensor when the depth sensor is positioned such that an aiming indicator appears on a first surface of an object; processing the 3D point cloud to identify an extent of the first surface; further processing the 3D point cloud to identify a second surface that is adjacent and normal to the first surface, and to identify an extent of the second surface; and displaying at least part of the 3D point cloud via a user interface, including displaying the identified first surface in a first color and the identified second surface in a second color different from the first color.

Abstract: Implementations relate to a device and method for barcode scanning and dimensioning. In some implementations, the method includes acquiring a two-dimensional (2D) preview image of an object, and processing the 2D preview image to determine one or more dark areas and to determine a location of a code on the object. The method also includes acquiring a three-dimensional (3D) image of the object based on the one or more dark areas, and processing the 3D image to determine depth data and to determine dimensions of the object. The method also includes acquiring a 2D data capture image of the object based on the depth data in the processed 3D image, where the 2D data capture image captures the code. The method also includes reading the code based on the 2D data capture image.

Abstract: Disclosed herein are methods and systems for highlighting box surfaces and edges in mobile box dimensioning. An embodiment takes the form of a method that includes obtaining a three-dimensional (3D) point cloud from a depth sensor when the depth sensor is positioned such that an aiming indicator appears on a first surface of an object; processing the 3D point cloud to identify an extent of the first surface; further processing the 3D point cloud to identify a second surface that is adjacent and normal to the first surface, and to identify an extent of the second surface; and displaying at least part of the 3D point cloud via a user interface, including displaying the identified first surface in a first color and the identified second surface in a second color different from the first color.

Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.

Abstract: The invention features an optically-controlled biological device that includes a biological component comprising a non-excitable cell expressing a light-gated ion channel protein and capable of forming gap junction channels with a target cell, and an optical stimulation unit.

Abstract: Methods for assaying for actin polymerization are described, as are the use of the assays to screen for modulators of actin polymerization. The screening methods can be utilized to identify active agents that interact with actin, the polymerization state of actin and other proteins or cellular components whose function is naturally or artificially coupled to actin polymerization or depolymerization. Protein constructs and kits useful in performing the methods are also provided.