Patents by Inventor Zhiheng Jia

Zhiheng Jia has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210088968
    Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.
    Type: Application
    Filed: November 17, 2020
    Publication date: March 25, 2021
    Applicant: MAGIC LEAP, INC.
    Inventors: Jeremy A. Grata, Zhiheng JIA
  • Publication number: 20210014477
    Abstract: Embodiments provide a camera design (e.g., an eyeball camera) that mimics a human eye in geometry, optical performance and/or motion. The eyeball camera adopts the same cornea and pupil geometry from the human eye, and has the iris and pupil configured with multiple texture, color or diameter options. The resolution of the eyeball camera is designed to match the acuity of typical 20/20 human vision, and focus is adjusted from 0 to 4 diopters. A pair of eyeball cameras are mounted independently on two hexapods to simulate the human eye gaze and vergence. The perceived virtual and real world are calibrated and evaluated based on eye conditions like pupil location and gaze using the eyeball cameras. The eyeball camera serves as a bridge to combine the data from spatial computing like eye tracking, 3D geometry of the digital world, display color accuracy/uniformity, and display optical quality (sharpness, contrast, etc.).
    Type: Application
    Filed: July 10, 2020
    Publication date: January 14, 2021
    Applicant: Magic Leap, Inc.
    Inventors: Zhiheng Jia, Jeffrey Todd Daiker, Tim Ellis, Xiao Li, Jeremy A. Grata
  • Patent number: 10877438
    Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.
    Type: Grant
    Filed: January 9, 2017
    Date of Patent: December 29, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Jeremy A. Grata, Zhiheng Jia
  • Patent number: 10867407
    Abstract: Multiple cameras are coupled to a camera rig. Multiple diffractive optical elements (DOEs) are coupled to a DOE prop. Each camera is positioned in an eye box of a DOE and takes an image when the cameras are positioned at a first position, a second position and a third position relative to the DOEs. Three images taken by a each camera at each one of the first position, the second position and third position. The images are transmitted to a processor coupled to the camera rig. For each image, the processor identifies data pairs, each data pair including pixel coordinates of an intensity peak in the image and virtual light source produced by the diffractive optical element that corresponds to the intensity peak, and determines extrinsic parameters of the cameras using the identified data pairs for each image.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: December 15, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Zhiheng Jia, Etienne Gregoire Grossmann, Hao Zheng
  • Publication number: 20200233214
    Abstract: Augmented reality glasses include near eye displays the include sources of imagewise amplitude modulated light optical coupled to spatial phase modulators or active zone plate modulators and optically coupled to eye coupling optics. The sources of imagewise amplitude modulated light can include emissive 2D display panels or light sources coupled to imagewise amplitude modulators. The eye coupling optics can include volume holographic diffraction gratings.
    Type: Application
    Filed: September 26, 2018
    Publication date: July 23, 2020
    Inventors: Zhiheng Jia, Hao Zheng, Jeffrey Todd Daiker, Jeremy A. Grata
  • Publication number: 20200128235
    Abstract: An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.
    Type: Application
    Filed: December 19, 2019
    Publication date: April 23, 2020
    Applicant: MAGIC LEAP, INC.
    Inventors: Jeffrey Steven Kranski, Frederick Dennis Zyda, Grace Vesom, Grace Shin-Yee Tsai, Jeremy A. Grata, Zhiheng Jia, Li Jiang
  • Patent number: 10547833
    Abstract: An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: January 28, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Jeffrey Steven Kranski, Frederick Dennis Zyda, Grace Vesom, Grace Shin-Yee Tsai, Jeremy A. Grata, Zhiheng Jia, Li Jiang
  • Publication number: 20200012095
    Abstract: A head-mounted display system is configured to project light to an eye of a user wearing the head-mounted display system to display content in a vision field of said user. The head-mounted display system comprises at least one diffusive optical element, at least one out-coupling optical element, at least one mask comprising at least one mask opening, at least one illumination in-coupling optical element configured to in-couple light from at least one illumination source into a light-guiding component, an image projector configured to in-couple an image and an at least one illumination source is configured to in-couple light into at least one illumination in-coupling optical element, an eyepiece, a curved light-guiding component, a light-guiding component comprising a portion of a frame, and/or two light-guiding components disposed on opposite sides of at least one out-coupling optical element.
    Type: Application
    Filed: July 3, 2019
    Publication date: January 9, 2020
    Inventors: Lionel Ernest EDWIN, Ivan Li Chuen YEOH, Zhiheng JIA, Adam C. CARLSON
  • Publication number: 20190147625
    Abstract: Multiple cameras are coupled to a camera rig. Multiple diffractive optical elements (DOEs) are coupled to a DOE prop. Each camera is positioned in an eye box of a DOE and takes an image when the cameras are positioned at a first position, a second position and a third position relative to the DOEs. Three images taken by a each camera at each one of the first position, the second position and third position. The images are transmitted to a processor coupled to the camera rig. For each image, the processor identifies data pairs, each data pair including pixel coordinates of an intensity peak in the image and virtual light source produced by the diffractive optical element that corresponds to the intensity peak, and determines extrinsic parameters of the cameras using the identified data pairs for each image.
    Type: Application
    Filed: November 13, 2018
    Publication date: May 16, 2019
    Applicant: Magic Leap, Inc.
    Inventors: Zhiheng Jia, Etienne Gregoire Grossmann, Hao Zheng
  • Publication number: 20170374360
    Abstract: An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.
    Type: Application
    Filed: June 27, 2017
    Publication date: December 28, 2017
    Applicant: Magic Leap, Inc.
    Inventors: Jeffrey Steven Kranski, Frederick Dennis Zyda, Grace Vesom, Grace Shin-Yee Tsai, Jeremy A. Grata, Zhiheng Jia, Li Jiang
  • Patent number: 9805240
    Abstract: Implementations relate to a device and method for barcode scanning and dimensioning. In some implementations, the method includes acquiring a two-dimensional (2D) preview image of an object, and processing the 2D preview image to determine one or more dark areas and to determine a location of a code on the object. The method also includes acquiring a three-dimensional (3D) image of the object based on the one or more dark areas, and processing the 3D image to determine depth data and to determine dimensions of the object. The method also includes acquiring a 2D data capture image of the object based on the depth data in the processed 3D image, where the 2D data capture image captures the code. The method also includes reading the code based on the 2D data capture image.
    Type: Grant
    Filed: April 18, 2016
    Date of Patent: October 31, 2017
    Assignee: Symbol Technologies, LLC
    Inventors: Hao Zheng, David S. Koch, Zhiheng Jia
  • Patent number: 9799111
    Abstract: Disclosed herein are methods and systems for highlighting box surfaces and edges in mobile box dimensioning. An embodiment takes the form of a method that includes obtaining a three-dimensional (3D) point cloud from a depth sensor when the depth sensor is positioned such that an aiming indicator appears on a first surface of an object; processing the 3D point cloud to identify an extent of the first surface; further processing the 3D point cloud to identify a second surface that is adjacent and normal to the first surface, and to identify an extent of the second surface; and displaying at least part of the 3D point cloud via a user interface, including displaying the identified first surface in a first color and the identified second surface in a second color different from the first color.
    Type: Grant
    Filed: February 11, 2016
    Date of Patent: October 24, 2017
    Assignee: Symbol Technologies, LLC
    Inventors: Hao Zheng, Zhiheng Jia, David S. Koch
  • Publication number: 20170300734
    Abstract: Implementations relate to a device and method for barcode scanning and dimensioning. In some implementations, the method includes acquiring a two-dimensional (2D) preview image of an object, and processing the 2D preview image to determine one or more dark areas and to determine a location of a code on the object. The method also includes acquiring a three-dimensional (3D) image of the object based on the one or more dark areas, and processing the 3D image to determine depth data and to determine dimensions of the object. The method also includes acquiring a 2D data capture image of the object based on the depth data in the processed 3D image, where the 2D data capture image captures the code. The method also includes reading the code based on the 2D data capture image.
    Type: Application
    Filed: April 18, 2016
    Publication date: October 19, 2017
    Inventors: HAO ZHENG, DAVID S. KOCH, ZHIHENG JIA
  • Publication number: 20170236265
    Abstract: Disclosed herein are methods and systems for highlighting box surfaces and edges in mobile box dimensioning. An embodiment takes the form of a method that includes obtaining a three-dimensional (3D) point cloud from a depth sensor when the depth sensor is positioned such that an aiming indicator appears on a first surface of an object; processing the 3D point cloud to identify an extent of the first surface; further processing the 3D point cloud to identify a second surface that is adjacent and normal to the first surface, and to identify an extent of the second surface; and displaying at least part of the 3D point cloud via a user interface, including displaying the identified first surface in a first color and the identified second surface in a second color different from the first color.
    Type: Application
    Filed: February 11, 2016
    Publication date: August 17, 2017
    Inventors: HAO ZHENG, ZHIHENG JIA, DAVID S. KOCH
  • Publication number: 20170199496
    Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.
    Type: Application
    Filed: January 9, 2017
    Publication date: July 13, 2017
    Applicant: Magic Leap, Inc.
    Inventors: Jeremy A. Grata, Zhiheng Jia
  • Publication number: 20130274838
    Abstract: The invention features an optically-controlled biological device that includes a biological component comprising a non-excitable cell expressing a light-gated ion channel protein and capable of forming gap junction channels with a target cell, and an optical stimulation unit.
    Type: Application
    Filed: October 18, 2011
    Publication date: October 17, 2013
    Applicant: The Research Foundation of State University of New York
    Inventors: Emilia Entcheva, Zhiheng Jia, Zhongju Lu, Harold Bien, Ira S. Cohen
  • Publication number: 20060003399
    Abstract: Methods for assaying for actin polymerization are described, as are the use of the assays to screen for modulators of actin polymerization. The screening methods can be utilized to identify active agents that interact with actin, the polymerization state of actin and other proteins or cellular components whose function is naturally or artificially coupled to actin polymerization or depolymerization. Protein constructs and kits useful in performing the methods are also provided.
    Type: Application
    Filed: June 10, 2005
    Publication date: January 5, 2006
    Applicant: Cytokinetics, Inc.
    Inventors: Nenad Tomasevic, Zhiheng Jia, Roman Sakowicz, Daniel Pierce, Jeffrey Finer