Patents Assigned to Magic Leap, Inc.
  • Publication number: 20190158549
    Abstract: One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.
    Type: Application
    Filed: January 29, 2019
    Publication date: May 23, 2019
    Applicant: Magic Leap, Inc.
    Inventor: Samuel A. MILLER
  • Publication number: 20190155019
    Abstract: Embodiments of optical scanners, optical projection systems, and methods of scanning optical waveguides and projecting images are described. The disclosed devices, systems and methods advantageously provide an improvement to the compactness, robustness, simplicity, and reliability of optical scanners and optical projection systems by implementing a thermally driven actuator for inducing oscillations of a cantilever within the optical scanners and optical projection systems. The stability and accuracy of optical scanners and optical projection systems are further enhanced using capacitive sensing, feedback, and phase correction techniques described herein.
    Type: Application
    Filed: November 20, 2018
    Publication date: May 23, 2019
    Applicant: Magic Leap, Inc.
    Inventor: Charles David Melville
  • Publication number: 20190155374
    Abstract: An augmented reality display system includes an electromagnetic field emitter to emit a known magnetic field in a known coordinate system. The system also includes an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor resulting from the known magnetic field. The system further includes a depth sensor to measure a distance in the known coordinate system. Moreover, the system includes a controller to determine pose information of the electromagnetic sensor relative to the electromagnetic field emitter in the known coordinate system based at least in part on the parameter related to the magnetic flux measured by the electromagnetic sensor and the distance measured by the depth sensor. In addition, the system includes a display system to display virtual content to a user based at least in part on the pose information of the electromagnetic sensor relative to the electromagnetic field emitter.
    Type: Application
    Filed: December 14, 2018
    Publication date: May 23, 2019
    Applicant: MAGIC LEAP, INC.
    Inventors: Samuel A. Miller, Michael J. Woods, David C. Lundmark
  • Publication number: 20190154914
    Abstract: One embodiment is directed to a compact system for scanning electromagnetic imaging radiation, comprising a first waveguide and a second waveguide, each of which is operatively coupled to at least one electromagnetic radiation source and configured such that output from the first and second waveguides is luminance modulated and scanned along one or more axes to form at least a portion of an image.
    Type: Application
    Filed: January 25, 2019
    Publication date: May 23, 2019
    Applicant: Magic Leap, Inc.
    Inventors: Brian T. SCHOWENGERDT, Matthew D. WATSON
  • Patent number: 10296792
    Abstract: Examples of systems and methods for determining a limbic boundary of an iris of an eye are provided. Properties of the corneal bulge can be computed from eye images. An intersection of the corneal bulge with the eye surface (e.g., sclera) can be determined as the limbic boundary. The determined limbic boundary can be used for iris segmentation or biometric applications. A head mounted display can include a camera that images the eye and a processor that analyzes the eye images and determines the limbic boundary.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: May 21, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Alexey Spizhevoy, Gholamreza Amayeh, Adrian Kaehler
  • Patent number: 10295338
    Abstract: A method of generating map data comprises capturing an image of a field of view of a user, extracting a set of map points based on the captured image, identifying respective sets of sparse points and dense points based on the extracted map points, performing point normalization of the respective sets of sparse points and dense points, generating sparse and dense point descriptors for the respective sets of sparse points and dense points, and combining the sparse point descriptors and dense point descriptors to store as map data.
    Type: Grant
    Filed: May 5, 2015
    Date of Patent: May 21, 2019
    Assignee: MAGIC LEAP, INC.
    Inventors: Rony Abovitz, Brian T. Schowengerdt, Mathew D. Watson
  • Publication number: 20190147341
    Abstract: Systems, devices, and methods for training a neural network and performing image interest point detection and description using the neural network. The neural network may include an interest point detector subnetwork and a descriptor subnetwork. An optical device may include at least one camera for capturing a first image and a second image. A first set of interest points and a first descriptor may be calculated using the neural network based on the first image, and a second set of interest points and a second descriptor may be calculated using the neural network based on the second image. A homography between the first image and the second image may be determined based on the first and second sets of interest points and the first and second descriptors. The optical device may adjust virtual image light being projected onto an eyepiece based on the homography.
    Type: Application
    Filed: November 14, 2018
    Publication date: May 16, 2019
    Applicant: Magic Leap, Inc.
    Inventors: Andrew Rabinovich, Daniel DeTone, Tomasz Jan Malisiewicz
  • Publication number: 20190147625
    Abstract: Multiple cameras are coupled to a camera rig. Multiple diffractive optical elements (DOEs) are coupled to a DOE prop. Each camera is positioned in an eye box of a DOE and takes an image when the cameras are positioned at a first position, a second position and a third position relative to the DOEs. Three images taken by a each camera at each one of the first position, the second position and third position. The images are transmitted to a processor coupled to the camera rig. For each image, the processor identifies data pairs, each data pair including pixel coordinates of an intensity peak in the image and virtual light source produced by the diffractive optical element that corresponds to the intensity peak, and determines extrinsic parameters of the cameras using the identified data pairs for each image.
    Type: Application
    Filed: November 13, 2018
    Publication date: May 16, 2019
    Applicant: Magic Leap, Inc.
    Inventors: Zhiheng Jia, Etienne Gregoire Grossmann, Hao Zheng
  • Patent number: 10288419
    Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
    Type: Grant
    Filed: May 8, 2015
    Date of Patent: May 14, 2019
    Assignee: MAGIC LEAP, INC.
    Inventors: Rony Abovitz, Brian T. Schowengerdt, Mathew D. Watson
  • Publication number: 20190137777
    Abstract: A method of fabricating a diffractive structure with varying diffractive element depth includes providing a shadow mask having a first region with a first aperture dimension to aperture periodicity ratio and a second region with a second aperture dimension to aperture periodicity ratio less than the first aperture dimension to aperture periodicity ratio. The method also includes positioning the shadow mask adjacent a substrate. The substrate comprises an etch mask corresponding to the diffractive structure. The method further includes exposing the substrate to an etchant, etching the substrate to form diffractive elements adjacent the first region having a first depth, and etching the substrate to form diffractive elements adjacent the second region having a second depth less than the first depth.
    Type: Application
    Filed: November 6, 2018
    Publication date: May 9, 2019
    Applicant: Magic Leap, Inc.
    Inventors: Shuqiang Yang, Vikramjit Singh, Kang Luo, Nai-Wen Pi, Frank Y. Xu
  • Patent number: 10282907
    Abstract: One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.
    Type: Grant
    Filed: May 4, 2015
    Date of Patent: May 7, 2019
    Assignee: MAGIC LEAP, INC
    Inventors: Samuel A. Miller, Rony Abovitz
  • Patent number: 10282611
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye-box is generated over an iris of the eye in the eye image. A plurality of radial lines can be generated from approximately the center of the eye-box to an upper edge or a lower edge of the eye box. Candidate points can be determined to have local maximum derivatives along the plurality of radial lines. From the candidate points, an eyelid shape curve (e.g., for an upper eyelid or a lower eyelid) can be determined by fitting a curve (e.g., a parabola or a polynomial) to the candidate points or a subset of the candidate points.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: May 7, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Gholamreza Amayeh, Adrian Kaehler
  • Patent number: 10275902
    Abstract: A user identification system includes an image recognition network to analyze image data and generate shape data based on the image data. The system also includes a generalist network to analyze the shape data and generate general category data based on the shape data. The system further includes a specialist network to compare the general category data with a characteristic to generate narrow category data. Moreover, the system includes a classifier layer including a plurality of nodes to represent a classification decision based on the narrow category data.
    Type: Grant
    Filed: May 9, 2016
    Date of Patent: April 30, 2019
    Assignee: MAGIC LEAP, INC.
    Inventor: Gary R. Bradski
  • Patent number: 10267970
    Abstract: A thermal monitoring and dissipation system for use with an optical device is described. The optical device includes the following: a frame defining a pair of eye openings and including a pair of arms configured to extend over the ears of a user of the optical device; a temperature monitoring system configured to monitor a distribution of heat within the frame; a display assembly configured to display content to a user of the optical device; and a processor configured to receive temperature data from the temperature monitoring system and to adjust an output of the display assembly based on variation in the distribution of heat within the frame.
    Type: Grant
    Filed: August 22, 2017
    Date of Patent: April 23, 2019
    Assignee: Magic Leap, Inc.
    Inventors: William K. Jones, Jr., Paul M. Greco, Charles Robert Schabacker
  • Patent number: 10261318
    Abstract: Architectures are provided for selectively outputting light for forming images, the light having different wavelengths and being outputted with low levels of crosstalk. In some embodiments, light is incoupled into a waveguide and deflected to propagate in different directions, depending on wavelength. The incoupled light then outcoupled by outcoupling optical elements that outcouple light based on the direction of propagation of the light. In some other embodiments, color filters are between a waveguide and outcoupling elements. The color filters limit the wavelengths of light that interact with and are outcoupled by the outcoupling elements. In yet other embodiments, a different waveguide is provided for each range of wavelengths to be outputted. Incoupling optical elements selectively incouple light of the appropriate range of wavelengths into a corresponding waveguide, from which the light is outcoupled.
    Type: Grant
    Filed: September 29, 2015
    Date of Patent: April 16, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Robert Dale TeKolste, Michael Anthony Klug, Brian T. Schowengerdt
  • Patent number: 10262462
    Abstract: An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.
    Type: Grant
    Filed: April 18, 2015
    Date of Patent: April 16, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Samuel A. Miller, Randall E. Hand, Philip O'Connor, Richmond B. Chan, Paul M. Greco
  • Patent number: 10260864
    Abstract: Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.
    Type: Grant
    Filed: November 2, 2016
    Date of Patent: April 16, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Lionel E. Edwin, Ivan L. Yeoh, Samuel A. Miller
  • Patent number: 10261162
    Abstract: Head-mounted augmented reality (AR) devices can track pose of a wearer's head to provide a three-dimensional virtual representation of objects in the wearer's environment. An electromagnetic (EM) tracking system can track head or body pose. A handheld user input device can include an EM emitter that generates an EM field, and the head-mounted AR device can include an EM sensor that senses the EM field. EM information from the sensor can be analyzed to determine location and/or orientation of the sensor and thereby the wearer's pose. The EM emitter and sensor may utilize time division multiplexing (TDM) or dynamic frequency tuning to operate at multiple frequencies. Voltage gain control may be implemented in the transmitter, rather than the sensor, allowing smaller and lighter weight sensor designs. The EM sensor can implement noise cancellation to reduce the level of EM interference generated by nearby audio speakers.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: April 16, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Brian Bucknor, Christopher Lopez, Michael Janusz Woods, Aly H. M. Aly, James William Palmer, Evan Francis Rynk
  • Publication number: 20190107722
    Abstract: The present invention comprises a compact optical see-through head-mounted display capable of combining, a see-through image path with a virtual image path such that the opaqueness of the see-through image path can be modulated and the virtual image occludes parts of the see-through image and vice versa.
    Type: Application
    Filed: November 20, 2018
    Publication date: April 11, 2019
    Applicant: Magic Leap, Inc.
    Inventors: Chunyu Gao, Yuxiang LIN, Hong HUA
  • Patent number: 10255529
    Abstract: The present disclosure provides an improved approach to implement structure learning of neural networks by exploiting correlations in the data/problem the networks aim to solve. A greedy approach is described that finds bottlenecks of information gain from the bottom convolutional layers all the way to the fully connected layers. Rather than simply making the architecture deeper, additional computation and capacitance is only added where it is required.
    Type: Grant
    Filed: March 13, 2017
    Date of Patent: April 9, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Andrew Rabinovich, Vijay Badrinarayanan, Daniel DeTone, Srivignesh Rajendran, Douglas Bertram Lee, Tomasz Malisiewicz