Patents by Inventor Adrian Kaehler

Adrian Kaehler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210133506
    Abstract: Disclosed herein are examples of a wearable display system capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.
    Type: Application
    Filed: January 13, 2021
    Publication date: May 6, 2021
    Inventors: Adrian Kaehler, Gary R. Bradski, Vijay Badrinarayanan
  • Publication number: 20210110020
    Abstract: Systems and methods for iris authentication are disclosed. In one aspect, a deep neural network (DNN) with a triplet network architecture can be trained to learn an embedding (e.g., another DNN) that maps from the higher dimensional eye image space to a lower dimensional embedding space. The DNN can be trained with segmented iris images or images of the periocular region of the eye (including the eye and portions around the eye such as eyelids, eyebrows, eyelashes, and skin surrounding the eye). With the triplet network architecture, an embedding space representation (ESR) of a person's eye image can be closer to the ESRs of the person's other eye images than it is to the ESR of another person's eye image. In another aspect, to authenticate a user as an authorized user, an ESR of the user's eye image can be sufficiently close to an ESR of the authorized user's eye image.
    Type: Application
    Filed: December 21, 2020
    Publication date: April 15, 2021
    Inventors: Alexey Spizhevoy, Adrian Kaehler, Gary Bradski
  • Patent number: 10977820
    Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: April 13, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Adrian Kaehler, Douglas Bertram Lee, Vijay Badrinarayanan
  • Patent number: 10976549
    Abstract: Systems and methods for generating a face model for a user of a head-mounted device are disclosed. The head-mounted device can include one or more eye cameras configured to image the face of the user while the user is putting the device on or taking the device off. The images obtained by the eye cameras may be analyzed using a stereoscopic vision technique, a monocular vision technique, or a combination, to generate a face model for the user.
    Type: Grant
    Filed: September 27, 2017
    Date of Patent: April 13, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Gholamreza Amayeh, Adrian Kaehler, Douglas Lee
  • Patent number: 10955662
    Abstract: Disclosed herein are systems and methods for device authentication or pairing. In an aspect, a wearable display system comprises a display, an image capture device configured to capture images of a companion device, a computer-readable storage medium configured to store the images of the companion device, and a processor in communication with the image capture device and the storage medium. The processor can be programmed with executable instructions to receive a first image of a first optical pattern displayed by the companion device captured by the image capture device, wherein the first optical pattern is generated by the companion device based on first shared data, extract first data from the first optical pattern in the received first image, authenticate the companion device based on the first data extracted from the first optical pattern, and notify a user of the wearable display system that the companion device is authenticated.
    Type: Grant
    Filed: May 17, 2018
    Date of Patent: March 23, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Nitin Singh, Adrian Kaehler
  • Publication number: 20210080321
    Abstract: Wearable spectroscopy systems and methods for identifying one or more characteristics of a target object are described. Spectroscopy systems may include a light source configured to emit light in an irradiated field of view and an electromagnetic radiation detector configured to receive reflected light from a target object irradiated by the light source. One or more processors of the systems may identify a characteristic of the target object based on a determined level of light absorption by the target object. Some systems and methods may include one or more corrections for scattered and/or ambient light such as applying an ambient light correction, passing the reflected light through an anti-scatter grid, or using a time-dependent variation in the emitted light.
    Type: Application
    Filed: March 21, 2019
    Publication date: March 18, 2021
    Inventors: Adrian Kaehler, Christopher M. Harrises, Eric Baerenrodt, Mark Baerenrodt, Nastasja U. Robaina, Nicole Elizabeth Samec, Tammy Sherri Powers, Ivan Li Chuen Yeoh, Adam Carl Wright
  • Publication number: 20210073845
    Abstract: Head mounted display systems configured to facilitate the exchange of biometric information between the head mounted display system and another computing device are disclosed. The head mounted display system can comprise a virtual or augmented reality device. After displaying a consent request regarding biometric information with the head mounted display system, a response to the consent request that includes a consent indication regarding an aspect of the biometric information can be determined. After obtaining biometric information from a wearer utilizing e.g., a camera of the head mounted display, and processing the biometric information, a biometric information processing result can be generated. The result can be communicated from the head mounted display system to another computing device.
    Type: Application
    Filed: November 16, 2020
    Publication date: March 11, 2021
    Inventor: Adrian Kaehler
  • Patent number: 10922583
    Abstract: An example wearable display system is capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.
    Type: Grant
    Filed: May 31, 2018
    Date of Patent: February 16, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Adrian Kaehler, Gary R. Bradski, Vijay Badrinarayanan
  • Patent number: 10922393
    Abstract: Systems and methods for iris authentication are disclosed. In one aspect, a deep neural network (DNN) with a triplet network architecture can be trained to learn an embedding (e.g., another DNN) that maps from the higher dimensional eye image space to a lower dimensional embedding space. The DNN can be trained with segmented iris images or images of the periocular region of the eye (including the eye and portions around the eye such as eyelids, eyebrows, eyelashes, and skin surrounding the eye). With the triplet network architecture, an embedding space representation (ESR) of a person's eye image can be closer to the ESRs of the person's other eye images than it is to the ESR of another person's eye image. In another aspect, to authenticate a user as an authorized user, an ESR of the user's eye image can be sufficiently close to an ESR of the authorized user's eye image.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: February 16, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Alexey Spizhevoy, Adrian Kaehler, Gary Bradski
  • Publication number: 20210037223
    Abstract: Disclosed are improved methods, systems and devices for color night vision that reduce the number of intensifiers and/or decrease noise. In some embodiments, color night vision is provided in system in which multiple spectral bands are maintained, filtered separately, and then recombined in a unique three-lens-filtering setup. An illustrative four-camera night vision system is unique in that its first three cameras separately filter different bands using a subtractive Cyan, Magenta and Yellow (CMY) color filtering-process, while its fourth camera is used to sense either additional IR illuminators or a luminance channel to increase brightness. In some embodiments, the color night vision is implemented to distinguish details of an image in low light. The unique application of the three-lens subtractive CMY filtering allows for better photon scavenging and preservation of important color information.
    Type: Application
    Filed: October 5, 2020
    Publication date: February 4, 2021
    Inventors: Michael KEESLING, Bran FERREN, Adrian KAEHLER, Dan RUDERMAN, David BEAL, Pablo MAURIN, Eric POWERS
  • Patent number: 10890465
    Abstract: An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. A diffractive optical element (DOE) is formed across the waveguide. The DOE is configured to couple a portion of the light passing through the waveguide into the waveguide. The light coupled into the waveguide is directed via total internal reflection to an exit location on the waveguide. The apparatus further includes a light sensor having an input positioned adjacent the exit location of the waveguide to capture light exiting therefrom and generate output signals corresponding thereto. A processor determines the angle and position of the coupled light with respect to the input face of the waveguide based on the output signals.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: January 12, 2021
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Patent number: 10867314
    Abstract: Head mounted display systems configured to facilitate the exchange of biometric information between the head mounted display system and another computing device are disclosed. The head mounted display system can comprise a virtual or augmented reality device. After displaying a consent request regarding biometric information with the head mounted display system, a response to the consent request that includes a consent indication regarding an aspect of the biometric information can be determined. After obtaining biometric information from a wearer utilizing e.g., a camera of the head mounted display, and processing the biometric information, a biometric information processing result can be generated. The result can be communicated from the head mounted display system to another computing device.
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: December 15, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Patent number: 10831264
    Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image combination can include assigning an eye pose region of a plurality of eye pose regions to each eye image and determining a representation of an eye pose in each eye image. The set of the determined representations can be fused to generate a hybrid eye image, which can in turn be used to generate an iris code associated with a confidence score.
    Type: Grant
    Filed: January 17, 2017
    Date of Patent: November 10, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Patent number: 10798355
    Abstract: Disclosed are improved methods, systems and devices for color night vision that reduce the number of intensifiers and/or decrease noise. In some embodiments, color night vision is provided in system in which multiple spectral bands are maintained, filtered separately, and then recombined in a unique three-lens-filtering setup. An illustrative four-camera night vision system is unique in that its first three cameras separately filter different bands using a subtractive Cyan, Magenta and Yellow (CMY) color filtering-process, while its fourth camera is used to sense either additional IR illuminators or a luminance channel to increase brightness. In some embodiments, the color night vision is implemented to distinguish details of an image in low light. The unique application of the three-lens subtractive CMY filtering allows for better photon scavenging and preservation of important color information.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: October 6, 2020
    Assignee: APPLIED MINDS, LLC
    Inventors: Michael Keesling, Bran Ferren, Adrian Kaehler, Dan Ruderman, David Beal, Pablo Maurin, Eric Powers
  • Publication number: 20200293744
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).
    Type: Application
    Filed: June 1, 2020
    Publication date: September 17, 2020
    Inventor: Adrian Kaehler
  • Publication number: 20200286251
    Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.
    Type: Application
    Filed: May 21, 2020
    Publication date: September 10, 2020
    Inventors: Adrian Kaehler, Douglas Bertram Lee, Vijay Badrinarayanan
  • Publication number: 20200272720
    Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.
    Type: Application
    Filed: May 8, 2020
    Publication date: August 27, 2020
    Inventor: Adrian Kaehler
  • Publication number: 20200250872
    Abstract: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.
    Type: Application
    Filed: February 3, 2020
    Publication date: August 6, 2020
    Inventors: Adrian Kaehler, Gary Bradski, Vijay Badrinarayanan
  • Publication number: 20200232622
    Abstract: A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. In various embodiments, the interior of the integrator may be a diffusely reflective surface and the integrator may be configured to produce a uniform light distribution at the aperture to approximate a point source. The integrator may be surrounded by a light bulb enclosure. In various embodiments, the light bulb enclosure may include transparent and opaque regions configured to project a structured pattern of visible and/or infrared light.
    Type: Application
    Filed: April 6, 2020
    Publication date: July 23, 2020
    Inventors: Adrian Kaehler, Gary Bradski
  • Patent number: 10719951
    Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: July 21, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Adrian Kaehler, Douglas Bertram Lee, Vijay Badrinarayanan