Patents by Inventor Adrian Kaehler

Adrian Kaehler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10337691
    Abstract: A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. In various embodiments, the interior of the integrator may be a diffusely reflective surface and the integrator may be configured to produce a uniform light distribution at the aperture to approximate a point source. The integrator may be surrounded by a light bulb enclosure. In various embodiments, the light bulb enclosure may include transparent and opaque regions configured to project a structured pattern of visible and/or infrared light.
    Type: Grant
    Filed: April 17, 2017
    Date of Patent: July 2, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Adrian Kaehler, Gary Bradski
  • Patent number: 10296792
    Abstract: Examples of systems and methods for determining a limbic boundary of an iris of an eye are provided. Properties of the corneal bulge can be computed from eye images. An intersection of the corneal bulge with the eye surface (e.g., sclera) can be determined as the limbic boundary. The determined limbic boundary can be used for iris segmentation or biometric applications. A head mounted display can include a camera that images the eye and a processor that analyzes the eye images and determines the limbic boundary.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: May 21, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Alexey Spizhevoy, Gholamreza Amayeh, Adrian Kaehler
  • Patent number: 10296168
    Abstract: A method for a multi-step selection interface is provided including receiving a multistep selection indication, causing, using a processing circuitry, a first selection menu extending in a first direction to be rendered on a display, receiving a first selection indication based on the first selection menu, in response to receiving the first selection indication; causing a second selection menu to be rendered on the display, extending in the first direction in substantially the same position of the display as the first selection menu, and causing a rendering of at least a portion of the first menu to be displaced in a direction substantially perpendicular to the first direction.
    Type: Grant
    Filed: June 25, 2015
    Date of Patent: May 21, 2019
    Assignee: NORTHROP GRUMMAN SYSTEMS CORPORATION
    Inventors: Adrian Kaehler, Shi-Ping Hsu, Sam Leventer, Fred Zyda
  • Patent number: 10282611
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye-box is generated over an iris of the eye in the eye image. A plurality of radial lines can be generated from approximately the center of the eye-box to an upper edge or a lower edge of the eye box. Candidate points can be determined to have local maximum derivatives along the plurality of radial lines. From the candidate points, an eyelid shape curve (e.g., for an upper eyelid or a lower eyelid) can be determined by fitting a curve (e.g., a parabola or a polynomial) to the candidate points or a subset of the candidate points.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: May 7, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Gholamreza Amayeh, Adrian Kaehler
  • Publication number: 20190114480
    Abstract: Systems and methods for eye pose identification using features of an eye are described. Embodiments of the systems and methods can include segmenting an iris of an eye in the eye image to obtain pupillary and limbic boundaries of the eye, determining two angular coordinates (e.g., pitch and yaw) of an eye pose using the pupillary and limbic boundaries of the eye, identifying an eye feature of the eye (e.g., an iris feature or a scleral feature), determining a third angular coordinate (e.g., roll) of the eye pose using the identified eye feature, and utilizing the eye pose measurement for display of an image or a biometric application. In some implementations, iris segmentation may not be performed, and the two angular coordinates are determined from eye features.
    Type: Application
    Filed: December 18, 2018
    Publication date: April 18, 2019
    Inventors: Adrian Kaehler, Michael Anthony Klug, Gholamreza Amayeh
  • Publication number: 20190087659
    Abstract: Methods and devices for estimating position of a device within a 3D environment are described. Embodiments of the methods include sequentially receiving multiple image segments forming an image representing a field of view (FOV) comprising a portion of the environment. The image includes multiple sparse points that are identifiable based in part on a corresponding subset of image segments of the multiple image segments. The method also includes sequentially identifying one or more sparse points of the multiple sparse points when each subset of image segments corresponding to the one or more sparse points is received and estimating a position of the device in the environment based on the identified the one or more sparse points.
    Type: Application
    Filed: November 19, 2018
    Publication date: March 21, 2019
    Inventors: Adrian Kaehler, Gary Bradski
  • Publication number: 20190087973
    Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.
    Type: Application
    Filed: September 18, 2018
    Publication date: March 21, 2019
    Inventors: Adrian Kaehler, Douglas Lee, Vijay Badrinarayanan
  • Publication number: 20190087634
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).
    Type: Application
    Filed: November 2, 2018
    Publication date: March 21, 2019
    Inventor: Adrian Kaehler
  • Publication number: 20190065722
    Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.
    Type: Application
    Filed: October 25, 2018
    Publication date: February 28, 2019
    Inventor: Adrian Kaehler
  • Publication number: 20190034692
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye-box is generated over an iris of the eye in the eye image. A plurality of radial lines can be generated from approximately the center of the eye-box to an upper edge or a lower edge of the eye box. Candidate points can be determined to have local maximum derivatives along the plurality of radial lines. From the candidate points, an eyelid shape curve (e.g., for an upper eyelid or a lower eyelid) can be determined by fitting a curve (e.g., a parabola or a polynomial) to the candidate points or a subset of the candidate points.
    Type: Application
    Filed: September 28, 2018
    Publication date: January 31, 2019
    Inventors: Gholamreza Amayeh, Adrian Kaehler
  • Publication number: 20190034765
    Abstract: Disclosed herein are examples of a wearable display system capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.
    Type: Application
    Filed: May 31, 2018
    Publication date: January 31, 2019
    Inventors: Adrian Kaehler, Gary Bradski, Vijay Badrinarayanan
  • Publication number: 20190035317
    Abstract: Apparatus and methods for displaying an image by a rotating structure are provided. The rotating structure can comprise blades of a fan. The fan can be a cooling fan for an electronics device such as an augmented reality display. In some embodiments, the rotating structure comprises light sources that emit light to generate the image. The light sources can comprises light-field emitters. In other embodiments, the rotating structure is illuminated by an external (e.g., non-rotating) light source.
    Type: Application
    Filed: July 26, 2018
    Publication date: January 31, 2019
    Inventors: Guillermo Padin Rohena, Ralph Remsburg, Adrian Kaehler, Evan Francis Rynk
  • Patent number: 10163010
    Abstract: Systems and methods for eye pose identification using features of an eye are described. Embodiments of the systems and methods can include segmenting an iris of an eye in the eye image to obtain pupillary and limbic boundaries of the eye, determining two angular coordinates (e.g., pitch and yaw) of an eye pose using the pupillary and limbic boundaries of the eye, identifying an eye feature of the eye (e.g., an iris feature or a scleral feature), determining a third angular coordinate (e.g., roll) of the eye pose using the identified eye feature, and utilizing the eye pose measurement for display of an image or a biometric application. In some implementations, iris segmentation may not be performed, and the two angular coordinates are determined from eye features.
    Type: Grant
    Filed: October 12, 2016
    Date of Patent: December 25, 2018
    Assignee: Magic Leap, Inc.
    Inventors: Adrian Kaehler, Michael Anthony Klug, Gholamreza Amayeh
  • Patent number: 10163011
    Abstract: Methods and devices for estimating position of a device within a 3D environment are described. Embodiments of the methods include sequentially receiving multiple image segments forming an image representing a field of view (FOV) comprising a portion of the environment. The image includes multiple sparse points that are identifiable based in part on a corresponding subset of image segments of the multiple image segments. The method also includes sequentially identifying one or more sparse points of the multiple sparse points when each subset of image segments corresponding to the one or more sparse points is received and estimating a position of the device in the environment based on the identified the one or more sparse points.
    Type: Grant
    Filed: May 17, 2017
    Date of Patent: December 25, 2018
    Assignee: Magic Leap, Inc.
    Inventors: Adrian Kaehler, Gary Bradski
  • Publication number: 20180356258
    Abstract: An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. A diffractive optical element (DOE) is formed across the waveguide. The DOE is configured to couple a portion of the light passing through the waveguide into the waveguide. The light coupled into the waveguide is directed via total internal reflection to an exit location on the waveguide. The apparatus further includes a light sensor having an input positioned adjacent the exit location of the waveguide to capture light exiting therefrom and generate output signals corresponding thereto. A processor determines the angle and position of the coupled light with respect to the input face of the waveguide based on the output signals.
    Type: Application
    Filed: July 27, 2018
    Publication date: December 13, 2018
    Inventor: Adrian KAEHLER
  • Patent number: 10146997
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).
    Type: Grant
    Filed: August 16, 2016
    Date of Patent: December 4, 2018
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Publication number: 20180336332
    Abstract: Disclosed herein are systems and methods for device authentication or pairing. In an aspect, a wearable display system comprises a display, an image capture device configured to capture images of a companion device, a computer-readable storage medium configured to store the images of the companion device, and a processor in communication with the image capture device and the storage medium. The processor can be programmed with executable instructions to receive a first image of a first optical pattern displayed by the companion device captured by the image capture device, wherein the first optical pattern is generated by the companion device based on first shared data, extract first data from the first optical pattern in the received first image, authenticate the companion device based on the first data extracted from the first optical pattern, and notify a user of the wearable display system that the companion device is authenticated.
    Type: Application
    Filed: May 17, 2018
    Publication date: November 22, 2018
    Inventors: Nitin Singh, Adrian Kaehler
  • Patent number: 10127369
    Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.
    Type: Grant
    Filed: March 3, 2017
    Date of Patent: November 13, 2018
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Patent number: 10089526
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye-box is generated over an iris of the eye in the eye image. A plurality of radial lines can be generated from approximately the center of the eye-box to an upper edge or a lower edge of the eye box. Candidate points can be determined to have local maximum derivatives along the plurality of radial lines. From the candidate points, an eyelid shape curve (e.g., for an upper eyelid or a lower eyelid) can be determined by fitting a curve (e.g., a parabola or a polynomial) to the candidate points or a subset of the candidate points.
    Type: Grant
    Filed: August 16, 2016
    Date of Patent: October 2, 2018
    Assignee: Magic Leap, Inc.
    Inventors: Gholamreza Amayeh, Adrian Kaehler
  • Patent number: 10089453
    Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an initial eye image obtained by an image capture device; adjusting a level of blue light exposed to an eye associated with the initial eye image; receiving an adjustment eye image of the eye exposed to the adjusted level of blue light; detecting a change in a pupillary response of the adjustment eye image relative to the initial eye image; determining that the detected change in the pupillary response passes a biometric application threshold; and utilizing eye images or the detected change in the pupillary response for a biometric application.
    Type: Grant
    Filed: March 3, 2017
    Date of Patent: October 2, 2018
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler