Patents by Inventor Adrian Kaehler

Adrian Kaehler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • COLOR NIGHT VISION CAMERAS, SYSTEMS, AND METHODS THEREOF
    Publication number: 20210037223
    Abstract: Disclosed are improved methods, systems and devices for color night vision that reduce the number of intensifiers and/or decrease noise. In some embodiments, color night vision is provided in system in which multiple spectral bands are maintained, filtered separately, and then recombined in a unique three-lens-filtering setup. An illustrative four-camera night vision system is unique in that its first three cameras separately filter different bands using a subtractive Cyan, Magenta and Yellow (CMY) color filtering-process, while its fourth camera is used to sense either additional IR illuminators or a luminance channel to increase brightness. In some embodiments, the color night vision is implemented to distinguish details of an image in low light. The unique application of the three-lens subtractive CMY filtering allows for better photon scavenging and preservation of important color information.
    Type: Application
    Filed: October 5, 2020
    Publication date: February 4, 2021
    Inventors: Michael KEESLING, Bran FERREN, Adrian KAEHLER, Dan RUDERMAN, David BEAL, Pablo MAURIN, Eric POWERS
  • Dual composite light field device
    Patent number: 10890465
    Abstract: An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. A diffractive optical element (DOE) is formed across the waveguide. The DOE is configured to couple a portion of the light passing through the waveguide into the waveguide. The light coupled into the waveguide is directed via total internal reflection to an exit location on the waveguide. The apparatus further includes a light sensor having an input positioned adjacent the exit location of the waveguide to capture light exiting therefrom and generate output signals corresponding thereto. A processor determines the angle and position of the coupled light with respect to the input face of the waveguide based on the output signals.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: January 12, 2021
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Head mounted display system configured to exchange biometric information
    Patent number: 10867314
    Abstract: Head mounted display systems configured to facilitate the exchange of biometric information between the head mounted display system and another computing device are disclosed. The head mounted display system can comprise a virtual or augmented reality device. After displaying a consent request regarding biometric information with the head mounted display system, a response to the consent request that includes a consent indication regarding an aspect of the biometric information can be determined. After obtaining biometric information from a wearer utilizing e.g., a camera of the head mounted display, and processing the biometric information, a biometric information processing result can be generated. The result can be communicated from the head mounted display system to another computing device.
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: December 15, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Eye image combination
    Patent number: 10831264
    Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image combination can include assigning an eye pose region of a plurality of eye pose regions to each eye image and determining a representation of an eye pose in each eye image. The set of the determined representations can be fused to generate a hybrid eye image, which can in turn be used to generate an iris code associated with a confidence score.
    Type: Grant
    Filed: January 17, 2017
    Date of Patent: November 10, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Color night vision cameras, systems, and methods thereof
    Patent number: 10798355
    Abstract: Disclosed are improved methods, systems and devices for color night vision that reduce the number of intensifiers and/or decrease noise. In some embodiments, color night vision is provided in system in which multiple spectral bands are maintained, filtered separately, and then recombined in a unique three-lens-filtering setup. An illustrative four-camera night vision system is unique in that its first three cameras separately filter different bands using a subtractive Cyan, Magenta and Yellow (CMY) color filtering-process, while its fourth camera is used to sense either additional IR illuminators or a luminance channel to increase brightness. In some embodiments, the color night vision is implemented to distinguish details of an image in low light. The unique application of the three-lens subtractive CMY filtering allows for better photon scavenging and preservation of important color information.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: October 6, 2020
    Assignee: APPLIED MINDS, LLC
    Inventors: Michael Keesling, Bran Ferren, Adrian Kaehler, Dan Ruderman, David Beal, Pablo Maurin, Eric Powers
  • EYELID SHAPE ESTIMATION USING EYE POSE MEASUREMENT
    Publication number: 20200293744
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).
    Type: Application
    Filed: June 1, 2020
    Publication date: September 17, 2020
    Inventor: Adrian Kaehler
  • PERSONALIZED NEURAL NETWORK FOR EYE TRACKING
    Publication number: 20200286251
    Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.
    Type: Application
    Filed: May 21, 2020
    Publication date: September 10, 2020
    Inventors: Adrian Kaehler, Douglas Bertram Lee, Vijay Badrinarayanan
  • BLUE LIGHT ADJUSTMENT FOR BIOMETRIC SECURITY
    Publication number: 20200272720
    Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.
    Type: Application
    Filed: May 8, 2020
    Publication date: August 27, 2020
    Inventor: Adrian Kaehler
  • PERIOCULAR TEST FOR MIXED REALITY CALIBRATION
    Publication number: 20200250872
    Abstract: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.
    Type: Application
    Filed: February 3, 2020
    Publication date: August 6, 2020
    Inventors: Adrian Kaehler, Gary Bradski, Vijay Badrinarayanan
  • INTEGRATING POINT SOURCE FOR TEXTURE PROJECTING BULB
    Publication number: 20200232622
    Abstract: A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. In various embodiments, the interior of the integrator may be a diffusely reflective surface and the integrator may be configured to produce a uniform light distribution at the aperture to approximate a point source. The integrator may be surrounded by a light bulb enclosure. In various embodiments, the light bulb enclosure may include transparent and opaque regions configured to project a structured pattern of visible and/or infrared light.
    Type: Application
    Filed: April 6, 2020
    Publication date: July 23, 2020
    Inventors: Adrian Kaehler, Gary Bradski
  • Personalized neural network for eye tracking
    Patent number: 10719951
    Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: July 21, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Adrian Kaehler, Douglas Bertram Lee, Vijay Badrinarayanan
  • PERIOCULAR AND AUDIO SYNTHESIS OF A FULL FACE IMAGE
    Publication number: 20200226830
    Abstract: Systems and methods for synthesizing an image of the face by a head-mounted device (HMD) are disclosed. The HMD may not be able to observe a portion of the face. The systems and methods described herein can generate a mapping from a conformation of the portion of the face that is not imaged to a conformation of the portion of the face observed. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.
    Type: Application
    Filed: December 19, 2019
    Publication date: July 16, 2020
    Inventor: Adrian Kaehler
  • SEMI-GLOBAL SHUTTER IMAGER
    Publication number: 20200228734
    Abstract: This disclosure is directed to an image sensor. The image sensor includes a two-dimensional pixel array divided into a plurality of blocks, each of the plurality of blocks comprising pixels arranged in at least two different rows and two different columns, and a shutter mechanism that exposes the plurality of blocks sequentially, with all pixels in each block being exposed synchronously.
    Type: Application
    Filed: January 17, 2020
    Publication date: July 16, 2020
    Inventor: Adrian KAEHLER
  • Software Compensated Robotics
    Publication number: 20200206913
    Abstract: A software compensated robotic system makes use of recurrent neural networks and image processing to control operation and/or movement of an end effector. Images are used to compensate for variations in the response of the robotic system to command signals. This compensation allows for the use of components having lower reproducibility, precision and/or accuracy that would otherwise be practical.
    Type: Application
    Filed: January 1, 2019
    Publication date: July 2, 2020
    Inventor: Adrian Kaehler
  • COLOR NIGHT VISION CAMERAS, SYSTEMS, AND METHODS THEREOF
    Publication number: 20200195902
    Abstract: Disclosed are improved methods, systems and devices for color night vision that reduce the number of intensifiers and/or decrease noise. In some embodiments, color night vision is provided in system in which multiple spectral bands are maintained, filtered separately, and then recombined in a unique three-lens-filtering setup. An illustrative four-camera night vision system is unique in that its first three cameras separately filter different bands using a subtractive Cyan, Magenta and Yellow (CMY) color filtering-process, while its fourth camera is used to sense either additional IR illuminators or a luminance channel to increase brightness. In some embodiments, the color night vision is implemented to distinguish details of an image in low light. The unique application of the three-lens subtractive CMY filtering allows for better photon scavenging and preservation of important color information.
    Type: Application
    Filed: February 26, 2020
    Publication date: June 18, 2020
    Inventors: Michael KEESLING, Bran FERREN, Adrian KAEHLER, Dan RUDERMAN, David BEAL, Pablo MAURIN, Eric POWERS
  • AUGMENTED REALITY IDENTITY VERIFICATION
    Publication number: 20200184201
    Abstract: An augmented reality device (ARD) can present virtual content which can provide enhanced experiences with the user's physical environment. For example, the ARD can detect a linkage between a person in the FOV of the ARD and a physical object (e.g., a document presented by the person) or detect linkages between the documents. The linkages may be used in identity verification or document verification.
    Type: Application
    Filed: December 10, 2019
    Publication date: June 11, 2020
    Inventor: Adrian Kaehler
  • WORD FLOW ANNOTATION
    Publication number: 20200184975
    Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.
    Type: Application
    Filed: February 14, 2020
    Publication date: June 11, 2020
    Inventors: Jeffrey Scott Sommers, Jennifer M.R. Devine, Joseph Wayne Seuck, Adrian Kaehler
  • Eyelid shape estimation using eye pose measurement
    Patent number: 10671845
    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).
    Type: Grant
    Filed: November 2, 2018
    Date of Patent: June 2, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • AUGMENTED REALITY SPECTROSCOPY
    Publication number: 20200166760
    Abstract: In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.
    Type: Application
    Filed: January 28, 2020
    Publication date: May 28, 2020
    Inventors: Nicole Elizabeth Samec, Nastasja U. Robaina, Adrian Kaehler, Mark Baerenrodt, Eric Baerenrodt, Christopher M. Harrises, Tammy Sherri Powers
  • Blue light adjustment for biometric security
    Patent number: 10664582
    Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.
    Type: Grant
    Filed: October 25, 2018
    Date of Patent: May 26, 2020
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler