Patents Assigned to Magic Leap, Inc.
  • Patent number: 11962741
    Abstract: Disclosed is an approach for displaying 3D videos in a VR and/or AR system. The 3D videos may include 3D animated objects that escape from the display screen. The 3D videos may interact with objects within the VR and/or AR environment. The 3D video may be interactive with a user such that based on user input corresponding to decisions elected by the user at certain portions of the 3D video such that a different storyline and possibly a different conclusion may result for the 3D video. The 3D video may be a 3D icon displayed within a portal of a final 3D render world.
    Type: Grant
    Filed: March 2, 2022
    Date of Patent: April 16, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Praveen Babu J D, Sean Christopher Riley
  • Patent number: 11959997
    Abstract: A method of using a first device to locate a second device is disclosed. The first device, while in a first mode, transmits a first signal and receives a second signal comprising a reflection of the first signal by the second device. The first device determines, based on the received second signal, a position of the second device relative to the first device. The first device transitions to a second mode, and while in the second mode, receives a third signal from the second device. The first device determines, based on the third signal, an orientation of the second device relative to the first device. The first device comprises one or more receiving antennas, and the second device comprises one or more transmitting antennas. The third signal corresponds to a transmitting antenna of the second device.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: April 16, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Koon Keong Shee, Jose Felix Rodriguez, Ricardo Arencibia, Aly H. M. Aly
  • Patent number: 11960636
    Abstract: Examples of wearable systems and methods can use multiple inputs (e.g., gesture, head pose, eye gaze, voice, and/or environmental factors (e.g., location)) to determine a command that should be executed and objects in the three-dimensional (3D) environment that should be operated on. The multiple inputs can also be used by the wearable system to permit a user to interact with text, such as, e.g., composing, selecting, or editing text.
    Type: Grant
    Filed: December 22, 2021
    Date of Patent: April 16, 2024
    Assignee: MAGIC LEAP, INC.
    Inventors: James M. Powderly, Savannah Niles, Jennifer M. R. Devine, Adam C. Carlson, Jeffrey Scott Sommers, Praveen Babu J D, Ajoy Savio Fernandes, Anthony Robert Sheeder
  • Patent number: 11961194
    Abstract: Examples of the disclosure describe systems and methods for recording augmented reality and mixed reality experiences. In an example method, an image of a real environment is received via a camera of a wearable head device. A pose of the wearable head device is estimated, and a first image of a virtual environment is generated based on the pose. A second image of the virtual environment is generated based on the pose, wherein the second image of the virtual environment comprises a larger field of view than a field of view of the first image of the virtual environment. A combined image is generated based on the second image of the virtual environment and the image of the real environment.
    Type: Grant
    Filed: September 29, 2022
    Date of Patent: April 16, 2024
    Assignee: Magic Leap, Inc.
    Inventors: John Carl Paulus, Jr., Michael Harold Liebenow
  • Patent number: 11960661
    Abstract: The invention relates generally to a user interaction system having a head unit for a user to wear and a totem that the user holds in their hand and determines the location of a virtual object that is seen by the user. A fusion routine generates a fused location of the totem in a world frame based on a combination of an EM wave and a totem IMU data. The fused pose may drift over time due to the sensor's model mismatch. An unfused pose determination modeler routinely establishes an unfused pose of the totem relative to the world frame. A drift is declared when a difference between the fused pose and the unfused pose is more than a predetermined maximum distance.
    Type: Grant
    Filed: February 7, 2023
    Date of Patent: April 16, 2024
    Assignee: Magic Leap, Inc.
    Inventor: Sheng Wan
  • Patent number: 11960165
    Abstract: A display device comprises a waveguide configured to guide light in a lateral direction parallel to an output surface of the waveguide. The waveguide is further configured to outcouple the guided light through the output surface. The display device additionally comprises a broadband adaptive lens assembly configured to incouple and to diffract therethrough the outcoupled light from the waveguide. The broadband adaptive lens assembly comprises a first waveplate lens comprising a liquid crystal (LC) layer arranged such that the waveplate lens has birefringence (?n) that varies in a radially outward direction from a central region of the first waveplate lens and configured to diffract the outcoupled light at a diffraction efficiency greater than 90% within a wavelength range including at least 450 nm to 630 nm. The broadband adaptive lens assembly is configured to be selectively switched between a plurality of states having different optical powers.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: April 16, 2024
    Assignee: MAGIC LEAP, INC.
    Inventors: Chulwoo Oh, Ravi Kumar Komanduri, Roy Matthew Patterson, Charles Scott Carden, Michael Nevin Miller, Vikramjit Singh
  • Patent number: 11953653
    Abstract: An anti-reflective waveguide assembly comprising a waveguide substrate having a first index of refraction, a plurality of diffractive optical elements disposed upon a first surface of the waveguide and an anti-reflective coating disposed upon a second surface of the waveguide. The anti-reflective coating preferably increases absorption of light through a surface to which it is applied into the waveguide so that at least 97 percent of the light is transmitted. The anti-reflective coating is composed of four layers of material having different indices of refraction that the first index of refraction and an imaginary refractive index less than 1×10?3 but preferably less than 5×10?4.
    Type: Grant
    Filed: February 7, 2022
    Date of Patent: April 9, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Christophe Peroz, Kevin Messer
  • Patent number: 11954243
    Abstract: An augmented reality (AR) device can be configured to generate a virtual representation of a user's physical environment. The AR device can capture images of the user's physical environment to generate or identify a user's location. The AR device can project graphics at designated locations within the user's environment to guide the user to capture images of the user's physical environment. The AR device can provide visual, audible, or haptic guidance to direct the user of the AR device to explore the user's environment.
    Type: Grant
    Filed: July 11, 2022
    Date of Patent: April 9, 2024
    Assignee: MAGIC LEAP, INC.
    Inventors: Amy Dedonato, James Cameron Petty, Griffith Buckley Hazen, Jordan Alexander Cazamias, Karen Stolzenberg
  • Patent number: 11954809
    Abstract: The present disclosure relates to display systems and, more particularly, to augmented reality display systems. In one aspect, a method of fabricating an optical element includes providing a substrate having a first refractive index and transparent in the visible spectrum. The method additionally includes forming on the substrate periodically repeating polymer structures. The method further includes exposing the substrate to a metal precursor followed by an oxidizing precursor. Exposing the substrate is performed under a pressure and at a temperature such that an inorganic material comprising the metal of the metal precursor is incorporated into the periodically repeating polymer structures, thereby forming a pattern of periodically repeating optical structures configured to diffract visible light. The optical structures have a second refractive index greater than the first refractive index.
    Type: Grant
    Filed: April 29, 2022
    Date of Patent: April 9, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Melanie Maputol West, Christophe Peroz, Mauro Melli
  • Patent number: 11954251
    Abstract: Enhanced eye-tracking techniques for augmented or virtual reality display systems. An example method includes obtaining an image of an eye of a user of a wearable system, the image depicting glints on the eye caused by respective light emitters, wherein the image is a low dynamic range (LDR) image; generating a high dynamic range (HDR) image via computation of a forward pass of a machine learning model using the image; determining location information associated with the glints as depicted in the HDR image, wherein the location information is usable to inform an eye pose of the eye.
    Type: Grant
    Filed: April 21, 2023
    Date of Patent: April 9, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Hao Zheng, Zhiheng Jia
  • Patent number: 11956620
    Abstract: A method of presenting audio comprises: identifying a first ear listener position and a second ear listener position in a mixed reality environment; identifying a first virtual sound source in the mixed reality environment; identifying a first object in the mixed reality environment; determining a first audio signal in the mixed reality environment, wherein the first audio signal originates at the first virtual sound source and intersects the first ear listener position; determining a second audio signal in the mixed reality environment, wherein the second audio signal originates at the first virtual sound source, intersects the first object, and intersects the second ear listener position; determining a third audio signal based on the second audio signal and the first object; presenting, to a first ear of a user, the first audio signal; and presenting, to a second ear of the user, the third audio signal.
    Type: Grant
    Filed: June 23, 2023
    Date of Patent: April 9, 2024
    Assignee: Magic Leap, Inc.
    Inventor: Anastasia Andreyevna Tajik
  • Publication number: 20240112370
    Abstract: Embodiments provide image display systems and methods for a camera calibration using a two-sided diffractive optical element (DOE). More specifically, embodiments are directed to determining intrinsic parameters of a camera using a single image obtained using a two-sided DOE. The two-sided DOE has a first pattern on a first surface and a second pattern on a second surface. Each of the first and second patterns may be formed by repeating sub-patterns that are lined when tiled on each surface. The patterns on the two-sided DOE are formed such that the brightness of the central intensity peak on the image of the image pattern formed by the DOE is reduced to a predetermined amount.
    Type: Application
    Filed: December 6, 2023
    Publication date: April 4, 2024
    Applicant: Magic Leap, Inc.
    Inventors: Zhiheng Jia, Etienne Gregoire Grossmann, Hao Zheng, Daniel Roger Dominguez, Robert D. Tekolste
  • Patent number: 11948320
    Abstract: Systems and methods for estimating depths of features in a scene or environment surrounding a user of a spatial computing system, such as a virtual reality, augmented reality or mixed reality (collectively, cross reality) system, in an end-to-end process. The estimated depths can be utilized by a spatial computing system, for example, to provide an accurate and effective 3D cross reality experience.
    Type: Grant
    Filed: March 5, 2021
    Date of Patent: April 2, 2024
    Assignee: Magic Leap, Inc.
    Inventor: Ayan Tuhinendu Sinha
  • Patent number: 11947121
    Abstract: An example waveguide can include a polymer layer having substantially optically transparent material with first and second major surfaces configured such that light containing image information can propagate through the polymer layer being guided therein by reflecting from the first and second major surfaces via total internal reflection. The first surface can include first smaller and second larger surface portions monolithically integrated with the polymer layer and with each other. The first smaller surface portion can include at least a part of an in-coupling optical element configured to couple light incident on the in-coupling optical element into the polymer layer for propagation therethrough by reflection from the second major surface and the second larger surface portion of the first major surface.
    Type: Grant
    Filed: October 27, 2022
    Date of Patent: April 2, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Christophe Peroz, Victor Kai Liu, Samarth Bhargava
  • Patent number: 11948256
    Abstract: Examples of the disclosure describe systems and methods for generating and displaying a virtual companion. In an example method, a first input from an environment of a user is received at a first time via a first sensor on a head-wearable device. An occurrence of an event in the environment is determined based on the first input. A second input from the user is received via a second sensor on the head-wearable device, and an emotional reaction of the user is identified based on the second input. An association is determined between the emotional reaction and the event. A view of the environment is presented at a second time later than the first time via a see-through display of the head-wearable device. A stimulus is presented at the second time via a virtual companion displayed via the see-through display, wherein the stimulus is determined based on the determined association between the emotional reaction and the event.
    Type: Grant
    Filed: March 25, 2022
    Date of Patent: April 2, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Andrew Rabinovich, John Monos
  • Patent number: 11940639
    Abstract: In some implementations, an optical device includes a one-way mirror formed by a polarization selective mirror and an absorptive polarizer. The absorptive polarizer has a transmission axis aligned with the transmission axis of the reflective polarizer. The one-way mirror may be provided on the world side of a head-mounted display system. Advantageously, the one-way mirror may reflect light from the world, which provides privacy and may improve the cosmetics of the display. In some implementations, the one-way mirror may include one or more of a depolarizer and a pair of opposing waveplates to improve alignment tolerances and reduce reflections to a viewer. In some implementations, the one-way mirror may form a compact integrated structure with a dimmer for reducing light transmitted to the viewer from the world.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: March 26, 2024
    Assignee: Magic leap, Inc.
    Inventors: Chulwoo Oh, Ravi Kumar Komanduri, David Kleinman, Vaibhav Mathur, David Manly
  • Patent number: 11941408
    Abstract: During a boot-up processing of a computing device, such as an augmented reality wearable device, a static image and a bootup process progress bar may be encoded in a single image file, such as a bitmap image, and displayed in conjunction with updates that are applied to a hardware gamma table at various stages of the bootup process to create the effect of an animated progress bar.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: March 26, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Marshall Charles Capps, Anuroop Suresh Jesu
  • Patent number: 11942013
    Abstract: Disclosed are techniques for improving the color uniformity of a display of a display device. A plurality of images of the display are captured using an image capture device. The plurality of images are captured in a color space, with each image corresponding to one of a plurality of color channels. A global white balance is performed to the plurality of images to obtain a plurality of normalized images. A local white balance is performed to the plurality of normalized images to obtain a plurality of correction matrices. Performing the local white balance includes defining a set of weighting factors based on a figure of merit and computing a plurality of weighted images based on the plurality of normalized images and the set of weighting factors. The plurality of correction matrices are computed based on the plurality of weighted images.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: March 26, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Kevin Messer, Miller Harry Schuck, III, Nicholas Ihle Morley, Po-Kang Huang, Nukul Sanjay Shah, Marshall Charles Capps, Robert Blake Taylor
  • Patent number: D1019391
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: March 26, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Shigeru Natsume, Sarah Hoit, James William Palmer, Daniel Marcelo Gamez Castillejos, Christopher G. Palmer
  • Patent number: D1022010
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: April 9, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Shigeru Natsume, Sebastian Gonzalo Arrieta Gunther