Patents Assigned to Magic Leaps, Inc.
  • Publication number: 20240214538
    Abstract: Disclosed is an approach for displaying 3D videos in a VR and/or AR system. The 3D videos may include 3D animated objects that escape from the display screen. The 3D videos may interact with objects within the VR and/or AR environment. The 3D video may be interactive with a user such that based on user input corresponding to decisions elected by the user at certain portions of the 3D video such that a different storyline and possibly a different conclusion may result for the 3D video. The 3D video may be a 3D icon displayed within a portal of a final 3D render world.
    Type: Application
    Filed: March 11, 2024
    Publication date: June 27, 2024
    Applicant: MAGIC LEAP, INC.
    Inventors: Praveen BABU J D, Sean Christopher RILEY
  • Publication number: 20240212271
    Abstract: Various techniques pertaining to methods, systems, and computer program products a spatial persistence process that places a virtual object relative to a physical object for an extended-reality display device based at least in part upon a persistent coordinate frame (PCF). A determination is made to decide whether a drift is detected for the virtual object relative to the physical object, upon or after detection of the drift or deviation, the drift or deviation is corrected at least by updating a tracking map into an updated tracking map and further at least by updating the persistent coordinate frame (PCF) based at least in part upon the updated tracking map, wherein the persistent coordinate frame (PCF) comprises six degrees of freedom relative to the map coordinate system.
    Type: Application
    Filed: March 7, 2024
    Publication date: June 27, 2024
    Applicant: Magic Leap, Inc.
    Inventors: Yilun Cao, Mohan Babu Kandra, David Geoffrey Molyneaux, Daniel Olshansky, David Paul Pena, Frank Thomas Steinbrücker, Rafael Domingos Torres
  • Patent number: 12016719
    Abstract: A method of viewing a patient including inserting a catheter is described for health procedure navigation. A CT scan is carried out on a body part of a patient. Raw data from the CT scan is processed to create three-dimensional image data, storing the image data in the data store. Projectors receive generated light in a pattern representative of the image data and waveguides guide the light to a retina of an eye of a viewer while light from an external surface of the body transmits to the retina of the eye so that the viewer sees the external surface of the body augmented with the processed data rendering of the body part.
    Type: Grant
    Filed: August 22, 2019
    Date of Patent: June 25, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Nastasja U Robaina, Praveen Babu JD, David Charles Lundmark, Alexander Ilic
  • Patent number: 12019233
    Abstract: An optical device, such as an eyepiece, including multiple layers of waveguides. The optical device can include an edge sealant for reducing light contamination, a lamination dam to restrict the wicking of the edge sealant between layers of the optical device, and venting gap(s) in the sealant and dam to allow air flow between the exterior and interior of the eyepiece. The gap(s) allow outgassing from the interior of the eyepiece of unreacted polymer and/or accumulated moisture, to prevent defect accumulation caused by chemical reaction of outgassed chemicals with the (e.g., ionic, acidic, etc.) surface of the eyepiece layers. The gap(s) also prevent pressure differences which may physically deform the eyepiece over time.
    Type: Grant
    Filed: July 22, 2019
    Date of Patent: June 25, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Wendong Xing, Vikramjit Singh, Neal Paul Ricks, Jeffrey Dean Schmulen, Emory D. Carroll, K. Brent Binkley, Frank Y. Xu, Thomas Mercier, William Hudson Welch, Michael Anthony Klug
  • Patent number: 12019239
    Abstract: A method for characterizing a digital color camera includes, for each of three primary colors used in a field sequential color virtual image, determining a conversion model for each color using RGB values and the color-measurement values. For each primary color, the method includes illuminating a display device using an input light beam of a primary color having spectral properties representative of a light beam in a virtual image in a wearable device. The method includes capturing, with the digital color camera, an image of the display device, and determining, from the image, RGB values for each primary color. The method includes capturing, with a color-measurement device, a color-measurement value associated with each corresponding primary color at the display device, thereby acquiring a color-measurement value in an absolute color space. A conversion model for each color is determined using RGB values and the color-measurement values.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: June 25, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Miller Harry Schuck, III, Lei Zhang, Etienne Gregoire Grossmann, Nukul Sanjay Shah, Ohad Zohar, Robert Zito, Nicholas Ihle Morley, Jason Schaefer, Zhiheng Jia, Eric C. Browy, Marshall Charles Capps, Kazunori Tanaka, Grace Vesom, John Monos
  • Patent number: 12020381
    Abstract: A method performed by an augmented reality (AR) system includes receiving a command that is input by the user through the AR system. The augmented reality (AR) system includes a hardware processor and an AR display configured to present virtual content in an environment of a user. The command specifies a type of virtual object to be presented in the environment. In response to the command, virtual objects of the specified type are presented in the environment, and a presentation of at least one of the virtual objects is altered in response to detecting a movement of the user in proximity to the at least one virtual object.
    Type: Grant
    Filed: January 25, 2022
    Date of Patent: June 25, 2024
    Assignee: Magic Leap, Inc.
    Inventor: Edmund Graves Brown, IV
  • Patent number: 12020167
    Abstract: Systems and methods for gradient adversarial training of a neural network are disclosed. In one aspect of gradient adversarial training, an auxiliary neural network can be trained to classify a gradient tensor that is evaluated during backpropagation in a main neural network that provides a desired task output. The main neural network can serve as an adversary to the auxiliary network in addition to a standard task-based training procedure. The auxiliary neural network can pass an adversarial gradient signal back to the main neural network, which can use this signal to regularize the weight tensors in the main neural network. Gradient adversarial training of the neural network can provide improved gradient tensors in the main network. Gradient adversarial techniques can be used to train multitask networks, knowledge distillation networks, and adversarial defense networks.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: June 25, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Ayan Tuhinendu Sinha, Andrew Rabinovich, Zhao Chen, Vijay Badrinarayanan
  • Patent number: 12020608
    Abstract: Apparatus and methods for displaying an image by a rotating structure are provided. The rotating structure can comprise blades of a fan. The fan can be a cooling fan for an electronics device such as an augmented reality display. In some embodiments, the rotating structure comprises light sources that emit light to generate the image. The light sources can comprises light-field emitters. In other embodiments, the rotating structure is illuminated by an external (e.g., non-rotating) light source.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: June 25, 2024
    Assignee: MAGIC LEAP, INC.
    Inventors: Guillermo Padin Rohena, Ralph Remsburg, Adrian Kaehler, Evan Francis Rynk
  • Patent number: 12020391
    Abstract: Exemplary systems and methods for creating spatial contents in a mixed reality environment are disclosed. In an example, a location associated with a first user in a coordinate space is determined. A persistent virtual content is generated. The persistent virtual content is associated with the first user's associated location. The first user's associated location is determined and is associated with the persistent virtual content. A location of a second user at a second time in the coordinate space is determined. The persistent virtual content is presented to the second user via a display at a location in the coordinate space corresponding to the first user's associated location.
    Type: Grant
    Filed: May 26, 2023
    Date of Patent: June 25, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Tushar Arora, Scott Kramarich
  • Publication number: 20240203138
    Abstract: Methods, systems, and wearable extended reality devices for generating a floorplan of an indoor scene are provided. A room classification of a room and a wall classification of a wall for the room may be determined from an input image of the indoor scene. A floorplan may be determined based at least in part upon the room classification and the wall classification without constraining a total number of rooms in the indoor scene or a size of the room.
    Type: Application
    Filed: January 16, 2024
    Publication date: June 20, 2024
    Applicant: MAGIC LEAP, INC.
    Inventor: Ameya Pramod PHALAK
  • Patent number: 12014522
    Abstract: Embodiments provide image display systems and methods for extrinsic calibration of one or more cameras. More specifically, embodiments are directed to camera extrinsic calibration approach based on determining intersection of the rays projecting from the optical centers of the camera and a reference camera. Embodiments determine the relative position and orientation of one or more cameras given image(s) of the same target object from each camera by projecting measured image points into 3D rays in the real world. The extrinsic parameters are found by minimizing the expected 3D intersections of those rays with the known 3D target points.
    Type: Grant
    Filed: January 23, 2023
    Date of Patent: June 18, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Joseph W. Weber, Zhiheng Jia
  • Patent number: 12013979
    Abstract: A wearable display system for cross reality (XR) systems may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR functions being performed. For object tracking, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. Objects may be tracked based on asynchronously acquired events indicating changes within patches. Stereoscopic or other types of image information may be used when event-based object tacking yields an inadequate quality metric. Tracked objects may include a user's hand or a stationary object in the physical world, enabling calculation of the pose of the wearable display system and the wearer's head.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: June 18, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Martin Georg Zahnert, Alexander Ilic
  • Patent number: 12014464
    Abstract: Examples of systems and methods for a wearable system to automatically select or filter available user interface interactions or virtual objects are disclosed. The wearable system can select a group of virtual objects for user interaction based on contextual information associated with the user, the user's environment, physical or virtual objects in the user's environment, or the user's physiological or psychological state.
    Type: Grant
    Filed: April 6, 2022
    Date of Patent: June 18, 2024
    Assignee: MAGIC LEAP, INC.
    Inventors: James M. Powderly, Alysha Naples, Paul Armistead Hoover, Tucker Spofford
  • Patent number: 12013537
    Abstract: Techniques for operating an optical system are disclosed. World light may be linearly polarized along a first axis. When the optical system is operating in accordance with a first state, a polarization of the world light may be rotated by 90 degrees, the world light may be linearly polarized along a second axis perpendicular to the first axis, and zero net optical power may be applied to the world light. When the optical system is operating in accordance with a second state, virtual image light may be projected onto an eyepiece of the optical system, the world light and the virtual image light may be linearly polarized along the second axis, a polarization of the virtual image light may be rotated by 90 degrees, and non-zero net optical power may be applied to the virtual image light.
    Type: Grant
    Filed: July 8, 2021
    Date of Patent: June 18, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Ravi Kumar Komanduri, Lionel Ernest Edwin, Chulwoo Oh
  • Patent number: 12014455
    Abstract: Examples of systems and methods to facilitate audiovisual presence transitions of virtual objects such as virtual avatars in a mixed reality collaborative environment are disclosed. The systems and methods may be configured to produce different audiovisual presence transitions such as appearance, disappearance and reappearance of the virtual avatars. The virtual avatar audiovisual transitions may be further indicated by various visual and sound effects of the virtual avatars. The transitions may occur based on various colocation or decolocation scenarios.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: June 18, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Tomislav Pejsa, Koichi Mori, Richard St. Clair Bailey
  • Publication number: 20240193942
    Abstract: A pupil separation system includes an input surface and a central portion including one or more dichroic mirrors. The pupil separation system also includes a reflective surface disposed laterally with respect to the central portion and an output surface including a central surface operable to transmit light in a first wavelength range and a peripheral surface operable to transmit light in a second wavelength range different from the first wavelength range. The light in the second wavelength range is reflected by the one or more dichroic mirrors before being reflected by the reflective surface.
    Type: Application
    Filed: February 20, 2024
    Publication date: June 13, 2024
    Applicant: Magic Leap, Inc.
    Inventors: Ravi Kumar Komanduri, Chulwoo Oh, Kevin Messer, Ioannis Papadopoulos
  • Patent number: 12007564
    Abstract: An apparatus configured to be head-worn by a user, includes: a screen configured to present graphics for the user; a camera system configured to view an environment in which the user is located; and a processing unit coupled to the camera system, the processing unit configured to: obtain locations of features for an image of the environment, wherein the locations of the features are identified by a neural network; determine a region of interest for one of the features in the image, the region of interest having a size that is less than a size of the image; and perform a corner detection using a corner detection algorithm to identify a corner in the region of interest.
    Type: Grant
    Filed: May 11, 2023
    Date of Patent: June 11, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Anush Mohan, Guy Rosenthal, Adi Perry, Gilboa Sheveki
  • Patent number: 12008982
    Abstract: Systems and methods for providing accurate and independent control of reverberation properties are disclosed. In some embodiments, a system may include a reverberation processing system, a direct processing system, and a combiner. The reverberation processing system can include a reverb initial power (RIP) control system and a reverberator. The RIP control system can include a reverb initial gain (RIG) and a RIP corrector. The RIG can be configured to apply a RIG value to the input signal, and the RIP corrector can be configured to apply a RIP correction factor to the signal from the RIG. The reverberator can be configured to apply reverberation effects to the signal from the RIP control system. In some embodiments, one or more values and/or correction factors can be calculated and applied such that the signal output from a component in the reverberation processing system is normalized to a predetermined value (e.g., unity (1.0)).
    Type: Grant
    Filed: April 6, 2023
    Date of Patent: June 11, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Remi Samuel Audfray, Jean-Marc Jot, Samuel Charles Dicker
  • Patent number: 12008686
    Abstract: An augmented reality device may communicate with a map server via an API interface to provide mapping data that may be implemented into a canonical map, and may also receive map data from the map server. A visualization of map quality, including quality indicators for multiple cells of the environment, may be provided to the user as an overlay to the current real-world environment seen through the AR device. These visualizations may include, for example, a map quality minimap and/or a map quality overlay. The visualizations provide guidance to the user that allows more efficient updates to the map, thereby improving map quality and localization of users into the map.
    Type: Grant
    Filed: November 21, 2022
    Date of Patent: June 11, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Griffith Buckley Hazen, Amy DeDonato, Ali Shahrokni, Ben Weisbih, Vinayram Balakumar
  • Patent number: D1032682
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: June 25, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Shigeru Natsume, Sebastian Gonzalo Arrieta Gunther, Haney Awad, Bryson John Green Mercer