Patents Assigned to Magic Leap, Inc.
-
Patent number: 11899200Abstract: An image display system includes an optical subsystem configured to emit a modulated light beam, and a scanning mirror for generating a reflected light beam that is scanned according to randomly selected or pseudo-randomly selected scan patterns to generate multiple image fields of a multiple interlaced scan image. A plurality of different scan patterns can be cycled through, randomly or pseudo-randomly selected, for the different image fields to reduce artifacts that may be observed while viewing a projected image.Type: GrantFiled: April 16, 2021Date of Patent: February 13, 2024Assignee: Magic Leap, Inc.Inventors: Lionel Ernest Edwin, Bjorn Nicolaas Servatius Vlaskamp, Samuel A. Miller, Aaron M. Clarke
-
Patent number: 11900547Abstract: A cross reality system enables portable devices to access stored maps and efficiently and accurately render virtual content specified in relation to those maps. The system may process images acquired with a portable device to quickly and accurately localize the portable device to the persisted maps by constraining the result of localization based on the estimated direction of gravity of a persisted map and the coordinate frame in which data in a localization request is posed. The system may actively align the data in the localization request with an estimated direction of gravity during the localization processing, and/or a portable device may establish a coordinate frame in which the data in the localization request is posed aligned with an estimated direction of gravity such that the subsequently acquired data for inclusion in a localization request, when posed in that coordinate frame, is passively aligned with the estimated direction of gravity.Type: GrantFiled: April 28, 2021Date of Patent: February 13, 2024Assignee: Magic Leap, Inc.Inventors: Javier Victorio Gomez Gonzalez, Miguel Andres Granados Velasquez, Mukta Prasad, Dominik Michael Kasper, Eran Guendelman, Keng-Sheng Lin
-
Patent number: 11898836Abstract: Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.Type: GrantFiled: November 28, 2022Date of Patent: February 13, 2024Assignee: Magic Leap, Inc.Inventors: Ivan Li Chuen Yeoh, Lionel Ernest Edwin, Samuel A. Miller
-
Patent number: 11901974Abstract: A multiple-input, multiple-output (MIMO) transceiver comprises a plurality of RF chains, a plurality of antennas, a plurality of switching components, and control circuitry operatively coupled to the plurality of switching components. In some examples, a total quantity of RF chains included in the plurality of RF chains is equal to a first value, and a total quantity of antennas included in the plurality of antennas is equal to a second value that is less than the first value.Type: GrantFiled: January 5, 2023Date of Patent: February 13, 2024Assignee: Magic Leap, Inc.Inventor: Shurhabeel Zamir Seyed
-
Patent number: 11902677Abstract: An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The augmented reality system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object and selectively output imaging information for that region. The region may be updated dynamically as the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an augmented reality scene can be developed. The amount of data may be further reduced by configuring the image sensor to output indications of pixels for which the measured intensity of incident light changes.Type: GrantFiled: October 30, 2019Date of Patent: February 13, 2024Assignee: Magic Leap, Inc.Inventors: Martin Georg Zahnert, Alexander Ilic, Erik Fonseka
-
Patent number: 11900912Abstract: Disclosed herein are systems and methods for presenting an audio signal associated with presentation of a virtual object colliding with a surface. The virtual object and the surface may be associated with a mixed reality environment. Generation of the audio signal may be based on at least one of an audio stream from a microphone and a video stream form a sensor. In some embodiments, the collision between the virtual object and the surface is associated with a footstep on the surface.Type: GrantFiled: March 16, 2023Date of Patent: February 13, 2024Assignee: Magic Leap, Inc.Inventors: Anastasia Andreyevna Tajik, Colby Nelson Leider, Omer Perry
-
Patent number: 11902377Abstract: Disclosed are methods and systems for a scripting framework and implementations therefor for mixed reality software applications of heterogeneous systems. These methods or systems create a mixed-reality software application that executes across heterogeneous platforms on a server-side instance of a scripting framework and manage a change in the mixed-reality software application using the server-side instance of the scripting framework. Moreover, the change in the mixed-reality software application using a client-side instance of the scripting framework; and the mixed-reality software application may be interactively executed on a mixed-reality device.Type: GrantFiled: July 15, 2022Date of Patent: February 13, 2024Assignee: Magic Leap, Inc.Inventors: Nikolay Ivanov Grozdanov, Konrad Piascik, Leonid Zolotarev, Timothy Dean Caswell
-
Publication number: 20240046903Abstract: An apparatus configured to be head-worn by a user, includes: a transparent screen configured to allow the user to see therethrough; a sensor system configured to sense a characteristic of a physical object in an environment in which the user is located; and a processing unit coupled to the sensor system, the processing unit configured to: cause the screen to display a user-controllable object, and cause the screen to display an image of a feature that is resulted from a virtual interaction between the user-controllable object and the physical object, so that the feature will appear to be a part of the physical object in the environment or appear to be emanating from the physical object.Type: ApplicationFiled: October 19, 2023Publication date: February 8, 2024Applicant: MAGIC LEAP, INC.Inventors: David Charles LUNDMARK, Gregory Michael BROADMORE
-
Publication number: 20240046433Abstract: A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. The display controller includes memory for storing optical distortion correction information, and one or more processing elements to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information.Type: ApplicationFiled: October 16, 2023Publication date: February 8, 2024Applicant: MAGIC LEAP, INC.Inventors: Jose Felix Rodriguez, Ricardo Martinez Perez
-
Patent number: 11892636Abstract: Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.Type: GrantFiled: July 15, 2021Date of Patent: February 6, 2024Assignee: MAGIC LEAP, INC.Inventors: Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Samuel A. Miller, Edwin Joseph Selker, Adam Charles Carlson, Bjorn Nicolaas Servatius Vlaskamp, Paul M. Greco
-
Patent number: 11892648Abstract: Expandable band systems for wearable devices, such as spatial computing headsets, are provided which have flexible and conformable form factors that enable users to reliably to secure such wearable devices in place. Further, in the context of spatial computing headsets with an optics assembly supported by opposing temple arms, the expandable band systems provide protection against over-extension of the temple arms or extreme deflections that may otherwise arise from undesirable torsional loading of the temple arms.Type: GrantFiled: February 22, 2023Date of Patent: February 6, 2024Assignee: Magic Leap, Inc.Inventor: Robert Coleman Skelton
-
Patent number: 11895483Abstract: A method of presenting an audio signal to a user of a mixed reality environment is disclosed. According to examples of the method, an audio event associated with the mixed reality environment is detected. The audio event is associated with a first audio signal. A location of the user with respect to the mixed reality environment is determined. An acoustic region associated with the location of the user is identified. A first acoustic parameter associated with the first acoustic region is determined. A transfer function is determined using the first acoustic parameter. The transfer function is applied to the first audio signal to produce a second audio signal, which is then presented to the user.Type: GrantFiled: November 4, 2020Date of Patent: February 6, 2024Assignee: Magic Leap, Inc.Inventors: Brian Lloyd Schmidt, Jehangir Tajik, Jean-Marc Jot
-
Patent number: 11894400Abstract: An imaging system includes an illumination unit and a sensor unit disposed on a printed circuit board. The illumination unit includes a diode laser source inside an illumination housing. The sensor unit includes an image sensor having a pixel array and a lens barrel mounted on the image sensor with an adhesive, and an optical fiber coupled between the illumination housing and image sensor. The optical fiber is configured to collect a portion of light from the interior of the illumination housing that is emitted by the diode laser source and direct the portion of light to a corner of the pixel array of the image sensor that is located outside the lens barrel.Type: GrantFiled: July 14, 2022Date of Patent: February 6, 2024Assignee: Magic Leap, Inc.Inventors: Erez Tadmor, David Cohen, Giora Yahav
-
Patent number: 11893789Abstract: A deep neural network provides real-time pose estimation by combining two custom deep neural networks, a location classifier and an ID classifier, with a pose estimation algorithm to achieve a 6D0F location of a fiducial marker. The locations may be further refined into subpixel coordinates using another deep neural network. The networks may be trained using a combination of auto-labeled videos of the target marker, synthetic subpixel corner data, and/or extreme data augmentation. The deep neural network provides improved pose estimations particularly in challenging low-light, high-motion, and/or high-blur scenarios.Type: GrantFiled: November 14, 2019Date of Patent: February 6, 2024Assignee: Magic Leap, Inc.Inventors: Danying Hu, Daniel DeTone, Tomasz Jan Malisiewicz
-
Patent number: 11885871Abstract: An augmented reality device has a radar system that generates radar maps of locations of real world objects. An inertial measurement unit detects measurement values such as acceleration, gravitational force and inclination ranges. The values from the measurement unit drift over time. The radar maps are processed to determine fingerprints and the fingerprints are combined with the values from the measurement unit to store a pose estimate. Pose estimates at different times are compared to determine drift of the measurement unit. A measurement unit filter is adjusted to correct for the drift.Type: GrantFiled: May 24, 2019Date of Patent: January 30, 2024Assignee: Magic Leap, Inc.Inventors: Alexander Ilic, Martin Georg Zahnert, Koon Keong Shee
-
Patent number: 11886631Abstract: Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.Type: GrantFiled: August 22, 2022Date of Patent: January 30, 2024Assignee: Magic Leap, Inc.Inventor: Eric C. Browy
-
Patent number: 11883104Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.Type: GrantFiled: September 2, 2021Date of Patent: January 30, 2024Assignee: Magic Leap, Inc.Inventors: Samuel A. Miller, Lomesh Agarwal, Lionel Ernest Edwin, Ivan Li Chuen Yeoh, Daniel Farmer, Sergey Fyodorovich Prokushkin, Yonatan Munk, Edwin Joseph Selker, Bradley Vincent Stuart, Jeffrey Scott Sommers
-
Patent number: 11889209Abstract: A wearable display system including multiple cameras and a processor is disclosed. A greyscale camera and a color camera can be arranged to provide a central view field associated with both cameras and a peripheral view field associated with one of the two cameras. One or more of the two cameras may be a plenoptic camera. The wearable display system may acquire light field information using the at least one plenoptic camera and create a world model using the first light field information and first depth information stereoscopically determined from images acquired by the greyscale camera and the color camera. The wearable display system can track head pose using the at least one plenoptic camera and the world model. The wearable display system can track objects in the central view field and the peripheral view fields using the one or two plenoptic cameras, when the objects satisfy a depth criterion.Type: GrantFiled: February 7, 2020Date of Patent: January 30, 2024Assignee: Magic Leap, Inc.Inventors: Martin Georg Zahnert, Alexander Ilic, Miguel Andres Granados Velasquez, Javier Victorio Gomez Gonzalez
-
Patent number: 11885969Abstract: An example head-mounted display device includes a plurality of optical elements in optical communication. The optical elements are configured to project an image in a field of view of a user wearing the head-mounted display device. A first optical element is configured to receive light from a second optical element. The first optical element defines a grating at along a periphery of the first optical element. The grating includes a plurality of protrusions extending from a base portion of the first optical element. The protrusions include a first material having a first optical dispersion profile for visible wavelengths of light. The grating also includes a second material disposed between at least some of the plurality of protrusions along the base portion of the first optical element. The second material has a second optical dispersion profile for visible wavelengths of light.Type: GrantFiled: March 10, 2022Date of Patent: January 30, 2024Assignee: Magic Leap, Inc.Inventors: Pierre St. Hilaire, Mohammadreza Khorasaninejad, Dianmin Lin
-
Patent number: D1013007Type: GrantFiled: December 16, 2019Date of Patent: January 30, 2024Assignee: Magic Leap, Inc.Inventors: Shigeru Natsume, Sebastian Gonzalo Arrieta Gunther, Haney Awad, Bryson John Green Mercer