Patents by Inventor Robert Blake Taylor

Robert Blake Taylor has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220309621
    Abstract: A method for displaying a three dimensional (“3D”) image includes rendering a frame of 3D image data. The method also includes analyzing the frame of 3D image data to generate best known depth data. The method further includes using the best known depth data to segment the 3D image data into near and far frames of two dimensional (“2D”) image data corresponding to near and far depths respectively. Moreover, the method includes displaying near and far 2D image frames corresponding to the near and far frames of 2D image data at near and far depths to a user respectively.
    Type: Application
    Filed: June 6, 2022
    Publication date: September 29, 2022
    Applicant: MAGIC LEAP, INC.
    Inventor: Robert Blake TAYLOR
  • Patent number: 11423626
    Abstract: A computer implemented method for warping virtual content from two sources includes a first source generating first virtual content based on a first pose. The method also includes a second source generating second virtual content based on a second pose. The method further includes a compositor processing the first and second virtual content in a single pass. Processing the first and second virtual content includes generating warped first virtual content by warping the first virtual content based on a third pose, generating warped second virtual content by warping the second virtual content based on the third pose, and generating output content by compositing the warped first and second virtual content.
    Type: Grant
    Filed: February 18, 2021
    Date of Patent: August 23, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Reza Nourai, Robert Blake Taylor
  • Patent number: 11417065
    Abstract: Methods and systems are provided for a reprojection engine for augmented-reality devices. The augmented-reality device projects virtual content within a real-world environment. The augmented-reality device tracks a six degrees of freedom headpose of the augmented-reality device, depth information of the virtual content, motion vectors that correspond to movement of the virtual content, and a color buffer for a reprojection engine. The reprojection engine generates a reprojection of the virtual content defined by an extrapolation of a first frame using the headpose, the depth information, motion vectors, and the color surface data structure. The reprojected virtual content continues to appear as if positioned with the real-world environment regardless of changes in the headpose of the augmented-reality device or motion of the virtual content.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: August 16, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Robert Blake Taylor, Gilles Cadet
  • Patent number: 11410269
    Abstract: A computer implemented method for warping virtual content includes generating warped virtual content by transforming source virtual content. The method also includes determining whether a memory location corresponding to an X, Y location of the warped virtual content in an output frame of reference is occupied by pre-existing virtual content. The method further includes storing the warped virtual content in the memory location if the memory location is not occupied. Moreover, the method includes comparing respective Z locations of the warped virtual content and the pre-existing virtual content to identify virtual content with a Z location closer to a viewing location if the memory location is occupied. The method also includes storing the warped virtual content in the memory location corresponding to the X, Y location if a Z location of warped virtual content is closer to the viewing location than a pre-existing Z location of pre-existing virtual content.
    Type: Grant
    Filed: November 6, 2020
    Date of Patent: August 9, 2022
    Inventors: Reza Nourai, Robert Blake Taylor
  • Publication number: 20220245758
    Abstract: A computer implemented method for warping virtual content includes receiving rendered virtual content data, the rendered virtual content data including a far depth. The method also includes receiving movement data indicating a user movement in a direction orthogonal to an optical axis. The method further includes generating warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data.
    Type: Application
    Filed: April 14, 2022
    Publication date: August 4, 2022
    Applicant: Magic Leap, Inc.
    Inventors: Reza NOURAI, Robert Blake TAYLOR, Michael Harold LIEBENOW, Gilles CADET
  • Patent number: 11386529
    Abstract: A method for displaying a three dimensional (“3D”) image includes rendering a frame of 3D image data. The method also includes analyzing the frame of 3D image data to generate best known depth data. The method further includes using the best known depth data to segment the 3D image data into near and far frames of two dimensional (“2D”) image data corresponding to near and far depths respectively. Moreover, the method includes displaying near and far 2D image frames corresponding to the near and far frames of 2D image data at near and far depths to a user respectively.
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: July 12, 2022
    Assignee: Magic Leap, Inc.
    Inventor: Robert Blake Taylor
  • Patent number: 11386629
    Abstract: An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: July 12, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Jeremy Dwayne Miranda, Rafael Domingos Torres, Daniel Olshansky, Anush Mohan, Robert Blake Taylor, Samuel A. Miller, Jehangir Tajik, Ashwin Swaminathan, Lomesh Agarwal, Ali Shahrokni, Prateek Singhal, Joel David Holder, Xuan Zhao, Siddharth Choudhary, Helder Toshiro Suzuki, Hirai Honar Barot, Eran Guendelman, Michael Harold Liebenow, Christian Ivan Robert Moore
  • Patent number: 11379948
    Abstract: A computer implemented method for warping virtual content includes receiving rendered virtual content data, the rendered virtual content data including a far depth. The method also includes receiving movement data indicating a user movement in a direction orthogonal to an optical axis. The method further includes generating warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data.
    Type: Grant
    Filed: July 22, 2019
    Date of Patent: July 5, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Reza Nourai, Robert Blake Taylor, Michael Harold Liebenow, Gilles Cadet
  • Patent number: 11380068
    Abstract: Disclosed is an improved approach for generated recordings from augmented reality systems from the perspective of a camera within the system. Instead of re-using rendered virtual content from the perspective of the user's eyes for AR recordings, additional virtual content is rendered from an additional perspective specifically for the AR recording. That additional virtual content is combined with image frames generated by a camera to form the AR recording.
    Type: Grant
    Filed: October 27, 2020
    Date of Patent: July 5, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Reza Nourai, Michael Harold Liebenow, Robert Blake Taylor, Robert Wyatt
  • Publication number: 20220188971
    Abstract: A computer implemented method for warping multi-field color virtual content for sequential projection includes obtaining first and second color fields having different first and second colors. The method also includes determining a first time for projection of a warped first color field. The method further includes determining a second time for projection of a warped second color field. Moreover, the method includes predicting a first pose at the first time and predicting a second pose at the second time. In addition, the method includes generating the warped first color field by warping the first color field based on the first pose. The method also includes generating the warped second color field by warping the second color field based on the second pose.
    Type: Application
    Filed: March 1, 2022
    Publication date: June 16, 2022
    Applicant: MAGIC LEAP, INC.
    Inventors: Michael Harold LIEBENOW, Reza NOURAI, Robert Blake TAYLOR, Fahri YARAS
  • Patent number: 11361474
    Abstract: A method for calibrating a wearable device includes displaying an image with a plurality of pixels for each of three primary colors using the wearable device, and determining RGB and XYZ values for each of the plurality of pixels. The method includes selecting a subset of the plurality of pixels to form a group of grid points, and dividing the image into a group of tile regions, with each tile region including a grid point. Grid XYZ values are determined for each grid point, based on averaging XYZ values of all pixels in a corresponding tile region, and a grid RGB-to-XYZ conversion matrix is determined for each grid point. The method also includes determining a correction matrix for each grid point by multiplying an inverse of the grid RGB-to-XYZ conversion matrix for the grid with an sRGB-to-XYZ conversion matrix.
    Type: Grant
    Filed: August 2, 2019
    Date of Patent: June 14, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Kazunori Tanaka, Lei Zhang, Etienne Gregoire Grossmann, Marshall Charles Capps, Robert Blake Taylor
  • Publication number: 20220171190
    Abstract: A wearable display system includes a light projection system having one or more emissive microdisplays, e.g., micro-LED displays. The light projection system projects time-multiplexed left-eye and right-eye images, which pass through an optical router having a polarizer and a switchable polarization rotator. The optical router is synchronized with the generation of images by the light projection system to impart a first polarization to left-eye images and a second different polarization to right-eye images. Light of the first polarization is incoupled into an eyepiece having one or more waveguides for outputting light to one of the left and right eyes, while light of the second polarization may be incoupled into another eyepiece having one or more waveguides for outputting light to the other of the left and right eyes. Each eyepiece may output incoupled light with variable amounts of wavefront divergence, to elicit different accommodation responses from the user's eyes.
    Type: Application
    Filed: December 20, 2019
    Publication date: June 2, 2022
    Inventors: Jahja I. Trisnadi, Hyunsun Chung, Lionel Ernest Edwin, Howard Russell Cohen, Robert Blake Taylor, Andrew Ian Russell, Kevin Richard Curtis, Clinton Carlisle
  • Patent number: 11315214
    Abstract: A computer implemented method for warping multi-field color virtual content for sequential projection includes obtaining first and second color fields having different first and second colors. The method also includes determining a first time for projection of a warped first color field. The method further includes determining a second time for projection of a warped second color field. Moreover, the method includes predicting a first pose at the first time and predicting a second pose at the second time. In addition, the method includes generating the warped first color field by warping the first color field based on the first pose. The method also includes generating the warped second color field by warping the second color field based on the second pose.
    Type: Grant
    Filed: July 23, 2020
    Date of Patent: April 26, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Michael Harold Liebenow, Reza Nourai, Robert Blake Taylor, Fahri Yaras
  • Patent number: 11288858
    Abstract: Disclosed is an approach for constructing a new frame using rendered content and non-rendered content from a previous perspective. Points of visible surfaces of a first set of objects from a first perspective are rendered. Both rendered content and non-rendered content from the first perspective are stored. The new frame from the second perspective is generated using the rendered content and the non-rendered content from the first perspective.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: March 29, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Reza Nourai, Robert Blake Taylor, Michael Harold Liebenow
  • Publication number: 20220092852
    Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.
    Type: Application
    Filed: December 3, 2021
    Publication date: March 24, 2022
    Applicant: Magic Leap, Inc.
    Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nicholas Atkinson Kramer, Kenneth William Tossell, Christian Ivan Robert Moore
  • Publication number: 20220092863
    Abstract: A method in a virtual, augmented, or mixed reality system includes a GPU determining/detecting an absence of image data. The method also includes shutting down a portion/component/function of the GPU. The method further includes shutting down a communication link between the GPU and a DB. Moreover, the method includes shutting down a portion/component/function of the DB. In addition, the method includes shutting down a communication link between the DB and a display panel. The further also includes shutting down a portion/component/function of the display panel.
    Type: Application
    Filed: November 30, 2021
    Publication date: March 24, 2022
    Applicant: MAGIC LEAP, INC.
    Inventors: Jose Felix RODRIGUEZ, Ricardo Martinez PEREZ, Reza NOURAI, Robert Blake TAYLOR
  • Publication number: 20220050298
    Abstract: A wearable display system includes one or more emissive micro-displays, e.g., micro-LED displays. The micro-displays may be monochrome micro-displays or full-color micro-displays. The micro-displays may include arrays of light emitters. Light collimators may be utilized to narrow the angular emission profile of light emitted by the light emitters. Where a plurality of emissive micro-displays is utilized, the micro-displays may be positioned at different sides of an optical combiner, e.g., an X-cube prism which receives light rays from different micro-displays and outputs the light rays from the same face of the cube. The optical combiner directs the light to projection optics, which outputs the light to an eyepiece that relays the light to a user's eye. The eyepiece may output the light to the user's eye with different amounts of wavefront divergence, to place virtual content on different depth planes.
    Type: Application
    Filed: December 20, 2019
    Publication date: February 17, 2022
    Inventors: Michael Anthony Klug, Evgeni Poliakov, Jahja I. Trisnadi, Hyunsun Chung, Lionel Ernest Edwin, Howard Russell Cohen, Robert Blake Taylor, Andrew Ian Russell, Kevin Richard Curtis, Clinton Carlisle
  • Patent number: 11227435
    Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: January 18, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Anush Mohan, Rafael Domingos Torres, Daniel Olshansky, Samuel A. Miller, Jehangir Tajik, Joel David Holder, Jeremy Dwayne Miranda, Robert Blake Taylor, Ashwin Swaminathan, Lomesh Agarwal, Hiral Honar Barot, Helder Toshiro Suzuki, Ali Shahrokni, Eran Guendelman, Prateek Singhal, Xuan Zhao, Siddharth Choudhary, Nicholas Atkinson Kramer, Kenneth William Tossell, Christian Ivan Robert Moore
  • Patent number: 11217025
    Abstract: A method in a virtual, augmented, or mixed reality system includes a GPU determining/detecting an absence of image data. The method also includes shutting down a portion/component/function of the GPU. The method further includes shutting down a communication link between the GPU and a DB. Moreover, the method includes shutting down a portion/component/function of the DB. In addition, the method includes shutting down a communication link between the DB and a display panel. The further also includes shutting down a portion/component/function of the display panel.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: January 4, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Jose Felix Rodriguez, Ricardo Martinez Perez, Reza Nourai, Robert Blake Taylor
  • Publication number: 20210407365
    Abstract: Disclosed are techniques for improving the color uniformity of a display of a display device. A plurality of images of the display are captured using an image capture device. The plurality of images are captured in a color space, with each image corresponding to one of a plurality of color channels. A global white balance is performed to the plurality of images to obtain a plurality of normalized images. A local white balance is performed to the plurality of normalized images to obtain a plurality of correction matrices. Performing the local white balance includes defining a set of weighting factors based on a figure of merit and computing a plurality of weighted images based on the plurality of normalized images and the set of weighting factors. The plurality of correction matrices are computed based on the plurality of weighted images.
    Type: Application
    Filed: June 25, 2021
    Publication date: December 30, 2021
    Applicant: Magic Leap, Inc.
    Inventors: Kevin Messer, Miller Harry Schuck, III, Nicholas Ihle Morley, Po-Kang Huang, Nukul Sanjay Shah, Marshall Charles Capps, Robert Blake Taylor