Patents by Inventor Xiaolin Wei

Xiaolin Wei has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10937246
    Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: March 2, 2021
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20210056763
    Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.
    Type: Application
    Filed: October 26, 2020
    Publication date: February 25, 2021
    Applicant: Magic Leap, Inc.
    Inventors: David Geoffrey MOLYNEAUX, Frank Thomas STEINBRÜCKER, Zhongle WU, Xiaolin WEI, Jianyuan MIN, Yifu ZHANG
  • Patent number: 10902679
    Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: January 26, 2021
    Assignee: MAGIC LEAP, INC.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20200342677
    Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.
    Type: Application
    Filed: July 9, 2020
    Publication date: October 29, 2020
    Applicant: Magic Leap, Inc.
    Inventors: David Geoffrey MOLYNEAUX, Frank Thomas STEINBRÜCKER, Zhongle WU, Xiaolin WEI, Jianyuan MIN, Yifu ZHANG
  • Publication number: 20200312023
    Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.
    Type: Application
    Filed: June 15, 2020
    Publication date: October 1, 2020
    Applicant: Magic Leap, Inc.
    Inventors: Jianyuan Min, Xiaolin Wei
  • Publication number: 20200284478
    Abstract: A method and system for circulating combined cooling, heating and power with a jet cooling device. An outlet of a working medium pump which is used to pressurize liquid working medium is connected to an inlet of a heater. An outlet of the heater is connected to an inlet of an expansion component. An outlet of the expansion component is connected to an inlet of a cooler. An outlet of the cooler is connected to a primary inlet of a jetting device. Primary outlets of the jetting device are respectively connected to an inlet of the working medium pump and an inlet of a throttle valve. An outlet of the throttle valve is connected to an inlet of an evaporator. An outlet of the evaporator and a gaseous outlet of the jetting device are both connected to an inlet of a pressurization component.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Applicant: Institute of mechanics, Chinese academy of sciences
    Inventors: LiSheng Pan, XiaoLin Wei, Yuan Yao, WeiXiu Shi
  • Patent number: 10726623
    Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.
    Type: Grant
    Filed: October 9, 2018
    Date of Patent: July 28, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Jianyuan Min, Xiaolin Wei
  • Patent number: 10713852
    Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: July 14, 2020
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrucker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20200202633
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Application
    Filed: March 4, 2020
    Publication date: June 25, 2020
    Applicant: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20200131504
    Abstract: Provided is a plasmid library comprising a DNA insertion site and two barcode sequences located upstream and downstream of the site. The combinations of two barcode sequences of any two plasmids selected from the library are different. Also provided is a method for high-throughput paired-end sequencing of an inserted DNA using the plasmid library.
    Type: Application
    Filed: March 24, 2015
    Publication date: April 30, 2020
    Inventors: Xiao LIU, Zhichao XU, Xiaolin WEI, Zhongyi WU, Jue RUAN
  • Patent number: 10636219
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: April 28, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20200126298
    Abstract: A method for forming a reconstructed 3D mesh includes receiving a set of captured depth maps associated with a scene, performing an initial camera pose alignment associated with the set of captured depth maps, and overlaying the set of captured depth maps in a reference frame. The method also includes detecting one or more shapes in the overlaid set of captured depth maps and updating the initial camera pose alignment to provide a shape-aware camera pose alignment. The method further includes performing shape-aware volumetric fusion and forming the reconstructed 3D mesh associated with the scene.
    Type: Application
    Filed: December 18, 2019
    Publication date: April 23, 2020
    Applicant: Magic Leap, Inc.
    Inventors: Xiaolin Wei, Yifu Zhang
  • Patent number: 10559127
    Abstract: A method for forming a reconstructed 3D mesh includes receiving a set of captured depth maps associated with a scene, performing an initial camera pose alignment associated with the set of captured depth maps, and overlaying the set of captured depth maps in a reference frame. The method also includes detecting one or more shapes in the overlaid set of captured depth maps and updating the initial camera pose alignment to provide a shape-aware camera pose alignment. The method further includes performing shape-aware volumetric fusion and forming the reconstructed 3D mesh associated with the scene.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: February 11, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Xiaolin Wei, Yifu Zhang
  • Publication number: 20190253674
    Abstract: A method for refining poses includes receiving a plurality of poses and performing volumetric reconstruction for the plurality of poses to produce a global geometry. The method also includes refining each pose of the plurality of poses with respect to the global geometry to produce a plurality of refined poses.
    Type: Application
    Filed: April 17, 2019
    Publication date: August 15, 2019
    Applicant: Magic Leap, Inc.
    Inventor: Xiaolin Wei
  • Publication number: 20190197777
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Application
    Filed: December 21, 2018
    Publication date: June 27, 2019
    Applicant: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20190197786
    Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.
    Type: Application
    Filed: December 21, 2018
    Publication date: June 27, 2019
    Applicant: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20190197765
    Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.
    Type: Application
    Filed: December 21, 2018
    Publication date: June 27, 2019
    Applicant: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20190197774
    Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.
    Type: Application
    Filed: December 21, 2018
    Publication date: June 27, 2019
    Applicant: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 10313639
    Abstract: A method of determining camera poses includes capturing a plurality of image frames using a camera, computing relative poses between each set of image frame pairs to provide a relative pose set and an uncategorized relative pose set, and detecting and removing miscategorized relative poses to provide a remaining relative pose set. The method also includes determining global poses using the remaining relative pose set and computing extended relative poses for at least a portion of the miscategorized relative poses and at least a portion of the uncategorized relative pose set to provide an extended relative pose set and an extended uncategorized relative pose set. The method further includes detecting and removing extended miscategorized relative poses to provide a remaining extended relative pose set and determining updated global poses for the plurality of image frames using the remaining relative pose set and the remaining extended relative pose set.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: June 4, 2019
    Assignee: Magic Leap, Inc.
    Inventor: Xiaolin Wei
  • Patent number: 10249087
    Abstract: A method of atlas packing includes receiving a three-dimensional (3D) mesh that includes a plurality of triangles representing surfaces of one or more objects; for each respective triangle, determining a normal of the respective triangle, and categorizing the respective triangle into one of six directions along positive and negative of x-, y-, and z-directions; categorizing triangles in each respective direction into one or more layers orthogonal to the respective direction; for each respective layer, identifying one or more connected components; projecting each respective connected component onto a plane orthogonal to the respective direction to obtain a corresponding projected two-dimensional (2D) connected component; cutting the projected 2D connected component into one or more sub-components; packing the bounding boxes of all sub-components into one or more atlases; and for each respective triangle of each sub-component, copying a texture of a corresponding triangle of the 3D mesh to the respective triang
    Type: Grant
    Filed: January 23, 2017
    Date of Patent: April 2, 2019
    Assignee: MAGIC LEAP, INC.
    Inventors: Xiaolin Wei, Yifu Zhang