Patents by Inventor Xiaolin Wei
Xiaolin Wei has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20200312023Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.Type: ApplicationFiled: June 15, 2020Publication date: October 1, 2020Applicant: Magic Leap, Inc.Inventors: Jianyuan Min, Xiaolin Wei
-
Publication number: 20200284478Abstract: A method and system for circulating combined cooling, heating and power with a jet cooling device. An outlet of a working medium pump which is used to pressurize liquid working medium is connected to an inlet of a heater. An outlet of the heater is connected to an inlet of an expansion component. An outlet of the expansion component is connected to an inlet of a cooler. An outlet of the cooler is connected to a primary inlet of a jetting device. Primary outlets of the jetting device are respectively connected to an inlet of the working medium pump and an inlet of a throttle valve. An outlet of the throttle valve is connected to an inlet of an evaporator. An outlet of the evaporator and a gaseous outlet of the jetting device are both connected to an inlet of a pressurization component.Type: ApplicationFiled: March 5, 2020Publication date: September 10, 2020Applicant: Institute of mechanics, Chinese academy of sciencesInventors: LiSheng Pan, XiaoLin Wei, Yuan Yao, WeiXiu Shi
-
Patent number: 10726623Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.Type: GrantFiled: October 9, 2018Date of Patent: July 28, 2020Assignee: Magic Leap, Inc.Inventors: Jianyuan Min, Xiaolin Wei
-
Patent number: 10713852Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.Type: GrantFiled: December 21, 2018Date of Patent: July 14, 2020Assignee: Magic Leap, Inc.Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrucker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
-
Publication number: 20200202633Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.Type: ApplicationFiled: March 4, 2020Publication date: June 25, 2020Applicant: Magic Leap, Inc.Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
-
Publication number: 20200131504Abstract: Provided is a plasmid library comprising a DNA insertion site and two barcode sequences located upstream and downstream of the site. The combinations of two barcode sequences of any two plasmids selected from the library are different. Also provided is a method for high-throughput paired-end sequencing of an inserted DNA using the plasmid library.Type: ApplicationFiled: March 24, 2015Publication date: April 30, 2020Inventors: Xiao LIU, Zhichao XU, Xiaolin WEI, Zhongyi WU, Jue RUAN
-
Patent number: 10636219Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.Type: GrantFiled: December 21, 2018Date of Patent: April 28, 2020Assignee: Magic Leap, Inc.Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
-
Publication number: 20200126298Abstract: A method for forming a reconstructed 3D mesh includes receiving a set of captured depth maps associated with a scene, performing an initial camera pose alignment associated with the set of captured depth maps, and overlaying the set of captured depth maps in a reference frame. The method also includes detecting one or more shapes in the overlaid set of captured depth maps and updating the initial camera pose alignment to provide a shape-aware camera pose alignment. The method further includes performing shape-aware volumetric fusion and forming the reconstructed 3D mesh associated with the scene.Type: ApplicationFiled: December 18, 2019Publication date: April 23, 2020Applicant: Magic Leap, Inc.Inventors: Xiaolin Wei, Yifu Zhang
-
Patent number: 10559127Abstract: A method for forming a reconstructed 3D mesh includes receiving a set of captured depth maps associated with a scene, performing an initial camera pose alignment associated with the set of captured depth maps, and overlaying the set of captured depth maps in a reference frame. The method also includes detecting one or more shapes in the overlaid set of captured depth maps and updating the initial camera pose alignment to provide a shape-aware camera pose alignment. The method further includes performing shape-aware volumetric fusion and forming the reconstructed 3D mesh associated with the scene.Type: GrantFiled: September 23, 2016Date of Patent: February 11, 2020Assignee: Magic Leap, Inc.Inventors: Xiaolin Wei, Yifu Zhang
-
Publication number: 20190253674Abstract: A method for refining poses includes receiving a plurality of poses and performing volumetric reconstruction for the plurality of poses to produce a global geometry. The method also includes refining each pose of the plurality of poses with respect to the global geometry to produce a plurality of refined poses.Type: ApplicationFiled: April 17, 2019Publication date: August 15, 2019Applicant: Magic Leap, Inc.Inventor: Xiaolin Wei
-
Publication number: 20190197786Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.Type: ApplicationFiled: December 21, 2018Publication date: June 27, 2019Applicant: Magic Leap, Inc.Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
-
Publication number: 20190197765Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.Type: ApplicationFiled: December 21, 2018Publication date: June 27, 2019Applicant: Magic Leap, Inc.Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
-
Publication number: 20190197777Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.Type: ApplicationFiled: December 21, 2018Publication date: June 27, 2019Applicant: Magic Leap, Inc.Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
-
Publication number: 20190197774Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.Type: ApplicationFiled: December 21, 2018Publication date: June 27, 2019Applicant: Magic Leap, Inc.Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
-
Patent number: 10313639Abstract: A method of determining camera poses includes capturing a plurality of image frames using a camera, computing relative poses between each set of image frame pairs to provide a relative pose set and an uncategorized relative pose set, and detecting and removing miscategorized relative poses to provide a remaining relative pose set. The method also includes determining global poses using the remaining relative pose set and computing extended relative poses for at least a portion of the miscategorized relative poses and at least a portion of the uncategorized relative pose set to provide an extended relative pose set and an extended uncategorized relative pose set. The method further includes detecting and removing extended miscategorized relative poses to provide a remaining extended relative pose set and determining updated global poses for the plurality of image frames using the remaining relative pose set and the remaining extended relative pose set.Type: GrantFiled: November 18, 2016Date of Patent: June 4, 2019Assignee: Magic Leap, Inc.Inventor: Xiaolin Wei
-
Patent number: 10249087Abstract: A method of atlas packing includes receiving a three-dimensional (3D) mesh that includes a plurality of triangles representing surfaces of one or more objects; for each respective triangle, determining a normal of the respective triangle, and categorizing the respective triangle into one of six directions along positive and negative of x-, y-, and z-directions; categorizing triangles in each respective direction into one or more layers orthogonal to the respective direction; for each respective layer, identifying one or more connected components; projecting each respective connected component onto a plane orthogonal to the respective direction to obtain a corresponding projected two-dimensional (2D) connected component; cutting the projected 2D connected component into one or more sub-components; packing the bounding boxes of all sub-components into one or more atlases; and for each respective triangle of each sub-component, copying a texture of a corresponding triangle of the 3D mesh to the respective triangType: GrantFiled: January 23, 2017Date of Patent: April 2, 2019Assignee: MAGIC LEAP, INC.Inventors: Xiaolin Wei, Yifu Zhang
-
Publication number: 20190043256Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.Type: ApplicationFiled: October 9, 2018Publication date: February 7, 2019Applicant: Magic Leap, Inc.Inventors: Jianyuan Min, Xiaolin Wei
-
Patent number: 10186082Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.Type: GrantFiled: March 23, 2017Date of Patent: January 22, 2019Assignee: MAGIC LEAP, INC.Inventors: Jianyuan Min, Xiaolin Wei
-
Publication number: 20170301133Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.Type: ApplicationFiled: March 23, 2017Publication date: October 19, 2017Applicant: Magic Leap, Inc.Inventors: Jianyuan Min, Xiaolin Wei
-
Publication number: 20170221263Abstract: A method of atlas packing includes receiving a three-dimensional (3D) mesh that includes a plurality of triangles representing surfaces of one or more objects; for each respective triangle, determining a normal of the respective triangle, and categorizing the respective triangle into one of six directions along positive and negative of x-, y-, and z-directions; categorizing triangles in each respective direction into one or more layers orthogonal to the respective direction; for each respective layer, identifying one or more connected components; projecting each respective connected component onto a plane orthogonal to the respective direction to obtain a corresponding projected two-dimensional (2D) connected component; cutting the projected 2D connected component into one or more sub-components; packing the bounding boxes of all sub-components into one or more atlases; and for each respective triangle of each sub-component, copying a texture of a corresponding triangle of the 3D mesh to the respective triangType: ApplicationFiled: January 23, 2017Publication date: August 3, 2017Applicant: Magic Leap, Inc.Inventors: Xiaolin Wei, Yifu Zhang