Patents by Inventor Zhongle Wu

Zhongle Wu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240013388
    Abstract: Systems and methods are disclosed for assessing the quality of medical images of at least a portion of a patient's anatomy, using a computer system. One method includes receiving one or more images of at least a portion of the patient's anatomy; determining, using a processor of the computer system, one or more image properties of the received images; performing, using a processor of the computer system, anatomic localization or modeling of at least a portion of the patient's anatomy based on the received images; obtaining an identification of one or more image characteristics associated with an anatomic feature of the patient's anatomy based on the anatomic localization or modeling; and calculating, using a processor of the computer system, an image quality score based on the one or more image properties and the one or more image characteristics.
    Type: Application
    Filed: September 22, 2023
    Publication date: January 11, 2024
    Inventors: Timothy A. FONTE, Leo J. GRADY, Zhongle WU, Michiel SCHAAP, Stanley C. HUNLEY, Souma SENGUPTA, Sophie KHEM
  • Patent number: 11803965
    Abstract: Systems and methods are disclosed for assessing the quality of medical images of at least a portion of a patient's anatomy, using a computer system. One method includes receiving one or more images of at least a portion of the patient's anatomy; determining, using a processor of the computer system, one or more image properties of the received images; performing, using a processor of the computer system, anatomic localization or modeling of at least a portion of the patient's anatomy based on the received images; obtaining an identification of one or more image characteristics associated with an anatomic feature of the patient's anatomy based on the anatomic localization or modeling; and calculating, using a processor of the computer system, an image quality score based on the one or more image properties and the one or more image characteristics.
    Type: Grant
    Filed: May 9, 2022
    Date of Patent: October 31, 2023
    Assignee: HeartFlow, Inc.
    Inventors: Timothy A. Fonte, Leo J. Grady, Zhongle Wu, Michiel Schaap, Stanley C. Hunley, Souma Sengupta, Sophie Khem
  • Publication number: 20230147759
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Application
    Filed: January 4, 2023
    Publication date: May 11, 2023
    Applicant: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 11580705
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: February 14, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 11494904
    Abstract: Systems and methods are disclosed for assessing the quality of medical images of at least a portion of a patient's anatomy, using a computer system. One method includes receiving one or more images of at least a portion of the patient's anatomy; determining, using a processor of the computer system, one or more image properties of the received images; performing, using a processor of the computer system, anatomic localization or modeling of at least a portion of the patient's anatomy based on the received images; obtaining an identification of one or more image characteristics associated with an anatomic feature of the patient's anatomy based on the anatomic localization or modeling; and calculating, using a processor of the computer system, an image quality score based on the one or more image properties and the one or more image characteristics.
    Type: Grant
    Filed: June 16, 2020
    Date of Patent: November 8, 2022
    Assignee: HeartFlow, Inc.
    Inventors: Timothy A. Fonte, Leo Grady, Zhongle Wu, Michiel Schaap, Stanley C. Hunley, Souma Sengupta, Sophie Khem
  • Publication number: 20220277446
    Abstract: Systems and methods are disclosed for assessing the quality of medical images of at least a portion of a patient's anatomy, using a computer system. One method includes receiving one or more images of at least a portion of the patient's anatomy; determining, using a processor of the computer system, one or more image properties of the received images; performing, using a processor of the computer system, anatomic localization or modeling of at least a portion of the patient's anatomy based on the received images; obtaining an identification of one or more image characteristics associated with an anatomic feature of the patient's anatomy based on the anatomic localization or modeling; and calculating, using a processor of the computer system, an image quality score based on the one or more image properties and the one or more image characteristics.
    Type: Application
    Filed: May 9, 2022
    Publication date: September 1, 2022
    Inventors: Timothy A. FONTE, Leo J. GRADY, Zhongle WU, Michiel SCHAAP, Stanley C. HUNLEY, Souma SENGUPTA, Sophie KHEM
  • Patent number: 11398081
    Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: July 26, 2022
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 11321924
    Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: May 3, 2022
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 11263820
    Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: March 1, 2022
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20210248829
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Application
    Filed: April 26, 2021
    Publication date: August 12, 2021
    Applicant: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 11024095
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: June 1, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20210142581
    Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.
    Type: Application
    Filed: December 17, 2020
    Publication date: May 13, 2021
    Applicant: MAGIC LEAP, INC.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 10937246
    Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: March 2, 2021
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20210056763
    Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.
    Type: Application
    Filed: October 26, 2020
    Publication date: February 25, 2021
    Applicant: Magic Leap, Inc.
    Inventors: David Geoffrey MOLYNEAUX, Frank Thomas STEINBRÜCKER, Zhongle WU, Xiaolin WEI, Jianyuan MIN, Yifu ZHANG
  • Patent number: 10902679
    Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: January 26, 2021
    Assignee: MAGIC LEAP, INC.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20200342677
    Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.
    Type: Application
    Filed: July 9, 2020
    Publication date: October 29, 2020
    Applicant: Magic Leap, Inc.
    Inventors: David Geoffrey MOLYNEAUX, Frank Thomas STEINBRÜCKER, Zhongle WU, Xiaolin WEI, Jianyuan MIN, Yifu ZHANG
  • Publication number: 20200311936
    Abstract: Systems and methods are disclosed for assessing the quality of medical images of at least a portion of a patient's anatomy, using a computer system. One method includes receiving one or more images of at least a portion of the patient's anatomy; determining, using a processor of the computer system, one or more image properties of the received images; performing, using a processor of the computer system, anatomic localization or modeling of at least a portion of the patient's anatomy based on the received images; obtaining an identification of one or more image characteristics associated with an anatomic feature of the patient's anatomy based on the anatomic localization or modeling; and calculating, using a processor of the computer system, an image quality score based on the one or more image properties and the one or more image characteristics.
    Type: Application
    Filed: June 16, 2020
    Publication date: October 1, 2020
    Inventors: Timothy A. FONTE, Leo GRADY, Zhongle WU, Michiel SCHAAP, Stanley C. HUNLEY, Souma SENGUPTA
  • Patent number: 10719931
    Abstract: Systems and methods are disclosed for assessing the quality of medical images of at least a portion of a patient's anatomy, using a computer system. One method includes receiving one or more images of at least a portion of the patient's anatomy; determining, using a processor of the computer system, one or more image properties of the received images; performing, using a processor of the computer system, anatomic localization or modeling of at least a portion of the patient's anatomy based on the received images; obtaining an identification of one or more image characteristics associated with an anatomic feature of the patient's anatomy based on the anatomic localization or modeling; and calculating, using a processor of the computer system, an image quality score based on the one or more image properties and the one or more image characteristics.
    Type: Grant
    Filed: November 3, 2017
    Date of Patent: July 21, 2020
    Assignee: HeartFlow, Inc.
    Inventors: Timothy A. Fonte, Leo Grady, Zhongle Wu, Michiel Schaap, Stanley C. Hunley, Souma Sengupta
  • Patent number: 10713852
    Abstract: A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: July 14, 2020
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrucker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Publication number: 20200202633
    Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.
    Type: Application
    Filed: March 4, 2020
    Publication date: June 25, 2020
    Applicant: Magic Leap, Inc.
    Inventors: Frank Thomas Steinbrücker, David Geoffrey Molyneaux, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang