Patents by Inventor Yanting Ma

Yanting Ma has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11948229
    Abstract: Embodiment of the present disclosure disclose a tomographic imaging system for reconstructing an image of an internal structure of an object. An incident wavefield is transmitted into the object occupying a background domain embedding the object. The incident wavefield is scattered into multiple scattered wavefield by the object. The incident and scattered wavefields are measured as a total wavefield. The total wavefield propagates through a computational domain and a residual domain in the background domain that are defined by cross-domain and residual measurement operators. The total wavefield is used for the image reconstruction. The image is reconstructed by solving an optimization problem corresponding to the computational domain. The optimization problem is solved iteratively to minimize a difference between the total wavefield and a wavefield synthesized using a measurement operator and a Green's function operator from the reconstructed image.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: April 2, 2024
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Hassan Mansour, Yanting Ma, Petros Boufounos
  • Patent number: 11842504
    Abstract: Systems and methods for image processing for determining a registration map between a first image of a scene with a second image of the scene, include solving an optimal transport (OT) problem to produce the registration map by optimizing a cost function that determines a minimum of a ground cost distance between the first and the second images modified with an epipolar geometry-based regularizer including a distance that quantifies the violation of an epipolar geometry constraint between corresponding points defined by the registration map. The ground cost compares a ground cost distance of features extracted within the first image with a ground cost distance of features extracted from the second image.
    Type: Grant
    Filed: August 13, 2021
    Date of Patent: December 12, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Yanting Ma, Dehong Liu, Petros Boufounos, Philip Orlik
  • Publication number: 20230260170
    Abstract: Embodiment of the present disclosure disclose a tomographic imaging system for reconstructing an image of an internal structure of an object. An incident wavefield is transmitted into the object occupying a background domain embedding the object. The incident wavefield is scattered into multiple scattered wavefield by the object. The incident and scattered wavefields are measured as a total wavefield. The total wavefield propagates through a computational domain and a residual domain in the background domain that are defined by cross-domain and residual measurement operators. The total wavefield is used for the image reconstruction. The image is reconstructed by solving an optimization problem corresponding to the computational domain. The optimization problem is solved iteratively to minimize a difference between the total wavefield and a wavefield synthesized using a measurement operator and a Green's function operator from the reconstructed image.
    Type: Application
    Filed: February 17, 2022
    Publication date: August 17, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Hassan Mansour, Yanting Ma, Petros Boufounos
  • Patent number: 11635394
    Abstract: A permittivity sensor, for determining an image of a distribution of permittivity of a material of an object in a scene, comprising an input interface, a hardware processor, and an output interface is provided. The input interface is configured to accept phaseless measurements of propagation of a known incident field through the scene and scattered by the material of the object in the scene. The hardware processor is configured to solve a multi-variable minimization problem over unknown phases of the phaseless measurements and unknown image of the permittivity of the material of the object by minimizing a difference of a nonlinear function of the known incident field and the unknown image with a product of known magnitudes of the phaseless measurements and the unknown phases. Further, the output interface is configured to render the permittivity of the material of the object provided by the solution of the multi-variable minimization problem.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: April 25, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Yanting Ma, Muhammad Asad Lodhi, Hassan Mansour, Petros Boufounos, Dehong Liu
  • Publication number: 20230052582
    Abstract: Systems and methods for image processing for determining a registration map between a first image of a scene with a second image of the scene, include solving an optimal transport (OT) problem to produce the registration map by optimizing a cost function that determines a minimum of a ground cost distance between the first and the second images modified with an epipolar geometry-based regularizer including a distance that quantifies the violation of an epipolar geometry constraint between corresponding points defined by the registration map. The ground cost compares a ground cost distance of features extracted within the first image with a ground cost distance of features extracted from the second image.
    Type: Application
    Filed: August 13, 2021
    Publication date: February 16, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Yanting Ma, Dehong Liu, Petros Boufounos, Philip Orlik
  • Patent number: 11500086
    Abstract: An imaging system to reconstruct a reflectivity image of a scene including an object moving with the scene. A tracking system to track a deforming object to estimate an object deformation for each time step. Sensors acquire snapshots of the scene, each acquired snapshot of the object includes measurements in the object deformation for that time step, to produce a set of object measurements with deformed shapes over the time steps. Compute a correction to estimates of object deformation for each time step, with matching measurements of the corrected object deformation for each time step to measurements in the acquired snapshot of object for that time step. Select a corrected deformation over other corrected deformations for each time step, according to a distance between the corrected deformation and the estimate of the deformation, to obtain a final estimate of the deformation of the deformable object moving in the scene.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: November 15, 2022
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Shuchin Aeron, Yanting Ma, Petros Boufounos, Hassan Mansour
  • Patent number: 11481876
    Abstract: Systems, methods and apparatus for image processing for reconstructing a super resolution image from multispectral (MS) images. Receive image data and initialize a fused image using a panchromatic (PAN) image, and estimate a blur kernel between the PAN image and the MS images as an initialization function. Iteratively, fuse a MS image with an associated PAN image of a scene using a fusing algorithm. Each iteration includes: update the blur kernel based on a Second-Order Total Generalized Variation function to regularize a kernel shape; fuse the PAN image and MS images with the updated blur kernel based on a local Laplacian prior function to regularize the high-resolution information to obtain an estimated fused image; compute a relative error between the estimated fused image of the current iteration and a previous estimated fused image from a previous iteration, to a predetermined threshold, to stop iterations stop, to obtain a PAN-sharpened image.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: October 25, 2022
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Dehong Liu, Lantao Yu, Yanting Ma, Hassan Mansour, Petros Boufounos
  • Publication number: 20220099823
    Abstract: An imaging system to reconstruct a reflectivity image of a scene including an object moving with the scene. A tracking system to track a deforming object to estimate an object deformation for each time step. Sensors acquire snapshots of the scene, each acquired snapshot of the object includes measurements in the object deformation for that time step, to produce a set of object measurements with deformed shapes over the time steps. Compute a correction to estimates of object deformation for each time step, with matching measurements of the corrected object deformation for each time step to measurements in the acquired snapshot of object for that time step. Select a corrected deformation over other corrected deformations for each time step, according to a distance between the corrected deformation and the estimate of the deformation, to obtain a final estimate of the deformation of the deformable object moving in the scene.
    Type: Application
    Filed: September 28, 2020
    Publication date: March 31, 2022
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Shuchin Aeron, Yanting Ma, Petros Boufounos, Hassan Mansour
  • Publication number: 20210319534
    Abstract: Systems, methods and apparatus for image processing for reconstructing a super resolution image from multispectral (MS) images. Receive image data and initialize a fused image using a panchromatic (PAN) image, and estimate a blur kernel between the PAN image and the MS images as an initialization function. Iteratively, fuse a MS image with an associated PAN image of a scene using a fusing algorithm. Each iteration includes: update the blur kernel based on a Second-Order Total Generalized Variation function to regularize a kernel shape; fuse the PAN image and MS images with the updated blur kernel based on a local Laplacian prior function to regularize the high-resolution information to obtain an estimated fused image; compute a relative error between the estimated fused image of the current iteration and a previous estimated fused image from a previous iteration, to a predetermined threshold, to stop iterations stop, to obtain a PAN-sharpened image.
    Type: Application
    Filed: April 8, 2020
    Publication date: October 14, 2021
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Dehong Liu, Lantao Yu, Yanting Ma, Hassan Mansour, Petros Boufounos
  • Publication number: 20210247333
    Abstract: A permittivity sensor, for determining an image of a distribution of permittivity of a material of an object in a scene, comprising an input interface, a hardware processor, and an output interface is provided. The input interface is configured to accept phaseless measurements of propagation of a known incident field through the scene and scattered by the material of the object in the scene. The hardware processor is configured to solve a multi-variable minimization problem over unknown phases of the phaseless measurements and unknown image of the permittivity of the material of the object by minimizing a difference of a nonlinear function of the known incident field and the unknown image with a product of known magnitudes of the phaseless measurements and the unknown phases. Further, the output interface is configured to render the permittivity of the material of the object provided by the solution of the multi-variable minimization problem.
    Type: Application
    Filed: February 10, 2020
    Publication date: August 12, 2021
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Yanting Ma, Muhammad Asad Lodhi, Hassan Mansour, Petros Boufounos, Dehong Liu
  • Patent number: 10212410
    Abstract: Systems and methods for image processing including a memory having stored multi-angled view images of a scene. Each multi-angled view image includes pixels, and at least one multi-angled view image includes a clouded area in the scene, resulting in missing pixels. A processor configured to align three multi-angled view images in the multi-angled view images to a target view angle of the scene, to form a set of aligned multi-angled view images representing a target point of view of the scene, at least one aligned multi-angled view image of the at least three multi-angled view images, has missing pixels due to the clouded area. Form a matrix using vectorized aligned multi-angled view images, wherein the matrix is incomplete due to the missing pixels. Complete the matrix using a matrix completion to combine the aligned multi-angled view images to produce a fused image of the scene without the clouded area.
    Type: Grant
    Filed: December 21, 2016
    Date of Patent: February 19, 2019
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Dehong Liu, Yanting Ma, Hassan Mansour, Ulugbek Kamilov, Yuichi Taguchi, Petros Boufounos, Anthony Vetro
  • Patent number: 10140249
    Abstract: Various examples of methods and systems are provided for approximate message passing with universal denoising. In one example, a method includes applying an approximate message passing (AMP) conversion framework to a plurality of substantially linear measurements to produce a plurality of scalar measurements; applying a denoiser algorithm to the plurality of scalar measurements to generate a plurality of denoised scalar measurements; and applying a conversion term to the plurality of denoised scalar measurements to convert the plurality of denoised scalar measurements to a plurality of denoised substantially linear measurements.
    Type: Grant
    Filed: June 3, 2016
    Date of Patent: November 27, 2018
    Assignee: North Carolina State University
    Inventors: Dror Baron, Yanting Ma, Junan Zhu
  • Publication number: 20180176531
    Abstract: Systems and methods for image processing including a memory having stored multi-angled view images of a scene. Each multi-angled view image includes pixels, and at least one multi-angled view image includes a clouded area in the scene, resulting in missing pixels. A processor configured to align three multi-angled view images in the multi-angled view images to a target view angle of the scene, to form a set of aligned multi-angled view images representing a target point of view of the scene, at least one aligned multi-angled view image of the at least three multi-angled view images, has missing pixels due to the clouded area. Form a matrix using vectorized aligned multi-angled view images, wherein the matrix is incomplete due to the missing pixels. Complete the matrix using a matrix completion to combine the aligned multi-angled view images to produce a fused image of the scene without the clouded area.
    Type: Application
    Filed: December 21, 2016
    Publication date: June 21, 2018
    Inventors: Dehong Liu, Yanting Ma, Hassan Mansour, Ulugbek Kamilov, Yuichi Taguchi, Petros Boufounos, Anthony Vetro
  • Patent number: 9607362
    Abstract: Various examples of methods and systems are provided for compressive imaging using approximate message passing with denoising. According to an aspect, a method includes applying an approximate message passing (AMP) conversion framework to a plurality of substantially linear measurements for conversion into a plurality of scalar measurements. A denoiser algorithm can be applied to the plurality of scalar measurements to generate a plurality of denoised scalar measurements. Further, a conversion term can be applied to the plurality of denoised scalar measurements for converting the plurality of denoised scalar measurements to a plurality of denoised substantially linear measurements. The plurality of substantially linear measurements can represent two-dimensional or three-dimensional signals.
    Type: Grant
    Filed: May 15, 2015
    Date of Patent: March 28, 2017
    Assignee: NORTH CAROLINA STATE UNIVERSITY
    Inventors: Dror Baron, Jin Tan, Yanting Ma
  • Publication number: 20160358316
    Abstract: Various examples of methods and systems are provided for approximate message passing with universal denoising. In one example, a method includes applying an approximate message passing (AMP) conversion framework to a plurality of substantially linear measurements to produce a plurality of scalar measurements; applying a denoiser algorithm to the plurality of scalar measurements to generate a plurality of denoised scalar measurements; and applying a conversion term to the plurality of denoised scalar measurements to convert the plurality of denoised scalar measurements to a plurality of denoised substantially linear measurements.
    Type: Application
    Filed: June 3, 2016
    Publication date: December 8, 2016
    Inventors: Dror Baron, Yanting Ma, Junan Zhu
  • Publication number: 20160048950
    Abstract: Various examples of methods and systems are provided for compressive imaging using approximate message passing with denoising. According to an aspect, a method includes applying an approximate message passing (AMP) conversion framework to a plurality of substantially linear measurements for conversion into a plurality of scalar measurements. A denoiser algorithm can be applied to the plurality of scalar measurements to generate a plurality of denoised scalar measurements. Further, a conversion term can be applied to the plurality of denoised scalar measurements for converting the plurality of denoised scalar measurements to a plurality of denoised substantially linear measurements. The plurality of substantially linear measurements can represent two-dimensional or three-dimensional signals.
    Type: Application
    Filed: May 15, 2015
    Publication date: February 18, 2016
    Inventors: DROR BARON, JIN TAN, Yanting Ma