Patents by Inventor Shijie Feng

Shijie Feng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11961244
    Abstract: Disclosed is a high-precision dynamic real-time 360-degree omnidirectional point cloud acquisition method based on fringe projection. The method comprises: firstly, by means of the fringe projection technology based on a stereoscopic phase unwrapping method, and with the assistance of an adaptive dynamic depth constraint mechanism, acquiring high-precision three-dimensional (3D) data of an object in real time without any additional auxiliary fringe pattern; and then, after a two-dimensional (2D) matching points optimized by the means of corresponding 3D information is rapidly acquired, by means of a two-thread parallel mechanism, carrying out coarse registration based on Simultaneous Localization and Mapping (SLAM) technology and fine registration based on Iterative Closest Point (ICP) technology.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: April 16, 2024
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Chao Zuo, Jiaming Qian, Qian Chen, Shijie Feng, Tianyang Tao, Yan Hu, Wei Yin, Liang Zhang, Kai Liu, Shuaijie Wu, Mingzhu Xu, Jiaye Wang
  • Patent number: 11946120
    Abstract: The present disclosure provides a method for controlling an amount of silicon added to ductile cast iron, a method for casting ductile cast iron, and a cast product, which relate to the technical fields of metallurgical and cast iron alloys. The method for controlling an amount of silicon added to ductile cast iron includes smelting ductile cast iron using scrap steel as a raw material. After the scrap steel is melted into molten iron, a copper alloy is added so that the molten iron has a copper equivalent of 0.8% to 1.0%, wherein the copper equivalent is controlled by formula (II). Then, ferrosilicon is added so that the content of silicon added to the molten iron satisfies formula (I).
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: April 2, 2024
    Assignees: TIANRUN INDUSTRY TECHNOLOGY CO., LTD., SHANDONG UNIVERSITY OF TECHNOLOGY
    Inventors: Jianchen Cong, Shibo Shao, Haiming Yu, Xuezhong Dai, Peixiang Ni, Meizhen Feng, Shijie Lv, Hongri Cong
  • Patent number: 11906286
    Abstract: The invention discloses a deep learning-based temporal phase unwrapping method for fringe projection profilometry. First, four sets of three-step phase-shifting fringe patterns with different frequencies (including 1, 8, 32, and 64) are projected to the tested objects. The three-step phase-shifting fringe images acquired by the camera are processed to obtain the wrapped phase map using a three-step phase-shifting algorithm. Then, a multi-frequency temporal phase unwrapping (MF-TPU) algorithm is used to unwrap the wrapped phase map to obtain a fringe order map of the high-frequency phase with 64 periods. A residual convolutional neural network is built, and its input data are set to be the wrapped phase maps with frequencies of 1 and 64, and the output data are set to be the fringe order map of the high-frequency phase with 64 periods. Finally, the training dataset and the validation dataset are built to train and validate the network.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: February 20, 2024
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian Chen, Chao Zuo, Shijie Feng, Yuzhen Zhang, Guohua Gu
  • Patent number: 11893719
    Abstract: A single-shot differential phase contrast quantitative phase imaging method based on color multiplexing illumination. A color multiplexing illumination solution is used to realize single-shot differential phase contrast quantitative phase imaging. In the single-shot color multiplexing illumination solution, three illumination wavelengths of red, green, and blue are used to simultaneously illuminate a sample, and the information of the sample in multiple directions is converted into intensity information on different channels of a color image. By performing channel separation on this color image, the information about the sample at different spatial frequencies can be obtained.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: February 6, 2024
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian Chen, Yao Fan, Chao Zuo, Jiasong Sun, Xiangpeng Pan, Shijie Feng, Yuzhen Zhang, Guohua Gu, Jiaji Li, Jialin Zhang
  • Publication number: 20240037765
    Abstract: Disclosed is a high-precision dynamic real-time 360-degree omnidirectional point cloud acquisition method based on fringe projection. The method comprises: firstly, by means of the fringe projection technology based on a stereoscopic phase unwrapping method, and with the assistance of an adaptive dynamic depth constraint mechanism, acquiring high-precision three-dimensional (3D) data of an object in real time without any additional auxiliary fringe pattern; and then, after a two-dimensional (2D) matching points optimized by the means of corresponding 3D information is rapidly acquired, by means of a two-thread parallel mechanism, carrying out coarse registration based on Simultaneous Localization and Mapping (SLAM) technology and fine registration based on Iterative Closest Point (ICP) technology.
    Type: Application
    Filed: August 27, 2020
    Publication date: February 1, 2024
    Applicant: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Chao ZUO, Jiaming QIAN, Qian CHEN, Shijie FENG, Tianyang TAO, Yan HU, Wei YIN, Liang ZHANG, Kai LIU, Shuaijie WU, Mingzhu XU, Jiaye WANG
  • Publication number: 20240020866
    Abstract: The invention discloses a three-dimensional (3D) measurement method based on end-to-end deep learning for speckle projection. First, the speckle pattern was projected by the projector and collected simultaneously by the stereo camera. The speckle images after stereo rectification are fed into the stereo matching network. A feature extraction sub-network based on shared weights processes the speckle images to obtain a series of low-resolution 3D feature tensors, The feature tensor is fed into the saliency object detection sub-network to detect foreground information in the speckle images, producing a full-resolution valid mask map. A 4D matching cost volume is generated using the feature tensor of both views based on the candidate disparity range, filtered by a series of 3D convolutional layers to achieve cost aggregation, so that the initial disparity map is obtained by disparity regression.
    Type: Application
    Filed: August 18, 2021
    Publication date: January 18, 2024
    Applicant: Nanjing University of Science and Technology
    Inventors: Chao Zuo, Qian Chen, Shijie Feng, Jiasong Sun, Yuzhen Zhang, Guohua Gu
  • Publication number: 20230359010
    Abstract: The invention discloses a miniaturized, low-cost, multi-contrast label-free microscopic imaging system. The imaging system is based on an inverted microscopic structure, a highly integrated optical system is designed by adopting a micro lens having a fixed focal length, and a complex optical system of a traditional microscope system is replaced, such that the whole microscope is highly integrated. The system uses a programmable LED array as an illumination light source the LED array is controlled by a computer to display different illumination modes, six imaging functions of a bright field, a dark field a rainbow dark field, Rheinberg optical dyeing, differential phase contrast, and quantitative phase imaging are achieved; and diversified unmarked imaging methods are provided for biological applications.
    Type: Application
    Filed: August 18, 2021
    Publication date: November 9, 2023
    Applicant: Nanjing University of Science and Technology
    Inventors: Qian Chen, Chao Zuo, Jiasong Sun, Shijie Feng, Yuzhen Zhang, Guohua Gu
  • Patent number: 11808564
    Abstract: A calibration method for fringe projection systems based on plane mirrors. Firstly, two mirrors are placed behind the tested object. Through the reflection of mirrors, the camera can image the measured object from the front and other two perspectives, so as to obtain 360-degree two-dimensional information of the measured object. The projector projects three sets of phase-shifting fringe patterns with frequencies of 1, 8, and 64. The camera captures the fringe image to obtain an absolute phase map with a frequency of 64 by using the phase-shifting method and the temporal phase unwrapping algorithm. By using the calibration parameters between the projector and the camera, the absolute phase map can be converted into three-dimensional information of the measured object. Then, the mirror calibration is realized by capturing a set of 3D feature point pairs, so that the 3D information from different perspectives is transformed into a unified world coordinate system.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: November 7, 2023
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Chao Zuo, Wei Yin, Qian Chen, Shijie Feng, Jiasong Sun, Tianyang Tao, Yan Hu, Liang Zhang, Jiaming Qian
  • Patent number: 11781966
    Abstract: The present invention discloses a three-dimensional diffraction tomography microscopy imaging method based on LED array coded illumination. Firstly, acquiring the raw intensity images, three sets of intensity image stacks are acquired at different out-of-focus positions by moving the stage or using electrically tunable lens. And then, after acquiring the intensity image stacks of the object to be measured at different out-of-focus positions, the three-dimensional phase transfer function of the microscopy imaging system with arbitrary shape illumination is derived. Further, the three-dimensional phase transfer function of the microscopic system under circular and annular illumination with different coherence coefficients is obtained as well, and the three-dimensional quantitative refractive index is reconstructed by inverse Fourier transform of the three-dimensional scattering potential function. The scattering potential function is converted into the refractive index distribution.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: October 10, 2023
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Chao Zuo, Qian Chen, Jiaji Li, Jiasong Sun, Yao Fan, Shijie Feng, Yuzhen Zhang
  • Publication number: 20230122985
    Abstract: The invention discloses a single-frame fringe pattern analysis method based on multi-scale generative adversarial network. A multi-scale generative adversarial neural network model is constructed and a comprehensive loss function is applied. Next, training data are collected to train the multi-scale generative adversarial network. During the prediction, a fringe pattern is fed into the trained multi-scale network where the generator outputs the sine term, cosine term, and the modulation image of the input pattern. Finally, the arctangent function is applied to compute the phase. When the network is trained, the parameters of the network do not need to manually tune during the calculation. Since the input of the neural network is only a single fringe pattern, the invention provides an efficient and high-precision phase calculation method for moving objects.
    Type: Application
    Filed: August 27, 2020
    Publication date: April 20, 2023
    Applicant: Nanjing University of Science and Technology
    Inventors: Shijie FENG, Qian CHEN, Chao ZUO, Yuzhen ZHANG, Jiasong SUN, Yan HU, Wei YIN, Jiaming QIAN
  • Patent number: 11555992
    Abstract: The invention discloses a programmable annular LED illumination-based high efficiency quantitative phase microscopy imaging method, the proposed method comprising the following steps: the derivation of system optical transfer function in a partially coherent illumination imaging system; the derivation of phase transfer function with the weak object approximation under the illumination of tilted axially symmetric coherent point illumination source; the extension of illumination from an axially symmetric coherence point source to a discrete annular point source, and the optical transfer function can be treated as an incoherent superposition of each pair of tilted axially symmetric coherent point sources. The acquisition of raw intensity dataset; the implementation of deconvolution for quantitative phase reconstruction.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: January 17, 2023
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian Chen, Chao Zuo, Jiasong Sun, Shijie Feng, Yuzhen Zhang, Guohua Gu
  • Publication number: 20220366552
    Abstract: A single-shot differential phase contrast quantitative phase imaging method based on color multiplexing illumination. A color multiplexing illumination solution is used to realize single-shot differential phase contrast quantitative phase imaging. In the single-shot color multiplexing illumination solution, three illumination wavelengths of red, green, and blue are used to simultaneously illuminate a sample, and the information of the sample in multiple directions is converted into intensity information on different channels of a color image. By performing channel separation on this color image, the information about the sample at different spatial frequencies can be obtained.
    Type: Application
    Filed: August 18, 2020
    Publication date: November 17, 2022
    Applicant: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian CHEN, Yao FAN, Chao ZUO, Jiasong SUN, Xiangpeng PAN, Shijie FENG, Yuzhen ZHANG, Guohua GU, Jiaji LI, Jialin ZHANG
  • Patent number: 11487096
    Abstract: The patent discloses a differential phase contrast (DPC) quantitative phase microscopy method based on the optimal illumination pattern design. Firstly, the optimal illumination pattern corresponding to the isotropic phase transfer function of DPC quantitative phase imaging is derived, which is determined as a semi-annular illumination pattern with the illumination numerical aperture NAill equal to the numerical aperture NAobj of the objective lens. The illumination intensity distribution varies with the cosine of the illumination angle, and it can be expressed as S(?)=cos(?). This patent effectively compensates for the frequency loss of phase transfer, not only the high-frequency responses of PTF are enhanced, but also the transfer responses of low-frequency phase information is significantly improved.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: November 1, 2022
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian Chen, Chao Zuo, Yao Fan, Jiasong Sun, Jiaji Li, Shijie Feng, Yuzhen Zhang
  • Publication number: 20220221270
    Abstract: A calibration method for fringe projection systems based on plane mirrors. Firstly, two mirrors are placed behind the tested object. Through the reflection of mirrors, the camera can image the measured object from the front and other two perspectives, so as to obtain 360-degree two-dimensional information of the measured object. The projector projects three sets of phase-shifting fringe patterns with frequencies of 1, 8, and 64. The camera captures the fringe image to obtain an absolute phase map with a frequency of 64 by using the phase-shifting method and the temporal phase unwrapping algorithm. By using the calibration parameters between the projector and the camera, the absolute phase map can be converted into three-dimensional information of the measured object. Then, the mirror calibration is realized by capturing a set of 3D feature point pairs, so that the 3D information from different perspectives is transformed into a unified world coordinate system.
    Type: Application
    Filed: August 7, 2020
    Publication date: July 14, 2022
    Applicant: Nanjing University of Science and Technology
    Inventors: Chao Zuo, Wei Yin, Qian Chen, Shijie Feng, Jiasong Sun, Tianyang Tao, Yan Hu, Liang Zhang, Jiaming Qian
  • Publication number: 20210372916
    Abstract: The present invention discloses a three-dimensional diffraction tomography microscopy imaging method based on LED array coded illumination. Firstly, acquiring the raw intensity images, three sets of intensity image stacks are acquired at different out-of-focus positions by moving the stage or using electrically tunable lens. And then, after acquiring the intensity image stacks of the object to be measured at different out-of-focus positions, the three-dimensional phase transfer function of the microscopy imaging system with arbitrary shape illumination is derived. Further, the three-dimensional phase transfer function of the microscopic system under circular and annular illumination with different coherence coefficients is obtained as well, and the three-dimensional quantitative refractive index is reconstructed by inverse Fourier transform of the three-dimensional scattering potential function. The scattering potential function is converted into the refractive index distribution.
    Type: Application
    Filed: July 5, 2019
    Publication date: December 2, 2021
    Applicant: Nanjing University of Science and Technology
    Inventors: Chao Zuo, Qian Chen, Jiaji Li, Jiasong Sun, Yao Fan, Shijie Feng, Yuzhen Zhang
  • Publication number: 20210356258
    Abstract: The invention discloses a deep learning-based temporal phase unwrapping method for fringe projection profilometry. First, four sets of three-step phase-shifting fringe patterns with different frequencies (including 1, 8, 32, and 64) are projected to the tested objects. The three-step phase-shifting fringe images acquired by the camera are processed to obtain the wrapped phase map using a three-step phase-shifting algorithm. Then, a multi-frequency temporal phase unwrapping (MF-TPU) algorithm is used to unwrap the wrapped phase map to obtain a fringe order map of the high-frequency phase with 64 periods. A residual convolutional neural network is built, and its input data are set to be the wrapped phase maps with frequencies of 1 and 64, and the output data are set to be the fringe order map of the high-frequency phase with 64 periods. Finally, the training dataset and the validation dataset are built to train and validate the network.
    Type: Application
    Filed: July 5, 2019
    Publication date: November 18, 2021
    Applicant: Nanjing University of Science and Technology
    Inventors: Qian CHEN, Chao ZUO, Shijie FENG, Yuzhen ZHANG, Guohua GU
  • Patent number: 11156821
    Abstract: A high-illumination numerical aperture-based large field-of-view high-resolution microimaging device, and a method for iterative reconstruction, the device comprising an LED array (1), a stage (2), a condenser (3), a microscopic objective (5), a tube lens (6), and a camera (7), the LED array (1) being arranged on the forward focal plane of the condenser (3). Light emitted by the i-th lit LED unit (8) of the LED array (1) passes through the condenser (3) and converges to become parallel light illuminating a specimen (4) to be examined, which is placed on the stage (2); part of the diffracted light passing through the specimen (4) is collected by the microscopic objective (5), converged by the tube lens (6), and reaches the imaging plane of the camera (7), forming an intensity image recorded by the camera (1). The present device and method ensure controllable programming of the illumination direction, while also ensuring an illumination-numerical-aperture up to 1.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: October 26, 2021
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian Chen, Chao Zuo, Jiasong Sun, Shijie Feng, Yuzhen Zhang, Guohua Gu
  • Publication number: 20210325654
    Abstract: The patent discloses a differential phase contrast (DPC) quantitative phase microscopy method based on the optimal illumination pattern design. Firstly, the optimal illumination pattern corresponding to the isotropic phase transfer function of DPC quantitative phase imaging is derived, which is determined as a semi-annular illumination pattern with the illumination numerical aperture NAill equal to the numerical aperture NAobj of the objective lens. The illumination intensity distribution varies with the cosine of the illumination angle, and it can be expressed as S(?)=cos(?). This patent effectively compensates for the frequency loss of phase transfer, not only the high-frequency responses of PTF are enhanced, but also the transfer responses of low-frequency phase information is significantly improved.
    Type: Application
    Filed: July 5, 2019
    Publication date: October 21, 2021
    Applicant: Nanjing University of Science and Technology
    Inventors: Qian CHEN, Chao ZUO, Yao FAN, Jiasong SUN, Jiaji LI, Shijie FENG, Yuzhen ZHANG
  • Patent number: 11106029
    Abstract: An annular-irradiation high-resolution quantitative phase microimaging based on light intensity transfer equation is proposed here includes designing an annular aperture for the imaging system illumination; invoking the weak object approximation by using the parameters of annular illumination aperture and bright field microscopy to calculate a weak object optical transfer function (WOTF) on the basis of a partially coherent imaging theory; and collecting three intensity images by a camera and obtaining the quantitative phase image of object by resolving the light intensity transfer equation with a deconvolution algorithm.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: August 31, 2021
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian Chen, Chao Zuo, Jiasong Sun, Shijie Feng, Yuzhen Zhang, Guohua Gu
  • Patent number: 11029144
    Abstract: A super-rapid three-dimensional measurement method and system based on an improved Fourier transform contour technique is disclosed.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: June 8, 2021
    Assignee: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Qian Chen, Chao Zuo, Shijie Feng, Jiasong Sun, Yuzhen Zhang, Guohua Gu