Patents by Inventor Zisheng Cao

Zisheng Cao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10793289
    Abstract: A system for adjusting an optical path length includes a camera body having a camera body opening, an image sensor coupled to the camera body, and an optical device movably coupled to the camera body. The movable coupling of the optical device to the camera body includes a first coupling position of the optical device relative to the camera body and a second coupling position of the optical device relative to the camera body. In the first coupling position, the optical device is located at a position that intersects a path between the image sensor and the camera body opening. In the second coupling position of the optical device, the optical device is located at a position that does not intersect the path between the image sensor and the camera body opening.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: October 6, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventor: Zisheng Cao
  • Publication number: 20200304727
    Abstract: A system includes an optical element configured to separate light into a first light beam and a second light beam, a first optical module configured to capture a first image having a first field of view from the first light beam, a second optical module configured to capture a second image having a second field of view different from the first field of view from the second light beam, and one or more processors configured to generate a scaled image by scaling one of the first image or the second image, and generate a combined image by aligning the scaled image and an unscaled one of the first image or the second image.
    Type: Application
    Filed: June 10, 2020
    Publication date: September 24, 2020
    Inventors: Zisheng CAO, Mingyu WANG, Linchao BAO
  • Publication number: 20200296259
    Abstract: The present disclosure provides a method for determining a depth value. The method includes adjusting a distance between an image sensor and a lens included in an image acquisition device M times by moving the image sensor, where M is an integer greater than 1; acquiring an image for each N of M times after adjusting the distance between the image sensor and the lens, where N is an integer less than or equal to M; calculating depth values of pixel points in the N acquired images; and determining a target depth value of the pixel point at a position in each of the images based on the depth value of the pixel point in each image.
    Type: Application
    Filed: May 29, 2020
    Publication date: September 17, 2020
    Inventors: Zhenbo LU, Zisheng CAO, Pan HU
  • Patent number: 10771734
    Abstract: Systems and methods can support a data processing apparatus. The data processing apparatus can include a data processor that is associated with a data capturing device on a stationary object and/or a movable object. The data processor can receive data in a data flow from one or more data sources, wherein the data flow is configured based on a time sequence. Then, the data processor can receive a control signal, which is associated with a first timestamp, wherein the first timestamp indicates a first time. Furthermore, the data processor can determine a first data segment by applying the first timestamp on the data flow, wherein the first data segment is associated with a time period in the time sequence that includes the first time.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: September 8, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Sheldon Schwartz, Tao Wang, Mingyu Wang, Zisheng Cao
  • Publication number: 20200272033
    Abstract: A method for controlling a gimbal includes obtaining a current angle of view of a photographing device provided on the gimbal, determining, according to the current angle of view, an adjustment strategy for adjusting the gimbal that allows the photographing device to output stable images, and adjusting at least one of an acceleration or a sensitivity of the gimbal according to the adjustment strategy.
    Type: Application
    Filed: May 14, 2020
    Publication date: August 27, 2020
    Inventors: Zisheng CAO, Bingzhen YANG, Lifu YU, Yan WANG
  • Patent number: 10750147
    Abstract: A method for generating a high dynamic range image (HDRI) includes acquiring a first illuminance diagram, generating a second illuminance diagram from the first illuminance diagram by modifying a dynamic range of at least a portion of the first illuminance diagram, and generating the HDRI based on the second illumination diagram. The first illuminance diagram is obtained based on a camera response function and an illuminance logarithm obtained based on a plurality of images having different exposure conditions.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: August 18, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Caigao Jiang, Zisheng Cao, Mingyu Wang, Taiwen Liang
  • Publication number: 20200244842
    Abstract: Video processing method and device, unmanned aerial vehicle and computer-readable medium are provided. The method includes: providing a neural network trained based on a training set of the neural network having a first training video and a second training video, the first training video including at least one first time-space domain cube, the second training video including a first training video at least one second time-space domain cube; inputting a first video into the neural network, the first video containing certain noise; performing a denoising processing on the first video by using the neural network to generate a second video, the second video being the first video with the certain noise substantially removed; and outputting the second video.
    Type: Application
    Filed: March 25, 2020
    Publication date: July 30, 2020
    Inventors: Jin XIAO, Zisheng CAO, Pan HU
  • Publication number: 20200228681
    Abstract: A method for color correction includes obtaining a noise evaluation image and a corrected noise evaluation image, determining a peak signal-to-noise ratio (PSNR) difference by comparing the noise evaluation image and the corrected noise evaluation image, obtaining a downsampled noise evaluation image and a downsampled corrected noise evaluation image, determining a downsampled PSNR difference by comparing the downsampled noise evaluation image and the downsampled corrected noise evaluation image, and determining a noise amplification metric based on a weighted average of the PSNR difference and the downsampled PSNR difference.
    Type: Application
    Filed: February 6, 2020
    Publication date: July 16, 2020
    Inventors: Wei CHEN, Zisheng CAO
  • Publication number: 20200228701
    Abstract: A method of operating a mobile platform includes determining a threshold angle relative to the mobile platform of an imaging device mounted to the mobile platform that avoids obstruction of a field-of-view of the imaging device by one or more components of the mobile platform, and controlling the mobile platform according to the threshold angle.
    Type: Application
    Filed: March 26, 2020
    Publication date: July 16, 2020
    Inventors: Jun WU, Ran LIAO, Zisheng CAO, Ye TAO
  • Publication number: 20200221056
    Abstract: A method for processing image data of an environment includes obtaining a plurality of images captured using an imaging device and attitude information of the imaging device corresponding to the plurality of images, and associating the plurality of images with the corresponding attitude information of the imaging device.
    Type: Application
    Filed: March 9, 2020
    Publication date: July 9, 2020
    Inventors: Zisheng CAO, Linchao BAO, Pan HU, Mingyu WANG
  • Patent number: 10708617
    Abstract: Methods and systems for evaluating a search area for encoding video are provided. The method comprises receiving video captured by an image capture device, the video comprising video frame components. Additionally, the method comprises receiving optical flow field data associated with the video frame component, wherein at least a portion of the optical flow field data is captured by sensors. The method also comprises determining a search area based on the optical flow field data.
    Type: Grant
    Filed: March 7, 2017
    Date of Patent: July 7, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Yannan Wu, Xiaozheng Tang, Wei Chen, Zisheng Cao, Mingyu Wang
  • Patent number: 10698295
    Abstract: A focusing method includes determining an initial search direction based on a present position of a lens. The focusing method also includes controlling the lens to perform a focusing process in the initial search direction.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: June 30, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Lifu Yu, Wenmeng Teng, Zisheng Cao
  • Publication number: 20200193135
    Abstract: An image processing method is provided for an image device. The method includes obtaining type information of an image sensor of the image device; obtaining multi-path serial image signals outputted by the image sensor; converting the multi-path serial image signals into effective pixels according to the type information; and outputting the effective pixels.
    Type: Application
    Filed: February 21, 2020
    Publication date: June 18, 2020
    Inventors: Junping MA, Wei TUO, Qiang ZHANG, Zisheng CAO
  • Publication number: 20200195847
    Abstract: Image processing method, drone, and drone-camera system are provided. The method includes acquiring, according to a current environmental parameter of the drone, a target sky image that matches the current environmental parameter; and determining a direction parameter of the camera device when capturing a to-be-stitched image. The to-be-stitched image is an image captured under the current environmental parameter. The method further includes stitching the target sky image with the to-be-stitched image according to the direction parameter to obtain a panoramic image.
    Type: Application
    Filed: February 26, 2020
    Publication date: June 18, 2020
    Inventors: Hongyong ZHENG, Zhenbo LU, Pan HU, Zisheng CAO
  • Patent number: 10685426
    Abstract: An imaging system for adaptively generating panoramic images and methods for manufacturing and using same are provided. The system includes an imaging device configured to capture digital images at a plurality of image capture positions. The system further includes a processor configured to identify an overlapping portion of first and second images captured at respective first and second image capture positions, determine a stitching position quality measure for a plurality of stitching positions in the overlapping portion of the first and second images, and select a stitching position based on the determined stitching position quality measures of the plurality of stitching positions of the first and second images. The processor is also configured to stitch the first and second images together at the selected stitching position to generate a panoramic image and determine a third image capture position based on the stitching position quality measure.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: June 16, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Zisheng Cao, Zhanli Zhang, Junjie Chen, Mingyu Wang
  • Patent number: 10687001
    Abstract: A system includes an optical element configured to separate light into a first light beam and a second light beam, a first lens module configured to focus the first light beam, a second lens module configured to focus the second light beam, a first sensor configured to capture a first image from the first light beam focused by the first lens module onto the first sensor, a second sensor configured to capture a second image from the second light beam focused by the second lens module onto the second sensor, and one or more processors configured to generate a combined image based on the first image and the second image. The first image has a first field of view and the second image has a second field of view different from the first field of view.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: June 16, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Zisheng Cao, Mingyu Wang, Linchao Bao
  • Publication number: 20200184598
    Abstract: A method of adaptive demosaicing of a mosaiced image includes receiving the mosaiced image having a mosaic pattern with a first color, a second color, and a third color, obtaining a noise level index for the mosaiced image, determining whether the noise level index is greater than a threshold value, and, in response to the noise level index being greater than the threshold value, performing an adaptive demosaicing on the mosaiced image to generate an adaptively demosaiced image. The adaptive demosaicing includes interpolating values of a portion of unknown pixels of the first color in a horizontal or vertical direction, interpolating values of a portion of unknown pixels of the second color in a horizontal or vertical direction, and interpolating values of a portion of unknown pixels of the third color in a horizontal or vertical direction.
    Type: Application
    Filed: February 13, 2020
    Publication date: June 11, 2020
    Inventors: Caigao JIANG, Zisheng CAO, Mingyu WANG
  • Patent number: 10659690
    Abstract: A method of image stabilization includes obtaining movement data for an imaging device mounted to a mobile platform, adjusting an input image acquired by the imaging device according to the movement data to obtain a stabilized image, and displaying the stabilized image according to a selected viewport.
    Type: Grant
    Filed: July 12, 2018
    Date of Patent: May 19, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Pan Hu, Linchao Bao, Zisheng Cao, Chenglin Mao, Zihan Chen
  • Patent number: 10656503
    Abstract: A method for controlling a gimbal includes obtaining a current angle of view of a photographing device provided on the gimbal, determining, according to the current angle of view, an adjustment strategy for adjusting the gimbal that allows the photographing device to output stable images, and adjusting the gimbal according to the adjustment strategy.
    Type: Grant
    Filed: February 13, 2019
    Date of Patent: May 19, 2020
    Assignee: SZ DJI OSMO TECHNOLOGY CO., LTD.
    Inventors: Zisheng Cao, Bingzhen Yang, Lifu Yu, Yan Wang
  • Publication number: 20200151858
    Abstract: An image contrast enhancement method includes calling a neural network trained using a set of image pairs each including a first image and a second image for a same scene, inputting a third image to the neural network, and obtaining a fourth image outputted by mapping the third image via the neural network. An image contrast of the first image is lower than an image contrast of the second image, and an image contrast of the fourth image is higher than an image contrast of the third image.
    Type: Application
    Filed: January 14, 2020
    Publication date: May 14, 2020
    Inventors: Jianrui CAI, Zisheng CAO, Pan HU