Patents by Inventor Cong Zhao

Cong Zhao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10922542
    Abstract: A method, system, article of manufacture, and UAV configured to identify a target object shown in an image, such as shown in a perspective view that is a two-dimensional image or frame of video. The method comprises: identifying and track the position of a target object shown in a sequence of images or video, even when the target object may be traveling at high speeds, detecting the target object within an image based on one or more of the object's physical characteristics, such as its color, shape, size, chrominance, luminance, brightness, lightness, darkness, and/or other characteristics. Thus, in this context a target object may be anything having one or more detectable physical characteristics. The method also providing an improved and more intuitive user interface that enables a user to select a target object for tracking. As a result, the method and system improve the accuracy, usability, and robustness of the system.
    Type: Grant
    Filed: March 1, 2016
    Date of Patent: February 16, 2021
    Assignee: SZ DJI Technology Co., Ltd.
    Inventors: Bo Zang, Cong Zhao, Xuyang Feng
  • Publication number: 20210018910
    Abstract: A control terminal for controlling an unmanned aerial vehicle (UAV) includes a processor and a storage medium storing instructions that, when executed by the processor, cause the processor to render an image on a user interface of the control terminal. The image is captured by an imaging device coupled to the UAV and is associated with a view of the imaging device. The instructions further cause the processor to detect, via the user interface, a gesture-based input including one or more reference points in the image and indicating a view change of the imaging device, determine a type of the gesture-based input by analyzing the one or more reference points, and generate control data based on the type of the gesture-based input to control at least one of the UAV or the imaging device for the view change of the imaging device.
    Type: Application
    Filed: October 1, 2020
    Publication date: January 21, 2021
    Inventors: Peiliang LI, Jie QIAN, Cong ZHAO, Xuyang FENG, You ZHOU
  • Patent number: 10896520
    Abstract: An imagery method includes obtaining a plurality of images of an object captured using one or more imaging devices within a period of time while the object is being tracked, performing motion and/or state estimation of the object for the period of time, and selecting one or more images related to a moment from the plurality of images based on the motion and/or state estimation of the object.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: January 19, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Cong Zhao, Xuyang Feng, Jie Qian, Sijin Li
  • Patent number: 10897569
    Abstract: A photographing control method includes obtaining a plurality sets of shooting information including shooting location information and shooing angle information for a target object, and determining location estimation information for the target object based on at least two sets of shooting information selected from the plurality sets of shooting information. The shooting location information in the at least two sets of shooting information corresponds to different locations. The method further includes generating a shooting adjustment instruction based on the location estimation information, and adjusting a shooting angle of a photographing device according to the shooting adjustment instruction to place a location corresponding to the location estimation information within a viewing angle of the photographing device.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: January 19, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Jie Qian, Haonan Li, Cong Zhao
  • Publication number: 20210011478
    Abstract: A method includes obtaining an image frame captured by an imaging device carried by an unmanned vehicle and containing the target object, extracting one or more features of a target object from a region selected by a user on the image frame, and determining whether the target object is a predetermined recognizable object type based on a comparison of the one or more features with one or more characteristics associated with the predetermined recognizable object type. In response to the target object being the predetermined recognizable object type, tracking functions associated with the predetermined recognizable object type are initiated. In response to the target object not belonging to the predetermined recognizable object type, tracking functions associated with a general object type are initiated.
    Type: Application
    Filed: September 28, 2020
    Publication date: January 14, 2021
    Inventors: Xuyang FENG, Cong ZHAO, Jie QIAN, Junfeng YU
  • Publication number: 20210001838
    Abstract: A movable object for responding to an object includes a first passive infrared sensor having a first detection range and a first field of view, and one or more second passive infrared sensors each having a second detection range and a second field of view. The second detection range is longer than the first detection range and the second field of view is smaller than the first field of view. The movable object further includes one or more processors configured to recognize the object based on one or more heat signals received from at least one of the first passive infrared sensor or the one or more second passive infrared sensors, and perform a flight response measure to control the movable object based on the recognized object.
    Type: Application
    Filed: June 11, 2020
    Publication date: January 7, 2021
    Inventors: Jinzhu HUANG, Cong ZHAO
  • Patent number: 10884667
    Abstract: This application relates to the field of storage technologies, and discloses a storage controller. The storage controller includes a distribution core, a plurality of ranking cores, and a request processing core. The three types of cores are respectively configured to: distribute IO requests to different ranking cores, generate a processing ranking index for each IO request, and process the IO request based on a value of the processing ranking index of the IO request, to flexibly schedule an IO request received by the storage controller.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: January 5, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Si Yu, Junhui Gong, Cong Zhao, Cheng Wang, Yue Lu
  • Patent number: 10880493
    Abstract: A system includes an image sensor configured to obtain consecutive image frames, an exposure parameter acquisition unit configured to obtain a current automatic exposure parameter of a current image frame of the consecutive image frames, and a fill light controller configured to adjust an illumination intensity of a fill light lamp for a next image frame based on the current automatic exposure parameter and a preset condition by increasing or decreasing the illumination intensity of the fill light lamp for the next image frame by a preset increment if the automatic exposure parameter does not satisfy the preset condition. The preset increment is pre-determined based on the current automatic exposure parameter.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: December 29, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: You Zhou, Cong Zhao, Jiaqi Yan
  • Publication number: 20200389595
    Abstract: An image processing method includes obtaining an image frame through an imaging device over a period of time. The image frame includes a plurality of groups of pixels that are exposed to light at different time points within the period of time. The method further includes obtaining attitude information of the imaging device during the period of time, deriving positional state of an individual group of pixels in the plurality of groups of pixels based on the attitude information of the imaging device, and processing the image frame using the positional state.
    Type: Application
    Filed: August 25, 2020
    Publication date: December 10, 2020
    Inventors: You ZHOU, Cong ZHAO, Jie QIAN, Peiliang LI
  • Publication number: 20200371535
    Abstract: An automatic image capturing method includes obtaining an image-to-be-processed, pre-processing the image-to-be-processed to obtain a pre-processing result, inputting the pre-processing result into a trained machine learning model for classification, and generating and transmitting a control signal according to the classification. The control signal is configured to perform a preset operation to the image-to-be-processed.
    Type: Application
    Filed: August 14, 2020
    Publication date: November 26, 2020
    Inventors: Sijin LI, Cong ZHAO, Liliang ZHANG
  • Publication number: 20200358999
    Abstract: A baseline adjustment method includes acquiring a first image of an object by a first imaging device of an imaging apparatus, acquiring a second image of the object by a second imaging device of the imaging apparatus, determining a binocular disparity between the first and second image and determining an object distance based at least on the binocular disparity by the controller, and automatically adjusting a baseline according to the object distance by a baseline adjustment mechanism. The object distance represents a distance between the imaging apparatus and the object. The baseline represents a relative distance between the first and second imaging device. The baseline is being adjusted to fall within a range approximately between a minimum and a maximum baseline. The maximum baseline is defined by the object distance and an angle-of-view of at least one of the first or the second imaging device.
    Type: Application
    Filed: July 27, 2020
    Publication date: November 12, 2020
    Inventors: Guyue ZHOU, Ketan TANG, Xingyu ZHANG, Cong ZHAO
  • Publication number: 20200349704
    Abstract: A control method for a mobile platform includes obtaining a captured image, identifying one or more candidate first characteristic parts from the captured image, determining a second characteristic part of a target object in the captured image, determining one or more matching parameters each corresponding to one of the one or more candidate first characteristic parts based on the one or more candidate first characteristic parts and the second characteristic part, determining a target first characteristic part of the target object from the one or more candidate first characteristic parts based on the one or more matching parameters, and switching from tracking the second characteristic part to tracking the target first characteristic part in response to a tracking parameter of the target object meeting a preset tracking condition.
    Type: Application
    Filed: July 22, 2020
    Publication date: November 5, 2020
    Inventors: Lei PANG, Cong ZHAO, Liliang ZHANG, Gao ZHU, Sijin LI, Yao LIU
  • Publication number: 20200348663
    Abstract: A method is provided for controlling flight of an aircraft carrying an imaging device. The method includes obtaining an environment image captured by the imaging device. The method also includes determining a characteristic part of a target user based on the environment image, determining a target image area based on the characteristic part, and recognizing a control object of the target user in the target image area. The method further includes generating a control command based on the control object to control the flight of the aircraft.
    Type: Application
    Filed: July 22, 2020
    Publication date: November 5, 2020
    Inventors: Jie QIAN, Xia CHEN, Liliang ZHANG, Cong ZHAO, Zhengzhe LIU, Sijin LI, Lei PANG, Haonan LI
  • Patent number: 10802491
    Abstract: A method includes obtaining an image frame captured by an imaging device carried by an unmanned vehicle and containing the target object, extracting one or more features of a target object from a region selected by a user on the image frame, and determining whether the target object is a predetermined recognizable object type based on a comparison of the one or more features with one or more characteristics associated with the predetermined recognizable object type. If the target object is the predetermined recognizable object type, tracking functions associated with the predetermined recognizable object type are initiated. IF the target object does not belong to the predetermined recognizable object type, tracking functions associated with a general object type are initiated.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: October 13, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xuyang Feng, Cong Zhao, Jie Qian, Junfeng Yu
  • Patent number: 10802479
    Abstract: A system for controlling an unmanned aerial vehicle (UAV) includes a processor and a storage medium storing instructions that, when executed by the processor, cause the processor to receive image data from a camera coupled to the UAV that is associated with a first view of the camera, send the image data in real time to a client device, and receive control data from the client device. The control data is associated one or more reference coordinates corresponding to a gesture-based input indicating a change from the first view to a second view of the camera. The gesture-based input is associated with at least one region of the image data. The instructions further cause the processor to control the UAV to change at least one of a position or an attitude of the UAV based on the control data.
    Type: Grant
    Filed: November 23, 2018
    Date of Patent: October 13, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Peiliang Li, Jie Qian, Cong Zhao, Xuyang Feng, You Zhou
  • Publication number: 20200296300
    Abstract: An unmanned aerial vehicle (UAV) includes a vehicle body and a multi-ocular imaging assembly. The multi-ocular imaging assembly includes at least two imaging devices disposed in and fixed to the vehicle body.
    Type: Application
    Filed: June 2, 2020
    Publication date: September 17, 2020
    Inventors: Cong ZHAO, Guyue ZHOU, Honghui ZHANG, Yin TANG, Guisheng NONG, Jiangang FENG
  • Patent number: 10771699
    Abstract: An image processing method includes obtaining an image frame through an imaging device over a period of time. The image frame includes a plurality of groups of pixels that are exposed to light at different time points within the period of time. The method further includes obtaining attitude information of the imaging device during the period of time, deriving positional state of an individual group of pixels in the plurality of groups of pixels based on the attitude information of the imaging device, and processing the image frame using the positional state.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: September 8, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: You Zhou, Cong Zhao, Jie Qian, Peiliang Li
  • Publication number: 20200272803
    Abstract: A method for supporting visual tracking includes receiving a plurality of image signals indicative of a plurality of image frames captured by an imaging device over a period of time while the imaging device is in motion. Each image frame includes a plurality of pixels. The method further includes obtaining motion characteristics of the imaging device based on a plurality of motion signals, and analyzing the plurality of image signals based on the motion characteristics of the imaging device, so as to compute movement characteristics associated with the plurality of pixels.
    Type: Application
    Filed: May 11, 2020
    Publication date: August 27, 2020
    Inventors: You ZHOU, Cong ZHAO, Ketan TANG, Jiaqi YAN
  • Publication number: 20200267309
    Abstract: The present disclosure provides a focusing method for an electronic device having a camera. The focusing method includes while capturing a target scene, determining a change in a relative position between the electronic device and the target scene. The relative position includes a distance between the electronic device and the target scene and/or an orientation of the target scene with respect to the electronic device. The focusing method further includes determining a focusing scheme according to the change in the relative position between the electronic device and the target scene; and focusing on an object to be tracked and photographed according to the determined focusing scheme. The object to be tracked and photographed is a part of the target scene.
    Type: Application
    Filed: May 5, 2020
    Publication date: August 20, 2020
    Inventors: Xuyang FENG, Cong ZHAO, Jie QIAN
  • Patent number: 10728514
    Abstract: A system for automatically adjusting a baseline of an imaging system for stereoscopic imaging and methods for making and using same. The imaging system includes a plurality of imaging devices that cooperate via a baseline adjustment mechanism. The imaging devices can acquire images of an object of interest and ascertain an object distance between the stereoscopic imaging system and the object of interest using triangulation. Based on the object distance, the baseline adjustment mechanism automatically adjusts a baseline between any pair of imaging devices. The baseline can be reduced when the object of interest is proximate to the imaging system and can be increased when the object of interest is distal. Once the baseline has been adjusted, one or more extrinsic parameters of the imaging devices are calibrated using a two-step optimization method. The imaging system is suitable for use aboard a mobile platform such as an unmanned aerial vehicle.
    Type: Grant
    Filed: May 16, 2017
    Date of Patent: July 28, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Guyue Zhou, Ketan Tang, Xingyu Zhang, Cong Zhao