Patents by Inventor Wenyi Zhao

Wenyi Zhao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210168376
    Abstract: An unmanned aerial vehicle comprises a body coupled with a plurality of propulsion systems and an imaging device; an encoder that encodes video data generated by the imaging device, and a wireless communication system for transmitting the encoded video data. The encoder includes a region of interest (ROI) control module that determines, within an image frame of the video data, a first region and a second region, the ROI control module further setting a first limit indicating a maximum value of quantization parameters for encoding each macroblock within the first region, a second limit indicating a maximum size of the first region, and a third limit indicating a minimum size of the second region.
    Type: Application
    Filed: February 9, 2021
    Publication date: June 3, 2021
    Applicant: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Lei ZHU, Wenjun Zhao, Wenyi Su, Liang Zhao
  • Publication number: 20210160480
    Abstract: A computer-implemented method includes receiving a feedback message from a receiver of image data. The feedback message includes a reference frame identifier associated with a reference frame correctly received or decoded by the receiver. The method further includes determining a difference between the reference frame identifier and a current frame identifier. The current frame identifier is associated with a current frame to be encoded and the difference indicates a number of frames between the reference frame and the current frame. The method also includes encoding the current frame based at least in part on the difference.
    Type: Application
    Filed: February 1, 2021
    Publication date: May 27, 2021
    Inventors: Liang ZHAO, Wenyi SU, Qingdong YU, Wei XIAO, Lei ZHU, Ming GONG, Ning MA, Wei FAN, Hao CUI
  • Patent number: 11019356
    Abstract: Motion estimation method and motion estimation device are provided. The method includes: determining a global motion vector of a current frame relative to a current reference frame according to the current frame and the current reference frame; and performing motion estimation on a target frame according to the global motion vector.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: May 25, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Wenyi Su, Liang Zhao, Lei Zhu
  • Publication number: 20210152752
    Abstract: An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.
    Type: Application
    Filed: January 27, 2021
    Publication date: May 20, 2021
    Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
  • Patent number: 10984567
    Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: April 20, 2021
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian David Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Patent number: 10944919
    Abstract: An exemplary system includes a scene processing module configured to receive a single frame comprising a first set of pixel data comprising a first combined scene including a fluorescence scene component and a second set of pixel data comprising a second combined scene including a combination of a visible color component scene and the fluorescence scene component. The scene processing module is further configured to extract a display fluorescence scene component from the first combined scene and extract a display visible scene component from the second combined scene. The system further includes a display unit configured to generate, based on the display fluorescence scene component and the display visible scene component, a displayed scene.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: March 9, 2021
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
  • Publication number: 20200368915
    Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.
    Type: Application
    Filed: July 17, 2020
    Publication date: November 26, 2020
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Publication number: 20200367720
    Abstract: A bleeding detection system may receive, from an image capture system during a surgical procedure, a first frame of data of a scene of a surgical site and identify, based on the first frame, a region of blood in the scene. The system may receive, from the image capture system subsequent to receiving the first frame, a second frame of data of the scene, the second frame including data representative of the region of blood. The system may estimate, based on the first frame and the second frame, motion of blood flow in the region of blood and generate data representative of a combined image comprising the second frame and a visual indicator indicating the motion of blood flow in the region of blood. The system may transmit, during the surgical procedure, the data representative of the combined image to a display unit for display of the combined image.
    Type: Application
    Filed: August 12, 2020
    Publication date: November 26, 2020
    Inventors: Wenyi Zhao, Catherine J. Mohr, Jonathan M. Sorger
  • Publication number: 20200359971
    Abstract: In one embodiment of the invention, an interactive vital signs scanning method is disclosed including concurrently scanning for a plurality of vital signs with a portable vital signs scanner; detecting movement of the portable vital signs scanner during the scanning for the plurality of vital signs; and determining a measure of quality of the scanning for the plurality of vital signs with the portable vital signs scanner. In another embodiment, a method of improving the quality of vital signs data is disclosed including concurrently sensing data from a plurality of vital signs sensors over a period of time with a portable vital signs scanner; determining a plurality of vital sign values for a respective plurality of vital signs in response to the sensed data from the plurality of vital signs sensors over the period of time; and fusing at least two vital sign values of the plurality of vital sign values for the respective plurality of vital signs.
    Type: Application
    Filed: July 31, 2020
    Publication date: November 19, 2020
    Applicant: SCANADU INCORPORATED
    Inventors: Wenyi Zhao, Brandon Dennis Woolsey, Walter DeBrouwer, Eron Anthony Villarreal, Whitney Morgan McGowan, Martin Zizi
  • Publication number: 20200334786
    Abstract: An exemplary method includes a demosaic module receiving a frame of raw pixels having values in a first color space, generating vertical and horizontal color difference signals using information from the frame of raw pixels, generating reconstructed color pixel values for raw pixels that are missing captured color pixel values of a first color component of the first color space, and transforming the captured and reconstructed color pixel values of the first color component to brightness pixel values in a second color space. In certain examples, the demosaic module may transform the vertical and horizontal color difference signals into other pixel values (e.g., chrominance pixel values) in the second color space.
    Type: Application
    Filed: June 30, 2020
    Publication date: October 22, 2020
    Inventor: Wenyi Zhao
  • Publication number: 20200322526
    Abstract: An imaging system comprises an image capturing device, a viewer, a control element, and a processor. The control element controls or adjusts an image characteristic of one of the image capturing device and the viewer. The processor is programmed to determine a depth value relative to the image capturing device, determine a desirable adjustment to the control element by using the determined depth value, and control adjustment of the control element to assist manual adjustment of the control element to the desirable adjustment. The processor may also be programmed to determine whether the adjustment of the control element is to be automatically or manually adjusted and control adjustment of the control element automatically to the desirable adjustment if the control element is to be automatically adjusted.
    Type: Application
    Filed: June 24, 2020
    Publication date: October 8, 2020
    Inventors: Paul E. Lilagan, Wenyi Zhao
  • Publication number: 20200305984
    Abstract: A tool tracking method comprises receiving stereo image data of a tool. The tool includes a tracking marker. The method also comprises receiving first kinematic data for the tool and determining a three-dimensional image-derived pose of the tool from the stereo image data of the tool and the tracking marker. The method also comprises determining a first kinematic pose of the tool from the first kinematic data and determining a pose offset between the image-derived pose of the tool and the first kinematic pose of the tool. The method also comprises determining a corrected first kinematic pose of the tool based on the pose offset and the first kinematic data.
    Type: Application
    Filed: April 27, 2020
    Publication date: October 1, 2020
    Inventors: Tao Zhao, William C. Nowlin, Wenyi Zhao
  • Patent number: 10772482
    Abstract: A bleeding detection unit in a surgical system processes information in an acquired scene before that scene is presented on a display unit in the operating room. For example, the bleeding detection unit analyzes the pixel data in the acquired scene and determines whether there are one or more initial sites of blood in the scene. Upon detection of an initial site of blood, the region is identified by an initial site icon in the scene displayed on the display unit. In one aspect, the processing is done in real-time which means that there is no substantial delay in presenting the acquired scene to the surgeon.
    Type: Grant
    Filed: January 5, 2018
    Date of Patent: September 15, 2020
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Wenyi Zhao, Catherine J. Mohr, Jonathan M. Sorger
  • Patent number: 10737394
    Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.
    Type: Grant
    Filed: October 16, 2018
    Date of Patent: August 11, 2020
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Patent number: 10733703
    Abstract: An exemplary demosaicing method includes a demosaic module receiving a frame of raw pixels, generating vertical and horizontal estimated color pixel values for missing color pixel values using information from the frame of raw pixels, generating vertical and horizontal color difference signals using information from the frame of raw pixels and the vertical and horizontal estimated color pixel values, and creating a full resolution frame of pixels using information from the frame of raw pixels and color difference signals selected from the vertical and horizontal color difference signals. The full resolution frame of pixels may include one captured color pixel value and two reconstructed color pixel values for each location in the full resolution frame of pixels and may be sent to a display unit for display.
    Type: Grant
    Filed: January 3, 2019
    Date of Patent: August 4, 2020
    Assignee: Intuitive Surgical Operations, Inc.
    Inventor: Wenyi Zhao
  • Publication number: 20200228783
    Abstract: The present disclosure relates to calibration assemblies and methods for use with an imaging system, such as an endoscopic imaging system. A calibration assembly includes: an interface for constraining engagement with an endoscopic imaging system; a target coupled with the interface so as to be within the field of view of the imaging system, the target including multiple of markers having calibration features that include identification features; and a processor configured to identify from first and second images obtained at first and second relative spatial arrangements between the imaging system and the target, respectively, at least some of the markers from the identification features, and using the identified markers and calibration feature positions within the images to generate calibration data.
    Type: Application
    Filed: March 23, 2020
    Publication date: July 16, 2020
    Inventors: Tao Zhao, Wenyi Zhao, David D. Scott
  • Patent number: 10715720
    Abstract: An imaging system comprises an image capturing device, a viewer, a control element, and a processor. The control element controls or adjusts an image characteristic of one of the image capturing device and the viewer. The processor is programmed to determine a depth value relative to the image capturing device, determine a desirable adjustment to the control element by using the determined depth value, and control adjustment of the control element to assist manual adjustment of the control element to the desirable adjustment. The processor may also be programmed to determine whether the adjustment of the control element is to be automatically or manually adjusted and control adjustment of the control element automatically to the desirable adjustment if the control element is to be automatically adjusted.
    Type: Grant
    Filed: March 28, 2018
    Date of Patent: July 14, 2020
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Paul E. Lilagan, Wenyi Zhao
  • Publication number: 20200215696
    Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.
    Type: Application
    Filed: March 23, 2020
    Publication date: July 9, 2020
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Craig R. Gerbi, Theodore W. Rogers, Wenyi Zhao
  • Publication number: 20200196962
    Abstract: In one embodiment of the invention, a system for periodically and simultaneously scanning for a plurality of vital signs of a user is disclosed. The system includes a personal portable wireless vital signs scanner having a pair of electrodes to form a circuit with a user's body; and a personal wireless multifunction device wirelessly in communication with the personal portable wireless vital signs scanner. Users may tag their vital signs scans with additional information. Vital signs data may be stored on non-volatile memory on the multifunction device and periodically uploaded to a vital signs storage server. The accumulated vital signs data is used to build the user's canonical curve. In another embodiment of the invention, multiple users may upload their vital signs to a group vital signs server. Group vital sign reference curves can made with the group data obtained. Group data may be compared with the user's personal vital sign data and health recommendations made accordingly to the user.
    Type: Application
    Filed: December 23, 2018
    Publication date: June 25, 2020
    Inventors: Wenyi Zhao, Brandon Dennis Woolsey, Walter De Brouwer, Eron Anthony Villarreal, Whitney Morgan McGowan
  • Patent number: 10675098
    Abstract: The present disclosure relates to systems, methods, and tools for tool tracking using image-derived data from one or more tool-located references features. In some embodiments, a medical system includes a tool having a distal end that is insertable into a patient body, an image capture device insertable into the patient body so that the image capture device captures an image of at least a portion of a two-dimensional marker at least partially surrounding a portion of the tool, and a processor coupled to the image capture device and configured to determine a pose of the tool by processing the image.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: June 9, 2020
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Tao Zhao, Wenyi Zhao, William C. Nowlin