Patents by Inventor Wenyi Zhao

Wenyi Zhao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10210599
    Abstract: An efficient demosaicing method includes reconstructing missing green pixels after estimating green-red color difference signals and green-blue color difference signals that are used in the reconstruction, and then constructing missing red and blue pixels using the color difference signals. This method creates a full resolution frame of red, green and blue pixels. The full resolution frame of pixels is sent to a display unit for display. In an efficient demosaicing process that includes local contrast enhancement, image contrast is enhanced to build and boost a brightness component from the green pixels, and to build chromatic components from all of the red, green, and blue pixels. Color difference signals are used in place of the red and blue pixels in building the chromatic components.
    Type: Grant
    Filed: August 5, 2014
    Date of Patent: February 19, 2019
    Assignee: Intuitive Surgical Operations, Inc.
    Inventor: Wenyi Zhao
  • Publication number: 20190052862
    Abstract: The present disclosure relates to calibration assemblies and methods for use with an imaging system, such as an endoscopic imaging system. A calibration assembly includes: an interface for constraining engagement with an endoscopic imaging system; a target coupled with the interface so as to be within the field of view of the imaging system, the target including multiple of markers having calibration features that include identification features; and a processor configured to identify from first and second images obtained at first and second relative spatial arrangements between the imaging system and the target, respectively, at least some of the markers from the identification features, and using the identified markers and calibration feature positions within the images to generate calibration data.
    Type: Application
    Filed: October 17, 2018
    Publication date: February 14, 2019
    Inventors: Tao Zhao, Wenyi Zhao, David D. Scott
  • Publication number: 20190047154
    Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.
    Type: Application
    Filed: October 16, 2018
    Publication date: February 14, 2019
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Patent number: 10178368
    Abstract: A stereo imaging system comprises a stereoscopic camera having left and right image capturing elements for capturing stereo images; a stereo viewer; and a processor configured to modify the stereo images prior to being displayed on the stereo viewer so that a disparity between corresponding points of the stereo images is adjusted as a function of a depth value within a region of interest in the stereo images after the depth value reaches a target depth value.
    Type: Grant
    Filed: October 14, 2013
    Date of Patent: January 8, 2019
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Wenyi Zhao, Catherine J. Mohr, Simon P. DiMaio
  • Patent number: 10143425
    Abstract: In one embodiment of the invention, an interactive vital signs scanning method is disclosed including concurrently scanning for a plurality of vital signs with a portable vital signs scanner; detecting movement of the portable vital signs scanner during the scanning for the plurality of vital signs; and determining a measure of quality of the scanning for the plurality of vital signs with the portable vital signs scanner. In another embodiment, a method of improving the quality of vital signs data is disclosed including concurrently sensing data from a plurality of vital signs sensors over a period of time with a portable vital signs scanner; determining a plurality of vital sign values for a respective plurality of vital signs in response to the sensed data from the plurality of vital signs sensors over the period of time; and fusing at least two vital sign values of the plurality of vital sign values for the respective plurality of vital signs.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: December 4, 2018
    Assignee: Scanadu Incorporated
    Inventors: Wenyi Zhao, Brandon Dennis Woolsey, Walter De Brouwer, Eron Anthony Villarreal, Whitney Morgan McGowan, Martin Zizi
  • Patent number: 10137575
    Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.
    Type: Grant
    Filed: June 21, 2017
    Date of Patent: November 27, 2018
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Patent number: 10134133
    Abstract: The present disclosure relates to calibration assemblies and methods for use with an imaging system, such as an endoscopic imaging system. A calibration assembly includes: an interface for constraining engagement with an endoscopic imaging system; a target coupled with the interface so as to be within the field of view of the imaging system, the target including multiple of markers having calibration features that include identification features; and a processor configured to identify from first and second images obtained at first and second relative spatial arrangements between the imaging system and the target, respectively, at least some of the markers from the identification features, and using the identified markers and calibration feature positions within the images to generate calibration data.
    Type: Grant
    Filed: August 18, 2015
    Date of Patent: November 20, 2018
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Tao Zhao, Wenyi Zhao, David D. Scott
  • Patent number: 10089724
    Abstract: Provided are a system and method for image sharpening is provided that involves capturing an image, and then decomposing the image into a plurality of image-representation components, such as RGB components for example. Each image-representation component is transformed to obtain an unsharpened multi-resolution representation for each image-representation component. A multi-resolution representation includes a plurality of transformation level representations. Sharpness information is transported from an unsharpened transformation level representation of a first one of the image-representation components to a transformation level representation of an unsharpened multi-resolution representation of a second one of the image-representation components to create a sharpened multi-resolution representation of the second one of the image-representation components. The sharpened multi-resolution representation of the second one of the image-representation components is then transformed to obtain a sharpened image.
    Type: Grant
    Filed: May 15, 2017
    Date of Patent: October 2, 2018
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Wenyi Zhao, Simon P. DiMaio, David D. Scott
  • Publication number: 20180250828
    Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.
    Type: Application
    Filed: May 7, 2018
    Publication date: September 6, 2018
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Craig R. Gerbi, Theodore W. Rogers, Wenyi Zhao
  • Publication number: 20180249089
    Abstract: Mixed mode imaging is implemented using a single-chip image capture sensor with a color filter array. The single-chip image capture sensor captures a frame including a first set of pixel data and a second set of pixel data. The first set of pixel data includes a first combined scene, and the second set of pixel data includes a second combined scene. The first combined scene is a first weighted combination of a fluorescence scene component and a visible scene component due to the leakage of a color filter array. The second combined scene includes a second weighted combination of the fluorescence scene component and the visible scene component. Two display scene components are extracted from the captured pixel data in the frame and presented on a display unit.
    Type: Application
    Filed: April 27, 2018
    Publication date: August 30, 2018
    Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
  • Publication number: 20180225855
    Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.
    Type: Application
    Filed: April 5, 2018
    Publication date: August 9, 2018
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Publication number: 20180220064
    Abstract: An imaging system comprises an image capturing device, a viewer, a control element, and a processor. The control element controls or adjusts an image characteristic of one of the image capturing device and the viewer. The processor is programmed to determine a depth value relative to the image capturing device, determine a desirable adjustment to the control element by using the determined depth value, and control adjustment of the control element to assist manual adjustment of the control element to the desirable adjustment. The processor may also be programmed to determine whether the adjustment of the control element is to be automatically or manually adjusted and control adjustment of the control element automatically to the desirable adjustment if the control element is to be automatically adjusted.
    Type: Application
    Filed: March 28, 2018
    Publication date: August 2, 2018
    Inventors: Paul E. Lilagan, Wenyi Zhao
  • Patent number: 10008017
    Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.
    Type: Grant
    Filed: February 15, 2013
    Date of Patent: June 26, 2018
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Brandon D. Itkowitz, Daniel J. Halabe, Tao Zhao, Simon P. DiMaio, Christopher J. Hasser, Catherine J. Mohr, Paul W. Mohr, David Q. Larkin, Brian David Hoffman, Wenyi Zhao
  • Patent number: 9992428
    Abstract: Mixed mode imaging is implemented using a single-chip image capture sensor with a color filter array. The single-chip image capture sensor captures a frame including a first set of pixel data and a second set of pixel data. The first set of pixel data includes a first combined scene, and the second set of pixel data includes a second combined scene. The first combined scene is a first weighted combination of a fluorescence scene component and a visible scene component due to the leakage of a color filter array. The second combined scene includes a second weighted combination of the fluorescence scene component and the visible scene component. Two display scene components are extracted from the captured pixel data in the frame and presented on a display unit.
    Type: Grant
    Filed: January 27, 2016
    Date of Patent: June 5, 2018
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Wenyi Zhao, Jeffrey DiCarlo, Ian E. McDowall
  • Patent number: 9987751
    Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.
    Type: Grant
    Filed: June 10, 2016
    Date of Patent: June 5, 2018
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Craig R. Gerbi, Theodore W. Rogers, Wenyi Zhao
  • Publication number: 20180125333
    Abstract: A bleeding detection unit in a surgical system processes information in an acquired scene before that scene is presented on a display unit in the operating room. For example, the bleeding detection unit analyzes the pixel data in the acquired scene and determines whether there are one or more initial sites of blood in the scene. Upon detection of an initial site of blood, the region is identified by an initial site icon in the scene displayed on the display unit. In one aspect, the processing is done in real-time which means that there is no substantial delay in presenting the acquired scene to the surgeon.
    Type: Application
    Filed: January 5, 2018
    Publication date: May 10, 2018
    Inventors: Wenyi Zhao, Catherine J. Mohr, Jonathan M. Sorger
  • Publication number: 20180126559
    Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.
    Type: Application
    Filed: June 21, 2017
    Publication date: May 10, 2018
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Publication number: 20180124387
    Abstract: Techniques of augmented reality device calibration are disclosed. In some example embodiments, a system calibrates a visual inertial navigation (VIN) camera of a head mounted display (HMD) device with at least one eye camera of the HMD device to generate multi-camera calibration parameters, calibrating the at eye camera(s) with a display module of the HMD to generate display calibration parameters, calibrating the IMU with the VIN camera to generate VIN calibration parameters, and calibrating the IMU to the display module using the multi-camera calibration parameters, the display calibration parameters, and the VIN calibration parameters.
    Type: Application
    Filed: October 28, 2016
    Publication date: May 3, 2018
    Inventors: Wenyi Zhao, Christopher Broaddus, Aniket Murarka, Varun Nasery, Brendan Drew, Chen-Chi Chu, Lawrence Gunn
  • Publication number: 20180109773
    Abstract: An imaging system processes images of a plurality of objects which have been captured by an image capture device for display. Normal processing of the images is modified as either a function of a depth corresponding to one or more of the plurality of objects appearing in the captured images relative to the image capture device or as a function of the depth and one or more image characteristics extracted from the captured images. A depth threshold may be used to avoid inadvertent modifications due to noise.
    Type: Application
    Filed: December 13, 2017
    Publication date: April 19, 2018
    Inventors: Amy E. Kerdok, Wenyi Zhao
  • Patent number: D820319
    Type: Grant
    Filed: April 21, 2017
    Date of Patent: June 12, 2018
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Christopher Broaddus, Muzaffer Kal, Wenyi Zhao, Ali M. Tatari, Saud Akram, Pip Tompkin, Denny Liao, Madison Smith, Samuel McClellan