Patents by Inventor Wenyi Zhao

Wenyi Zhao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230000568
    Abstract: A system may comprise a tool including at least one reference feature. a processor, and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, may cause the system to receive image data including an image of the tool and the at least one reference feature, determine a pose of the tool from the image data, and modify the image data to visually decrement a portion of the image data corresponding to the at least one reference feature.
    Type: Application
    Filed: September 12, 2022
    Publication date: January 5, 2023
    Inventors: Tao Zhao, Wenyi Zhao, William C. Nowlin
  • Patent number: 11471221
    Abstract: A tool tracking method comprises receiving stereo image data of a tool. The tool includes a tracking marker. The method also comprises receiving first kinematic data for the tool and determining a three-dimensional image-derived pose of the tool from the stereo image data of the tool and the tracking marker. The method also comprises determining a first kinematic pose of the tool from the first kinematic data and determining a pose offset between the image-derived pose of the tool and the first kinematic pose of the tool. The method also comprises determining a corrected first kinematic pose of the tool based on the pose offset and the first kinematic data.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: October 18, 2022
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Tao Zhao, William C. Nowlin, Wenyi Zhao
  • Publication number: 20220296317
    Abstract: A system may comprise an image capture device to capture an image of a work site. The system may also comprise a processor to determine whether a tool disposed at the work site is energized and determine a first area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image. The processor may also determine a second area of the captured image including a remainder of the captured image that does not include the first area. Conditioned upon determining that the tool is energized, at least one of the first area and the second area of the captured image of the work site may be processed to indicate that the tool in the first area is being energized. The image of the work site with the first area and the second area may be displayed.
    Type: Application
    Filed: June 3, 2022
    Publication date: September 22, 2022
    Inventors: SIMON P. DIMAIO, Brian D. Hoffman, Brandon D. Itkowitz, Paul W. Mohr, David W. Robinson, Tao Zhao, Wenyi Zhao
  • Publication number: 20220294995
    Abstract: An example method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.
    Type: Application
    Filed: May 31, 2022
    Publication date: September 15, 2022
    Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
  • Publication number: 20220261956
    Abstract: An exemplary method includes a demosaic module receiving a frame of raw pixels having values in a first color space, generating vertical and horizontal color difference signals using information from the frame of raw pixels, generating reconstructed color pixel values for raw pixels that are missing captured color pixel values of a first color component of the first color space, transforming the captured and reconstructed color pixel values of the first color component to brightness pixel values in a second color space, and transforming the vertical and horizontal color difference signals into chrominance pixel values in the second color space.
    Type: Application
    Filed: May 9, 2022
    Publication date: August 18, 2022
    Inventor: Wenyi Zhao
  • Publication number: 20220227000
    Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.
    Type: Application
    Filed: January 31, 2022
    Publication date: July 21, 2022
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Craig R. Gerbi, Theodore W. Rogers, Wenyi Zhao
  • Patent number: 11389255
    Abstract: A system may comprise an image capture device disposed to capture an image of a work site, a display, and a processor. The processor may be configured to determine whether a tool disposed at the work site is energized and determine an area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image, to be filtered to indicate the tool has been energized. Conditioned upon determining that the tool is energized, the processer may also filter the area of the captured image of the work site to generate a filtered area of the captured image of the work site so as to create a glowing effect on the image of the portion of the energized tool, indicating that the tool is being energized. The image of the work site with the filtered area may be displayed on the display.
    Type: Grant
    Filed: November 20, 2019
    Date of Patent: July 19, 2022
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Simon P. DiMaio, Brian D. Hoffman, Brandon D. Itkowitz, Paul W. Mohr, David W. Robinson, Tao Zhao, Wenyi Zhao
  • Patent number: 11381759
    Abstract: An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.
    Type: Grant
    Filed: January 27, 2021
    Date of Patent: July 5, 2022
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
  • Publication number: 20220191388
    Abstract: A method for intelligent manual adjustment of a manually rotatable focus control of a camera may comprise determining a depth value of a target area relative to the camera and determining a desirable focus adjustment according to a direction and an amount that a focal point of the camera is to be moved in order to coincide with the depth value of the target area. The method may also comprise assisting an operator of the manually rotatable focus control to the desirable focus adjustment by providing a haptic force on the manually rotatable focus control that decreases as the focal point of the camera moves toward the depth value of the target area and increases as the focal point of the camera moves away from the depth value of the target area.
    Type: Application
    Filed: March 4, 2022
    Publication date: June 16, 2022
    Inventors: Paul E. Lilagan, Wenyi Zhao
  • Publication number: 20220159848
    Abstract: A flexible display panel includes a flexible display body and a supporting structure disposed on a side of the flexible display body. The supporting structure includes a plurality of supporting layers disposed on a stack and a flexible layer disposed between each two adjacent supporting layers. An angle between at least one supporting layer of the plurality of supporting layers and a plane where a display surface of the flexible display body is located is greater than 0° and less than 90°.
    Type: Application
    Filed: February 7, 2022
    Publication date: May 19, 2022
    Applicant: Hefei Visionox Technology Co., Ltd.
    Inventors: Fengzhi YU, Mingfu ZHANG, Tao ZHOU, Wenyi ZHAO
  • Publication number: 20220132093
    Abstract: A calibration assembly may be used with an endoscopic imaging system having a field of view. The calibration assembly may comprise an interface configured for constraining engagement with the endoscopic imaging system and a target coupled with the interface so as to be within the field of view. The target may include a plurality of calibration features. The calibration assembly may be reconfigurable from a first spatial arrangement between the target and the endoscopic imaging system to a second spatial arrangement between the target and the endoscopic imaging system. The calibration assembly may also comprise a processor configured to obtain, from the endoscopic imaging system, first and second images of at least some of the calibration features of the target at the first and second spatial arrangements. The processor may also generate calibration data for the endoscopic imaging system using the first and second images.
    Type: Application
    Filed: January 6, 2022
    Publication date: April 28, 2022
    Inventors: Tao Zhao, Wenyi Zhao, David D. Scott
  • Patent number: 11290637
    Abstract: A method performed by a processor comprises determining a depth value of a target area relative to the image capturing device. The method also includes determining an adjustment to the brightness control so that a brightness level of images captured by the image capturing device is lowered if the depth value of the target area relative to the image capturing device is less than a threshold depth value. The method also includes determining whether an adjustment of the brightness control is to be automatically or manually adjusted. If the adjustment of the brightness control is to be manually adjusted, the processor over-rides manual control of the brightness control if an operator of the brightness control is causing the brightness level of images not to be lowered if the depth value of the target area relative to the image capturing device is less than the threshold depth value.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: March 29, 2022
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Paul E. Lilagan, Wenyi Zhao
  • Publication number: 20220092747
    Abstract: The systems and methods described can include approaches to calibrate head-mounted displays for improved viewing experiences. Some methods include receiving data of a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device; receiving data of a first captured image associated with deformed state of the first eyepiece of the head-mounted display device; determining a first transformation that maps the first captured image to the image; and applying the first transformation to a subsequent image for viewing on the first eyepiece of the head-mounted display device.
    Type: Application
    Filed: December 3, 2021
    Publication date: March 24, 2022
    Inventors: Lionel Ernest Edwin, Samuel A. Miller, Etienne Gregoire Grossmann, Brian Christopher Clark, Michael Robert Johnson, Wenyi Zhao, Nukul Sanjay Shah, Po-Kang Huang
  • Patent number: 11260535
    Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: March 1, 2022
    Assignee: Intuitive Surgical Operations, Inc.
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Craig R. Gerbi, Theodore W. Rogers, Wenyi Zhao
  • Patent number: 11252395
    Abstract: A calibration target comprises a target pattern plane having a planar surface and a plurality of markers disposed on the planar surface. An optical axis of the imaging system is at a first angle with respect to the planar surface of the target pattern plane when the calibration target is being used to calibrate the imaging system. The plurality of markers is pre-warped in size and aspect ratio using a set of trigonometric functions that use the first angle and a distance from the imaging system to the marker, so that each of the plurality of markers appears a substantially same size as all others of the plurality of markers when viewed by the imaging system at the first angle. The plurality of markers includes a plurality of localizer features that have known relative positions on the target pattern plane and are used to determine an orientation for each marker.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: February 15, 2022
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Tao Zhao, Wenyi Zhao, David D. Scott
  • Patent number: 11200646
    Abstract: The systems and methods described can include approaches to calibrate head-mounted displays for improved viewing experiences. Some methods include receiving data of a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device; receiving data of a first captured image associated with deformed state of the first eyepiece of the head-mounted display device; determining a first transformation that maps the first captured image to the image; and applying the first transformation to a subsequent image for viewing on the first eyepiece of the head-mounted display device.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: December 14, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Lionel Ernest Edwin, Samuel A. Miller, Etienne Gregoire Grossmann, Brian Christopher Clark, Michael Robert Johnson, Wenyi Zhao, Nukul Sanjay Shah, Po-Kang Huang
  • Patent number: 11110437
    Abstract: A method for preparing an SCR catalyst may include: (1) placing a first aqueous solution containing a titanium oxide and a tungstate in an electric field environment, adjusting the pH value of the first aqueous solution, and adjusting the current direction of the electric field environment to obtain a first mixture; (2) providing a second mixture by, in the electric field environment, adding dropwise a second aqueous solution containing a soluble salt of one or more active components, a copper-organic polyamine complex and a dispersant to the first mixture, and adjusting the current direction; and (3) processing the second mixture to obtain the SCR catalyst. The one or more active components may be selected from Ce, Zr, Cu, Fe, Pr and Sc.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: September 7, 2021
    Assignees: BAOTOU RESEARCH INSTITUTE OF RARE EARTHS, NATIONAL ENGINEERING RESEARCH CENTRE OF RUIKE RARE EARTH METALLURGY AND FUNCTION MATERIALS CO., LTD., HEBEI HWAT AUTOMOBILE COMPONENTS CO., LTD.
    Inventors: Wenyi Zhao, Yan Wang, Zhaoqiang Li, Cheng Zhang, Rongrong Fan, Xin Guo, Yu Wang, Rong Wang, Lihua Song, Yanhai Song, Yuan Li, Zhiyong Ding, Jing Song
  • Publication number: 20210256749
    Abstract: A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.
    Type: Application
    Filed: March 26, 2021
    Publication date: August 19, 2021
    Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian David Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
  • Patent number: 11090003
    Abstract: Methods, systems, and apparatus for periodically and simultaneously scanning for a plurality of vital signs of a user is disclosed. The system includes a personal portable wireless vital signs scanner having a pair of electrodes to form a circuit with a user's body; and a personal wireless multifunction device wirelessly in communication with the personal portable wireless vital signs scanner. The personal portable wireless vital signs scanner includes a processor to concurrently scan for a plurality of vital signs. Some methods include squeezing a personal wireless vital signs scanner between first and second fingers to connect to a first electrode; and pressing the wireless vital signs scanner against a forehead to form a circuit through the body of the user with the personal wireless vital signs scanner. The wireless vital signs scanner may also be pressed against a chest to form a second circuit through the body of the user.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: August 17, 2021
    Assignee: HEALTHY.IO LTD.
    Inventors: Wenyi Zhao, Brandon Dennis Woolsey, Walter De Brouwer, Eron Anthony Villarreal, Whitney Morgan McGowan
  • Publication number: 20210217147
    Abstract: The systems and methods described can include approaches to calibrate head-mounted displays for improved viewing experiences. Some methods include receiving data of a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device; receiving data of a first captured image associated with deformed state of the first eyepiece of the head-mounted display device; determining a first transformation that maps the first captured image to the image; and applying the first transformation to a subsequent image for viewing on the first eyepiece of the head-mounted display device.
    Type: Application
    Filed: December 21, 2020
    Publication date: July 15, 2021
    Inventors: Lionel Ernest Edwin, Samuel A. Miller, Etienne Gregoire Grossmann, Brian Christopher Clark, Michael Robert Johnson, Wenyi Zhao, Nukul Sanjay Shah, Po-Kang Huang