Patents by Inventor Daniel J. Halabe
Daniel J. Halabe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11941734Abstract: A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.Type: GrantFiled: March 26, 2021Date of Patent: March 26, 2024Assignee: INTUITIVE SURGICAL OPERATIONS, INC.Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian David Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Publication number: 20230249354Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera configured to capture an image of a camera field of view. The system further comprises an input device, a display, and a processor. The processor is configured to display a first synthetic image including a first synthetic image of the tool. The first synthetic image of the tool includes a portion of the tool outside of the camera field of view. The processor is also configured to receive a user input at the input device and responsive to the user input, change the display of the first synthetic image to a display of a second synthetic image including a second synthetic image of the tool that is different from the first synthetic image of the tool.Type: ApplicationFiled: March 21, 2023Publication date: August 10, 2023Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 11638999Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.Type: GrantFiled: July 17, 2020Date of Patent: May 2, 2023Assignee: INTUITIVE SURGICAL OPERATIONS, INC.Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Publication number: 20210256749Abstract: A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.Type: ApplicationFiled: March 26, 2021Publication date: August 19, 2021Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian David Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 10984567Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.Type: GrantFiled: March 12, 2019Date of Patent: April 20, 2021Assignee: INTUITIVE SURGICAL OPERATIONS, INC.Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian David Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Publication number: 20200368915Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.Type: ApplicationFiled: July 17, 2020Publication date: November 26, 2020Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 10737394Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.Type: GrantFiled: October 16, 2018Date of Patent: August 11, 2020Assignee: Intuitive Surgical Operations, Inc.Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Publication number: 20190213770Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.Type: ApplicationFiled: March 12, 2019Publication date: July 11, 2019Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian David Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 10282881Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.Type: GrantFiled: April 5, 2018Date of Patent: May 7, 2019Assignee: Intuitive Surgical Operations, Inc.Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Publication number: 20190047154Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.Type: ApplicationFiled: October 16, 2018Publication date: February 14, 2019Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 10137575Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.Type: GrantFiled: June 21, 2017Date of Patent: November 27, 2018Assignee: Intuitive Surgical Operations, Inc.Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Publication number: 20180225855Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.Type: ApplicationFiled: April 5, 2018Publication date: August 9, 2018Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 10008017Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.Type: GrantFiled: February 15, 2013Date of Patent: June 26, 2018Assignee: Intuitive Surgical Operations, Inc.Inventors: Brandon D. Itkowitz, Daniel J. Halabe, Tao Zhao, Simon P. DiMaio, Christopher J. Hasser, Catherine J. Mohr, Paul W. Mohr, David Q. Larkin, Brian David Hoffman, Wenyi Zhao
-
Publication number: 20180126559Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.Type: ApplicationFiled: June 21, 2017Publication date: May 10, 2018Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 9789608Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.Type: GrantFiled: March 31, 2009Date of Patent: October 17, 2017Assignee: Intuitive Surgical Operations, Inc.Inventors: Brandon D. Itkowitz, Daniel J. Halabe, Tao Zhao, Simon Dimaio, Christopher J. Hasser, Catherine J. Mohr, Paul W. Mohr, David Q. Larkin, Wenyi Zhao, Brian D. Hoffman
-
Publication number: 20170282372Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.Type: ApplicationFiled: June 21, 2017Publication date: October 5, 2017Inventors: Brandon D. Itkowitz, Simon P. DiMaio, Daniel J. Halabe, Christopher J. Hasser, Brian D. Hoffman, David Q. Larkin, Catherine J. Mohr, Paul W. Mohr, Tao Zhao, Wenyi Zhao
-
Patent number: 9526587Abstract: The present disclosure relates to systems, methods, and tools for tool tracking using image-derived data from one or more tool-located reference features. A method includes: capturing a first image of a tool that includes multiple features that define a first marker, where at least one of the features of the first marker includes an identification feature; determining a position for the first marker by processing the first image; determining an identification for the first marker by using the at least one identification feature by processing the first image; and determining a tool state for the tool by using the position and the identification of the first marker.Type: GrantFiled: April 23, 2009Date of Patent: December 27, 2016Assignee: Intuitive Surgical Operations, Inc.Inventors: Tao Zhao, Wenyi Zhao, Daniel J. Halabe, Brian D. Hoffman, William C. Nowlin
-
Publication number: 20140055489Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.Type: ApplicationFiled: February 15, 2013Publication date: February 27, 2014Applicant: Intuitive Surgical Operations, Inc.Inventors: Brandon D. Itkowitz, Daniel J. Halabe, Tao Zhao, Simon P. DiMaio, Christopher J. Hasser, Catherine J. Mohr, Paul W. Mohr, David Q. Larkin, Brian David Hoffman, Wenyi Zhao
-
Publication number: 20100168562Abstract: The present disclosure relates to systems, methods, and tools for tool tracking using image-derived data from one or more tool-located reference features. A method includes: capturing a first image of a tool that includes multiple features that define a first marker, where at least one of the features of the first marker includes an identification feature; determining a position for the first marker by processing the first image; determining an identification for the first marker by using the at least one identification feature by processing the first image; and determining a tool state for the tool by using the position and the identification of the first marker.Type: ApplicationFiled: April 23, 2009Publication date: July 1, 2010Applicant: INTUITIVE SURGICAL, INC.Inventors: Tao Zhao, Wenyi Zhao, Daniel J. Halabe, Brian D. Hoffman, William C Nowlin
-
Publication number: 20090192524Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.Type: ApplicationFiled: March 31, 2009Publication date: July 30, 2009Applicant: Intuitive Surgical, Inc.Inventors: Brandon D. Itkowitz, Daniel J. Halabe, Tao Zhao, Simon Dimaio, Christopher J. Hasser, Catherine J. Mohr, Paul W. Mohr, David Q. Larkin, Wenyi Zhao, Brian D. Hoffman