Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, or external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.

Abstract: A surgical system comprises an instrument and a teleoperated instrument operation system. The instrument comprises a drive member having an end effector coupled to the distal end and a ratchet assembly coupled to the proximal end. The ratchet assembly includes a pin, a gear, and a spring- loaded button. A lever is coupled to and configured to pivot relative to the ratchet assembly to engage the spring-loaded button to disengage the pin from the gear. The lever in a first position places the ratchet assembly in a gripping position in which the end effector grips a surgical accessory. The lever in a second position places the ratchet assembly in a release position in which the end effector releases the surgical accessory. The lever is movable while compressing the spring-loaded button. The teleoperated instrument operation system comprises a capture mechanism configured to move the lever between the first and second positions.

Abstract: An endoscope captures images of a surgical site for display in a viewing area of a monitor. When a tool is outside the viewing area, a GUI indicates the position of the tool by positioning a symbol in a boundary area around the viewing area so as to indicate the tool position. The distance of the out-of-view tool from the viewing area may be indicated by the size, color, brightness, or blinking or oscillation frequency of the symbol. A distance number may also be displayed on the symbol. The orientation of the shaft or end effector of the tool may be indicated by an orientation indicator superimposed over the symbol, or by the orientation of the symbol itself. When the tool is inside the viewing area, but occluded by an object, the GUI superimposes a ghost tool at its current position and orientation over the occluding object.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, or external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.

Abstract: A minimally invasive system comprises an elongate medical instrument including a flexible body. The flexible body includes a wall including a channel, and the channel includes a groove. The flexible body further includes a lumen defined by an interior surface of the wall and a curved distal tip portion. The elongate medical instrument further includes a shape sensor coupled to the flexible body. The shape sensor is at least partially positioned within the groove, and the shape sensor is configured to detect shape characteristics of at least a portion of the flexible body. The system further includes an actuator for manipulating the elongate medical instrument.

Abstract: An endoscope captures images of a surgical site for display in a viewing area of a monitor. When a tool is outside the viewing area, a GUI indicates the position of the tool by positioning a symbol in a boundary area around the viewing area so as to indicate the tool position. The distance of the out-of-view tool from the viewing area may be indicated by the size, color, brightness, or blinking or oscillation frequency of the symbol. A distance number may also be displayed on the symbol. The orientation of the shaft or end effector of the tool may be indicated by an orientation indicator superimposed over the symbol, or by the orientation of the symbol itself. When the tool is inside the viewing area, but occluded by an object, the GUI superimposes a ghost tool at its current position and orientation over the occluding object.

Abstract: To perform a tool exchange in a medical robotic system, tool is retracted back into an entry guide from a deployed position and pose so that an assistant in the operating room may replace it with a different tool. While the tool is being retracted back towards the entry guide by user action, its configuration is changed to an entry pose while avoiding collisions with other objects so that it may fit in the entry guide. After the tool exchange is completed, a new tool is inserted in the entry guide and extended out of the guide by user action to the original position of the old tool prior to its retraction into the entry guide while the tool's controller assists the user by reconfiguring the new tool so as to resemble the original deployed pose of the old tool prior to its retraction into the entry guide.

Abstract: A surgical system uses a single entry port in a wide variety of surgeries. To insert multiple surgical instruments into a patient through a single entry port requires that the shaft of at least one of the surgical instruments be bent between the base of the surgical instrument and the point where the shaft contacts a channel in an entry guide. Each surgical instrument is positioned by an instrument manipulator positioning system so that when the shaft is inserted in a channel of the entry guide, any bending of the shaft does not damage the surgical instrument and does not inhibit proper operation of the surgical instrument.

Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.

Abstract: A user interface for a surgical system can include a display configured to output video images of a remote surgical site at which one or more electrosurgical instruments of the surgical system are deployed; and a graphical user interface configured to be output on the display with the video images. The graphical user interface may comprise a visual indication of a state of the one or more electrosurgical instruments that indicates a state of the one or more electrosurgical instruments being ready for activation to deliver energy or actively delivering energy.

Abstract: An endoscope captures images of a surgical site for display in a viewing area of a monitor. When a tool is outside the viewing area, a GUI indicates the position of the tool by positioning a symbol in a boundary area around the viewing area so as to indicate the tool position. The distance of the out-of-view tool from the viewing area may be indicated by the size, color, brightness, or blinking or oscillation frequency of the symbol. A distance number may also be displayed on the symbol. The orientation of the shaft or end effector of the tool may be indicated by an orientation indicator superimposed over the symbol, or by the orientation of the symbol itself. When the tool is inside the viewing area, but occluded by an object, the GUI superimposes a ghost tool at its current position and orientation over the occluding object.

Abstract: A surgical system uses a single entry port in a wide variety of surgeries. To insert multiple surgical instruments into a patient through a single entry port requires that the shaft (262A1) of at least one (260A1) of the surgical instruments be bent between the base of the surgical instrument (260A1) and the point where the shaft contacts a channel in an entry guide (270A). Each surgical instrument (260A1, 260A2) is positioned by an instrument manipulator positioning system (231A) so that when the shaft is inserted in a channel of the entry guide (270A), any bending of the shaft does not damage the surgical instrument and does not inhibit proper operation of the surgical instrument.

Abstract: Collisions between a minimally invasive surgical instrument and patient tissue are prevented in various ways. A real time image of a surgical site is mosaiced over a previously recorded more distal image of the site. Surgical instruments are visible in the real time image, and representations of the surgical instruments as they would appear in the previously recorded image are generated and displayed on the previously recorded image. Consequently, a person moving the surgical instruments sees a representation of the instruments outside the field of view of an imaging system taking the real time images.

Abstract: A system includes a control device, a manipulator configured to support a tool having a tool frame, and at least one processor coupled to the control device and the manipulator. The at least one processor is configured to perform a method. The method includes receiving one or more images captured by an image-capturing system, the image-capturing system having an image frame. The tool is visible in the one or more images. The method further includes determining, based on information in the one or more images, an estimated frame transform relating the image frame and the tool frame, determining, based on the estimated frame transform, an output movement for the tool in response to an input at the control device, and causing movement of the tool according to the output movement.

Abstract: A minimally invasive system comprises an elongate medical instrument including a lumen; an elongate, flexible stylet removably receivable within the lumen; a sensor system coupled to the stylet, the sensor system configured to detect characteristics of at least a portion of the elongate medical instrument; and a processor. The processor comprises an error detection module configured to receive the detected characteristics from the sensor system; compare the detected characteristics with expected characteristics of at least the portion of the elongate medical instrument; and notify a user of a deviation between the detected characteristics and the expected characteristics. The processor further comprises a path planning module configured to intraoperatively generate, based on a shape of at least the portion of the elongate medical instrument detected by the sensor system, a target trajectory for continuing advancement of the elongate medical instrument within a patient anatomy.

Abstract: A robotic system includes a camera having an image frame whose position and orientation relative to a fixed frame is determinable through one or more image frame transforms, a tool disposed within a field of view of the camera and having a tool frame whose position and orientation relative to the fixed frame is determinable through one or more tool frame transforms, and at least one processor programmed to identify pose indicating points of the tool from one or more camera captured images, determine an estimated transform for an unknown one of the image and tool frame transforms using the identified pose indicating points and known ones of the image and tool frame transforms, update a master-to-tool transform using the estimated and known ones of the image and tool frame transforms, and command movement of the tool in response to movement of a master using the updated master-to-tool transform.

Abstract: A user interface for a surgical system can include a display configured to output video images of a remote surgical site at which one or more electrosurgical instruments of the surgical system are deployed; and a graphical user interface configured to be output on the display with the video images. The graphical user interface may comprise a visual indication of a state of the one or more electrosurgical instruments that indicates a state of the one or more electrosurgical instruments being ready for activation to deliver energy or actively delivering energy.

Abstract: Telerobotic, telesurgical, and/or surgical robotic devices, systems, and methods employ surgical robotic linkages that may have more degrees of freedom than an associated surgical end effector in space. A processor can calculate a tool motion that includes pivoting of the tool about an aperture site. Linkages movable along a range of configurations for a given end effector position may be driven toward configurations which inhibit collisions. Refined robotic linkages and methods for their use are also provided.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, or external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.