Abstract: In one embodiment of the invention, a a minimally invasive surgical system is disclosed. The system configured to capture and display camera images of a surgical site on at least one display device at a surgeon console; switch out of a following mode and into a masters-as-mice (MaM) mode; overlay a graphical user interface (GUI) including an interactive graphical object onto the camera images; and render a pointer within the camera images for user interactive control. In the following mode, the input devices of the surgeon console may couple motion into surgical instruments. In the MaM mode, the input devices interact with the GUI and interactive graphical objects. The pointer is manipulated in three dimensions by input devices having at least three degrees of freedom. Interactive graphical objects are related to physical objects in the surgical site or a function thereof and are manipulatable by the input devices.

Abstract: A method for determining a shape of a lumen in an anatomical structure comprises reading information from a plurality of strain sensors disposed substantially along a length of a flexible medical device when the flexible medical device is positioned in the lumen. When the flexible medical device is positioned in the lumen, the flexible medical device conforms to the shape of the lumen. The method further comprises computationally determining, by a processing system, the shape of the lumen based on the information from the plurality of strain sensors.

Abstract: A bend sensor is used to determine force applied to a robotic arm. The force may be an external force applied to the arm, an internal actuation force, or both. In some aspects, a stiffening element is used to restore the arm to a minimum kinematic energy state. In other aspects, the stiffening element is eliminated, and the arm is fully actuated.

Abstract: A minimally invasive surgical system is disclosed including a processor coupled to a stereoscopic endoscope and a stereoscopic video display device. The processor generates an operative image of an anatomic structure in the surgical site, overlays the operative image onto the captured stereo video images for display on the stereoscopic video display device, generates and overlays a pointer onto the operative image or the captured stereo video images to display the pointer on the stereoscopic video display device with a three dimensional appearance, and switches between a first mode for input devices of a surgeon console used to couple motion into surgical instruments and a second mode used to control an interactive graphical user interface to allow interactions with the pointer and the operative image in three dimensions using input devices having at least three degrees of freedom.

Abstract: A medical system may comprise a stereo display and an input device. The medical system may also comprise a processor configured to generate a three-dimensional image of an anatomical object and cause the three-dimensional image of the anatomical object and a two-dimensional window to be displayed. The processor may also be configured to cause a position and an orientation of the two-dimensional window relative to the three-dimensional image of the anatomical object to be changed on the stereo display by manipulation of the input device. The processor may also be configured to define a cut-plane to indicate a two-dimensional slice of the three-dimensional image of the anatomical object. The processor may also be configured to cause the two-dimensional slice of the three-dimensional image of the anatomical object to be displayed. An orientation of the displayed two-dimensional slice may be different than an orientation of the cut-plane with the three-dimensional image.

Abstract: Telerobotic, telesurgical, and/or surgical robotic devices, systems, and methods employ surgical robotic linkages that may have more degrees of freedom than an associated surgical end effector in space. A processor can calculate a tool motion that includes pivoting of the tool about an aperture site. Linkages movable along a range of configurations for a given end effector position may be driven toward configurations which inhibit collisions. Refined robotic linkages and methods for their use are also provided.

Abstract: An apparatus comprises a surgical instrument mountable to a robotic manipulator. The surgical instrument comprises an elongate arm. The elongate arm comprises an actively controlled bendable region including at least one joint region, a passively bendable region including a distal end coupled to the actively controlled bendable region, an actuation mechanism extending through the passively bendable region and coupled to the at least one joint region to control the actively controlled bendable region, and a channel extending through the elongate arm. The surgical instrument also comprises an optical fiber positioned in the channel. The optical fiber includes an optical fiber bend sensor in at least one of the passively bendable region or the actively controlled bendable region.

Abstract: In a coupled control mode, an operator directly controls movement of an associated manipulator with an input device while indirectly controlling movement of one or more non-associated manipulators, in response to commanded motion of the directly controlled manipulator, to achieve a secondary objective. By automatically performing secondary tasks through coupled control modes, the system's usability is enhanced by reducing the operator's need to switch to another direct mode to manually achieve the desired secondary objective. Thus, coupled control modes allow the operator to better focus on performing tasks and to pay less attention to managing the system.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, or external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.

Abstract: A system comprises an arm including a bendable section and a force transmission mechanism. The system also comprises an actuation mechanism coupled to the force transmission mechanism to bend the bendable section. The system also comprises an electronic data processor configured to receive sensor data about the bendable section and determine external force information about at least one of a magnitude or a direction of an external force applied to the arm from the sensor data. the processor is also configured to determine a pose of the bendable section from the sensor data and generate control information for the actuation mechanism to maintain the pose of the bendable section in a stationary configuration as the external force is applied to or withdrawn from the arm.

Abstract: Techniques for limiting motion of a first structure include a manipulator supported by the first structure, a second structure supporting the first structure, and a processor. The processor is configured to, in response to entering a first mode, determine, relative to the first structure, a first position of a reference location on entry into the first mode, the reference location being associated with a link of the manipulator; and while in the first mode: detect a manual movement of the reference location to a second position relative to the first structure, wherein a difference between the first and second positions comprises a displacement having first and second components in respective different first and second directions; and, in response, command the second structure to move relative to the reference location in the first direction so as to reduce the first component while not changing the second component.

Abstract: A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.

Abstract: An apparatus for performing surgical procedures is disclosed including a flexible entry guide tube and a first steering device. The guide tube has one or more lumens extending along its length from a proximal end to substantially at or near a distal end. At least one of the one or more lumens is an instrument lumen with open ends to receive a flexible shaft of a surgical tool. The first steering device is insertable into the instrument lumen to shape the guide tube as it is inserted through an opening in a body and along a path towards a surgical site. The apparatus may further include a flexible locking device to couple to the flexible entry guide tube and selectively rigidize the guide tube to hold its shape. The guide tube may be steered by remote control with one or more actuators.

Abstract: A tele-operated system includes a platform, a manipulator supported by the platform, a support structure supporting the platform, and a processor. In a platform movement mode the processor is configured to sense a manual movement of a link of the manipulator relative to the platform that moves the link from a first to a second positional relationship relative to the platform wherein a difference between the first and second positional relationships includes a displacement having components in first, second, and third directions that are perpendicular to one another, calculate, in response to the sensed manual movement, a command for the support structure that causes the link to move in the first direction so as to reduce the displacement in the first direction and does not change the displacement in the second direction, and transmit the command to the support structure so as to move the platform and the manipulator.

Abstract: A user interface for a surgical system can include a display configured to output video images of a remote surgical site at which one or more electrosurgical instruments of the surgical system are deployed; and a graphical user interface configured to be output on the display with the video images. The graphical user interface may comprise a visual indication of a state of the one or more electrosurgical instruments that indicates a state of the one or more electrosurgical instruments being ready for activation to deliver energy or actively delivering energy.

Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.

Abstract: An apparatus comprises a flexible entry guide tube comprising one or more lumens, wherein at least one lumen is an instrument lumen; and a rigidizing cable to lock a shape of the guide tube within a body cavity with a distal end of the guide tube near a medical site. The rigidizing cable can steer the guide tube. The apparatus comprises a flexible tool insertable into the instrument lumen. The tool can perform a medical procedure near the distal end of the guide tube. The tool comprises an end effector, a steerable tip portion, and a steering cable for steering the tip portion. While the tip portion remains within the instrument lumen, articulation of the tip portion causes corresponding articulation of a distal portion of the guide tube. The tool can extend away from the distal end while the shape of the guide tube is locked by the rigidizing cable.

Abstract: A user interface for a surgical system can include a display configured to output video images of a remote surgical site at which one or more electrosurgical instruments of the surgical system are deployed; and a graphical user interface configured to be output on the display with the video images. The graphical user interface may comprise a visual indication of a state of the one or more electrosurgical instruments that indicates a state of the one or more electrosurgical instruments being ready for activation to deliver energy or actively delivering energy.

Abstract: A method comprises receiving a surgical instrument into engagement with a grip actuator of a teleoperational activation system. The surgical instrument includes movable jaws, and the surgical instrument is received in a prearranged gripping configuration with the jaws gripping a surgical accessory. The method includes generating a first control signal for manipulating the surgical instrument while maintaining the surgical instrument in the prearranged gripping configuration. The method further includes generating a second control signal for manipulating the surgical instrument to move from the prearranged gripping configuration to a second configuration.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined. using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, of external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.