Abstract: A method comprises receiving a surgical instrument into engagement with a grip actuator of a teleoperational activation system. The surgical instrument includes movable jaws, and the surgical instrument is received in a prearranged gripping configuration with the jaws gripping a surgical accessory. The method includes generating a first control signal for manipulating the surgical instrument while maintaining the surgical instrument in the prearranged gripping configuration. The method further includes generating a second control signal for manipulating the surgical instrument to move from the prearranged gripping configuration to a second configuration.

Abstract: A method comprises receiving a surgical instrument into engagement with a grip actuator of a teleoperational activation system. The surgical instrument includes movable jaws, and the surgical instrument is received in a prearranged gripping configuration with the jaws gripping a surgical accessory. The method includes generating a first control signal for manipulating the surgical instrument while maintaining the surgical instrument in the prearranged gripping configuration. The method further includes generating a second control signal for manipulating the surgical instrument to move from the prearranged gripping configuration to a second configuration.

Abstract: Techniques for retracting an instrument into an entry guide include an entry guide manipulator configured to support an entry guide and an instrument manipulator configured to support an instrument. The robotic system is configured to receive a command indicating a commanded movement of the entry guide in a direction parallel to an insertion axis of the entry guide; in response to the commanded movement of the entry guide being greater than a threshold distance in the direction parallel to the insertion axis, cause a response comprising one or more actions selected from the group consisting of: movement, using the instrument manipulator, of one or more rotational joints of the instrument external to the entry guide toward a distal end of the entry guide; and actuation of the one or more rotational joints to straighten the instrument so that the instrument can be retracted into the entry guide.

Abstract: Techniques for control using hand tracking include a system having an input control configured to be manipulated by an operator of the system, a hand tracking unit, and a controller. The controller is configured to determine a first position of the input control; receive, from the hand tracking unit, a second position of a hand of the operator; determine whether the first position is within a threshold distance of the second position; and control display of a user interface based on the determination of whether the first position is within the threshold distance of the second position.

Abstract: A method for intelligent manual adjustment of a manually rotatable focus control of a camera may comprise determining a depth value of a target area relative to the camera and determining a desirable focus adjustment according to a direction and an amount that a focal point of the camera is to be moved in order to coincide with the depth value of the target area. The method may also comprise assisting an operator of the manually rotatable focus control to the desirable focus adjustment by providing a haptic force on the manually rotatable focus control that decreases as the focal point of the camera moves toward the depth value of the target area and increases as the focal point of the camera moves away from the depth value of the target area.

Abstract: Techniques for retracting an instrument into an entry guide include receiving a retraction command for the instrument, the retraction command commanding movement of the instrument into the entry guide; causing, in response to the retraction command and using an instrument manipulator, movement of a rotational joint of the instrument that is external to the entry guide toward a distal end of the entry guide; actuating, after the rotational joint reaches a minimum distance from the distal end of the entry guide, the rotational joint to orient a link of the instrument so that the link can be retracted into the entry guide, the link being adjacent to and distal to the rotational joint; and causing, after the link is oriented so that the link can be retracted into the entry guide and using the instrument manipulator, further movement of the rotational joint toward the distal end of the entry guide.

Abstract: A medical robotic system includes a viewer, a gaze tracker, and a processor programmed to: draw an area or volume defining shape overlaid on an image based on the tracked gaze point after the user has gazed on the tracked gaze point for a programmed period of time; in response to receiving a user-selected action command, assign a fixed virtual constraint to the area or volume defining shape and constrain movement of a robotic tool; map points of the robotic tool in a tool reference frame to a viewer reference frame; determine a closest object to the tracked gaze point is the robotic tool based at least in part on the mapped points; display an object including text identifying the robotic tool, overlaid on the image, proximate to the robotic tool based on determining the robotic tool is the closest object; and perform an action indicated by the object.

Abstract: A robotic system provides user selectable actions associated with gaze tracking according to user interface types. User initiated correction and/or recalibration of the gaze tracking may be performed during the processing of individual of the user selectable actions.

Abstract: A method and system for hand tracking in a robotic system includes a hand tracking system and a controller coupled to the hand tracking system. The controller is configured to receive, from the hand tracking system, a plurality of locations of a hand; determine if the hand is in a first hand pose based on the plurality of locations; in response to determining that the hand is in the first hand pose, and switch the robotic system to a hand trajectory detection mode. While in the hand trajectory detection mode, the control unit is configured to detect, based on hand tracking information from the hand tracking system, that the hand has performed a first hand trajectory of a plurality of known hand trajectories; and in response to detecting the first hand trajectory, change a mode of operation of the robotic system.

Abstract: A teleoperative system includes an input device and a controller. The controller is configured to receive input associated with movement of the input device, determine a commanded pose of an instrument coupled to the teleoperative system based on the received input, determine a first preferred pose of the instrument based on at least one parameter selected from a group consisting of: a type of the instrument and an operating mode of the instrument, determine a first feedback force command based on a difference between the commanded pose and the first preferred pose, and actuate the input device based on the first feedback force command.

Abstract: Techniques for retracting an instrument into an entry guide include receiving a retraction command for the instrument, the retraction command commanding movement of the instrument into the entry guide; causing, in response to the retraction command and using an instrument manipulator, movement of a rotational joint of the instrument that is external to the entry guide toward a distal end of the entry guide; actuating, after the rotational joint reaches a minimum distance from the distal end of the entry guide, the rotational joint to orient a link of the instrument so that the link can be retracted into the entry guide, the link being adjacent to and distal to the rotational joint; and causing, after the link is oriented so that the link can be retracted into the entry guide and using the instrument manipulator, further movement of the rotational joint toward the distal end of the entry guide.

Abstract: A medical system comprises an entry guide, a display, and a processor. The processor may be configured to receive state information for an articulatable image capture device controllably extendable out of a distal end of the entry guide. The processor may be configured to generate a view including a graphical representation of a distal end portion of the articulatable image capture device as determined from the received state information and a graphical representation of a field of view of the articulatable image capture device extending distally from the distal end portion of the articulatable image capture device. The processor may also cause the view to be displayed on the display.

Abstract: A medical robotic system includes articulated instruments extending out of a distal end of an entry guide. Prior to pivoting the entry guide to re-orient it and the instruments, the instruments are moved in tandem back towards the entry guide after a delay. Haptic cues and velocity limits are provided to assist the operator in the retraction of the instruments. After retraction, the entry guide may then be pivoted without concern that the instruments will harm patient anatomy. The movement of the instruments in tandem back towards the entry guide may also occur through coupled control modes while the entry guide is held in a fixed position and orientation.

Abstract: A medical robotic system includes an entry guide with surgical tools and a camera extending out of its distal end. To supplement the view provided by an image captured by the camera, an auxiliary view including articulatable arms of the surgical tools and/or camera is generated from sensed or otherwise determined information about their positions and orientations are displayed along with indications of range of motion limitations on a display screen from the perspective of a specified viewing point.

Abstract: Embodiments of a rotating assistant port device are presented. The assistant port device can be utilized to provide for additional assistant instruments in single port robotic surgery. In some embodiments, the assistant port device can be utilized for skin retraction during single port teleoperated robotic surgery.

Abstract: A method for intelligent manual adjustment of a manually rotatable focus control of a camera may comprise determining a depth value of a target area relative to the camera and determining a desirable focus adjustment according to a direction and an amount that a focal point of the camera is to be moved in order to coincide with the depth value of the target area. The method may also comprise assisting an operator of the manually rotatable focus control to the desirable focus adjustment by providing a haptic force on the manually rotatable focus control that decreases as the focal point of the camera moves toward the depth value of the target area and increases as the focal point of the camera moves away from the depth value of the target area.

Abstract: A method of operating a manipulator arm comprising a manipulator interface configured to removably couple with and transmit actuation force to a medical instrument includes mounting a cannula to a cannula mount coupled to the manipulator arm; mounting a medical instrument to the manipulator interface; inserting a shaft of the medical instrument through an entry guide mounted to the cannula; rotating the manipulator interface and the medical instrument relative to the cannula mount; and rotating the entry guide relative to the cannula mount about a longitudinal axis of the cannula.

Abstract: A method performed by a processor comprises determining a depth value of a target area relative to the image capturing device. The method also includes determining an adjustment to the brightness control so that a brightness level of images captured by the image capturing device is lowered if the depth value of the target area relative to the image capturing device is less than a threshold depth value. The method also includes determining whether an adjustment of the brightness control is to be automatically or manually adjusted. If the adjustment of the brightness control is to be manually adjusted, the processor over-rides manual control of the brightness control if an operator of the brightness control is causing the brightness level of images not to be lowered if the depth value of the target area relative to the image capturing device is less than the threshold depth value.

Abstract: An entry guide tube and cannula assembly, a surgical system including the assembly, and a method of surgical instrument insertion are provided. In one embodiment, the assembly includes a cannula having a proximal portion that operably couples to an accessory clamp of a manipulator arm, and a distal tubular member coupled to the proximal portion, the tubular member having an opening for passage of at least one instrument shaft. The assembly also includes an entry guide tube rotatably coupled to the proximal portion of the cannula, the entry guide tube including a plurality of channels for passage of a plurality of instrument shafts, wherein the entry guide tube is rotatably driven relative to the proximal portion of the cannula by rotation of at least one instrument shaft about a longitudinal axis of the entry guide tube.

Abstract: Embodiments of a rotating assistant port device are presented. The assistant port device can be utilized to provide for additional assistant instruments in single port robotic surgery. In some embodiments, the assistant port device can be utilized for skin retraction during single port teleoperated robotic surgery.