Abstract: A device includes a first mechanism having a surface and a helical slot in the surface, a second mechanism having a periphery and an axial slot in the periphery, and an insert comprising a pin. The second mechanism is located within the first mechanism. The insert is located within the second mechanism. The pin extends from the insert through the axial slot of the second mechanism and into the helical slot of the first mechanism. The insert is configured to couple to an instrument. In some embodiments, the insert is configured to move the instrument in a degree of freedom in response to the second mechanism being held stationary and the first mechanism being rotated. In some embodiments, the degree of freedom is an insertion and retraction degree of freedom.

Abstract: A surgical module is supported by manipulators that are removably attached to the surgical module. The surgical module may enable operation of surgical tools by providing an integration between actuating mechanisms of the manipulators and actuating mechanisms of the surgical tools. Alternatively or additionally, the surgical module may enable operation of the surgical tools by providing physical access for deploying surgical tools that are operatively connected to the manipulators.

Abstract: A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.

Abstract: A teleoperated surgical system is provided comprising: a first robotic surgical instrument; an image capture; a user display; a user input command device coupled to receive user input commands to control movement of the first robotic surgical instrument; and a movement controller coupled to scale a rate of movement of the first robotic surgical instrument, based at least in part upon a surgical skill level at using the first robotic surgical instrument of the user providing the received user input commands, from a rate of movement indicated by the user input commands received at the user input command device.

Abstract: A method is performed by a computing system. The method includes receiving image data from an imaging device, and determining, using the image data, a plurality of image-space tools, each image-space tool associated with a tool of a plurality of tools, each tool controlled by a manipulator of a plurality of manipulators. The method further includes determining a first correspondence between a first image-space tool of the plurality of image-space tools and a first tool of the plurality of tools based on a first disambiguation setting associated with the first tool.

Abstract: A system comprises a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, cause the system to receive an image of a medical environment and identify a medical component in the image of the medical environment. The medical component may be disposed in a first configuration. The computer readable instructions, when executed by the processor also cause the system to receive kinematic information about the medical component and generate virtual guidance based on the kinematic information. The virtual guidance may include a virtual image of the medical component disposed in a second configuration.

Abstract: A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Abstract: A teleoperated system comprises a display, a master input device, and a control system. The control system is configured to determine an orientation of an end effector reference frame relative to a field of view reference frame, determine an orientation of a master input device reference frame relative to a display reference frame, establish an alignment relationship between the master input device reference frame and the display reference frame, and command, based on the alignment relationship, a change in a pose of the end effector in response to a change in a pose of the master input device. The alignment relationship is independent of a position relationship between the master input device reference frame and the display reference frame. In one aspect, the teleoperated system is a telemedical system such as a telesurgical system.

Abstract: A surgical module is supported by manipulators that are removably attached to the surgical module. The surgical module may enable operation of surgical tools by providing an integration between actuating mechanisms of the manipulators and actuating mechanisms of the surgical tools. Alternatively or additionally, the surgical module may enable operation of the surgical tools by providing physical access for deploying surgical tools that are operatively connected to the manipulators.

Abstract: A system comprises a processor and a memory having computer readable instructions stored thereon, which, when executed by the processor, cause the system to display an image of a surgical environment. The image includes an information icon corresponding to an instrument in the surgical environment. The instructions further cause the system to display an image of a body part of a user. The image of the body part is used to interact with the information icon. The instructions further cause the system to receive a gesture of the body part, via a gesture-based input device registering movement of the body part, to cause the image of the body part to interact with the information icon. The instructions further cause the system to display an information menu in the image of the surgical environment based on the interaction between the image of the body part and the information icon.

Abstract: A system may comprise an image capture device to capture an image of a work site. The system may also comprise a processor to determine whether a tool disposed at the work site is energized and determine a first area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image. The processor may also determine a second area of the captured image including a remainder of the captured image that does not include the first area. Conditioned upon determining that the tool is energized, at least one of the first area and the second area of the captured image of the work site may be processed to indicate that the tool in the first area is being energized. The image of the work site with the first area and the second area may be displayed.

Abstract: Techniques for control using hand tracking include a system having an input control configured to be manipulated by an operator of the system, a hand tracking unit, and a controller. The controller is configured to determine a first position of the input control; receive, from the hand tracking unit, a second position of a hand of the operator; determine whether the first position is within a threshold distance of the second position; and control display of a user interface based on the determination of whether the first position is within the threshold distance of the second position.

Abstract: A teleoperated system includes a robotic arm configured to support an instrument, a grip configured to be manipulated by an operator to command motion of the instrument, and a control system communicatively coupled to the robotic arm and the grip. To align the grip with the instrument by the grip, the control system is configured to determine grip rotation values describing an orientation of the grip, determine instrument rotation values describing an orientation of the instrument, determine an orientation error between the orientation of the grip and the orientation of the instrument based on the grip rotation values and the instrument rotation values, produce a motion command by selectively imposing, based on the orientation error, an artificial joint limit on a commanded movement of the instrument, and command the robotic arm to move in accordance with the motion command.

Abstract: A movable table may be configured to support a patient. The movable table may comprise a communication interface configured to communicatively couple with a medical device. The movable table may also comprise one or more processors and a non-transitory machine-readable medium comprising a plurality of instructions which, when executed by the one or more processors, cause the one or more processors to perform operations. The operations may include transmitting, via the communication interface and to the medical device, information relating to a planned motion of the movable table and receiving, via the communication interface and from the medical device, a response to the information relating to the planned motion of the movable table. Based on the response received from the medical device, the operations may include selectively causing performance of the planned motion of the movable table.

Abstract: A system comprises a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, cause the system to display a surgical environment image. The surgical environment image includes a virtual control element for controlling a component of a surgical system. The virtual control element includes a real-time image of the component of the surgical system in the surgical environment image. The computer readable instructions also cause the system to display an image of a body part of a user used to interact with the virtual control element, receive a gesture of the body part of the user in a predetermined motion via a gesture based input device, and adjust a setting of the component of the surgical system based on the received gesture.

Abstract: A system includes a robotic manipulator including a serial chain comprising a first joint, a second joint, and a first link. The system further includes a processing unit including one or more processors. The processing unit is configured to receive first link data from a first sensor system located at the first link, generate a first joint state estimate of the first joint based on the first link data, and generate a second joint state estimate of the second joint. The processing unit is further configured to apply a first weight to the first joint state estimate to generate a first weighted joint state estimate, apply a second weight to the second joint state estimate to generate a second weighted joint state estimate, and control the first and second joints based on the first weighted joint state estimate and second weighted joint state estimate.

Abstract: A medical robotic system includes a viewer, a gaze tracker, and a processor programmed to: draw an area or volume defining shape overlaid on an image based on the tracked gaze point after the user has gazed on the tracked gaze point for a programmed period of time; in response to receiving a user-selected action command, assign a fixed virtual constraint to the area or volume defining shape and constrain movement of a robotic tool; map points of the robotic tool in a tool reference frame to a viewer reference frame; determine a closest object to the tracked gaze point is the robotic tool based at least in part on the mapped points; display an object including text identifying the robotic tool, overlaid on the image, proximate to the robotic tool based on determining the robotic tool is the closest object; and perform an action indicated by the object.

Abstract: A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Abstract: A robotic system provides user selectable actions associated with gaze tracking according to user interface types. User initiated correction and/or recalibration of the gaze tracking may be performed during the processing of individual of the user selectable actions.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera configured to capture an image of a camera field of view. The system further comprises an input device, a display, and a processor. The processor is configured to display a first synthetic image including a first synthetic image of the tool. The first synthetic image of the tool includes a portion of the tool outside of the camera field of view. The processor is also configured to receive a user input at the input device and responsive to the user input, change the display of the first synthetic image to a display of a second synthetic image including a second synthetic image of the tool that is different from the first synthetic image of the tool.