Abstract: A system and method of registration includes detecting a first motion of a table that causes motion of a computer-assisted device, determining a first angular direction of the first motion in a table coordinate frame, determining a second angular direction of the motion of the computer-assisted device in a computer-assisted device coordinate frame, determining a first angular relationship between the table and the computer-assisted device based on the first and second angular directions, and aggregating the first angular relationship in a composite angular relationship. The second angular direction includes a direction of a second motion of a first articulated arm of the computer-assisted device or an aggregation of a plurality of angular directions, wherein, for each angular direction of the plurality of angular directions, that angular direction is of a respective third motion, of a respective articulated arm of a plurality of articulated arms of the computer-assisted device.

Abstract: A system and method for integrated surgical table icons includes a computer-assisted medical device. The computer-assisted medical device includes a control unit for controlling the computer-assisted medical device and a display unit coupled to the control unit having at least a surgical table status region. The control unit is configured to receive information from a surgical table describing an orientation of a top of the surgical table relative to a base of the surgical table, generate one or more icons graphically depicting the surgical table and the orientation, and send the one or more icons to the display unit for display within the surgical table status region. The surgical table is coupled to the computer-assisted medical device via a communications connection.

Abstract: A method and system for hand tracking in a robotic system includes a hand tracking system and a controller coupled to the hand tracking system. The controller is configured to receive, from the hand tracking system, a plurality of locations of a hand; determine if the hand is in a first hand pose based on the plurality of locations; in response to determining that the hand is in the first hand pose, and switch the robotic system to a hand trajectory detection mode. While in the hand trajectory detection mode, the control unit is configured to detect, based on hand tracking information from the hand tracking system, that the hand has performed a first hand trajectory of a plurality of known hand trajectories; and in response to detecting the first hand trajectory, change a mode of operation of the robotic system.

Abstract: A computer-assisted medical device includes a first articulated arm, the first articulated arm having an end effector, a first joint set, a second joint set and a control unit. The control unit configures one or more joints in the first joint set to a floating mode, detects movement of the first joint set caused by a movement of the surgical table, drives the second joint set based on the movement of the surgical table, receives an instrument motion command to move the end effector while the surgical table is moving, and moves the end effector based on the instrument motion command. In some embodiments, the instrument motion command is relative to an imaging coordinate frame. In some embodiments, the imaging coordinate frame is based on a pose of an imaging device saved prior to the movement of the surgical table.

Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.

Abstract: A system comprises a teleoperational assembly including an operator control system and a plurality of manipulators configured for teleoperation by the operator control system. A first manipulator of the plurality of manipulators is configured to control movement of a first medical instrument in a surgical environment. The system further comprises a processing unit configured to display an image of a field of view of the surgical environment; determine first association information for the first medical instrument, the first association information including information about at least one of the first manipulator or the operator control system; display a first badge proximate to an image of the first medical instrument in the image of the field of view, the first badge including the first association information; and adjust a size of the first badge as the first medical instrument changes depth relative to an imaging instrument capturing the field of view.

Abstract: A system and method of aligning with a reference target includes a computer-assisted device. The computer-assisted device includes a link, one or more first joints coupled proximally to the link, an articulated arm comprising one or more second joints coupled distally to the link, the articulated arm configured to couple to an instrument, and a control unit. The control unit is configured to position or orient the link, using the one or more first joints, based on at least one reference of the instrument selected from the group consisting of a reference point associated with the instrument and a reference orientation of the instrument. The control unit is further configured to maintain, while positioning or orienting the link and by using the one or more second joints, a position or an orientation of the instrument relative to a workspace in accordance with the at least one reference of the instrument.

Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the object, tools and work site on a display. Tool information is provided by filtering a part of the real-time images for enhancement or degradation to indicate a state of a tool and displaying the filtered images on the display.

Abstract: A system comprises a teleoperational assembly including an operator control system and a teleoperational manipulator configured for operation by the operator control system. The teleoperational manipulator is coupled to a medical instrument in a surgical environment. The system also comprises a processing unit including one or more processors. The processing unit is configured to retrieve a user profile for a user. The user profile including a parameter established during a prior teleoperational procedure. The processing unit is also configured to provide instructions to configure an operation of the teleoperational assembly based upon the parameter.

Abstract: A system and method of maintaining a tool position and orientation for a computer-assisted medical device include a device with an articulated structure including a plurality of joints and a control unit. The articulated structure is configured to support a tool distal to the joints. The control unit is configured to determine an initial position and orientation of the tool prior to movement of a first joint, determine, while the first joint is moving, a current position and orientation of the tool, determine a difference between the current and the initial position and orientation, and drive at least a second joint based on the difference to maintain a position and orientation of the tool at the initial position and orientation. In some embodiments, the position and orientation of the tool are maintained relative to a reference coordinate frame based on a cause of the moving of the first joint.

Abstract: A teleoperational medical system for performing a medical procedure in a surgical field includes a dynamic guided setup system having step-by-step setup instructions for setting up a teleoperational assembly having at least one motorized surgical arm configured to assist in a surgical procedure. It also includes a user interface configured to communicate the step-by-step setup instructions to a user. The dynamic guided setup system is configured to automatically recognize completion of a first setup step based on detected physical arrangement of at least one surgical arm on a teleoperational assembly and automatically display a prompt for a subsequent setup step after the recognizing completion of the first setup step.

Abstract: A system and method of registering a surgical table and a computer-assisted device includes an articulated arm and a control unit coupled to the articulated arm. The articulated arm has a distally mounted instrument configured to be inserted into a patient at a body opening. The control unit is configured to detect a first motion of a surgical table coupled to the control unit via a communications connection. The first motion of the surgical table causes a corresponding second motion of a control point of the articulated arm. The control unit is further configured to determine a first angular direction of the first motion in a surgical table coordinate frame, determine a second angular direction of the second motion in a computer-assisted medical device coordinate frame, and determine a third angular relationship between the surgical table and the computer-assisted medical device based on the first and second angular directions.

Abstract: A medical imaging system comprises a teleoperational assembly and a processing unit configured for receiving a roll position indicator for an imaging instrument coupled to the teleoperational assembly. The imaging instrument has a view angle other than 0° relative to an optical axis of the imaging instrument, and the imaging instrument is a stereoscopic imaging instrument including first and second image sources. The processing unit is further configured for: obtaining first image data from the imaging instrument at a first roll position; obtaining subsequent image data from the imaging instrument at a second roll position; and, responsive to a roll movement of the imaging instrument between the first and second roll positions, transitioning between presentation of the first image data on a user display and presentation of the subsequent image data on the user display. The transition includes changing a position of presentation of the first and second image sources.

Abstract: In a minimally invasive surgical system, a hand tracking system tracks a location of a sensor element mounted on part of a human hand. A system control parameter is generated based on the location of the part of the human hand. Operation of the minimally invasive surgical system is controlled using the system control parameter. Thus, the minimally invasive surgical system includes a hand tracking system. The hand tracking system tracks a location of part of a human hand. A controller coupled to the hand tracking system converts the location to a system control parameter, and injects into the minimally invasive surgical system a command based on the system control parameter.

Abstract: A teleoperational system comprises a teleoperational control system and a teleoperational manipulator configured for operating an instrument in an environment. The teleoperational system also comprises an operator controller in communication with the teleoperational control system. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether an operator of the operator controller has a head portion directed toward a display region of a display device and based on a determination that the operator's head portion is directed toward the display region, initiate an operator following mode in which movement of the operator controller provides a corresponding movement to the teleoperational manipulator. The teleoperational system may be a teleoperational medical system.

Abstract: A teleoperational assembly is disclosed which includes an operator control system and a plurality of manipulators configured to control the movement of medical instruments in a surgical environment. The manipulators are teleoperationally controlled by the operator control system. The system further includes a processing unit configured to display an image of a field of view of the surgical environment, project the position of distal end portions of the medical instruments into the image's coordinate space, determine initial positions for badges associated with the distal end portions of each medical instrument, evaluate a display factor for each badge based on its initial position, and determine a final display position for each badge in the image's coordinate space based on the display factor.

Abstract: A system comprises a medical tool including a shaft having proximal and distal ends and an articulatable distal portion coupled to the distal end of the shaft. The system also comprises a processing unit including one or more processors. The processing unit is configured to determine a target in a medical environment. The articulatable distal portion is directed toward the target. The processing unit is also configured to determine a motion of at least a portion of the shaft, and in response to the determined motion, control a pose of the articulatable distal portion so that the articulatable distal portion remains directed toward the target.

Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the object, tools and work site on a display. Tool information is provided by filtering a part of the real-time images for enhancement or degradation to indicate a state of a tool and displaying the filtered images on the display.

Abstract: A teleoperational medical system for performing a medical procedure in a surgical field includes a dynamic guided setup system having step-by-step setup instructions for setting up a teleoperational assembly having at least one motorized surgical arm configured to assist in a surgical procedure. It also includes a user interface configured to communicate the step-by-step setup instructions to a user. The dynamic guided setup system is configured to automatically recognize completion of a first setup step based on detected physical arrangement of at least one surgical arm on a teleoperational assembly and automatically display a prompt for a subsequent setup step after the recognizing completion of the first setup step.

Abstract: In a minimally invasive surgical system, a plurality of video images is acquired. Each image includes a hand pose image. Depth data for the hand pose image is also acquired or synthesized. The hand pose image is segmented from the image using the depth data. The segmented image is combined with an acquired surgical site image using the depth data. The combined image is displayed to a person at a surgeon's console of the minimally invasive surgical system. Processing each of the video images in the plurality video images in this way reproduces the hand gesture overlaid on the video of the surgical site in the display.