Abstract: A teleoperational medical system for performing a medical procedure in a surgical field includes a teleoperational assembly having a plurality of motorized surgical arms configured to assist in a surgical procedure. It also includes an input device configured to receive an input to move all the arms of the plurality of motorized surgical arms to a pre-established position. A processing system is configured to receive the input form the input device and output control signals to each arm of the plurality of motorized surgical arms to move each arm to the pre-established position.

Abstract: In a minimally invasive surgical system, a plurality of video images is acquired. Each image includes a hand pose image. Depth data for the hand pose image is also acquired or synthesized. The hand pose image is segmented from the image using the depth data. The segmented image is combined with an acquired surgical site image using the depth data. The combined image is displayed to a person at a surgeon's console of the minimally invasive surgical system. Processing each of the video images in the plurality video images in this way reproduces the hand gesture overlaid on the video of the surgical site in the display.

Abstract: A system and method of assisting operator engagement with input devices includes an input device, a hand detection system, and a control unit. The control unit is configured to detect the hand of the operator using the hand detection system; in response to a trigger condition, command the input device to move from a first to a second position; and in response to a signal indicating an input provided by the operator to the input device, command a motion of an end effector associated with the input device. The second position is closer to a grasping position for the hand than the first position. In some embodiments, the control unit is further configured to, in response to the trigger condition, command the input device to move from a first to a second orientation. The second orientation is closer to a grasping orientation for the hand than the first orientation.

Abstract: A method comprises displaying a surgical environment image. The surgical environment image includes a virtual control element for controlling a component of a surgical system. The method also includes displaying an image of a body part of a user used to interact with the virtual control element. The method also comprises receiving a user input from the user with a gesture based input device while the body part interacts with the virtual control element. The method also comprises adjusting a setting of the component of the surgical system based on the received user input.

Abstract: A system comprises a teleoperational assembly including an operator control system and a plurality of manipulators. A first manipulator is configured to control a medical instrument in a surgical environment. A second manipulator is configured to control an imaging instrument. The system further comprises a processing unit configured to: display an image of a field of view of the surgical environment captured by the imaging instrument; determine a position of a distal portion of the medical instrument in an image coordinate space; determine an initial position for a badge associated with the distal portion; determine a badge placement boundary, which is inside the image, for the image by determining a viewable space boundary for the image; and adjust the badge from the initial position to a display position within the badge placement boundary by determining an inset boundary between the badge placement boundary and the viewable space boundary.

Abstract: A system and method of registration includes detecting a first motion of a table that causes motion of a computer-assisted device, determining a first angular direction of the first motion in a table coordinate frame, determining a second angular direction of the motion of the computer-assisted device in a computer-assisted device coordinate frame, determining a first angular relationship between the table and the computer-assisted device based on the first and second angular directions, and aggregating the first angular relationship in a composite angular relationship. The second angular direction includes a direction of a second motion of a first articulated arm of the computer-assisted device or an aggregation of a plurality of angular directions, wherein, for each angular direction of the plurality of angular directions, that angular direction is of a respective third motion, of a respective articulated arm of a plurality of articulated arms of the computer-assisted device.

Abstract: Systems and methods for instrument control include first and second actuators and a controller configured to command the first actuator to maintain a first degree of freedom (DOF) of an instrument at a first position; command the second actuator to maintain a second DOF of the instrument at a second position; detect, while the first actuator is maintaining the first DOF at the first position, a first manual actuation of the first actuator that exceeds a first threshold; detect, while the second actuator is maintaining the second DOF at the second position, a second manual actuation of the second actuator that does not exceed a second threshold; and in response to detecting that the first manual actuation exceeds the first threshold and the second manual actuation does not exceed the second threshold, terminate the command to the first actuator to maintain the first DOF at the first position.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining a grip orientation by which the master grip is gripped by an operator, determining a commanded velocity for the slave instrument based on a manipulation of the master grip by the operator, determining an error, and altering the commanded velocity for the slave instrument based on at least the grip orientation and the error. The error includes a parameter selected from a group consisting of a position error between a position of the master grip and a position of the slave instrument and an orientation error between an orientation of the master grip and an orientation of the slave instrument.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.

Abstract: A computing device comprises a memory and a control unit coupled to the memory. The control unit is configured to receive a patient model and identify a plurality of port locations on the patient model for accessing a workspace using a plurality of instruments controlled by a computer-assisted device. For each of the port locations, the control unit determines a collision volume for portions of the computer-assisted device proximal to the port location, a reachability metric, and an anthropomorphic metric. For each combination of the plurality of port locations, the control unit determines a collision metric based on overlaps of the collision volumes for the port locations in the combination, and an aggregate metric for the combination. The control unit is also configured to display one or more of the combinations of the plurality of port locations to a user along with a corresponding aggregate metric.

Abstract: A surgical instrument is configured to be installed for use on a teleoperated surgical system. A surgeon or other medical person controls the surgical instrument by manipulating one or more control inputs. Computer-assisted teleoperated actuators of the teleoperated surgical system move one or more surgical instrument mechanical degrees of freedom in response to movements of the one or more control inputs. A teleoperated surgical system is provided to enable a surgeon or medical person to manually control one or more surgical instrument mechanical degrees of freedom, while the surgical instrument is installed for use on the teleoperated surgical system.

Abstract: Devices, systems, and methods include a teleoperated system including a kinematic structure having a joint, a drive or brake system for controlling the joint, and a computing unit coupled with the drive or brake system. The computing unit is configured to detect that the joint is between a software defined range of motion limit for the joint and a physical range of motion limit for the joint, the software defined range of motion limit being spaced a distance apart from the physical range of motion limit and delay for a duration of time, in response to detecting the joint between the software defined range of motion limit and the physical range of motion limit, applying the drive or brake system to stop motion of the joint.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining a grip orientation by which the master grip is gripped by an operator, determining a commanded velocity for the slave instrument based on a manipulation of the master grip by the operator, determining an error, and altering the commanded velocity for the slave instrument based on at least the grip orientation and the error. The error includes a parameter selected from a group consisting of a position error between a position of the master grip and a position of the slave instrument and an orientation error between an orientation of the master grip and an orientation of the slave instrument.

Abstract: A system and method of monitoring control points during reactive motion includes a computer-assisted device. The computer-assisted device includes the one or more articulated arms and a control unit coupled to the one or more articulated arms. The control unit is configured to perform operations comprising determining, before movement of a table separate from the computer-assisted device, a latched spatial configuration of a plurality of control points associated with the one or more articulated arms; determining one or more geometric attributes of the latched spatial configuration; determining an actual spatial configuration of the plurality of control points as the one or more articulated arms track the movement of the table; determining a difference between the one or more geometric attributes of the latched spatial configuration and corresponding one or more geometric attributes of the actual spatial configuration; and performing, based on the determined difference, a remedial action.

Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.

Abstract: A system comprises a teleoperational assembly including an operator control system and manipulators configured for teleoperation by the operator control system. A first manipulator controls a first medical instrument in a surgical environment and a second manipulator controls an imaging instrument. The system also comprises a processing unit to display an image of a field of view of the surgical environment captured by the imaging instrument and determine a position of a distal portion of the first medical instrument in an image coordinate space. The processing unit determines an initial position for a first badge associated with the distal portion of the first medical instrument and determine a badge placement boundary for the image of the field of view. The processing unit also adjusts the first badge from the initial position to a display position within the badge placement boundary of the image of the field of view.

Abstract: A computer-assisted device includes an articulated arm configured to support an end effector and a control unit configured to, when coupled to the articulated arm and a table: determine a virtual coordinate frame before a first joint of the articulated arm is set to a floating mode, configure the first joint to the floating mode, detect movement of the first joint, determine a movement of the table, and drive a second joint of the articulated arm based on the movement of the first joint and the movement of the table. In some embodiments, the virtual coordinate frame is based on a pose of an imaging device and/or is detached from the imaging device. In some embodiments, the control unit is further configured to maintain the virtual coordinate frame in fixed relationship to a top of the table based on motion data received from the table.

Abstract: Robotic and/or surgical devices, systems, and methods include kinematic linkage structures and associated control systems configured to control movement of passive or under-actuated joints by coordinated joint braking of the under-actuated joints concurrent with driving of one or more driven joints. In one aspect, the methods include driving a set-up structure by pivoting an orienting platform supporting multiple manipulators back-and-forth in opposite directions while selectively braking the under-actuated joints to inhibit passive joint movement away from a reference joint state and releasing braking to facilitate movement of the joints toward the reference until each of the under-actuated joints of the multiple manipulators are at the respective reference states. In another aspect, a joint brake controller is provided that receives a motor torque input and converts the input to a brake control input by determining an impulse applied variable braking to deplete the impulse over time.

Abstract: A teleoperational assembly is disclosed which includes an operator control system and a plurality of manipulators configured to control the movement of medical instruments in a surgical environment. The manipulators are teleoperationally controlled by the operator control system. The system further includes a processing unit configured to display an image of a field of view of the surgical environment, determine association information about the manipulators and the operator control system, and display badges near the medical instruments in the image of the field of view of the surgical environment. The badges display the association information for the medical instrument they appear associated with.

Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.