Abstract: A robotic system comprises a display that is viewable by an operator. An operator reference frame is defined relative to the display or the operator viewing the display. The robotic system also includes an input device movable by the operator and a processing unit. The processing unit is configured to present, in the display, a first image of a first tool captured by an imaging device, receive, from the operator, a first indication that a first axis of the input device is aligned with a corresponding axis of the first tool in the first image, and in response to the first indication, determine a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between the operator reference frame and the input device.

Abstract: A system and method of maintaining a tool position and orientation for a computer-assisted device include a control unit and an articulated structure coupled to the control unit and including a plurality of joints. The articulated structure is configured to support an instrument. The control unit is configured to determine an error that is introduced to a position of the instrument, an orientation of the instrument, or both the position of the instrument and the orientation of the instrument by movement of a first joint of the plurality of joints; and drive at least a second joint of the plurality of joints to reduce the error.

Abstract: A teleoperational medical system for performing a medical procedure in a surgical field includes a dynamic guided setup system having step-by-step setup instructions for setting up a teleoperational assembly having at least one motorized surgical arm configured to assist in a surgical procedure. It also includes a user interface configured to communicate the step-by-step setup instructions to a user. The dynamic guided setup system is configured to automatically recognize completion of a first setup step based on detected physical arrangement of at least one surgical arm on a teleoperational assembly and automatically display a prompt for a subsequent setup step after the recognizing completion of the first setup step.

Abstract: A system and method of maintaining a tool position and orientation for a computer-assisted device include an articulated structure including a plurality of joints and a control unit coupled to the articulated structure. The control unit is configured to determine whether a cannula or an instrument is coupled to a distal end of the articulated structure and in response to determining that the cannula or the instrument is coupled to the distal end of the articulated structure: determine an initial position and orientation of the instrument prior to detection of a disturbance in a first joint of the plurality of joints; determine, during the disturbance in the first joint, a current position and orientation of the instrument; determine a difference between the current position and orientation and the initial position and orientation; and drive at least a second joint of the plurality of joints based on the difference.

Abstract: A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.

Abstract: A console for a medical includes a display, an eye tracking input module, a second input module, and one or more processors coupled to the display, the eye tracking input module, and the second input module. The one or more processors is configured to perform operations including receiving a first user input from the eye tracking input module; determining, based on the first user input, whether a gaze of a user is directed toward an activation region of the display; in response to determining that the gaze of the user is directed toward the activation region, displaying, via the display, a control; receiving a second user input from the second input module; and adjusting the control based on the second user input.

Abstract: Integrated table motion includes a device including a control unit and an arm having one or more joints and a distal portion. The control unit is configured to receive a table movement request from a separate table, determine whether to allow the table movement request based on one or more of whether a type of movement in the table movement request is permitted, whether one or more instruments mounted to the device are within a field of view of an imaging device, or whether one or more instruments mounted to the device are withdrawn into respective cannulas, allow the table to perform the table movement request based on the determining; track movement of the table while the table performs the table movement request; and maintain, using the joint(s) and based on the tracked movement of the table, a position and/or an orientation of the distal portion relative to the table.

Abstract: A teleoperational medical system for performing a medical procedure in a surgical field includes a teleoperational assembly having a plurality of motorized surgical arms configured to assist in a surgical procedure. It also includes an input device configured to receive an input to move all the arms of the plurality of motorized surgical arms to a pre-established position. A processing system is configured to receive the input form the input device and output control signals to each arm of the plurality of motorized surgical arms to move each arm to the pre-established position.

Abstract: A system and method of assisting operator engagement with input devices includes a repositionable structure configured to support a physical input device, a hand detection system, and a control unit. The repositionable structure includes one or more actuators. The physical input device is configured to be operated by a hand of an operator. The control unit is configured to detect the hand of the operator using the hand detection system and in response to a trigger condition, command the one or more actuators to move the input device from a first orientation to a second orientation, wherein the second orientation is closer to a grasping orientation of the hand than the first orientation is to the grasping orientation of the hand.

Abstract: A system and method for integrated table motion includes a device. The device includes an articulated arm having joints and a distal portion distal to the joints and a control unit. To support integrated motion with a separate table, the control unit is configured to receive a table movement request from the table, determine whether allowing the table movement request would result in a first joint of the joints being at a range of motion limit, allow the table to perform the table movement request based on determining that allowing the table to perform the table movement request would not result in the first joint being at the range of motion limit, track movement of the table due to performing the table movement request, and maintain, using the joints and based on the tracked movement, a position and/or an orientation of the distal portion relative to the table.

Abstract: Techniques for registering a computer-assisted device to a table include a computer-assisted device having an articulated arm and a control unit coupled to the articulated arm. The control unit is configured to receive information of a first motion of a table. The first motion of the table caused a corresponding second motion of a point associated with the articulated arm. The control unit further configured to receive information of the second motion and determine a first angular relationship between the table and the computer-assisted device based on the first motion and the second motion.

Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining grip rotation values describing an orientation of the master grip, determining instrument rotation values describing an orientation of the instrument, determining an orientation error between an orientation of the master grip and the orientation of the instrument based on the grip rotation values and the instrument rotation values, and reducing the orientation error by low pass filtering the grip rotation values or the instrument rotation values.

Abstract: A method and apparatus for manipulating tissue. A tissue control point is displayed over an image of the tissue in a user interface. An input is received that moves the tissue control point within the user interface. A first instrument that is physically associated with the tissue is operated based on the received input to thereby manipulate the tissue.

Abstract: A teleoperational medical system for performing a medical procedure in a surgical field includes a teleoperational assembly having a plurality of motorized surgical arms configured to assist in a surgical procedure. It also includes an input device configured to receive an input to move all the arms of the plurality of motorized surgical arms to a pre-established position. A processing system is configured to receive the input form the input device and output control signals to each arm of the plurality of motorized surgical arms to move each arm to the pre-established position.

Abstract: In a minimally invasive surgical system, a plurality of video images is acquired. Each image includes a hand pose image. Depth data for the hand pose image is also acquired or synthesized. The hand pose image is segmented from the image using the depth data. The segmented image is combined with an acquired surgical site image using the depth data. The combined image is displayed to a person at a surgeon's console of the minimally invasive surgical system. Processing each of the video images in the plurality video images in this way reproduces the hand gesture overlaid on the video of the surgical site in the display.

Abstract: A system and method of assisting operator engagement with input devices includes an input device, a hand detection system, and a control unit. The control unit is configured to detect the hand of the operator using the hand detection system; in response to a trigger condition, command the input device to move from a first to a second position; and in response to a signal indicating an input provided by the operator to the input device, command a motion of an end effector associated with the input device. The second position is closer to a grasping position for the hand than the first position. In some embodiments, the control unit is further configured to, in response to the trigger condition, command the input device to move from a first to a second orientation. The second orientation is closer to a grasping orientation for the hand than the first orientation.

Abstract: A method comprises displaying a surgical environment image. The surgical environment image includes a virtual control element for controlling a component of a surgical system. The method also includes displaying an image of a body part of a user used to interact with the virtual control element. The method also comprises receiving a user input from the user with a gesture based input device while the body part interacts with the virtual control element. The method also comprises adjusting a setting of the component of the surgical system based on the received user input.

Abstract: A system comprises a teleoperational assembly including an operator control system and a plurality of manipulators. A first manipulator is configured to control a medical instrument in a surgical environment. A second manipulator is configured to control an imaging instrument. The system further comprises a processing unit configured to: display an image of a field of view of the surgical environment captured by the imaging instrument; determine a position of a distal portion of the medical instrument in an image coordinate space; determine an initial position for a badge associated with the distal portion; determine a badge placement boundary, which is inside the image, for the image by determining a viewable space boundary for the image; and adjust the badge from the initial position to a display position within the badge placement boundary by determining an inset boundary between the badge placement boundary and the viewable space boundary.

Abstract: A system and method of registration includes detecting a first motion of a table that causes motion of a computer-assisted device, determining a first angular direction of the first motion in a table coordinate frame, determining a second angular direction of the motion of the computer-assisted device in a computer-assisted device coordinate frame, determining a first angular relationship between the table and the computer-assisted device based on the first and second angular directions, and aggregating the first angular relationship in a composite angular relationship. The second angular direction includes a direction of a second motion of a first articulated arm of the computer-assisted device or an aggregation of a plurality of angular directions, wherein, for each angular direction of the plurality of angular directions, that angular direction is of a respective third motion, of a respective articulated arm of a plurality of articulated arms of the computer-assisted device.