Abstract: A teleoperational medical system comprises a plurality of manipulators configured to support an imaging instrument and one or more medical instruments. The system further comprises one or more processors communicatively coupled to the imaging instrument and the one or more medical instruments. The processor(s) are configured to display a field of view captured by the imaging instrument, and present, within the displayed field of view, a first indicator that corresponds to a first medical instrument of the one or more medical instruments. The first indicator is presented at a default location associated with the first medical instrument. The processor(s) are further configured to determine, for the first indicator, an alternate location associated with the first medical instrument, and update presentation of the first indicator such that the first indicator is moved from the default location to the alternate location.

Abstract: A medical system includes a mobile cart configured to support one or more medical instruments; an illumination source mounted on the mobile cart, the illumination source configured to direct light in a direction of a path of the mobile cart during movement relative to a ground surface; and a control system operably coupled to the illumination source and the mobile cart. The control system is configured to in response to the illuminating, storing a threshold height in a memory; and automatically control the movement of the cart based on the threshold height.

Abstract: Techniques for control using hand tracking include a system having an input control configured to be manipulated by an operator of the system, a hand tracking unit, and a controller. The controller is configured to determine a first position of the input control; receive, from the hand tracking unit, a second position of a hand of the operator; determine whether the first position is within a threshold distance of the second position; and control display of a user interface based on the determination of whether the first position is within the threshold distance of the second position.

Abstract: A method may comprise displaying an interaction panel on a display device. The interaction panel having a display frame of reference and include a plurality of interaction elements. The method may also comprise constraining motion of an operator interface device to translational motion in a haptic plane with a haptic plane constraint while the interaction panel is displayed and determining a cursor position in the display frame of reference that corresponds to a position of a selection portion of the operator interface device in an operator frame of reference. The method may also comprise determining an element type for a first interaction element of the plurality of interaction elements at which the cursor position is located and removing the haptic plane constraint on the operator interface device if the element type is a three-dimensional rotation type.

Abstract: A robotic system comprises a display that is viewable by an operator. The robotic system also includes an input device movable by the operator and a control system. The control system is configured to determine whether an alignment target is located in an error region, the alignment target associated with a tool supported by the first manipulator, and the error region associated with an imaging device supported by the second manipulator, and in response to a determination that the alignment target is located in the error region, disable an operator-guided registration mode for performing an operator-guided registration.

Abstract: Techniques for maintaining instrument position and orientation include a teleoperated device comprising an articulated structure comprising a plurality of joints, a plurality of links, one or more sensors, and a plurality of actuators; and a control unit comprising one or more hardware processors. The control unit is coupled to the articulated structure. The control unit is configured to: determine, based on information from the one or more sensors, a first change to an instrument due to a disturbance causing movement of at least a first joint of the plurality of joints, the first change comprising: a change in a position of the instrument and/or a change in an orientation of the instrument; and drive, using at least a first actuator of the plurality of actuators, at least a second joint of the plurality of joints to reduce the first change. The instrument is supported by the articulated structure.

Abstract: Integrated table motion includes a teleoperated device comprising an articulated structure and a control unit. The articulated structure comprises a first plurality of joints, a plurality of links coupled by the first plurality of joints, and a plurality of actuators coupled to drive motion of the articulated structure. The control unit comprises one or more hardware processors. The control unit is operatively coupled to the articulated structure. The control unit is configured to receive a table movement request from a command unit of a table, the table being separate from the teleoperated device; determine whether the table movement request should be allowed; and in response to a determination that the table movement request should be allowed, allow the table to perform the table movement request.

Abstract: A bifurcated navigation control system is configured to identify a navigation condition associated with a navigation of a component of a computer-assisted medical system component along a path from an initial location to a target location; determine, based on the navigation condition, a propulsion limitation configured to be imposed on operator-provided commands related to a propulsion of the component during the navigation of the component along the path; and direct the component to navigate, in a bifurcated navigation control mode, along at least part of the path from the initial location to the target location. In the bifurcated navigation control mode, the bifurcated navigation control system is configured to autonomously control a steering of the component while allowing operator control of the propulsion of the component based on the operator-provided commands as limited by the propulsion limitation.

Abstract: A system is configured to perform operations comprising: determining that a viewpoint of a user of a display device is directed within an anchor region of a physical world containing the user while a medical procedure comprising a first operational stage and a second operational stage is performed in the physical world; directing, in response to the determination, the display device to present augmented content in an evident manner, wherein the evident manner comprises anchoring the augmented content relative to the viewpoint, such that the augmented content follows the viewpoint as the user moves the viewpoint within the anchor region; and automatically redefining, in response to the medical procedure transitioning, the anchor region from a first region to a second region, the first region being associated with the first operational stage and the second region being associated with the second operational stage.

Abstract: A system comprises a processor and a memory having computer readable instructions stored thereon, which, when executed by the processor, cause the system to display a surgical environment image, which includes an image from an imaging system and an interaction image. The interaction image displays a body part of a user and an input control device. The instructions further cause the system to display, in the interaction image, a movement of the body part as the body part interacts with the input control device. The movement causes the body part to actuate the input control device. The instructions further cause the system to receive an input from the input control device in response to the actuation of the input control device. The instructions further cause the system to adjust a setting or a position of a component of a surgical system based on the received input.

Abstract: A system comprises: a robotic arm operatively coupleable to a tool comprising a working end; and an input device communicatively coupled to the robotic arm. The input device is manipulatable by an operator. The system further comprises a processor configured to cause an image of a work site, captured by an image capture device from a perspective of an image reference frame, to be displayed on a display. The image of the work site includes an image of the working end of the tool. The processor is further configured to determine a position of the working end of the tool in the image of the work site and render a tool information overlay at the position of the working end of the tool in the image of the work site. The tool information overlay visually indicates an identity of the input device.

Abstract: A method and apparatus for manipulating tissue. A tissue control point is displayed over an image of the tissue in a user interface. An input is received that moves the tissue control point within the user interface. A first instrument that is physically associated with the tissue is operated based on the received input to thereby manipulate the tissue.

Abstract: Techniques for registering a teleoperated device to a table include a teleoperated device comprising a control unit and an articulated arm. The control unit is configured to receive information of a first table motion of a table, the first table motion causing a corresponding first arm motion, the first arm motion being of at least a portion of the articulated arm, the table comprising one or more links and one or more joints coupling a base of the table to a top of the table, the first table motion indicating a movement of the top of the table; receive information of the first arm motion; determine a first angular relationship between the table and the first articulated arm based on the first table motion and the first arm motion; and control, using a plurality of actuators, movement of the articulated arm based on the first angular relationship.

Abstract: A method comprises obtaining, for one or more medical instruments coupled to a teleoperational medical system, one or more corresponding medical instrument positions relative to a field of view of at least one imaging instrument coupled to the teleoperation medical system. The method also comprises initiating, for a selected medical instrument of the one or more medical instruments, generation of a corresponding indicator to a user. The corresponding indicator may be based on a position of the selected medical instrument relative to the field of view.

Abstract: Techniques for controlling an imaging device include a first repositionable arm comprising a plurality of actuators configured to cause movement of the first repositionable arm and a plurality of joints; and a controller comprising one or more hardware processors. The controller is configured to determine whether an imaging device supported by the first repositionable arm comprises an articulable joint coupling an imaging apparatus to a shaft of the imaging device; in response to a determination that the imaging device comprises the articulable joint: command the plurality of actuators to move the plurality of joints and the articulable joint to position and orient a field of view of the imaging apparatus; and in response to a determination that the imaging device does not comprises the articulable joint: command the plurality of actuators to move the plurality of joints to position and orient the field of view of the imaging apparatus.

Abstract: Integrated table motion includes a computer-assisted device. The computer-assisted device includes articulating means; means for receiving, via a means for communicatively coupling the computer-assisted device with a table means, a table movement request from a table command means, the table means being separate from the computer-assisted device; means for determining whether the table movement request should be allowed; and means for allowing the table means to perform the table movement request based on determining that the table movement request should be allowed.

Abstract: A robotic system comprises an input device movable by an operator and a processing unit. An operator reference frame is defined relative to the operator. The processing unit is configured to present, to the operator, a first image of a first tool captured by an imaging device, receive, from the operator, a first indication that a first axis of the input device is aligned with a corresponding axis of the first tool in the first image, and in response to the first indication, determine a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between the operator reference frame and the input device.

Abstract: Techniques for maintaining instrument position and orientation include a computer-assisted device having an articulated structure and a control unit. The articulated structure includes a plurality of joints and is configured to support an instrument. The control unit is configured to determine a reference frame based on a type of a disturbance that causes a movement of a first joint of the plurality of joints; determine, in the reference frame, a first change to the instrument due to the disturbance; and rive at least a second joint of the plurality of joints to reduce the first change. The first change comprises: a change in a position of the instrument, or a change in an orientation of the instrument, or a change in both the position of the instrument and the orientation of the instrument.

Abstract: A bifurcated navigation control system defines a path whereby a manipulator cart is to navigate from an initial location to a target location, and identifies a navigation condition associated with a navigation of the manipulator cart along the path. Based on the navigation condition, the bifurcated navigation control system defines a propulsion limitation for the manipulator cart during the navigation of the manipulator cart along the path. The bifurcated navigation control system directs the manipulator cart to navigate along at least part of the path in a bifurcated navigation control mode in which the bifurcated navigation control system is configured to autonomously control a steering of the manipulator cart while allowing operator control of a propulsion of the manipulator cart in accordance with the propulsion limitation. Corresponding methods and systems are also disclosed.

Abstract: A region-based augmentation system is configured to determine that a viewpoint of a user of a display device is directed within an anchor region of a physical world containing the user. In response, the system directs the display device to present augmented content in an evident manner. The evident manner comprises anchoring the augmented content relative to the viewpoint, such that the augmented content follows the viewpoint as the user moves the viewpoint within the anchor region. The system further determines that the viewpoint is directed outside of the anchor region by the user. In response, the system directs the display device to present the augmented content in a less evident manner. The presenting of the augmented content in the less evident manner comprises presenting the augmented content less visibly than the evident manner and/or unanchoring the augmented content relative to the viewpoint. Corresponding methods and systems are also disclosed.