Abstract: A system comprises a manipulator assembly, one or more sensing elements configured to sense an arrangement of the assembly, and a control system configured to: determine a motion limit of the manipulator assembly based on the sensed arrangement of the assembly by using a position of a joint of a plurality of joints or using a position of a link of a plurality of links; store a plurality of threshold limits, where each of the plurality of threshold limits is associated with a procedure type and defines a limit of a range to be potentially travelled by the manipulator assembly to perform a procedure of the associated procedure type; select a threshold limit of the plurality of threshold limits based on which procedure type is to be performed; and provide a notification indicative of whether the selected threshold limit is outside a range of motion bounded by the motion limit.

Abstract: Integrated table motion includes a computer-assisted device. The computer-assisted device includes articulating means; means for receiving, via a means for communicatively coupling the computer-assisted device with a table means, a table movement request from a table command means, the table means being separate from the computer-assisted device; means for determining whether the table movement request should be allowed; and means for allowing the table means to perform the table movement request based on determining that the table movement request should be allowed.

Abstract: A robotic system comprises an input device movable by an operator and a processing unit. An operator reference frame is defined relative to the operator. The processing unit is configured to present, to the operator, a first image of a first tool captured by an imaging device, receive, from the operator, a first indication that a first axis of the input device is aligned with a corresponding axis of the first tool in the first image, and in response to the first indication, determine a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between the operator reference frame and the input device.

Abstract: A method is provided to control actuation of a click event by a hand-actuated selector moveably mounted to a mount structure, comprising: in a first control state, imparting a maintaining force to the hand-actuated selector; in a second control state, imparting a haptic force to the hand-actuated selector that increases as a function of increasing displacement of the hand-actuated selector from the neutral displacement position; imparting a click event signal to cause an occurrence of the click event at a display system, in a third control state, imparting a haptic force to the hand-actuated selector that decreases in magnitude to a reduced magnitude.

Abstract: A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.

Abstract: A medical system may comprise a display system and a control system. The control system may include a processing unit including one or more processors. The processing unit may be configured to display, on the display system, an image of a field, generated by an imaging component, of view of a surgical environment. The processing unit may also be configured to generate a three-dimensional synthetic indicator for a position of an instrument outside of the field of view of the surgical environment and display the three-dimensional synthetic indicator with the image of the field of view of the surgical environment.

Abstract: A medical imaging system comprises a teleoperational assembly which includes a medical instrument including an instrument tip and an imaging instrument including an imaging instrument tip. The medical imaging system also comprises a processing unit including one or more processors. The processing unit may be configured to determine an instrument tip position for the instrument tip, determine an instrument tip position error relative to the imaging instrument, and determine at least one instrument tip bounding volume based on the determined instrument tip position, the determined instrument tip position error, and a ratio between an error radius of the instrument tip position error and a size of a display screen.

Abstract: Integrated table motion includes a computer-assisted device. The computer-assisted device includes an articulated arm and a control unit coupled to the articulated arm. To support integrated motion with a table physically separate from and communicatively coupled to the computer-assisted device via a communications connection, the control unit is configured to receive a table movement request from a table command unit of the table, determine whether the table movement request should be allowed, and allow the table to perform the table movement request based on determining that the table movement request should be allowed.

Abstract: Techniques are disclosed for imaging device control in a computer-assisted device that includes a repositionable structure configured to support an imaging device, and a control system configured to determine a position of a first reference point associated with a first input modality; in a first mode, determine a position of a target reference point for the imaging device based on the first reference point; in a second mode, determine a position of a second reference point associated with a second input modality, and determine the position of the target reference point based on the position of the first reference point and the position of the second reference point; determine a movement of the first repositionable structure that moves the imaging device such that a third reference point associated with the imaging device moves toward the target reference point; and cause actuation of the repositionable structure based on the movement.

Abstract: Techniques are disclosed for imaging device control in a computer-assisted device that includes a repositionable structure configured to support an imaging device, and a control system coupled to the repositionable structure. The control system is configured to: determine a position of a reference point offset from a display unit, convert the position of the reference point to a target position of another reference point offset from the imaging device, determine a movement command of the first repositionable structure that moves the imaging device such that the another reference point moves toward the target position, and cause actuation of the repositionable structure based on the movement command.

Abstract: A robotic system comprises a display that is viewable by an operator. An operator reference frame is defined relative to the display or the operator viewing the display. The robotic system also includes an input device movable by the operator and a processing unit. The processing unit is configured to present, in the display, a first image of a first tool captured by an imaging device, receive, from the operator, a first indication that a first axis of the input device is aligned with a corresponding axis of the first tool in the first image, and in response to the first indication, determine a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between the operator reference frame and the input device.

Abstract: A teleoperational assembly is disclosed which includes an operator control system and a plurality of manipulators configured to control the movement of medical instruments in a surgical environment. The manipulators are teleoperationally controlled by the operator control system. The system further includes a processing unit configured to display an image of a field of view of the surgical environment, determine association information about the manipulators and the operator control system, and display badges near the medical instruments in the image of the field of view of the surgical environment. The badges display the association information for the medical instrument they appear associated with.

Abstract: Embodiments relate to a computer-assisted robotic system, In some embodiments, the system includes a head input device, the head input device comprising a head input sensor configured to provide head input signals indicative of a an operator's head inputs, and a foot input device comprising a foot input sensor configured to provide foot input signals indicative of the operator's foot inputs. The system further includes a controller, configured to process the head input signals and the foot input signals, and identify, based on the processed head and foot input signals, that the operator has provided a combination of head and foot inputs corresponding to a steerable viewer mode activation command. The controller is further configured to cause the robotic system to enter a steerable viewer mode in response to identifying that the operator has provided a combination.

Abstract: A system comprises a display configured to present a graphical user interface including a viewing area and one or more user interface elements. The system also comprises a gaze tracking device configured to detect a change in a gaze of a user while the user views the graphical user interface presented on the display. The system also comprises an audio input device configured to receive audio information. The system also comprises one or more processors configured to process the audio information received at the audio input device in accordance with a first mode to direct the received audio information as audio output to one or more audio output devices; and in response to the gaze tracking device detecting the change in the gaze of the user, process the received audio information in accordance with a second mode, the second mode being distinct from the first mode.

Abstract: A system comprises a teleoperational assembly including an operator input system and a teleoperational manipulator configured for operation by the operator input system. The teleoperational manipulator is coupled to a medical instrument in a surgical environment. The system also comprises a processing unit including one or more processors. The processing unit is configured to retrieve a user profile for a user, the user profile including a parameter established during a prior teleoperational procedure. The parameter includes an ergonomic setup for an input device of the operator input system. The input device is configured to operate the teleoperational manipulator. The processing unit is also configured to provide instructions to configure an operation of the teleoperational assembly based upon the parameter. The operation includes adjusting the operator input system based on the at least one of the ergonomic setup for the operator input system.

Abstract: A system comprises a processor and a memory having computer readable instructions stored thereon, which, when executed by the processor, cause the system to display an image of a surgical environment. The image includes an information icon corresponding to an instrument in the surgical environment. The instructions further cause the system to display an image of a body part of a user. The image of the body part is used to interact with the information icon. The instructions further cause the system to receive a gesture of the body part, via a gesture-based input device registering movement of the body part, to cause the image of the body part to interact with the information icon. The instructions further cause the system to display an information menu in the image of the surgical environment based on the interaction between the image of the body part and the information icon.

Abstract: Techniques for registering a computer-assisted device to a table include a computer-assisted device having an articulated arm and a control unit. The control unit is configured to receive information of a first motion of a table, the first motion comprising a first rotation about a first axis and causing a second motion of a point associated with the articulated arm; receive information of the second motion; receive information of a third motion of the table, the third motion of the table comprising a second rotation about a second axis different from the first axis and causing a fourth motion of the point; receive information of the fourth motion; determine a relationship between the computer-assisted device and the table based on a position of the point, the first rotation, the second motion, the second rotation, and the fourth motion; and control motion of the articulated arm based on the relationship.

Abstract: A system may comprise an image capture device to capture an image of a work site. The system may also comprise a processor to determine whether a tool disposed at the work site is energized and determine a first area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image. The processor may also determine a second area of the captured image including a remainder of the captured image that does not include the first area. Conditioned upon determining that the tool is energized, at least one of the first area and the second area of the captured image of the work site may be processed to indicate that the tool in the first area is being energized. The image of the work site with the first area and the second area may be displayed.

Abstract: Techniques for control using hand tracking include a system having an input control configured to be manipulated by an operator of the system, a hand tracking unit, and a controller. The controller is configured to determine a first position of the input control; receive, from the hand tracking unit, a second position of a hand of the operator; determine whether the first position is within a threshold distance of the second position; and control display of a user interface based on the determination of whether the first position is within the threshold distance of the second position.

Abstract: A patient side cart for a teleoperated surgical system may comprise a column extending from a base, the column having a first end connected to the base and a second end opposite the first end. The patient side cart may further include a surgical instrument manipulator arm coupled proximate the second end of the column, and an obstacle indication system comprising an illumination source mounted on the patient side cart at a height above a location the surgical instrument manipulator arm is coupled to the second end of the column, the height being measured in a direction the column extends from the base.