Abstract: Techniques for inter-arm registration include a computer-assisted system having a repositionable arm and a control unit coupled to the repositionable arm. The control unit is configured to receive, from an imaging device, image data of an instrument, the instrument mounted to the repositionable arm; determine an observed geometric property of a feature set of the instrument based on the image data, the feature set comprising at least one feature; determine an expected geometric property of the feature set based on at least kinematic data of the repositionable arm; determine a difference between the observed geometric property and the expected geometric property; update, based on the difference. a registration transform to produce an updated registration transform associated with the instrument; and control the instrument using the updated registration transform.

Abstract: A method is performed by a computing system. The method includes receiving image data from an imaging device, and determining, using the image data, a plurality of image-space tools, each image-space tool associated with a tool of a plurality of tools, each tool controlled by a manipulator of a plurality of manipulators. The method further includes determining a first correspondence between a first image-space tool of the plurality of image-space tools and a first tool of the plurality of tools based on a first disambiguation setting associated with the first tool.

Abstract: A method is provided for intra-surgical use of a surgical patient health record in a teleoperated surgical system that includes a surgical instrument and a surgical instrument actuator, comprising: receiving user input commands to control movement of a robotic surgical instrument; tracking robotic surgical instrument actuator state in response to the user input commands; and transitioning robotic surgical instrument actuator state to a safety mode in response to the robotic surgical instrument transitioning to a prescribed actuator state.

Abstract: Techniques for virtually recreating devices include a replay service configured to access a log associated with a first device, extract a first log entry from the log, recreate a first recreated service request for the one or more shared services based on information associated with the first log entry, and send the first recreated service request to a shared service to recreate an event associated with the first log entry; one or more shared services configured to receive and respond to a second service request from a second device coupled to the logging and replay device; and a recreation engine configured to receive the first recreated service request, a response to the first recreated service request, the second service request, and a response to the second service request and create a virtual recreation of the first device.

Abstract: Systems and methods for inter-arm registration include a computer-assisted system having a control unit coupled to a repositionable arm of a computer-assisted device. The control unit is configured to: receive, from an imaging device, successive images of an instrument mounted to the repositionable arm; determine an observed velocity of a feature of the instrument; determine an expected velocity of the feature of the instrument based on kinematics of the repositionable arm; transform the observed velocity and/or the expected velocity to a common coordinate system using a registration transform; determine an error between directions of the observed and expected velocities in the common coordinate system; and update the registration transform based on the determined error. In some embodiments, the instrument is a medical instrument and the imaging device is an endoscope. In some embodiments, the control unit is further configured to control the instrument using the registration transform.

Abstract: A system comprises: a robotic arm operatively coupleable to a tool comprising a working end; and an input device communicatively coupled to the robotic arm. The input device is manipulatable by an operator. The system further comprises a processor configured to cause an image of a work site, captured by an image capture device from a perspective of an image reference frame, to be displayed on a display. The image of the work site includes an image of the working end of the tool. The processor is further configured to determine a position of the working end of the tool in the image of the work site and render a tool information overlay at the position of the working end of the tool in the image of the work site. The tool information overlay visually indicates an identity of the input device.

Abstract: Techniques for ratcheting an alignment between an input means and an instrument include a teleoperated system comprising a robotic means configured to support an instrument, an input means configured to be manipulated by an operator to command motion of the instrument, and a ratcheting means. The ratcheting means is configured to determine first rotation values describing an orientation of the input means; determine second rotation values describing an orientation of the instrument; determine, based on the first rotation values and the second rotation values, an orientation error between the orientation of the input means and the orientation of the instrument; generate, based on the orientation error, a motion command for the instrument to reduce the orientation error by increasing an alignment between the input means and the instrument; and command the robotic means to move in accordance with the motion command.

Abstract: A system is configured to direct a manipulator cart to navigate, in a first bifurcated navigation control mode, from an initial location to an intermediate location; and direct the manipulator cart to navigate, in a second bifurcated navigation control mode, from the intermediate location to a target location. In the first bifurcated navigation control mode, the system is configured to autonomously control a steering of the manipulator cart while allowing operator control of a propulsion of the manipulator cart using a primary control interface configured to facilitate operator control of both steering and propulsion of the manipulator cart. In the second bifurcated navigation control mode, the system is configured to autonomously control the steering of the manipulator cart while allowing operator control of the propulsion of the manipulator cart using a secondary control interface configured to facilitate operator control of the propulsion and not the steering of the manipulator cart.

Abstract: A computer-assisted system includes a manipulator arm coupled to an active imaging device and one or more processors configured to perform a process comprising: automatically directing a display device to display a shape overlay overlaid with an external view of a body, wherein the shape overlay is indicative of an extent of a field of view of the active imaging device relative to the body, and automatically directing the display device to display an auxiliary shape overlay overlaid with the external view of the body, wherein the auxiliary shape overlay is indicative of an extent of a potential field of view of the active imaging device relative to the body, the potential field of view distinct from the field of view.

Abstract: A teleoperational system comprises a teleoperational control system and a teleoperational manipulator configured for operating an instrument in an environment. The teleoperational system also comprises an operator controller in communication with the teleoperational control system. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether an operator of the operator controller has a head portion directed toward a display region of a display device and based on a determination that the operator's head portion is directed toward the display region, initiate an operator following mode in which movement of the operator controller provides a corresponding movement to the teleoperational manipulator. The teleoperational system may be a teleoperational medical system.

Abstract: A teleoperated surgical system is provided comprising: a first robotic surgical instrument; an image capture; a user display; a user input command device coupled to receive user input commands to control movement of the first robotic surgical instrument; and a movement controller coupled to scale a rate of movement of the first robotic surgical instrument, based at least in part upon a surgical skill level at using the first robotic surgical instrument of the user providing the received user input commands, from a rate of movement indicated by the user input commands received at the user input command device.

Abstract: A teleoperated system includes a robotic arm configured to support an instrument, a grip configured to be manipulated by an operator to command motion of the instrument, and a control system communicatively coupled to the robotic arm and the grip. To align the grip with the instrument by the grip, the control system is configured to determine grip rotation values describing an orientation of the grip, determine instrument rotation values describing an orientation of the instrument, determine an orientation error between the orientation of the grip and the orientation of the instrument based on the grip rotation values and the instrument rotation values, produce a motion command by selectively imposing, based on the orientation error, an artificial joint limit on a commanded movement of the instrument, and command the robotic arm to move in accordance with the motion command.

Abstract: A mixed reality presentation system identifies an operating condition associated with an operation performed on a body while an active imaging device captures imagery of an internal view of the body. The mixed reality presentation system also determines, based on the identified operating condition, that a display device is to toggle a display of a shape overlay that is displayed together with an external view of the body and that is indicative of an extent of a field of view of the active imaging device relative to the body. Based on the determining that the display device is to toggle the display of the shape overlay, the mixed reality presentation system directs the display device to toggle the display of the shape overlay. Corresponding systems and methods are also disclosed.

Abstract: A teleoperational medical system includes a teleoperational control system, a teleoperational manipulator configured for operating a medical instrument in a medical environment, and an operator controller. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether a head portion of an operator of the operator controller is directed toward or away from a display region of a display device based on at least one marker on the operator that is configured to remain substantially fixed relative to the head portion of the operator during a movement of the head portion. The processing unit is further configured to, based on a determination that the head portion is directed away from the display region for at least a threshold time period, enter a standby mode such that movement of the operator controller does not provide corresponding movement to the teleoperational manipulator.

Abstract: A bifurcated navigation control system defines a path whereby a manipulator cart is to navigate from an initial location to a target location. The system directs the manipulator cart to navigate, in a first bifurcated navigation control mode associated with a primary control interface that facilitates both operator control of steering and propulsion, along at least part of a first portion of the path from the initial to an intermediate location. The system further directs the manipulator cart to navigate, in a second bifurcated navigation control mode associated with a secondary control interface that facilitates operator control of propulsion but not steering, along at least part of a second portion of the path from the intermediate to the target location. In the first and second bifurcated navigation control modes, the system autonomously controls the steering of the manipulator cart while allowing operator control of the propulsion of the manipulator cart.

Abstract: A teleoperated system comprises a display, a master input device, and a control system. The control system is configured to determine an orientation of an end effector reference frame relative to a field of view reference frame, determine an orientation of a master input device reference frame relative to a display reference frame, establish an alignment relationship between the master input device reference frame and the display reference frame, and command, based on the alignment relationship, a change in a pose of the end effector in response to a change in a pose of the master input device. The alignment relationship is independent of a position relationship between the master input device reference frame and the display reference frame. In one aspect, the teleoperated system is a telemedical system such as a telesurgical system.

Abstract: A medical robotic system includes a viewer for displaying an image of a work site, a gaze tracker for tracking a gaze point of a user on the viewer, and a processor. The processor is configured to: draw an area or volume defining shape, overlaid on the image of the work site, in a position determined by the gaze tracker; assign a fixed virtual constraint to the shape and constrain movement of a robotic tool according to the fixed virtual constraint; receive a user selected action command selecting an image of patient anatomy; and superimpose the selected image of the patient anatomy over the image of the work site within the shape. The selected image of the patient anatomy is registered to the image of the work site.

Abstract: A method is performed by a computing system. The method includes receiving image data from an imaging device, and determining, using the image data, a plurality of image-space tools, each image-space tool associated with a tool of a plurality of tools, each tool controlled by a manipulator of a plurality of manipulators. The method further includes determining a first correspondence between a first image-space tool of the plurality of image-space tools and a first tool of the plurality of tools based on a first disambiguation setting associated with the first tool.

Abstract: A device includes a first mechanism having a surface and a helical slot in the surface, a second mechanism having a periphery and an axial slot in the periphery, and an insert comprising a pin. The second mechanism is located within the first mechanism. The insert is located within the second mechanism. The pin extends from the insert through the axial slot of the second mechanism and into the helical slot of the first mechanism. The insert is configured to couple to an instrument. In some embodiments, the insert is configured to move the instrument in a degree of freedom in response to the second mechanism being held stationary and the first mechanism being rotated. In some embodiments, the degree of freedom is an insertion and retraction degree of freedom.

Abstract: A surgical module is supported by manipulators that are removably attached to the surgical module. The surgical module may enable operation of surgical tools by providing an integration between actuating mechanisms of the manipulators and actuating mechanisms of the surgical tools. Alternatively or additionally, the surgical module may enable operation of the surgical tools by providing physical access for deploying surgical tools that are operatively connected to the manipulators.