Abstract: A tool guide may be used with a computer-assisted medical device. The tool guide comprises an elongated body comprising a first end and a second end opposite the first end. The tool guide also comprises a joint attached to the first end of the elongated body and a mounting arm coupled to the elongated body via the joint. The tool guide also comprises a tool sleeve attached to the second end of the elongated body. The mounting arm is configured to be attached to a first articulated arm of the computer-assisted medical device, and the tool sleeve is adapted to receive an end effector attached to a second articulated arm of the computer-assisted medical device.

Abstract: A method is provided to produce a multi-modality image of a surgical scene comprising: capture light reflected from the surgical scene; producting first image information corresponding to a first modality image; producing second image information corresponding to a second modality image; selecting a portion of the second image modality based at least in part upon anatomical structure information included within the selected portion; and producing simultaneously within a display at least a portion of the first modality image of the surgical scene and the selected portion of the second modality image.

Abstract: A method is provided for use with a teleoperated surgical system, the method comprising: determining patient position information during a setup for a performance of the surgical procedure within an instance of the surgical system; determining a match between the determined patient position and a patient position signature; and launching a support arm control signal within the surgical system that corresponds to the matched support arm signature.

Abstract: A method is provided to model a 3D structure comprising: producing a surface mesh representation of the 3D structure; producing a volume mesh representation of the 3D structure based upon the surface mesh; sorting vertices of the volume mesh into a first sub-list that includes only surface vertices and a second sub-list that includes only internal vertices; applying shading to the surface mesh by accessing only surface vertices in the first sub-list; determining deformation of the volume mesh by accessing both surface vertices in the first sub-list and internal vertices in the second sub-list.

Abstract: A system and method for an articulated arm based tool guide includes an elongated body having a guide hole, a first joint attached to a first end of the body, a second joint attached to a second end of the body opposite the first end, a first mounting arm coupled to the body using the first joint, and a second mounting arm coupled to the body using the second joint. The first mounting arm is configured to be attached to a first articulated arm of a computer-assisted medical device. The second mounting arm is configured to be attached to a second articulated arm of the computer-assisted medical device. The guide hole is adapted to receive a medical tool and maintain a working end of the medical tool in alignment with the guide. In some embodiments, the first mounting arm includes identifying information identifying the tool guide as a tool guide.

Abstract: A system and method for registration and coordinated manipulation of augmented reality image components includes registering a model of patient anatomy to a first image of the patient anatomy captured using an imaging device to determine a baseline relationship between the model and the first image, tracking movement of a computer-assisted device used to manipulate the imaging device, updating the baseline relationship based on the tracked movement, and generating a composite image by overlaying the model on a second image of the patient anatomy according to the updated relationship. In some embodiments, the model is semi-transparent. In some embodiments, registering the model to the first image includes adjusting the model relative to the first image based on one or more inputs received from a user and generating a model to image transformation based on the adjustments to the model. The model to image transformation captures the baseline relationship.

Abstract: A medical imaging system comprises a teleoperated assembly including a medical instrument. The medical imaging system also comprises a first imaging instrument for generating a first image of a field of view of the first imaging instrument and a second imaging instrument for generating a second image. A tracking fixture is engagable along at least a portion of the second imaging instrument. The medical instrument is attachable to the tracking fixture within the field of view of the first imaging instrument.

Abstract: The technology described in this document can be embodied in a method of displaying images of portions of a human body on a display device. The method includes receiving a representation of a plurality of images that includes images of at least two different modalities, and location information corresponding to at least a subset of the plurality of images. A first image of a first modality is displayed on the display device in accordance with the corresponding location information. A second image of a second modality is overlaid on the first image in accordance with corresponding location information. At least a third image is overlaid on the first image in accordance with corresponding location information, the third image being of the second modality, and the second and third images being displayed concurrently for at least a period of time.

Abstract: A system and method of specular reflection detection and reduction includes a processing unit including one or more processors and an imaging unit coupled to the processing unit. The imaging unit includes one or more first illuminators for providing illumination of a region of interest, one or more first detectors for detecting reflections of the illumination, one or more second illuminators for triggering fluorescing of one or more fluorescent materials in the region of interest, and one or more second detectors for detecting the fluorescing of the fluorescent materials. The processing unit is configured to receive a first image from the first detectors, determine one or more regions of high specular reflection in the first image, mask out the regions of high specular reflection in the first image, and generate a composite image based on the masked first image and the detected fluorescence. The first image includes the detected reflections.

Abstract: A system and method includes deploying first and second articulated arms of a computer-assisted device so that a first attachment point on the first articulated arm and a second attachment point of the second articulated arm are positioned and oriented relative to each other based on a size and a shape of an arm stabilizer; stabilizing and reducing vibration of the first and second articulated arms by attaching the arm stabilizer to the first and second attachment points; after the stabilizing and reducing vibration of the first and second articulated arms, positioning and orienting a tool with the first articulated arm; and after the positioning and orienting of the tool, operating the tool. In some embodiments, the tool is a medical tool. In some embodiments, the system and method further include positioning and orienting a second tool with the second articulated arm and operating the second tool.

Abstract: A system and method of specular reflection detection and reduction includes a processing unit including one or more processors and an imaging unit coupled to the processing unit. The imaging unit includes one or more first illuminators for providing illumination of a region of interest, one or more first detectors for detecting reflections of the illumination, one or more second illuminators for triggering fluorescing of one or more fluorescent materials in the region of interest, and one or more second detectors for detecting the fluorescing of the fluorescent materials. The processing unit is configured to receive a first image from the first detectors, determine one or more regions of high specular reflection in the first image, mask out the regions of high specular reflection in the first image, and generate a composite image based on the masked first image and the detected fluorescence. The first image includes the detected reflections.

Abstract: A device for generating composite images of dynamically changing surgical anatomy includes circuitry configured to receive, from an endoscopic imaging device, endoscopic image data. The circuitry is configured to receive, from a tomographic imaging device, intra-operative tomographic image data. The circuitry is configured to receive, from a tracking device, spatial tracking data corresponding to the endoscopic imaging device and the tomographic imaging device. The circuitry is configured to generate real-time dynamically changing composite image data by overlaying, based on the spatial tracking data, the intra-operative tomographic image data on the endoscopic image data. The circuitry is configured to output the composite image data to a display.

Abstract: A teleoperated surgical system is provided comprising: a first robotic surgical instrument; an image capture; a user display; a user input command device coupled to receive user input commands to control movement of the first robotic surgical instrument; and a movement controller coupled to scale a rate of movement of the first robotic surgical instrument, based at least in part upon a surgical skill level at using the first robotic surgical instrument of the user providing the received user input commands, from a rate of movement indicated by the user input commands received at the user input command device.

Abstract: System and method for tracking and control in medical procedures. The system including a device that deploys fluorescent material on at least one of an organ under surgery and a surgical tool, a visual light source, a fluorescent light source corresponding to an excitation wavelength of the fluorescent material, an image acquisition and control element that controls the visual light source and the fluorescent light source, and captures and digitizes at least one of resulting visual images and fluorescent images, and an image-based, tracking module that applies image processing to the visual and fluorescent images, the image processing detecting fluorescent markers on at least one of the organ and the surgical tool.

Abstract: A method is provided for intra-surgical use of a surgical patient health record in a teleoperated surgical system that includes a surgical instrument and a surgical instrument actuator, comprising: receiving user input commands to control movement of a robotic surgical instrument; tracking robotic surgical instrument actuator state in response to the user input commands; and transitioning robotic surgical instrument actuator state to a safety mode in response to the robotic surgical instrument transitioning to a prescribed actuator state.

Abstract: The technology described in this document can be embodied in a method that includes operating a surgical system to perform a surgical process, the surgical system including a display device, and receiving, at one or more processing devices, data from multiple data sources. The method also includes determining a current phase of the surgical process, and displaying, on the display device, visual representations corresponding to the data from a first set of the multiple data sources in a first arrangement within a display region of the display device. At least one of the first set of the multiple data sources and the first arrangement is associated with the current phase of the surgical process.

Abstract: In a method and an apparatus to provide updated images during a robotically-implemented surgical procedure, 3D data is obtained of a volume of a patient, which includes anatomy involved in the procedure. The anatomy is segmented from a reconstructed image of the volume. During the procedure, the surgeon applies forces on the anatomy, causing a geometric change of the anatomy. Force sensors in the surgical robot detect these forces, which are supplied to a processor that controls display of the segmented anatomy at a display screen. From the applied forces and the physical properties of the anatomy, the processor calculates the geometric change of the anatomy that has occurred and modifies the appearance and/or position of the displayed segmented anatomy on the display screen in real time during the procedure, so as to visualize the geometric change.

Abstract: A system and method for an articulated arm stabilization includes an arm stabilizer for use with articulated arms of a computer-assisted medical device. The stabilizer includes a spine, a first vibration absorbing mount attached to the spine, a second vibration absorbing mount attached to the spine, a first clamp attached to the first vibration absorbing mount, and a second clamp attached to the second vibration absorbing mount. The first clamp is adapted to hold a first attachment point of a first articulated arm without slipping. The second clamp is adapted to hold a second attachment point of a second articulated arm without slipping. In some embodiments, the arm stabilizer stabilizes and reduces vibration in the first and second articulated arms. In some embodiments, the vibration is in a range from 0.5 to 14 Hz. In some embodiments, the spine limits relative motion between the first clamp and the second clamp.

Abstract: A system and method of coordinated motion includes a device with one or more movable elements and one or more processors. The device is configured to discover a second device, determine a desired type of coordinated motion based on the discovery of the second device, request a movement token of a first type from a token service, the first type being selected based on the desired type of coordinated motion, receive the movement token from the token service, receive configuration data, kinematic data, or planned motion data for the second device, plan a first motion for a movable element of the movable elements based on the first type of the movement token and the configuration data, the kinematic data, or the planned motion data for the second device, and execute the first motion while the device holds the movement token.

Abstract: Systems and methods of virtual feedback include a virtual feedback device virtually coupled between a first and second device and a control unit. The control unit is configured to select a virtual feedback model (VFM) for the virtual feedback device from among a plurality of VFMs; configure the VFM; determine, based on information from one or more first sensors for detecting information related to a position of the first device and one or more second sensors for detecting information related to a position of the second device, a relative displacement between the first second devices; determine, based on the relative displacement and the VFM, a feedback level; send feedback commands, based on the feedback level, to one or more first actuators for inducing feedback on the first device and to one or more second actuators for inducing feedback on the second device.