Abstract: A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Abstract: An exemplary surgical instrument tracking system includes at least one physical computing device that determines, based on endoscopic imagery of a surgical area and using a trained neural network, an observation for an object of interest depicted in the endoscopic imagery, associates, based on a probabilistic framework and kinematics of a robotically-manipulated surgical instrument located at the surgical area, the observation for the object of interest to the robotically-manipulated surgical instrument, and determines a physical position of the robotically-manipulated surgical instrument at the surgical area based on the kinematics of the robotically-manipulated surgical instrument and the observation associated with the robotically-manipulated surgical instrument.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, or external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.

Abstract: A method of estimating a pose of a surgical table comprises reading one or more fiducial markers on a base of the surgical table with a camera mounted to a manipulator assembly adjacent the surgical table. The surgical table includes a substrate and a support structure supporting the substrate. The substrate has a support surface. The support structure is movable such that the support surface of the substrate is positionable along one or more degrees of freedom (DOF).

Abstract: A robotic system includes a display to display an image captured by an image capture device, a linkage movably supporting the display, the linkage including a multitude of links, a multitude of joints coupling the multitude of links, and a multitude of sensors configured to sense configuration information of the linkage. A physical movement of the display corresponds to a configuration change of the linkage. The robotic system further includes a processor coupled to the multitude of sensors. The processor is configured to obtain sensor signals from the multitude of sensors, the sensor signals indicative of the configuration change, and adjust the image in response to the sensor signals.

Abstract: A measurement system accesses first and second images captured respectively from first and second vantage points by first and second cameras included within a stereoscopic endo scope located at a surgical area associated with a patient. The measurement system receives user input designating a user-selected two-dimensional (“2D”) endpoint corresponding to a feature within the surgical area as represented in the first image, and identifies, based on the user-selected 2D endpoint, a matched 2D endpoint corresponding to the feature as represented in the second image. Based on the user-selected and matched 2D endpoints, the measurement system defines a three-dimensional (“3D”) endpoint corresponding to the feature within the surgical area. The measurement system then determines a distance from the 3D endpoint to an additional 3D endpoint corresponding to an additional feature within the surgical area. Corresponding systems and methods are also described.

Abstract: A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Abstract: In one embodiment, a digital zoom and panning system for digital video is disclosed including an image acquisition device to capture digital video images; an image buffer to store one or more frames of digital video images as source pixels; a display device having first pixels to display images; a user interface to accept user input including a source rectangle to select source pixels within frames of the digital video images, a destination rectangle to select target pixels within the display device to display images, and a region of interest within the digital video images to display in the destination rectangle; and a digital mapping and filtering device to selectively map and filter source pixels in the region of interest from the image buffer into target pixels of the display device in response to the user input.

Abstract: An apparatus may configure an illuminator to illuminate a scene with non-white light and control a camera to capture, in a plurality of color channels of the camera, a frame of the scene illuminated with the non-white light. The apparatus may adjust a signal of a color channel of the camera in the frame of the scene based on the non-white light.

Abstract: Methods and systems for registering a manipulator assembly and independently positionable surgical table are provided herein. In one aspect, methods include reading a fiducial marker on the surgical table with a sensor associated with the manipulator assembly and localizing the manipulator assembly and surgical table with respect to a common reference frame. Methods may further include translating a 3D configuration of the surgical table to a 2D frame of reference so as to estimate a 3D pose of the surgical table relative the manipulator assembly for use in coordinating movements therebetween.

Abstract: A method comprises displaying an image of a field of view of a surgical environment. A first medical instrument in the field of view may be coupled to a first manipulator in a teleoperational assembly. The method may comprise displaying a menu proximate to an image of the first medical instrument in the image of the field of view. The menu may include a plurality of icons wherein each icon is associated with a function for the first medical instrument. The method may also comprise identifying a selected icon from the plurality of icons based upon a movement of an operator control device of a teleoperational operator control system.

Abstract: A system may control an illuminator to illuminate a surgical site with non-white light and control a camera to capture light reflected from the surgical site. The camera may separate the captured light into a plurality of color components. The plurality of color components may be captured by the camera as a plurality of sets of pixels of a frame in a video stream, and each set of the plurality of sets of pixels may be in a different color channel of the camera. The system may further control, based on color component characteristics of the light captured by the camera, the illuminator to configure the non-white light such that each color channel of the camera has an about equal response to the light captured by the camera for a subsequently captured frame in the video stream.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined. using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, of external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, or external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.

Abstract: A system comprises a teleoperational assembly including an operator control system and a first teleoperational manipulator configured for operation by an operator control device of the operator control system. The first teleoperational manipulator is configured to control the operation of a first medical instrument in a surgical environment. The system also comprises a processing unit including one or more processors. The processing unit is configured to display an image of a field of view of the surgical environment and display a menu proximate to an image of the first medical instrument in the image of the field of view. The menu includes at least one icon representing a function for the first medical instrument.

Abstract: A robotic system includes a display to display an image captured by an image capture device, a linkage movably supporting the display, the linkage including a multitude of links, a multitude of joints coupling the multitude of links, and a multitude of sensors configured to sense configuration information of the linkage. A physical movement of the display corresponds to a configuration change of the linkage. The robotic system further includes a processor coupled to the multitude of sensors. The processor is configured to obtain sensor signals from the multitude of sensors, the sensor signals indicative of the configuration change, and adjust the image in response to the sensor signals.

Abstract: Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, or external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.

Abstract: A teleoperated surgical system is provided that comprises a support arm; a surgical instrument, moveably mounted to the support arm, including a housing a proximal end portion and a distal end portion and having an end effector at the distal end portion thereof; an actuator to impart movement to the surgical instrument; an optical fiber, including a proximal end portion and a distal end portion, mounted to the surgical instrument to emit first light from its distal end at the distal end portion of the surgical instrument; and a light source disposed to impart the first light to the proximal end of the optical fiber at a first angle within an acceptance angle of the optical fiber.

Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.