Abstract: A surgical system includes a light source, a sensor for detecting light, and a surgical device including an elongate shaft having a distal part positionable at a surgical working site within a body cavity. A first optical pathway transmits light from the light source to a distal part of the elongate shaft and onto tissue within the body cavity, and a second optical pathway receives light from tissue within the body cavity and transmits the received light to the sensor. A surgical drape, such as one covering a robotic manipulator arm housing components of the system, is positioned such that at least the first or second optical pathway includes an optically transmissive portion of the surgical drape.

Abstract: A system and method for measuring an area of interest such as a hernia defect within a body cavity, in which real time image data is captured at a treatment site that includes the area of interest. Computer vision is applied to identify the extents of the area of interest within images captured using the camera, and dimensions of the area of interest are measured using the image data. The user is given output, which may include recommendations of hernia mesh shape/size and or positioning, based on the measured dimensions.

Abstract: A system and method for augmenting an endoscopic display during a medical procedure including capturing a real-time image of a working space within a body cavity during a medical procedure. A feature of interest in the image is identified to the system using a user input handle of a surgical robotic system, and a graphical tag is displayed on the image marking the feature.

Abstract: A robotic surgical system configured to control movement of a first instrument and a second instrument, each of which is on a robotic manipulator. In described modes of operation, movement of the first instrument is surgeon controlled based on surgeon input to the robotic system. Movement of the second instrument is also surgeon controlled, but its motion is defined by the chosen mode of operation which sets the amplitude and direction of the second instrument's motion relative to the actual or instructed motion of the first instrument. In this way, two instruments are simultaneously moved based on input from a single surgeon input device.

Abstract: A system and method for measuring an area of interest within a body cavity, in which real time image data is captured at a treatment site that includes the area of interest. Computer vision is applied to identify the extents of the area of interest within images captured using the camera, and dimensions of the area of interest are measured using the image data. The user is given output as to the area of the area of interest. The system may calculate a cumulative total of the estimated areas of areas of interest measured or treated within the treatment site.

Abstract: A system and method for providing visual assistance to a practitioner during a medical suturing procedure. Real time images of the suture site are captured and displayed on an image display. The images are analyzed in real time to detect the suture needle, suture penetration sites, relevant tissue, adjacent tissue edges or other features of interest in the visual images. Based on the orientation of, or relationship between, the detected features of interest, overlays are generated and displayed on the image display to inform the user about the suturing task that is underway, such as the anticipated needle path, the suture spacing, or the separation between sutures and adjacent tissue edges.

Abstract: During a medical procedure, a system and method facilitate identification and treatment of sites within patient anatomy. A digital image of a region of patient anatomy is captured and displayed on a digital display. Target treatment sites are tagged with respect to the image, and overlays identifying the tagged target treatment sites are displayed. As tagged sites are treated, the corresponding overlays are removed, altered or replaced to indicate the tagged target treatment site has been treated.

Abstract: A system and method provide feedback to guide a user to arrange components of a surgical robotic system in a suitable arrangement for the surgical procedure to be performed. An image of a medical procedure site at which a robotic manipulator and a second object such as a second robotic manipulator, patient table, patient, and bedside staff are located. The image is displayed for a user. The system uses computer vision to recognize the robotic manipulator and second object in the image and determine their relative positions. Based on the type of surgical procedure that is to be performed, the system determines a target position for the robotic manipulator and/or the second object, and displays, as an overlay to the displayed image, a graphical indication of the target position.

Abstract: A system makes use of kinematic data from a robotic manipulator to aid in segmenting images of a robotically maneuvered surgical instrument at an operative site. A camera is positioned to capture image data of the surgical instrument at the surgical site. At least one processor receives the image data as well as kinematic data from the robotic manipulator. The kinematic data is used to define regions of interest in the images, and image segmentation is then carried out at the regions of interest to identify the surgical instruments in the image data.

Abstract: A surgical system and method for maintaining optimal surgeon-controlled tissue force or torque with a surgical robot in which a surgical instrument held by an additional robotic arm that is not being actively telemanipulated by a surgeon applies a force or torque to tissue.

Abstract: A robotic surgical system includes a fluid drive system and a surgical instrument removably positioned in operative engagement with the drive system. A sterile barrier covers non-sterile portions of the surgical system. Features of the sterile barrier are used to transfer motion output from the fluid drive system to the instrument for actuation of the instrument.

Abstract: A robotic surgical system comprises a surgical instrument moveable by a robotic manipulator within a work area. A processor is configured to receive input identifying a structure at the operative site to be avoided by the surgical instrument, to automatically determine whether the surgical instrument is approaching contact with the structure, and to initiate an avoidance step if the system determines that the surgical instrument is approaching contact with the structure.

Abstract: In a robotic surgical system, an organ manipulation device such as a uterine manipulator with a colpotomy cup is positionable on a first robotic manipulator while a surgical instrument is positionable on a second robotic manipulator. During the course of surgery, a user inputs instructions to the robotic surgical system to cause movement of the organ manipulator and surgical instrument.

Abstract: A powered user interface for a robotic surgical system includes a handle on a linkage having a plurality of joints, a base, and actuators. The interface operates in accordance with a first mode of operation in which a plurality of its actuators are operated to constrain predetermined ones of the joints to permit motion of the handle in only 4DOF with respect to the base, and a second mode of operation in which the actuators permit motion of the handle in at least 6DOF with respect to the base.

Abstract: A system and method for augmenting an endoscopic display during a medical procedure including capturing a real-time image of a working space within a body cavity during a medical procedure. A feature of interest in the image is identified and an overlay is displayed on the image marking the feature. Computer vision is used to detect in real time changes in the image that are indicative of the feature of interest being at least partially obscured. In response to such detected changes, a quality of the overlay is altered, e.g. to make it more bright or opaque, based on the change in visibility of the feature of interest in the image.

Abstract: A system and method for displaying tissue information on a display screen includes a camera capturing an image of an anatomical working site including a surgical instrument, and a display displaying the image. A tissue information detection device determines information about the health, pathology etc. of tissue in contact with a surgical instrument, or about an interaction between the surgical instrument and the tissue. The system renders overlays depicting the tissue information with the image on the display.

Abstract: In a system and method for assessing tissue excision comprise, first 3-dimensional data is acquired for a surgical region of interest from which tissue is to be excised, the first data defining initial geometry of tissue in the region of interest. A desired excision parameter, such as depth or shape, is determined and tissue is excised from the region of interest. Second 3-dimensional data for the region of interest is then acquired, the second scan data defining post-excision geometry of the tissue in the region of interest. The first and second data is compared to determine whether the desired excision parameter has been reached. The 3-dimensional data may be scan data acquired using a 3D or 2D endoscope, and/or it may be derived from kinematic data generated as a result of moving an instrument tip over the region of interest.

Abstract: A robotic surgical system includes a fluid drive system and a surgical instrument removably positioned in operative engagement with the drive system. A sterile barrier covers non-sterile portions of the surgical system. Features of the sterile barrier are used to transfer motion output from the fluid drive system to the instrument for actuation of the instrument.

Abstract: A system for correcting illumination in an image includes a light source positioned to illuminate scene points and a camera positionable to capture images of the scene points. The system determines a distance between each of a plurality of scene points and the light source, computes an enhanced light compensated image of the plurality of scene points, and displaying the enhanced light compensated image on an image display.

Abstract: A system for measuring distances within a surgical site includes a camera positionable to capture 3D image data corresponding to a treatment site. Using the image data, the system determines the relative 3D positions of identified measurement points at the treatment site captured in the images, and it estimates or determines the distance between the measurement points. Output is generated communicating the measured distances to the user. The measurement taken follows the 3D topography of the tissue positioned between the measurement points.