Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure. e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: Systems and methods for minimally invasive computer-assisted telesurgery are described. For example, this disclosure provides surgical instruments and instrument drive systems for computer-assisted tele-operated surgery that are structured and operated to negate the effects of cable stretch within the surgical instruments.

Abstract: An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: Compact and low mass augmented and fully virtual head mounted display designs are disclosed. The disclosed displays employ a display located between the eye and the main optical element of the head mounted display. These designs additionally afford the ability to support augmented reality displays because the user can see both the virtual image from the display and the real world if desired. The designs use semi-transparent displays where either the display emits circularly polarized light or the displays which emits light from one surface or the view of the display directly from the eye is obscured.

Abstract: An exemplary system includes a scene processing module configured to receive a single frame comprising a first set of pixel data comprising a first combined scene including a fluorescence scene component and a second set of pixel data comprising a second combined scene including a combination of a visible color component scene and the fluorescence scene component. The scene processing module is further configured to extract a display fluorescence scene component from the first combined scene and extract a display visible scene component from the second combined scene. The system further includes a display unit configured to generate, based on the display fluorescence scene component and the display visible scene component, a displayed scene.

Abstract: The technology described in this document can be embodied in a viewing apparatus for a surgical device, the apparatus including a lens assembly including a first polarizer, a display device configured to present an image of a surgical scene, and a reflective surface oriented at an acute angle with respect to the display device such that light from the display device is reflected from the reflective surface towards the lens assembly. The first polarizer in the lens assembly is configured such that light reflected from the reflective surface passes through the first polarizer, and light reaching the first polarizer without being reflected from the reflective surface is substantially blocked.

Abstract: The technology described herein can be embodied in a stereoscopic endoscope in which the orientation of the two eyes may be determined dynamically as the endoscope is moved and rotated. This may enable an improved user-experience when using an angled stereoscopic endoscope even when it is rotated, for example, to view the sides of a cavity.

Abstract: A family of endoscopes includes a non-zero degree endoscope and a zero degree endoscope. The zero degree endoscope includes a first image capture unit mounted in a distal portion of the zero degree endoscope with a lengthwise axis of the first image capture unit substantially parallel to a lengthwise axis of that distal portion. The non-zero degree endoscope includes a second image capture unit mounted in a distal portion of the non-zero degree endoscope with a lengthwise axis of the second image capture unit intersecting a lengthwise axis of that distal portion at a non-zero angle. The first and second image capture units have substantially identical non-folded optical paths.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: In one embodiment, a surgical instrument includes a housing linkable with a manipulator arm of a robotic surgical system, a shaft operably coupled to the housing, a force transducer on a distal end of the shaft, and a plurality of fiber optic strain gauges on the force transducer. In one example, the plurality of strain gauges are operably coupled to a fiber optic splitter or an arrayed waveguide grating (AWG) multiplexer. A fiber optic connector is operably coupled to the fiber optic splitter or the AWG multiplexer. A wrist joint is operably coupled to a distal end of the force transducer, and an end effector is operably coupled to the wrist joint. In another embodiment, a robotic surgical manipulator includes a base link operably coupled to a distal end of a manipulator positioning system, and a distal link movably coupled to the base link, wherein the distal link includes an instrument interface and a fiber optic connector optically linkable to a surgical instrument.

Abstract: Systems and methods for image detection during grasping and stapling include an end effector having a first jaw and a second jaw, an imaging sensor mounted to the end effector and configured to capture images of a material graspable by the end effector, and one or more processors coupled to the end effector and the imaging sensor. The one or more processors are configured to receive the images from the imaging sensor, determine one or more properties of the material based on the images, and display the one or more properties of the material on an interface. In some embodiments, the end effector is part of a medical tool and the material is anatomical tissue. In some embodiments, the end effector further includes one or more of a stapling mechanism configured to staple the material or a cutting mechanism configured to cut the material.

Abstract: The technology described herein can be embodied in a method that includes obtaining a representation of a first image of a surgical scene using electromagnetic radiation of a first wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the first wavelength range received from a first tissue type is lower than that received for a second tissue type. The method also includes obtaining a representation of a second image using electromagnetic radiation of a second wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the second wavelength range received from the second tissue type is substantially different from that received for the first tissue type. The visual representation of the surgical scene is rendered on the one or more displays using the representation of the first image and the representation of the second image.

Abstract: A teleoperated surgical system is provided that comprises a support arm; a surgical instrument, moveably mounted to the support arm, including a housing a proximal end portion and a distal end portion and having an end effector at the distal end portion thereof; an actuator to impart movement to the surgical instrument; an optical fiber, including a proximal end portion and a distal end portion, mounted to the surgical instrument to emit first light from its distal end at the distal end portion of the surgical instrument; and a light source disposed to impart the first light to the proximal end of the optical fiber at a first angle within an acceptance angle of the optical fiber.

Abstract: An exemplary method includes receiving images of a site captured at a same time by a camera, generating, based one or more of the images, a monochromatic image, generating, based on one or more of the images, an alternate image representative of an alternate imaging characteristic of the site, and displaying the displaying the monochromatic image combined with the alternate image, the alternate image being highlighted relative to the monochromatic image.

Abstract: A radiation finder tool assists in locating tissue of interest within a patient. The radiation finder tool includes a body and a plurality of radiation detectors. The body has a distal end, a proximal end. A lengthwise axis of the radiation finder tool extends between the proximal end and the distal end of the body. The plurality of radiation detectors is oriented serially along the lengthwise axis, e.g., stacked one after the other along the lengthwise axis. Each radiation detector of the plurality of radiation detectors has a different field of view for radiation detected by that radiation detector. Each field of view of the plurality of radiation detectors has the lengthwise axis at its center.

Abstract: A stereoscopic endoscope that includes at least one image sensor, one or more processing devices, and a display device. The image sensors sense a pair of stereo images, based on capturing light passing through apertures electronically defined at a first aperture location and a second aperture location, respectively, on a liquid crystal layer within the endoscope. The size of each aperture, spacing between the apertures, and polarization state associated with each aperture are controlled using corresponding control signals provided to the liquid crystal layer. The image data captured through the apertures is used to generate control signals representing one or more views of a surgical scene. The views are then presented on a display device.

Abstract: A family of endoscopes includes a non-zero degree endoscope and a zero degree endoscope. The zero degree endoscope includes a first image capture unit mounted in a distal portion of the zero degree endoscope with a lengthwise axis of the first image capture unit substantially parallel to a lengthwise axis of that distal portion. The non-zero degree endoscope includes a second image capture unit mounted in a distal portion of the non-zero degree endoscope with a lengthwise axis of the second image capture unit intersecting a lengthwise axis of that distal portion at a non-zero angle. The first and second image capture units have substantially identical non-folded optical paths.

Abstract: A computer-assisted medical system includes manipulators, a user input system, a user output system comprising a display device, and a controller configured to execute instructions to perform operations. The operations include, in a pairing mode and in response to a first set of signals generated by the user input system, causing a virtual selector shown on the display device to move relative to an imagery shown on the display device. The operations further include, in the pairing mode, associating a first manipulator with a portion of the user input system based on movement of the virtual selector relative to a represented location of the first instrument, and, in a following mode, controlling motion of the first instrument in accordance to a second set of signals generated by the user input system in response to operation of the portion of the user input system by a user.

Abstract: A method is provided for use with a teleoperated surgical system, the method comprising: determining patient position information during a setup for a performance of the surgical procedure within an instance of the surgical system; determining a match between the determined patient position and a patient position signature; and launching a support arm control signal within the surgical system that corresponds to the matched support arm signature.