Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: A surgical site is simultaneously illuminated by less than all the visible color components that make up visible white light, and a fluorescence excitation illumination component by an illuminator in a minimally invasive surgical system. An image capture system acquires an image for each of the visible color components illuminating the surgical site and a fluorescence image, which is excited by the fluorescence excitation component from the illuminator. The minimally invasive surgical system uses the acquired images to generate a background black and white image of the surgical site. The acquired fluorescence image is superimposed on the background black and white image, and is highlighted in a selected color, e.g., green. The background black and white image with the superimposed highlighted fluorescence image is displayed for a user of the system. The highlighted fluorescence image identifies tissue of clinical interest.

Abstract: A surgical site is simultaneously illuminated by less than all the visible color components that make up visible white light, and a fluorescence excitation illumination component by an illuminator in a minimally invasive surgical system. An image capture system acquires an image for each of the visible color components illuminating the surgical site and a fluorescence image, which is excited by the fluorescence excitation component from the illuminator. The minimally invasive surgical system uses the acquired images to generate a background black and white image of the surgical site. The acquired fluorescence image is superimposed on the background black and white image, and is highlighted in a selected color, e.g., green. The background black and white image with the superimposed highlighted fluorescence image is displayed for a user of the system. The highlighted fluorescence image identifies tissue of clinical interest.

Abstract: A head-mounted display (HMD) allows a user to view a virtual environment. The HMD displays a field of view to the user. However, the user may experience simulator sickness or motion sickness from viewing the field of view. The HMD is connected to a sensor which can monitor the user. By monitoring the user's physiological state, the user's simulator sickness can be detected or predicted. To reduce the negative effects, the field of view can be throttled. The field of view can also be throttled in order to provide a better user experience even if the user does not experience sickness.

Abstract: Compact and low mass augmented and fully virtual head mounted display designs are disclosed. The disclosed displays employ a display located between the eye and the main optical element of the head mounted display. These designs additionally afford the ability to support augmented reality displays because the user can see both the virtual image from the display and the real world if desired. The designs use semi-transparent displays where either the display emits circularly polarized light or the displays which emits light from one surface or the view of the display directly from the eye is obscured.

Abstract: Compact and low mass augmented and fully virtual head mounted display designs are disclosed. The disclosed displays employ a display located between the eye and the main optical element of the head mounted display. These designs additionally afford the ability to support augmented reality displays because the user can see both the virtual image from the display and the real world if desired. The designs use semi-transparent displays where either the display emits circularly polarized light or the displays which emits light from one surface or the view of the display directly from the eye is obscured.

Abstract: A surgical instrument that includes a housing linkable with a manipulator arm of a robotic surgical system, a shaft coupled to the housing, a force transducer on a distal end of the shaft, and a plurality of fiber optic strain gauges on the force transducer is disclosed. The plurality of strain gauges are coupled to a fiber optic splitter or an arrayed waveguide grating (AWG) multiplexer, which can be coupled to a fiber optic connector. A wrist joint coupled to an end effector is coupled to a distal end of the force transducer. A robotic surgical manipulator that includes a base link coupled to a distal end of a manipulator positioning system, and a distal link with an instrument interface, and a fiber optic connector optically linkable to a surgical instrument. A method of passing data between an instrument and a manipulator via optical connectors is also provided.

Abstract: A minimally invasive surgical system includes a scene anti-bloom process that allows switching between imaging modes on a stereoscopic display without causing a surgeon to look-away or being momentarily distracted by sudden changes in overall scene luminance. The process receives a switch from a first imaging mode to a second imaging mode. An overall scene luminance of a scene in the first imaging mode is less than an overall scene luminance of a scene in the second imaging mode. The process delays the switch to the second imaging mode until after an illumination output level of a visible illumination source has changed to a higher output level, and then switches to the second imaging mode.

Abstract: An interactive, autostereoscopic system for displaying an object in 3D includes a mirror configured to spin around a vertical axis when actuated by a motor, a high speed video projector, and a processing system including a graphics card interfaced to the video projector. An anisotropic reflector is bonded onto an inclined surface of the mirror. The video projector projects video signals of the object from the projector onto the inclined surface of the mirror while the mirror is spinning, so that light rays representing the video signals are redirected toward a field of view of a 360 degree range. The processing system renders the redirected light rays so as to interactively generate a horizontal-parallax 3D display of the object. Vertical parallax can be included in the display by adjusting vertically the displayed views of the object, in response to tracking of viewer motion by a tracking system.

Abstract: A head-mounted display (HMD) allows a user to view a virtual environment. The HMD displays a field of view to the user. However, the user may experience simulator sickness or motion sickness from viewing the field of view. The HMD is connected to a sensor which can monitor the user. By monitoring the user's physiological state, the user's simulator sickness can be detected or predicted. To reduce the negative effects, the field of view can be throttled. The field of view can also be throttled in order to provide a better user experience even if the user does not experience sickness.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: The effective focal length of an optical system can be electronically controlled using switchable wave plates in conjunction with polarized light.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: In one embodiment of the invention, an apparatus includes a display device. The display device displays a desaturated image of tissue captured in the visible electro-magnetic (EM) spectrum from a body cavity; and a first color enhanced image combined with the desaturated image. The first color enhanced image represents the first data captured from the body cavity outside the visible electromagnetic spectrum. The relative brightness between the desaturated image and the first color enhanced image is set to emphasize the first data over the tissue captured in the visible electromagnetic spectrum to provide improved information content.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

Abstract: A surgical instrument that includes a housing linkable with a manipulator arm of a robotic surgical system, a shaft coupled to the housing, a force transducer on a distal end of the shaft, and a plurality of fiber optic strain gauges on the force transducer is disclosed. The plurality of strain gauges are coupled to a fiber optic splitter or an arrayed waveguide grating (AWG) multiplexer, which can be coupled to a fiber optic connector. A wrist joint coupled to an end effector is coupled to a distal end of the force transducer. A robotic surgical manipulator that includes a base link coupled to a distal end of a manipulator positioning system, and a distal link with an instrument interface, and a fiber optic connector optically linkable to a surgical instrument. A method of passing data between an instrument and a manipulator via optical connectors is also provided.

Abstract: In one embodiment, a surgical instrument includes a housing linkable with a manipulator arm of a robotic surgical system, a shaft operably coupled to the housing, a force transducer on a distal end of the shaft, and a plurality of fiber optic strain gauges on the force transducer. In one example, the plurality of strain gauges are operably coupled to a fiber optic splitter or an arrayed waveguide grating (AWG) multiplexer. A fiber optic connector is operably coupled to the fiber optic splitter or the AWG multiplexer. A wrist joint is operably coupled to a distal end of the force transducer, and an end effector is operably coupled to the wrist joint. In another embodiment, a robotic surgical manipulator includes a base link operably coupled to a distal end of a manipulator positioning system, and a distal link movably coupled to the base link, wherein the distal link includes an instrument interface and a fiber optic connector optically linkable to a surgical instrument.