Abstract: A system includes a controller communicatively coupled to an illuminator and to a camera configured to capture a scene including tissue. The controller may change the output optical power of the illuminator from a first output optical power to a second output optical power so that a subsequently captured frame is captured by the camera from reflected light, the reflected light being light from the illuminator having the second output optical power prior to being reflected. The controller may determine that an endoscope contacted the tissue if the change of the output optical power of the illuminator results in a change of a reflected luminance that is less than a predetermined threshold, the change of the reflected luminance being a change from a first reflected luminance for the first output optical power to a second reflected luminance for the second output optical power.

Abstract: A system directs an imaging device to continuously capture visible light and fluorescence illumination from a surgical area. The system generates a visible light image stream based on the captured visible light and a fluorescence image stream based on the captured fluorescence illumination. The system operates in a first display mode by directing a display device to display a first video stream based on a first set of at least one of the visible light image stream and the fluorescence image stream. In response to detecting an event that occurs within the surgical area, the system switches from operating in the first display mode to operating in a second display mode by directing the display device to display a second video stream based on a second set of at least one of the visible light image stream and the fluorescence image stream, the first Instructions set being different than the second set.

Abstract: The technology described herein can be embodied in a method that includes receiving data representing information captured using a first sensor and a second sensor of a multi-sensor camera. The sensors are configured to capture a surgical scene illuminated by a light source configured to emit wavelengths in the visible spectrum corresponding to sensing capabilities of the first and second sensors, respectively. The method also includes receiving data representing information captured using a third sensor of the multi-sensor camera, the third sensor configured to capture the surgical scene as illuminated by a near-infrared light source, and generating a first visual representation of the surgical scene based on the data representing the information captured using the first and second sensors. The first visual representation is combined with the information captured using the third sensor to generate a second visual representation, and the second visual representation is presented on a display device.

Abstract: Technology described herein can be embodied in a method of displaying a visual representation of a portion of a surgical scene. The method includes receiving data representing information captured using a first sensor of a camera associated with a surgical device, the information being indicative of a first quantity representing an amount of fluorescence emitted from the portion of the surgical scene. The method also includes obtaining information indicative of a second quantity representing an amount of excitation signal causing the fluorescence to be emitted from the portion of the surgical scene, and generating a normalized fluorescence signal as a function of the first quantity and the second quantity. The method further includes generating the visual representation of the portion of the surgical scene based on the normalized fluorescence signal, and presenting the visual representation on a display device associated with the surgical device.

Abstract: Technology described herein can be embodied in a method that includes obtaining, using an endoscopic camera, a plurality of images of the surgical scene, each image in the plurality of images being obtained under illumination by electromagnetic radiation in a corresponding wavelength range. The corresponding wavelength ranges are selected in accordance with a set of chromophores present in the surgical scene, and any two of the corresponding wavelength ranges partially non-overlapping. The method also includes determining, based on the plurality of images, a concentration of each of one or more chromophores in the set at various portions of the surgical scene, and generating, by one or more processing devices, based on information about the concentration of each of the one or more chromophores, a representation of the surgical scene. The method further includes presenting the representation of the surgical scene on an output device associated with the surgical device.

Abstract: An illustrative apparatus may identify, within an image frame captured by an image capture system, a signal region that includes pixels having auto-exposure values exceeding an auto-exposure value threshold. The apparatus may adjust, based on the auto-exposure values of the pixels included within the signal region, one or more auto-exposure parameters used by the image capture system to capture an additional image frame. Additionally, the apparatus may determine, based on a size of the signal region within the image frame, whether to change the auto-exposure value threshold. Corresponding apparatuses, systems, and methods for managing auto-exposure of image frames are also disclosed.

Abstract: A two-by-two pixel array within an image sensor includes a first pixel, a second pixel, a third pixel, and a fourth pixel. A red filter covers the first pixel, a first blue filter covers the second pixel, a second blue filter covers the third pixel, and a green filter covers the fourth pixel. The red filter is configured to allow the first pixel to collect a red component of visible light and prevent the first pixel from collecting blue and green components of the visible light. The first and second blue filters are configured to allow the second and third pixels to each collect the blue component and prevent the second and third pixels from collecting the red and green components. The green filter is configured to allow the fourth pixel to collect the green component and prevent the fourth pixel from collecting the red and blue components.

Abstract: An illustrative apparatus may identify, within an image frame captured by an image capture system, a signal region of the image frame and a background region of the image frame. The apparatus may determine one or more of a signal auto-exposure value of the signal region or a background auto-exposure value of the background region. Based on one or more of the signal auto-exposure value or the background auto-exposure value, the apparatus may determine a frame auto-exposure value. Additionally, based on the frame auto-exposure value, the apparatus may adjust one or more auto-exposure parameters used by the image capture system to capture an additional image frame. Corresponding apparatuses, systems, and methods for managing auto-exposure of image frames are also disclosed.

Abstract: An illustrative apparatus may perform gaze-based auto-exposure management of image frames. For example, the apparatus may determine, for an image frame within an image frame sequence captured by an image capture system, auto-exposure values for pixel units into which the image frame is divided. The apparatus may then assign weight values to the pixel units based on a gaze direction of a viewer viewing the image frame sequence. Based on the auto-exposure values determined for the pixel units and the weight values assigned to the pixel units, the apparatus may update one or more auto-exposure parameters for use by the image capture system to capture an additional image frame within the image frame sequence. Corresponding apparatuses, systems, and methods for gaze-based auto-exposure management of image frames are also disclosed.

Abstract: An exemplary medical imaging system includes a visible light illumination system configured to selectively emit one of a first visible light biased to a first wavelength and a second visible light biased to a second wavelength, a fluorescence excitation illumination system configured to selectively emit one of a first fluorescence excitation illumination having a third wavelength and a second fluorescence excitation illumination having a fourth wavelength, and an illumination source control unit configured to selectively direct the visible light illumination system to emit the second visible light and the fluorescence excitation illumination system to emit the first fluorescence excitation illumination for use with a first fluorescence imaging agent, and selectively direct the visible light illumination system to emit the first visible light and the fluorescence excitation illumination system to emit the second fluorescence excitation illumination for use with a second fluorescence imaging agent.

Abstract: A stereoscopic image capture device includes a first image sensor, a second image sensor, a first frame timer, and a second frame timer. The first and second frame timers are different frame timers. The first image sensor includes a first plurality of rows of pixels. The second image sensor includes a second plurality of rows of pixels. The first and second image sensors can be separate devices or different areas of a sensor region in an integrated circuit. The first frame timer is coupled to the first image sensor to provide image capture timing signals to the first image sensor. The second frame timer coupled to the second image sensor to provide image capture timing signals to the second image sensor.

Abstract: An image sensing apparatus including a pixel array comprising two or more photo-sensor elements, a first optical filter disposed on a first photo-sensor element of the pixel array and a second optical filter disposed on a second photo-sensor element of the pixel array. The first optical filter is configured such that a spectral response of the first optical filter includes a first passband in a first wavelength range and a second passband in a second wavelength range, where the first passband and the second passband are separated by a first stop band. The second optical filter is configured such that a spectral response of the second optical filter includes a third passband in the first wavelength range and a fourth passband in the second wavelength range, where the third passband and the fourth passband are separated by a second stop band.

Abstract: A system includes an image sensor, an imaging pipeline, and a display device. The image sensor is configured to capture a first frame of pixel data. The imaging pipeline is coupled to the image sensor to receive the first frame of pixel data. The imaging pipeline includes an adaptive noise filter. The adaptive noise filter is configured to filter a pixel based on noise in the pixel. The imaging pipeline is configured to output a second frame of pixel data. The second frame of pixel data includes pixels filtered by the adaptive noise filter. The display device is coupled to the imaging pipeline to receive the second frame of pixel data. The display device is configured to display the second frame of pixel data.

Abstract: A system includes an image sensor, an imaging pipeline, and a display device. The image sensor is configured to capture a first frame of pixel data. The imaging pipeline is coupled to the image sensor to receive the first frame of pixel data. The imaging pipeline includes an adaptive noise filter. The adaptive noise filter is configured to filter a pixel based on noise in the pixel. The imaging pipeline is configured to output a second frame of pixel data. The second frame of pixel data includes pixels filtered by the adaptive noise filter. The display device is coupled to the imaging pipeline to receive the second frame of pixel data. The display device being configured to display the second frame of pixel data.

Abstract: An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.

Abstract: An exemplary system includes a scene processing module configured to receive a single frame comprising a first set of pixel data comprising a first combined scene including a fluorescence scene component and a second set of pixel data comprising a second combined scene including a combination of a visible color component scene and the fluorescence scene component. The scene processing module is further configured to extract a display fluorescence scene component from the first combined scene and extract a display visible scene component from the second combined scene. The system further includes a display unit configured to generate, based on the display fluorescence scene component and the display visible scene component, a displayed scene.

Abstract: The technology described herein can be embodied in a method that includes obtaining a representation of a first image of a surgical scene using electromagnetic radiation of a first wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the first wavelength range received from a first tissue type is lower than that received for a second tissue type. The method also includes obtaining a representation of a second image using electromagnetic radiation of a second wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the second wavelength range received from the second tissue type is substantially different from that received for the first tissue type. The visual representation of the surgical scene is rendered on the one or more displays using the representation of the first image and the representation of the second image.

Abstract: An illustrative apparatus maps a first color of a first image of a scene to a second color of a second image of the scene. The first color of the first image is defined by a combination of real primary colors of a first display technology. The second color of the second image is determined by mapping at least one of the real primary colors of the first display technology to at least one virtual primary color for a second display technology and using the at least one virtual primary color to define the second color of the second image. The at least one virtual primary color is different from real primary colors of the second display technology.

Abstract: A system includes an image sensor, an imaging pipeline, and a display device. The image sensor is configured to capture a first frame of pixel data. The imaging pipeline is coupled to the image sensor to receive the first frame of pixel data. The imaging pipeline includes an adaptive noise filter. The adaptive noise filter is configured to filter a pixel based on noise in the pixel. The imaging pipeline is configured to output a second frame of pixel data. The second frame of pixel data includes pixels filtered by the adaptive noise filter. The display device is coupled to the imaging pipeline to receive the second frame of pixel data. The display device being configured to display the second frame of pixel data.

Abstract: An exemplary surgical system is configured to 1) access a plurality of surgical site scenes captured entirely outside a structure within a patient, each surgical site scene in the plurality of surgical site scenes being captured from reflected light of a different waveband of a plurality of wavebands, each waveband of the plurality of wavebands being reflected by structure tissue of the structure and non-structure tissue outside the structure; 2) detect a difference between spectral reflectances of each of the surgical site scenes in the captured surgical site scenes, and 3) identify, based on the detected difference between the spectral reflectances of each of the surgical site scenes in the captured surgical site scenes, pixels in the captured surgical site scenes that correspond to the structure tissue and pixels in the captured surgical site scenes that correspond to the non-structure tissue outside the structure.