Abstract: Systems and methods for automatic detection of surgical specialty type and procedure type are disclosed. One or more classification networks may be applied to automatically process input surgical image data in order to recognize and determine a surgical specialty type and a surgical procedure type depicted in the input image data. Based on the determination made by the system, one or more output indications may be generated and one or more surgical devices may be automatically controlled, such as by being optimized for use during the surgical procedure type and/or surgical specialty type represented by the input image.

Abstract: Systems and methods for detecting, characterizing, and addressing surgical smoke are disclosed. In some embodiments, a surgical system receives image data representing an image of a surgical environment and generates sets of values based on the received image. The sets of values may include representations of atmospheric light in the image and representations of contrast values in the image. The system may determine from the sets of values whether predetermined smoke severity criteria are met, and may responsively automatically engage and/or disengage one or more surgical devices, such as a surgical smoke evacuation system and/or an image processing system (e.g., a video enhancement feature) configured to improve quality of smoky surgical images.

Abstract: An imaging system for viewing a surgical site, the imaging system including a system controller configured to: receive and process video images of the surgical site captured by an endoscopic camera coupled to an endoscope to detect at least one video signature corresponding to at least one condition that interferes with a quality of the video images; and in response to detecting the at least one video signature corresponding to the at least one condition that interferes with the quality of the video images, control a fluid system to clean a tip of the endoscope based on at least one learned preference that was learned by the system controller from user action over time

Abstract: A system for displaying medical imaging data comprising one or more data inputs, one or more processors, and one or more displays, wherein the one or more data inputs are configured for receiving first image data generated by a first medical imaging device, wherein the first image data comprises a field of view (FOV) portion and a non-FOV portion, and the one or more processors are configured for identifying the non-FOV portion of the first image data and generating cropped first image data by removing at least a portion of the non-FOV portion of the first image data, and transmitting the cropped first image data for display in a first portion of the display and additional information for display in a second portion of the display.

Abstract: Systems and methods for detecting, characterizing, and addressing surgical smoke are disclosed. In some embodiments, a surgical system receives image data representing an image of a surgical environment and generates sets of values based on the received image. The sets of values may include representations of atmospheric light in the image and representations of contrast values in the image. The system may determine from the sets of values whether predetermined smoke severity criteria are met, and may responsively automatically engage and/or disengage one or more surgical devices, such as a surgical smoke evacuation system and/or an image processing system (e.g., a video enhancement feature) configured to improve quality of smoky surgical images.

Abstract: A surgical system for providing an improved video image of a surgical site including a system controller that receives and processes video images to determine a video signature corresponding to a condition that interferes with a quality of the video images, with the system controller interacting with a video enhancer to enhance the video images from a video capturing device to automatically control the video enhancer to enhance the video images. The surgical system can also review the video images for a trigger event and automatically begin or stop recording of the video images upon occurrence of the trigger event.

Abstract: A system for displaying medical imaging data comprising one or more data inputs, one or more processors, and one or more displays, wherein the one or more data inputs are configured for receiving first image data generated by a first medical imaging device, wherein the first image data comprises a field of view (FOV) portion and a non-FOV portion, and the one or more processors are configured for identifying the non-FOV portion of the first image data and generating cropped first image data by removing at least a portion of the non-FOV portion of the first image data, and transmitting the cropped first image data for display in a first portion of the display and additional information for display in a second portion of the display.

Abstract: Systems, methods, and computer readable storage medium techniques for masking endoscopic images are disclosed. A system receives an input digital image and applies one or more denoising algorithms and one or more contour detection algorithms to detect a plurality of contours in the image. A contour having the largest area is identified. A smallest circular area enclosing the largest area contour is estimated, and a mask is applied to the image based on the circular area to generate a masked image.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: According to an aspect, video data taken from an endoscopic imaging device can be used to automatically control a surgical pump for purposes of regulating fluid pressure in an internal area of a patient during an endoscopic procedure. Control of the pump can be based in part on one or more features extracted from video data received from an endoscopic imaging device. The features can be extracted from the video data using a combination of machine learning classifiers and other processes configured to determine the presence of various conditions within the images of the internal area of the patient. Using the one or more extracted features, the system can adjust the inflow and outflow settings of the surgical pump to regulate the fluid pressure of the internal area of the patient commensurate with the needs of the surgery and the patient at any given moment in time during the surgical procedure.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: Systems and methods for automatic detection of surgical specialty type and procedure type are disclosed. One or more classification networks may be applied to automatically process input surgical image data in order to recognize and determine a surgical specialty type and a surgical procedure type depicted in the input image data. Based on the determination made by the system, one or more output indications may be generated and one or more surgical devices may be automatically controlled, such as by being optimized for use during the surgical procedure type and/or surgical specialty type represented by the input image.

Abstract: An endoscopic system including an endoscope, a light source for the endoscope and at least one image sensor for capturing a plurality of images of a body cavity. The light source is configured to emit light from the endoscope and into the body cavity such that the light is reflected off of a plurality of locations in the body cavity. The system also includes a control system for controlling both the light source and the at least one image sensor to vary parameters of the light source and the at least one image sensor such that the plurality of images have underexposed and overexposed regions. The endoscopic system could alternatively include a variable-attenuator element device adjacent the image sensor and configured to be located between the body cavity and the image sensor for capturing a single clear image with the image sensor.

Abstract: Described are methods and systems for operating devices in an operating room (OR), according to some embodiments. An OR hub can provide an operations user interface (UI) that is provisioned by a hub software developer to enable authorized users to access permitted software functions run by the system software on the OR hub to operate one or more medical devices in the OR. The operations UI can be configured to prevent an interaction of the one or more medical devices and the OR hub with a user until that user is authenticated through the operations U. In some embodiments, the operations UI of the OR hub implements role-based security in which the operations UI provides an authenticated user with different sets of permitted software and/or security functions based on a type of credential possessed by the authenticated user.

Abstract: Systems and methods for detecting, characterizing, and addressing surgical smoke are disclosed. In some embodiments, a surgical system receives image data representing an image of a surgical environment and generates sets of values based on the received image. The sets of values may include representations of atmospheric light in the image and representations of contrast values in the image. The system may determine from the sets of values whether predetermined smoke severity criteria are met, and may responsively automatically engage and/or disengage one or more surgical devices, such as a surgical smoke evacuation system and/or an image processing system (e.g., a video enhancement feature) configured to improve quality of smoky surgical images.

Abstract: An endoscopic system including an endoscope, a light source for the endoscope and at least one image sensor for capturing a plurality of images of a body cavity. The light source is configured to emit light from the endoscope and into the body cavity such that the light is reflected off of a plurality of locations in the body cavity. The system also includes a control system for controlling both the light source and the at least one image sensor to vary parameters of the light source and the at least one image sensor such that the plurality of images have underexposed and overexposed regions. The endoscopic system could alternatively include a variable-attenuator element device adjacent the image sensor and configured to be located between the body cavity and the image sensor for capturing a single clear image with the image sensor.

Abstract: A method of providing a visual indication that information is being saved or broadcast includes providing at least one recording device for obtaining the information, providing a system for saving and/or broadcasting the information obtained from the at least one recording device, providing at least one monitor for viewing the information, providing a plurality of visual indications, and activating the plurality of visual indications when the information is being saved or broadcast.

Abstract: A system for displaying medical imaging data comprising one or more data inputs, one or more processors, and one or more displays, wherein the one or more data inputs are configured for receiving first image data generated by a first medical imaging device, wherein the first image data comprises a field of view (FOV) portion and a non-FOV portion, and the one or more processors are configured for identifying the non-FOV portion of the first image data and generating cropped first image data by removing at least a portion of the non-FOV portion of the first image data, and transmitting the cropped first image data for display in a first portion of the display and additional information for display in a second portion of the display.

Abstract: A surgical system for providing an improved video image of a surgical site including a system controller that receives and processes video images to determine a video signature corresponding to a condition that interferes with a quality of the video images, with the system controller interacting with a video enhancer to enhance the video images from a video capturing device to automatically control the video enhancer to enhance the video images. The surgical system can also review the video images for a trigger event and automatically begin or stop recording of the video images upon occurrence of the trigger event.