Abstract: A system obtains a first portion of real-time medical video data and creates first training data using the first portion of real-time medical video data. The system trains a machine learning model for a pretext task based on the first training data, using a training program of a computer. The system obtains a second portion of the real-time medical video data and replaces, in a memory of the computer, at least a subset the first portion of the real-time medical video data with the second portion of the real-time medical video data. The memory is accessible only by the training program. The system creates second training data for the pretext task using the second portion of the real-time medical video data and trains the machine learning model for the pretext task based on the second training data, using the training program of the computer.

Abstract: An imaging system for viewing a surgical site, the imaging system including a system controller configured to: receive and process video images of the surgical site captured by an endoscopic camera coupled to an endoscope to detect at least one video signature corresponding to at least one condition that interferes with a quality of the video images; and in response to detecting the at least one video signature corresponding to the at least one condition that interferes with the quality of the video images, control a fluid system to clean a tip of the endoscope based on at least one learned preference that was learned by the system controller from user action over time.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: A method of improving personnel actions in an operating room includes capturing at least one image of the operating room by at least one camera, wherein the at least one image depicts at least one medical personnel; processing the at least one image by a computing system to identify at least one action performed by the at least one medical personnel; determining, using the computing system, a relationship between the at least one action and a metric associated with a surgical workflow in the operating room; and generating, using the computing system, instructions for improving personnel actions in the operating room based on the determined relationship.

Abstract: Described are methods and systems for improving cybersecurity of an operating room. A user is prevented from interacting with one or more medical devices connected to an operating room (OR) hub until the user is authenticated through an operations user interface (UI) of the OR hub. The user is authenticated through the operations UI. Authenticating the user through the operations UI includes determining a type of credential possessed by the user. Based on a determination that the user possesses a hospital network administrator credential, the user is permitted to access a plurality of security functions, including enabling and disabling one or more communication ports to which the one or more medical devices are connected. Based on a determination that the user possesses an operator credential, the user is prevented from enabling and disabling the one or more communication ports.

Abstract: Described are methods and systems for operating devices in an operating room (OR), according to some embodiments. An OR hub can provide an operations user interface (UI) that is provisioned by a hub software developer to enable authorized users to access permitted software functions run by the system software on the OR hub to operate one or more medical devices in the OR. The operations UI can be configured to prevent an interaction of the one or more medical devices and the OR hub with a user until that user is authenticated through the operations U. In some embodiments, the operations UI of the OR hub implements role-based security in which the operations UI provides an authenticated user with different sets of permitted software and/or security functions based on a type of credential possessed by the authenticated user.

Abstract: The present disclosure relates to dynamically providing machine learning models to a target device for a surgical procedure. An exemplary method can comprise: identifying a user profile associated with the surgical procedure; determining, based on the identified user profile, a plurality of candidate procedures; obtaining data from one or more devices in a surgical environment associated with the surgical procedure; selecting at least one procedure from the plurality of candidate procedures based on: the data obtained from the one or more devices, and one or more weights associated with the data obtained from the one or more devices; identifying a machine learning model based on the selected at least one procedure; and providing the identified machine learning model to the target device for execution.

Abstract: Provided herein are systems and methods for operating and maintaining a graphical user interface (GUI) layout database. The method can include receiving GUI layout information from a first external device, the GUI layout information comprising identification data that identifies one or more surgical devices associated with the GUI layout information; updating a GUI layout database with the received GUI layout information from the external device; receiving a request for GUI layout information from a second external device that includes surgical device identifying information; matching the received surgical device identifying information to one or more entries in the GUI layout database; and transmitting the matching entries in the GUI layout database to the second external device that is configured to render GUIs in response to determining that it is communicatively coupled to the surgical device, the GUIs rendered based on the transmitted matching entries in the GUI layout database.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: Presented herein are systems and methods for dynamically updating and rendering graphical user interfaces at a surgical hub device that is configured to simultaneously coordinate the operation of multiple medical devices connected to the hub. According to an aspect, when a device is connected to the hub, the device can send identifying information to the hub so that the hub can ascertain the identity of the device. Based on the identification data, the hub can access an internal graphical user interface (GUI) database to determine if there are any entries in the database that correspond to the device that is now connected to the hub. If it is determined that the internal GUI database of the hub contains one or more GUIs associated with the device, then the GUI database can transmit the corresponding to GUIs to the electronic display for rendering at the appropriate times.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: A method of providing a visual indication that information is being saved or broadcast includes providing at least one recording device for obtaining the information, providing a system for saving and/or broadcasting the information obtained from the at least one recording device, providing at least one monitor for viewing the information, providing a plurality of visual indications, and activating the plurality of visual indications when the information is being saved or broadcast.

Abstract: An imaging system for viewing a surgical site, the imaging system including a system controller configured to: receive and process video images of the surgical site captured by an endoscopic camera coupled to an endoscope to detect at least one video signature corresponding to at least one condition that interferes with a quality of the video images; and in response to detecting the at least one video signature corresponding to the at least one condition that interferes with the quality of the video images, control a fluid system to clean a tip of the endoscope based on at least one learned preference that was learned by the system controller from user action over time

Abstract: A system for displaying medical imaging data comprising one or more data inputs, one or more processors, and one or more displays, wherein the one or more data inputs are configured for receiving first image data generated by a first medical imaging device, wherein the first image data comprises a field of view (FOV) portion and a non-FOV portion, and the one or more processors are configured for identifying the non-FOV portion of the first image data and generating cropped first image data by removing at least a portion of the non-FOV portion of the first image data, and transmitting the cropped first image data for display in a first portion of the display and additional information for display in a second portion of the display.

Abstract: A surgical system for providing an improved video image of a surgical site including a system controller that receives and processes video images to determine a video signature corresponding to a condition that interferes with a quality of the video images, with the system controller interacting with a video enhancer to enhance the video images from a video capturing device to automatically control the video enhancer to enhance the video images. The surgical system can also review the video images for a trigger event and automatically begin or stop recording of the video images upon occurrence of the trigger event.

Abstract: A system for displaying medical imaging data comprising one or more data inputs, one or more processors, and one or more displays, wherein the one or more data inputs are configured for receiving first image data generated by a first medical imaging device, wherein the first image data comprises a field of view (FOV) portion and a non-FOV portion, and the one or more processors are configured for identifying the non-FOV portion of the first image data and generating cropped first image data by removing at least a portion of the non-FOV portion of the first image data, and transmitting the cropped first image data for display in a first portion of the display and additional information for display in a second portion of the display.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.

Abstract: Presented herein are systems and methods for dynamically updating and rendering graphical user interfaces at a surgical hub device that is configured to simultaneously coordinate the operation of multiple medical devices connected to the hub. According to an aspect, when a device is connected to the hub, the device can send identifying information to the hub so that the hub can ascertain the identity of the device. Based on the identification data, the hub can access an internal graphical user interface (GUI) database to determine if there are any entries in the database that correspond to the device that is now connected to the hub. If it is determined that the internal GUI database of the hub contains one or more GUIs associated with the device, then the GUI database can transmit the corresponding to GUIs to the electronic display for rendering at the appropriate times.

Abstract: A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.