Abstract: An interactive control unit is disclosed. The interactive control unit includes an interactive touchscreen display, an interface configured to couple the control unit to a surgical hub, a processor, and a memory coupled to the processor. The memory stores instructions executable by the processor to receive input commands from the interactive touchscreen display located inside a sterile field and transmit the input commands to the surgical hub to control devices coupled to the surgical hub located outside the sterile field.

Abstract: An interactive control unit is disclosed. The interactive control unit includes an interactive touchscreen display, an interface configured to couple the control unit to a surgical hub, a processor, and a memory coupled to the processor. The memory stores instructions executable by the processor to receive input commands from the interactive touchscreen display located inside a sterile field and transmit the input commands to the surgical hub to control devices coupled to the surgical hub located outside the sterile field.

Abstract: A surgical stapler is disclosed comprising an end effector configured to receive a staple cartridge, a trocar movable relative to the end effector, an anvil removably coupleable to the trocar, a sensor, a housing comprising a display, and a control circuit operably coupled to the sensor and the display. The anvil is movable relative to the end effector based on movement of the trocar. The sensor is configured to sense a position of the anvil relative to the end effector. The control circuit is configured to interrogate the sensor to determine the position of the anvil and display a representation of the determined position on the display.

Abstract: Systems for customizing and troubleshooting the display of surgical data and wireless pairing techniques for surgical instruments are disclosed.

Abstract: Various systems and methods for controlling the activation of energy surgical instruments are disclosed. An advance energy surgical instrument, such an electrosurgical instrument or an ultrasonic surgical instrument, can include one or more sensor assemblies for detecting the state or position of the end effector, arm, or other components of the surgical instrument. A control circuit can be configured to control the activation of the surgical instrument according to the state or position of the components of the surgical instrument.

Abstract: An end effector of an electrosurgical device may include a discharge port, an aspiration port, two electrodes, and a diverter formed from a porous material. The diverter includes a matrix having voids to receive fluid from the discharge port. A releasable diverter assembly may include an assembly body configured to receive a pair of electrodes and a diverter composed of a porous material. A shaft assembly of an electrosurgical device may include two electrodes and two fluid cannulae. Each cannula may be disposed proximate to a surface of each of the electrodes. An end effector of an electrosurgical device may include a fluid discharge port, two electrodes, and a diverter disposed therebetween. A proximal edge of the diverter may form a secant line with respect to the end of the discharge port so that fluid emitted by the discharge port is disposed on a surface of the diverter.

Abstract: An augmented reality display system and method for use during a surgical procedure are disclosed. An imaging device captures a real image of a surgical area during the surgical procedure generates a first data feed. A sensor device generates a second data feed. An augmented reality device including an augmented reality display generates an augmented overlay based on the first and second data feeds. The augmented overlay includes a visual portion and a non-visual visual portion. A processor receives the first and second data feeds and combines the first and second data feeds to generate the augmented overlay.

Abstract: An augmented reality display system used during a surgical procedure is disclosed. The augmented reality display system includes an imaging device to capture a real image of a surgical area during the surgical procedure. An augmented reality display presents an overlay of an operational aspect of a surgical instrument being actively visualized onto the real image of the surgical area. The overlay combines aspects of tissue interaction in the surgical area with functional data received from the surgical instrument. A processor receives the functional data from the surgical instrument, determines the overlay related to the operational aspect of the surgical instrument, and combines the aspect of the tissue in the surgical area with the functional data received from the surgical instrument.

Abstract: A system, method, and device for displaying relevant augmented reality (AR) content to a surgical staff members without over-saturating the augmented display with virtual elements. The surgical staff members (e.g., doctors, nurses, surgeons, technicians, etc.) require AR content that is delicately balanced between displaying helpful information without distracting the surgeon. A surgical hub receives a plurality of inputs related to surgical environment and displays only necessary information to allow the surgeon to provide effective care to the patient, based on a determined trigger event.

Abstract: A method of assessing inter-device communication pairing in a surgical setting, may include transmitting, by a first intelligent medical device, wireless communication data within the surgical setting, receiving, by a second intelligent medical device, the wireless communication data from the first intelligent medical device, determining, by the second intelligent medical device, communication pairing data indicative of an inter-device communication pairing of the second intelligent medical device with the first intelligent medical device, transmitting, by the second intelligent medical device, the communication pairing data to a modular control tower, and displaying, by the modular control tower on a display device, an augmented reality display comprising one or more virtual objects indicative of the inter-device communication pairing. An interactive surgical system may include multiple intelligent medical devices and displays which can form communication pairs in this manner.

Abstract: A surgical system is for use in a surgical procedure. The surgical system includes a surgical instrument configured to treat tissue in the surgical procedure; an imaging device; a display configured to show a livestream of a surgical field of the surgical procedure, wherein the livestream is captured by the imaging device; and a control module. The control module is configured to detect a surgical risk; assign a display priority to the surgical risk; and determine a display arrangement of the surgical risk based on the display priority, wherein the display arrangement comprises overlaying an alert feature on the livestream.

Abstract: A tracking system of operating room (OR) personnel and is configured to extrapolate the movement, position, orientation, and context of one or more of the active OR participants to determine the specific operation procedure in progress, the surgical instrument being used by the OR participant, and/or anticipated movement of the OR personnel. The system may further be configured to render a virtual element that includes an anticipated position of a surgical instrument, recommendations, guidance, warning, and surgical location information, as augmented reality (AR) content. The AR content is integrated in real-time with the live-feed of the surgical site, and aids the OR personnel in perioperative surgical procedures.

Abstract: A method for presenting surgical data onto a livestream of a surgical field on a display during a surgical procedure is disclosed. The method includes detecting, by a control module, surgical data, assigning, by the control module, display priority values to the surgical data, determining, by the control module, a display arrangement of the surgical data on the display based on the display priority values, and presenting onto the livestream visual representations of the surgical data in accordance with the display arrangement.

Abstract: A surgical system is disclosed including an imaging device, a display, and a control system operably coupled to the imaging device and the display. The display is configured to show a livestream of a surgical field of a surgical procedure. The livestream is captured by the imaging device. The control system is configured to overlay, on the livestream, a first amount of information associated with the surgical procedure, detect an event configured to cause the first amount of information being overlaid to increase to a second amount of information being overlaid, compare the second amount of information to a distraction threshold, adjust the second amount of information to a third amount of information based on the comparison, and overlay, on the livestream, the third amount of information based on the second amount of information being adjusted. The third amount of information is less than the distraction threshold.

Abstract: Apparatuses, systems, and methods for method for mixed reality visualization are disclosed herein. In one aspect, a method for mixed reality visualization includes capturing, by a first camera of a first visualization system, an image of an object in a surgical field, wherein a first portion of the object is outside of a field of view of the first camera; tracking, by a tracking system, a position of a second portion of the object; determining, by a surgical hub, an attribute of the object based on the tracked position of the second portion of the object, wherein the attribute of the object is related to the first portion of the object outside of a field of view of the camera; and displaying, by an augmented reality display device, the captured image of the object in the surgical field and a graphic based on the attribute of the object.

Abstract: A surgical visualization system is disclosed including an imaging device, a display configured to show a livestream of a surgical field of a surgical procedure, a control module configured to detect surgical data competing for presentation on the display, generate visual contents based on the surgical data, and selectively overlay the visual contents onto the livestream of the surgical field based on the surgical data. The livestream is captured by the imaging device.

Abstract: A surgical visualization system is disclosed including an imaging device, a display configured to show a livestream of a surgical field of a surgical procedure, and a control module configured to detect surgical data, assign display priority values to the surgical data, determine a display arrangement of the surgical data based on the display priority values, and present the surgical data on the display in accordance with the display arrangement. The livestream is captured by the imaging device.

Abstract: A method of distributing data among members of a surgical team may include receiving imaging data, by a modular control tower, from a plurality of imaging devices, receiving device-dependent data, by the modular control tower, from each of a plurality of intelligent surgical instruments, associating, by the modular control tower, a display device with a member of the surgical team, defining, by the modular control tower, a functional role for the member of the surgical team, and displaying, by the modular control tower, a augmented reality display by the display device. The augmented reality display on the display device may include virtual objects based on the imaging data, the device-dependent data, the functional role of the member of the surgical team, and a surgical activity by the member of the surgical team. An interactive surgical system may implement this method.

Abstract: Apparatuses, systems, and methods for displaying a cooperative overlays based on interacting instruments are disclosed herein. In one aspect, a method for displaying cooperative overlays includes communicatively coupling a first augmented reality display device to a surgical hub; generating, by the first augmented reality display device, a first intraoperative display of a surgical field; displaying, by the first intraoperative display, a first data overlay based on operation of a first surgical instrument; interacting the first surgical instrument with a second surgical instrument; and displaying, by the first intraoperative display, an indicator of the interaction based on the interaction between the first and second surgical instruments.

Abstract: A camera system integrated into a trocar. The camera system allows for wide field of view of an internal surgical site and 3D mapping of fiducial markers during a laparoscopic procedure. Upon entry into the patient, the camera system is configured to deploy from a recessed position at the distal end of the trocar. In various aspects, the internal camera system is configured to keep the trocar ports free for surgical instruments and provide the surgical staff members with an increased view of the surgical environment.