Abstract: An immersive display for use in a robotic surgical system includes a support arm, a housing mounted to the support arm and configured to engage with a face of the user, at least two eyepiece assemblies disposed in the housing and configured to provide a three-dimensional display, and at least one sensor, wherein the sensor enables operation of the robotic surgical system, and wherein the support arm is actuatable to move the housing for ergonomic positioning.

Abstract: A method performed by a surgical robotic system that includes a seat that is arranged for a user to sit and a display column that includes at least one display for displaying a three-dimensional (3D) surgical presentation. The method includes receiving an indication that the user has manually adjusted the seat and in response, determining, while the user is sitting on the seat, a position of the user's eyes, determining a configuration for the display column based on the determined position of the user's eyes, and adjusting the display column by actuating one or more actuators of the display column according to the determined configuration.

Abstract: A surgical robotic system is disclosed to include an operating table, a plurality of robotic arms and surgical instruments, a user console, and a control tower. The plurality of robotic arms are mounted on the operating table and can be stowed folded under the table for storage. The user console has one or more user interface devices, which function as master devices to control the plurality of surgical instruments.

Abstract: Robotic arms and surgical robotic systems incorporating such arms are described. A robotic arm includes a roll joint connected to a prismatic link by a pitch joint and a tool drive connected to the prismatic link by another pitch joint. The prismatic link includes several prismatic sublinks that are connected by a prismatic joint. A surgical tool supported by the tool drive can insert into a patient along an insertion axis through a remote center of motion of the robotic arm. Movement of the robotic arm can be controlled to telescopically move the prismatic sublinks relative to each other by the prismatic joint while maintaining the remote center of motion fixed. Other embodiments are also described and claimed.

Abstract: A surgical tool for a surgical robotic system, the surgical tool comprising: a surgical tool grasper having a jaw operable to perform a surgical procedure; a handle coupled to the surgical tool grasper and having a lever operable to actuate the jaw; and an actuation combiner mechanism coupled to the lever and operable to combine an actuation force output of the lever with an actuation force output of a motor to control the operation of the jaw or the lever.

Abstract: A robotic surgical system and method for providing a stadium view with arm set-up guidance is provided. In one embodiment, a robotic surgical system comprises a plurality of robotic arms, a display device, and a processor. The processor is configured to render, on the display device, a graphical representation of the plurality of robotic arms in their current positions, as well as user-guidance information on how to move the plurality of robotic arms to a different position. Other embodiments are provided.

Abstract: Disclosed are systems and methods for an endoscope or other surgical instruments to automatically sense when it's placed inside or outside of a trocar or a cannula. Operational setting of the endoscope may be adjusted as a function of the detected environmental condition to improve the function of the endoscope and the safety of a surgical procedure. The endoscope may include a sensor to sense a tag embedded in a trocar or cannula. The endoscope may transmit sensing information to a controller of a surgical robotic system to indicate that the endoscope has been inserted into the trocar or cannula. The controller may generate configuration information corresponding to the sensed state. The controller may transmit the configuration information to the endoscope to configure the endoscope to operate in the state. In another aspect, the endoscope may wirelessly communicate with another surgical instrument to receive operational information from the surgical instrument.

Abstract: A surgical exercise performed with a surgical robotic system is sensed by depth cameras, generating 3D point cloud data. Robot system data associated with the surgical robotic system is logged. Object recognition is performed on image data produced by the one or more depth cameras, to recognized objects, including surgical equipment and people, in the operating room (OR). The surgical exercise is digitized by storing the 3D point cloud data of unrecognized objects, a position and orientation associated with the recognized objects, and c) the robot system data.

Abstract: A method for engaging and disengaging a surgical instrument of a surgical robotic system comprising: receiving a plurality of interlock inputs from one or more interlock detection components of the surgical robotic system; determining, by one or more processors communicatively coupled to the interlock detection components, whether the plurality of interlock inputs indicate each of the following interlock requirements are satisfied: (1) a user is looking toward a display, (2) at least one or more user interface devices of the surgical robotic system are configured in a usable manner, and (3) a surgical workspace of the surgical robotic system is configured in a usable manner; in response to determining each of the interlock requirements are satisfied, transition the surgical robotic system into a teleoperation mode; and in response to determining less than all of the interlock requirements are satisfied, transition the surgical robotic system out of a teleoperation mode.

Abstract: Embodiments described herein provide various techniques and systems for building machine-learning surgical tool presence/absence detection models for processing surgical videos and predicting whether a surgical tool is present or absent in each video frame of a surgical video. In one aspect, a process for ensuring patient safety during a laparoscopic or robotic surgery involving an energy tool is disclosed. The process can begin receiving a real-time control signal indicating an operating state of an energy tool during the surgery. Next, the process receives real-time endoscope video images of the surgery. The process simultaneously applies a machine-learning surgical tool presence/absence detection model to the real-time endoscope video images to generate real-time decisions on a location of the energy tool in the real-time endoscope video images.

Abstract: Disclosed is an augmented reality (AR) headset that provides a wearer with spatial, system, and temporal contextual information of a surgical robotic system to guide the wearer in configuring, operating, or troubleshooting the surgical robotic system prior to, during, or after surgery. The spatial context information may be rendered to display spatially-fixed 3D-generated virtual models of the robotic arms, instruments, bed, and other components of the surgical robotic system that match the actual position or orientation of the surgical robotic system in the AR headset's coordinate frame. The AR headset may communicate with the surgical robotic system to receive real-time state information of the components of the surgical robotic system. The AR headset may use the real-time state information to display context-sensitive user interface information such as tips, suggestions, visual or audio cues on maneuvering the robotic arms and table to their target positions and orientations or for troubleshooting purpose.

Abstract: Disclosed are various real-time robotic-assisted dimension measurement systems and techniques based on the collected kinematic data from one or more surgical tools within a robotic surgical system. In some embodiments, the collected kinematic data can include positions and orientations of each joint of the one or more surgical tools which are derived from positions and orientations of a set of arm joints of one or more robotic arms which the one or more surgical tools are attached to. The disclosed dimension measurement systems allow a surgeon to perform real-time length measurements of both straight-lines and curved-lines, as well as area and volume measurements on specified portions of tissues or organs by strategically placing the tips of the one or more surgical tools over the tissues or organs, while viewing the distal ends of the surgical tools in a user display.

Abstract: This patent disclosure provides various verification techniques to ensure that anonymized surgical procedure videos are indeed free of any personally-identifiable information (PII). In a particular aspect, a process for verifying that an anonymized surgical procedure video is free of PII is disclosed. This process can begin by receiving a surgical video corresponding to a surgery. The process next removes personally-identifiable information (PII) from the surgical video to generate an anonymized surgical video. Next, the process selects a set of verification video segments from the anonymized surgical procedure video. The process subsequently determines whether each segment in the set of verification video segments is free of PII. If so, the process replaces the surgical video with the anonymized surgical video for storage. If not, the process performs additional PII removal steps on the anonymized surgical video to generate an updated anonymized surgical procedure video.

Abstract: The disclosed embodiments relate to systems and methods for a surgical tool or a surgical robotic system. A tool driver is coupled to a distal end of a robotic arm and includes a roll drive disk driven by a rotary motor. One or more processors are configured to detect an attachment of a surgical tool to the tool driver. The surgical tool includes a roll tool disk to be engaged with the roll drive disk of the tool driver, actuate of the roll drive disk through the rotary motor, determine that a measured torque of the rotary motor exceeds a preset torque threshold for a preset period of time since the actuation, and report a successful engagement between the roll drive disk and the roll tool disk.

Abstract: An apparatus for use during robotic surgery, where the apparatus includes a robotic arm; a tool driver connected to the robotic arm; a cannula including a proximal portion and a distal portion wherein the proximal portion is coupled to the tool driver; and a damping element connected to one of the robotic arm, the tool driver and the cannula. Also, a method including guiding a surgical tool coupled to a robotic arm into a patient, wherein the surgical tool is disposed through a cannula and coupled to a tool driver coupled to a distal portion of the robotic arm; and maneuvering the tool driver by way of the robotic arm, wherein vibrations generated by the maneuvering are inhibited by a damping element coupled to one of the robotic arm, the tool driver and the cannula.

Abstract: A method for disengaging a surgical instrument of a surgical robotic system comprising receiving a gaze input from an eye tracker; determining, by one or more processors, whether the gaze input indicates the gaze of the user is outside or inside of the display; in response to determining the gaze input indicates the gaze of the user is outside of the display, determining an amount of time the gaze of the user is outside of the display; in response to determining the gaze of the user is outside of the display for less than a maximum amount of time, pause the surgical robotic system from a teleoperation mode; and in response to determining the gaze of the user is outside of the display for more than the maximum amount of time, disengage the surgical robotic system from the teleoperation mode.

Abstract: A surgical robotic system comprising: a surgical robotic arm having a plurality of robotic arm links and a plurality of joints operable to move according to multiple degrees of freedom; a proximity sensor coupled to the surgical robotic arm, the proximity sensor comprising a plurality of sensing pads operable to detect a movement of a nearby controlling object prior to contact with the surgical robotic arm; and a processor configured to determine a desired position of the surgical robotic arm based on the detected movement of the nearby controlling object and drive a movement of more than one of the plurality of robotic arm links or the plurality of joints to achieve the desired position of the surgical robotic arm.

Abstract: A method performed by a surgical robotic system. The method determines a surgical procedure that is to be performed using a robotic arm. The method determines, for the robotic arm, a planned trajectory based on the surgical procedure, where the planned trajectory is from a current pose of the robotic arm to a predefined procedure pose that is within a threshold distance from a trocar that is coupled to a patient. The method drives the robotic arm along the planned trajectory from the current pose to the predefined procedure pose.

Abstract: A virtual representation of an operating room is generated based on robot information and sensing of the OR with depth cameras. One of the depth cameras is integrated with a portable electronic device, operated by a local user in the operating room. The virtual representation of the OR is communicated to the virtual reality headset, with three-dimensional point cloud data. A virtual reality environment is rendered to a display of the virtual reality headset, operated by a remote user. A virtual representation of the remote user is rendered in augmented reality to a display of the portable electronic device.

Abstract: A surgical robotic system has a robotic grasper, a user interface device (UID), and one or more processors communicatively coupled to the UID and the robotic grasper. The system detects a directive to engage or re-engage a teleoperation mode, determines that the system is in a non-teleoperation mode, receives a sequence of user actions through the UID, determines the UID matches a jaw angle or a grip force of the robotic grasper, and transitions into teleoperation mode. Other embodiments are also described and claimed.