Abstract: A surgical tool for a surgical robotic system, the surgical tool comprising: a surgical tool grasper having a jaw operable to perform a surgical procedure; a handle coupled to the surgical tool grasper and having a lever operable to actuate the jaw; and an actuation combiner mechanism coupled to the lever and operable to combine an actuation force output of the lever with an actuation force output of a motor to control the operation of the jaw or the lever.

Abstract: A robotic surgical system and method for providing a stadium view with arm set-up guidance is provided. In one embodiment, a robotic surgical system comprises a plurality of robotic arms, a display device, and a processor. The processor is configured to render, on the display device, a graphical representation of the plurality of robotic arms in their current positions, as well as user-guidance information on how to move the plurality of robotic arms to a different position. Other embodiments are provided.

Abstract: Disclosed are systems and methods for an endoscope or other surgical instruments to automatically sense when it's placed inside or outside of a trocar or a cannula. Operational setting of the endoscope may be adjusted as a function of the detected environmental condition to improve the function of the endoscope and the safety of a surgical procedure. The endoscope may include a sensor to sense a tag embedded in a trocar or cannula. The endoscope may transmit sensing information to a controller of a surgical robotic system to indicate that the endoscope has been inserted into the trocar or cannula. The controller may generate configuration information corresponding to the sensed state. The controller may transmit the configuration information to the endoscope to configure the endoscope to operate in the state. In another aspect, the endoscope may wirelessly communicate with another surgical instrument to receive operational information from the surgical instrument.

Abstract: A surgical exercise performed with a surgical robotic system is sensed by depth cameras, generating 3D point cloud data. Robot system data associated with the surgical robotic system is logged. Object recognition is performed on image data produced by the one or more depth cameras, to recognized objects, including surgical equipment and people, in the operating room (OR). The surgical exercise is digitized by storing the 3D point cloud data of unrecognized objects, a position and orientation associated with the recognized objects, and c) the robot system data.

Abstract: A method for engaging and disengaging a surgical instrument of a surgical robotic system comprising: receiving a plurality of interlock inputs from one or more interlock detection components of the surgical robotic system; determining, by one or more processors communicatively coupled to the interlock detection components, whether the plurality of interlock inputs indicate each of the following interlock requirements are satisfied: (1) a user is looking toward a display, (2) at least one or more user interface devices of the surgical robotic system are configured in a usable manner, and (3) a surgical workspace of the surgical robotic system is configured in a usable manner; in response to determining each of the interlock requirements are satisfied, transition the surgical robotic system into a teleoperation mode; and in response to determining less than all of the interlock requirements are satisfied, transition the surgical robotic system out of a teleoperation mode.

Abstract: Embodiments described herein provide various techniques and systems for building machine-learning surgical tool presence/absence detection models for processing surgical videos and predicting whether a surgical tool is present or absent in each video frame of a surgical video. In one aspect, a process for ensuring patient safety during a laparoscopic or robotic surgery involving an energy tool is disclosed. The process can begin receiving a real-time control signal indicating an operating state of an energy tool during the surgery. Next, the process receives real-time endoscope video images of the surgery. The process simultaneously applies a machine-learning surgical tool presence/absence detection model to the real-time endoscope video images to generate real-time decisions on a location of the energy tool in the real-time endoscope video images.

Abstract: Disclosed is an augmented reality (AR) headset that provides a wearer with spatial, system, and temporal contextual information of a surgical robotic system to guide the wearer in configuring, operating, or troubleshooting the surgical robotic system prior to, during, or after surgery. The spatial context information may be rendered to display spatially-fixed 3D-generated virtual models of the robotic arms, instruments, bed, and other components of the surgical robotic system that match the actual position or orientation of the surgical robotic system in the AR headset's coordinate frame. The AR headset may communicate with the surgical robotic system to receive real-time state information of the components of the surgical robotic system. The AR headset may use the real-time state information to display context-sensitive user interface information such as tips, suggestions, visual or audio cues on maneuvering the robotic arms and table to their target positions and orientations or for troubleshooting purpose.

Abstract: This patent disclosure provides various verification techniques to ensure that anonymized surgical procedure videos are indeed free of any personally-identifiable information (PII). In a particular aspect, a process for verifying that an anonymized surgical procedure video is free of PII is disclosed. This process can begin by receiving a surgical video corresponding to a surgery. The process next removes personally-identifiable information (PII) from the surgical video to generate an anonymized surgical video. Next, the process selects a set of verification video segments from the anonymized surgical procedure video. The process subsequently determines whether each segment in the set of verification video segments is free of PII. If so, the process replaces the surgical video with the anonymized surgical video for storage. If not, the process performs additional PII removal steps on the anonymized surgical video to generate an updated anonymized surgical procedure video.

Abstract: Disclosed are various real-time robotic-assisted dimension measurement systems and techniques based on the collected kinematic data from one or more surgical tools within a robotic surgical system. In some embodiments, the collected kinematic data can include positions and orientations of each joint of the one or more surgical tools which are derived from positions and orientations of a set of arm joints of one or more robotic arms which the one or more surgical tools are attached to. The disclosed dimension measurement systems allow a surgeon to perform real-time length measurements of both straight-lines and curved-lines, as well as area and volume measurements on specified portions of tissues or organs by strategically placing the tips of the one or more surgical tools over the tissues or organs, while viewing the distal ends of the surgical tools in a user display.

Abstract: The disclosed embodiments relate to systems and methods for a surgical tool or a surgical robotic system. A tool driver is coupled to a distal end of a robotic arm and includes a roll drive disk driven by a rotary motor. One or more processors are configured to detect an attachment of a surgical tool to the tool driver. The surgical tool includes a roll tool disk to be engaged with the roll drive disk of the tool driver, actuate of the roll drive disk through the rotary motor, determine that a measured torque of the rotary motor exceeds a preset torque threshold for a preset period of time since the actuation, and report a successful engagement between the roll drive disk and the roll tool disk.

Abstract: An apparatus for use during robotic surgery, where the apparatus includes a robotic arm; a tool driver connected to the robotic arm; a cannula including a proximal portion and a distal portion wherein the proximal portion is coupled to the tool driver; and a damping element connected to one of the robotic arm, the tool driver and the cannula. Also, a method including guiding a surgical tool coupled to a robotic arm into a patient, wherein the surgical tool is disposed through a cannula and coupled to a tool driver coupled to a distal portion of the robotic arm; and maneuvering the tool driver by way of the robotic arm, wherein vibrations generated by the maneuvering are inhibited by a damping element coupled to one of the robotic arm, the tool driver and the cannula.

Abstract: A method for disengaging a surgical instrument of a surgical robotic system comprising receiving a gaze input from an eye tracker; determining, by one or more processors, whether the gaze input indicates the gaze of the user is outside or inside of the display; in response to determining the gaze input indicates the gaze of the user is outside of the display, determining an amount of time the gaze of the user is outside of the display; in response to determining the gaze of the user is outside of the display for less than a maximum amount of time, pause the surgical robotic system from a teleoperation mode; and in response to determining the gaze of the user is outside of the display for more than the maximum amount of time, disengage the surgical robotic system from the teleoperation mode.

Abstract: A surgical robotic system comprising: a surgical robotic arm having a plurality of robotic arm links and a plurality of joints operable to move according to multiple degrees of freedom; a proximity sensor coupled to the surgical robotic arm, the proximity sensor comprising a plurality of sensing pads operable to detect a movement of a nearby controlling object prior to contact with the surgical robotic arm; and a processor configured to determine a desired position of the surgical robotic arm based on the detected movement of the nearby controlling object and drive a movement of more than one of the plurality of robotic arm links or the plurality of joints to achieve the desired position of the surgical robotic arm.

Abstract: A method performed by a surgical robotic system. The method determines a surgical procedure that is to be performed using a robotic arm. The method determines, for the robotic arm, a planned trajectory based on the surgical procedure, where the planned trajectory is from a current pose of the robotic arm to a predefined procedure pose that is within a threshold distance from a trocar that is coupled to a patient. The method drives the robotic arm along the planned trajectory from the current pose to the predefined procedure pose.

Abstract: A virtual representation of an operating room is generated based on robot information and sensing of the OR with depth cameras. One of the depth cameras is integrated with a portable electronic device, operated by a local user in the operating room. The virtual representation of the OR is communicated to the virtual reality headset, with three-dimensional point cloud data. A virtual reality environment is rendered to a display of the virtual reality headset, operated by a remote user. A virtual representation of the remote user is rendered in augmented reality to a display of the portable electronic device.

Abstract: A surgical robotic system has a robotic grasper, a user interface device (UID), and one or more processors communicatively coupled to the UID and the robotic grasper. The system detects a directive to engage or re-engage a teleoperation mode, determines that the system is in a non-teleoperation mode, receives a sequence of user actions through the UID, determines the UID matches a jaw angle or a grip force of the robotic grasper, and transitions into teleoperation mode. Other embodiments are also described and claimed.

Abstract: A medical image viewer can render to a display, a three-dimensional view of patient anatomy, a multi planar reconstruction (MPR) view of the patient anatomy, and an intra-operational view. Some of the views can be synchronized to show a common focal point of the anatomy. Other embodiments are described and claimed.

Abstract: A foot pedal assembly for controlling a robotic surgical system. The foot pedal assembly including a foot pedal base, a foot pedal and a sensor. The foot pedal moves relative to the foot pedal base and has a contact surface extending from a distal end to a proximal end of the foot pedal. The contact surface is to come into contact with a foot of a user during use of the foot pedal assembly for controlling the robotic surgical system and the distal end is farther away from a heel of the foot than the proximal end during use of the assembly for controlling the robotic surgical system. The sensor is coupled to the contact surface of the foot pedal at a position closer to the proximal end than the distal end, and the sensor is operable to sense a target object positioned a distance over the contact surface.

Abstract: A method for disengagement detection of a surgical instrument of a surgical robotic system, the method comprising: determining whether a user's head is unstable prior to disengagement of a teleoperation mode; determining whether a pressure release has occurred relative to at least one of a first user input device or a second user input device for controlling a surgical instrument of the surgical robotic system during the teleoperation mode; and in response to determining the user's head is unstable or determining the pressure release has occurred, determining whether a distance change between the first user input device and the second user input device indicates the user is performing an unintended action prior to disengagement of the teleoperation mode.

Abstract: A method for engaging and disengaging a surgical instrument of a surgical robotic system including receiving a sequence of user inputs from one or more user interface devices of the surgical robotic system; determining, by one or more processors communicatively coupled to the user interface devices and the surgical instrument, whether the sequence of user inputs indicates an intentional engagement or disengagement of a teleoperation mode in which the surgical instrument is controlled by user inputs received from the user interface devices; in response to determining of engagement, transition the surgical robotic system into the teleoperation mode; and in response to determining of disengagement, transition the surgical robotic system out of the teleoperation mode such that the user interface devices are prevented from controlling the surgical instrument.