Abstract: An autostereoscopic three-dimensional display system for surgical robotics has an autostereoscopic three-dimensional display configured to receive and display video from a surgical robotics camera, and a first sensor assembly and a second sensor assembly. A processor is configured to detect and track an eye position or a head position of a user relative to the display based on processing output data of the first sensor assembly, and to detect and track a gaze of the user based on processing output data of the second sensor assembly. The processor further is configured to modify or control an operation of the display system based on the detected gaze of the user. A spatial relationship of the display also can be automatically adjusted in relation to the user based on the detected eye or head position of the user to optimize the user's visualization of three-dimensional images on the display.

Abstract: A surgical exercise performed with a surgical robotic system is sensed by depth cameras, generating 3D point cloud data. Robot system data associated with the surgical robotic system is logged. Object recognition is performed on image data produced by the one or more depth cameras, to recognized objects, including surgical equipment and people, in the operating room (OR). The surgical exercise is digitized by storing the 3D point cloud data of unrecognized objects, a position and orientation associated with the recognized objects, and c) the robot system data.

Abstract: Disclosed are systems and methods for achieving a smooth transition in the grip force when the wrist jaws transition between the position and force mode. In the position mode, the desired jaw angle is above a threshold corresponding to an angle at which both jaws are just simultaneously in contact with an object held between the jaws or, if there is no object, when the jaws begin to touch each other. A feedback loop may determine that the jaws are transitioning between the modes based on changes of the desired jaw angle. The feedback loop may analyze the commanded grip force and the measured grip force to determine whether to adjust the commanded grip force during the transition. If so, the feedback loop may adjust the commanded grip force to reduce changes in the measured grip force that is otherwise based on the desired jaw angle.

Abstract: Embodiments described herein provide various examples of a system for extracting an actual procedure duration composed of actual surgical tool-tissue interactions from an overall procedure duration of a surgical procedure on a patient. In one aspect, the system is configured to obtain the actual procedure duration by: obtaining an overall procedure duration of the surgical procedure; receiving a set of operating room (OR) data from a set of OR data sources collected during the surgical procedure, wherein the set of OR data includes an endoscope video captured during the surgical procedure; analyzing the set of OR data to detect a set of non-surgical events during the surgical procedure that do not involve surgical tool-tissue interactions; extracting a set of durations corresponding to the set of non-surgical events; and determining the actual procedure duration by subtracting the set of extracted durations from the overall procedure duration.

Abstract: The disclosed embodiments relate to systems and methods for a surgical tool or a surgical robotic system. An actuator or a motor of a tool driver is configured to operate a joint of a tool. One or more processors are configured to receive an initial joint command for the joint of the tool, determine a joint torque based on motor torque of the motor or actuator as well as motor to joint torque mapping, calculate a tip force based on an effective length associated with the joint and based on the joint torque, compare the tip force to a predetermined threshold, calculate an admittance control compensation term in response to the tip force exceeding the predetermined threshold, and generate a command for the motor or actuator based on the admittance control compensation term and the initial joint command.

Abstract: Communication apparatus and devices for surgical robotic systems are described. The communication apparatus can include a user console in communication with a communication device having a surgical tool. The communication device can include a microphone to convert a sound input into an acoustic input signal. The communication device can transmit the acoustic input signal to the user console for reproduction as a sound output for a remote operator. The surgical tool can include an endoscope having several microphones mounted on a housing. The surgical tool can be a sterile barrier having a microphone and a drape. The microphone(s) of the surgical tools can face a surrounding environment such that a tableside staff is a source of the sound input that causes the sound output, and a surgeon and the tableside staff can communicate in a noisy environment. Other embodiments are also described and claimed.

Abstract: A method for controlling a robotic arm in a robotic surgical system includes defining a reference plane at a predetermined reference location for a robotic arm, where the robotic arm includes a plurality of joints, and driving at least one of the plurality of joints to guide the robotic arm through a series of predetermined poses substantially constrained within the reference plane.

Abstract: A surgical robotic system that includes a robotic arm, glove configured to be worn on a hand of a user and including a force-feedback mechanism, a tracking device, a processor, and memory. The memory includes instructions which when executed by the processor causes the system to determine that the user is performing a hand gesture with the glove to grasp a virtual user input device (UID) based on the tracking device, and in response to the user grasping the virtual UID, apply, via the force-feedback mechanism, a force upon the glove that corresponds to a physical representation of the virtual UID, and engage the robotic arm to be controlled by the virtual UID.

Abstract: Generally, a sterile adapter for use in robotic surgery may include a frame configured to be interposed between a tool driver and a surgical tool, a plate assembly coupled to the frame, and at least one rotatable coupler supported by the plate assembly and configured to communicate torque from an output drive of the tool driver to an input drive of the surgical tool.

Abstract: A braking assembly for a strain wave gearing of a surgical robotic manipulator, the braking assembly including a first braking member fixedly coupled to an input portion of a strain wave gearing of a surgical robotic manipulator; and a second braking member fixedly coupled to an output portion of the strain wave gearing, and wherein during a braking operation the first braking member contacts the second braking member to mechanically brake the input portion to the output portion.

Abstract: The disclosed embodiments relate to systems and methods for a surgical tool or a surgical robotic system. A tool driver is coupled to a distal end of a robotic arm and includes a roll drive disk driven by a rotary motor. One or more processors are configured to detect an attachment of a surgical tool to the tool driver. The surgical tool includes a roll tool disk to be engaged with the roll drive disk of the tool driver, actuate of the roll drive disk through the rotary motor, determine that a measured torque of the rotary motor exceeds a preset torque threshold for a preset period of time since the actuation, and report a successful engagement between the roll drive disk and the roll tool disk.

Abstract: Disclosed herein are methods to detect a free-falling or other non-surgical motions of the user interface device (UID) of a surgical robotic system so that the surgical robotic system may pause the robotic arm controlled by the UID to prevent the robotic arm from mimicking the unintentional movement of the UID. Contact sensors embedded in the UID may be used to detect conditions indicating that a user does not possess full control of the UID. After determining that the user does not have full control of the UID, the UID may detect if the UID is experiencing non-surgical motions using motion sensors such as inertial sensors. By conditioning analysis of the data from the motion sensors by the initial determination that the UID is not being held based on the contact sensors, the method increases the robustness of the detection of non-surgical motions and reduces the probability of false positives.

Abstract: A computerized method for estimating joint friction in a joint of a robotic wrist of an end effector. Sensor measurements of force or torque in a transmission that mechanically couples a robotic wrist to an actuator, are produced. Joint friction in a joint of the robotic wrist that is driven by the actuator is computed by applying the sensor measurements of force or torque to a closed form mathematical expression that relates transmission force or torque variables to a joint friction variable. A tracking error of the end effector is also computed, using a closed form mathematical expression that relates the joint friction variable to the tracking error. Other aspects are also described and claimed.

Abstract: A handheld user interface device for controlling a robotic system may include a member, a housing at least partially disposed around the member and configured to be held in the hand of a user, and a tracking sensor system disposed on the member and configured to detect at least one of position and orientation of at least a portion of the device. At least one of the detected position of the portion of the device and detected orientation of the portion of the device is correlatable to a control of the robotic system.

Abstract: Mobile virtual reality system for simulation, training or demonstration of a surgical robotic system can include a virtual reality processor. The processor can generate a virtual surgical robot and render the virtual surgical robot on a display. The virtual surgical robot can include a virtual surgical tool. A handheld user input device (UID) can sense a hand input from a hand. A foot input device can sense a foot input from a foot. The virtual reality processor can be configured to control a movement or action of the virtual surgical robot based on the hand input, and change which of the virtual surgical instruments is controlled by the one or more handheld UIDs based on the foot input. Other embodiments and aspects are disclosed and claimed.

Abstract: This patent disclosure provides various verification techniques to ensure that anonymized surgical procedure videos are indeed free of any personally-identifiable information (PII). In a particular aspect, a process for verifying that an anonymized surgical procedure video is free of PII is disclosed. This process can begin by receiving a surgical video corresponding to a surgery. The process next removes personally-identifiable information (PII) from the surgical video to generate an anonymized surgical video. Next, the process selects a set of verification video segments from the anonymized surgical procedure video. The process subsequently determines whether each segment in the set of verification video segments is free of PII. If so, the process replaces the surgical video with the anonymized surgical video for storage. If not, the process performs additional PII removal steps on the anonymized surgical video to generate an updated anonymized surgical procedure video.

Abstract: Generally, a system for use in a robotic surgical system may be used to determine an attachment state between a tool driver, sterile adapter, and surgical tool of the system. The system may include sensors used to generate attachment data corresponding to the attachment state. The attachment state may be used to control operation of the tool driver and surgical tool. In some variations, one or more of the attachment states may be visually output to an operator using one or more of the tool driver, sterile adapter, and surgical tool. In some variations, the tool driver and surgical tool may include electronic communication devices configured to be in close proximity when the surgical tool is attached to the sterile adapter and tool driver.

Abstract: A robotic surgical system includes at least one robotic arm comprising at least one movable joint and an actuator configured to drive the at least one movable joint, and a controller configured to generate a first signal, the first signal comprising a first oscillating waveform having a first frequency and being modulated by a second oscillating waveform having a second frequency, wherein the second frequency is higher than the first frequency. The actuator is configured to drive the at least one movable joint based on the first signal to at least partially compensate for friction in the at least one movable joint.

Abstract: This disclosure provides techniques of synchronizing the playback of two recorded videos of the same surgical procedure. In one aspect, a process for generating a composite video from two recorded videos of a surgical procedure is disclosed. This process begins by receiving a first and second surgical videos of the same surgical procedure. The process then performs phase segmentation on each of the first and second surgical videos to segment the first and second surgical videos into a first set of video segments and a second set of video segments, respectively, corresponding to a sequence of predefined phases. Next, the process time-aligns each video segment of a given predefined phase in the first video with a corresponding video segment of the given predefined phase in the second video. The process next displays the time-aligned first and second surgical videos for comparative viewing.

Abstract: A method for determining surgical port placement for minimally invasive surgery. Based on received measurements, an instance of a parametric torso model that defines an external surface and a visceral surface each having a dome shape that takes into account an insufflation effect, is determined. Normalized surgical target locations in the parametric torso model are determined in response to an identification of a surgical procedure, and are mapped to un-normalized surgical target locations. Permissible port locations on the instance of the parametric torso model are computed, based on the characteristics of a surgical tool and based on the un-normalized surgical target locations. Other aspects are also described and claimed.