Abstract: A surgical robotic system comprising: a surgical robotic arm having a plurality of robotic arm links and a plurality of joints operable to move according to multiple degrees of freedom; a proximity sensor coupled to the surgical robotic arm, the proximity sensor comprising a plurality of sensing pads operable to detect a movement of a nearby controlling object prior to contact with the surgical robotic arm; and a processor configured to determine a desired position of the surgical robotic arm based on the detected movement of the nearby controlling object and drive a movement of more than one of the plurality of robotic arm links or the plurality of joints to achieve the desired position of the surgical robotic arm.

Abstract: An immersive display for use in a robotic surgical system includes a support arm, a housing mounted to the support arm and configured to engage with a face of the user, at least two eyepiece assemblies disposed in the housing and configured to provide a three-dimensional display, and at least one sensor, wherein the sensor enables operation of the robotic surgical system, and wherein the support arm is actuatable to move the housing for ergonomic positioning.

Abstract: A surgical robotic system is disclosed to include an operating table, a plurality of robotic arms and surgical instruments, a user console, and a control tower. The plurality of robotic arms are mounted on the operating table and can be stowed folded under the table for storage. The user console has one or more user interface devices, which function as master devices to control the plurality of surgical instruments.

Abstract: Embodiments described herein provide various examples of a surgical video analysis system for segmenting surgical videos of a given surgical procedure into shorter video segments and labeling/tagging these video segments with multiple categories of machine learning descriptors. In one aspect, a process for processing surgical videos recorded during performed surgeries of a surgical procedure includes the steps of: receiving a diverse set of surgical videos associated with the surgical procedure; receiving a set of predefined phases for the surgical procedure and a set of machine learning descriptors identified for each predefined phase in the set of predefined phases; for each received surgical video, segmenting the surgical video into a set of video segments based on the set of predefined phases and for each segment of the surgical video of a given predefined phase, annotating the video segment with a corresponding set of machine learning descriptors for the given predefined phase.

Abstract: A surgical robotic system comprising: a surgical robotic arm having a plurality of robotic arm links and a plurality of joints operable to move according to multiple degrees of freedom; a proximity sensor coupled to the surgical robotic arm, the proximity sensor comprising a plurality of sensing pads operable to detect a movement of a nearby controlling object prior to contact with the surgical robotic arm; and a processor configured to determine a desired position of the surgical robotic arm based on the detected movement of the nearby controlling object and drive a movement of more than one of the plurality of robotic arm links or the plurality of joints to achieve the desired position of the surgical robotic arm.

Abstract: Embodiments described in this disclosure include a process for collecting energy tool usage data from surgical videos and using such data for post surgery analysis. The process can begin by receiving a plurality of surgical videos of a surgical procedure involving an energy tool. For each surgical video in the plurality of surgical videos, the process detects a set of activation events in the surgical video, wherein each detected activation event includes an identified starting timestamp and a duration. The process further extracts a set of energy tool usage data based on the set of detected activation events, and then stores the extracted set of energy tool usage data in a database indexed based on a set of energy tool usage metrics. Next, in response to a user search request, the process returns the stored energy tool usage data that matches the search request from the database.

Abstract: Embodiments described herein include a process for detecting energy tool activations. The process can begin by receiving a surgical video of a surgical procedure involving energy tool activations. The process then applies a sequence of sampling windows to the surgical video to generate a sequence of windowed samples of the surgical video. Next, for each windowed sample in the sequence of windowed samples, the process applies a deep-learning model to a sequence of video frames within the windowed sample to generate an activation/non-activation inference and a confidence level associated with the activation/non-activation inference for the windowed sample. As a result, a sequence of activation/non-activation inferences and a sequence of associated confidence levels are generated. The process subsequently identifies a sequence of activation events in the surgical video based on the sequence of activation/non-activation inferences and the sequence of associated confidence levels.

Abstract: A surgical robotic user input apparatus has a fiber optic cable with a handheld user input device attached at one end, and a connector attached at another end. Multiple intrinsic sensors, such as fiber Bragg grating sensors, are in the fiber optic cable. The intrinsic sensors are used to detect a pose of the handheld user input device. Other embodiments are also described and claimed.

Abstract: A surgical robotic system is disclosed to include an operating table, a plurality of robotic arms and surgical instruments, a user console, and a control tower. The plurality of robotic arms are mounted on the operating table and can be stowed folded under the table for storage. The user console has one or more user interface devices, which function as master devices to control the plurality of surgical instruments.

Abstract: An immersive display for use in a robotic surgical system includes a support arm, a housing mounted to the support arm and configured to engage with a face of the user, at least two eyepiece assemblies disposed in the housing and configured to provide a three-dimensional display, and at least one sensor, wherein the sensor enables operation of the robotic surgical system, and wherein the support arm is actuatable to move the housing for ergonomic positioning.

Abstract: A surgical robotic user input apparatus has a fiber optic cable with a handheld user input device attached at one end, and a connector attached at another end. Multiple intrinsic sensors, such as fiber Bragg grating sensors, are in the fiber optic cable. The intrinsic sensors are used to detect a pose of the handheld user input device. Other embodiments are also described and claimed.

Abstract: A capacitive sensor for characterizing force or torque includes a first plurality of non-patterned conductive regions and a first plurality of patterned conductive regions, and a second plurality of non-patterned conductive regions and a second plurality of patterned conductive regions. The first and second pluralities of non-patterned conductive regions are facing and the first and second pluralities of patterned conductive regions are facing.

Abstract: A user console for a surgical robotic system has a seat having an armrest and an electromagnetic (EM) transmitter coupled to the armrest to generate an EM field in an EM tracking space around the armrest. A user input device having a handheld housing is to be positioned within the EM tracking by an operator who is seated in the seat, during a surgical procedure. Other aspects are also described and claimed.

Abstract: A surgical robotic system including a surgical table, a surgical robotic manipulator coupled to the surgical table and comprising a plurality of links coupled together by a plurality of joints that are operable to move with respect to one another to move the surgical robotic manipulator, at least one of the plurality of links or the plurality of joints having a portion that faces another of the plurality of links or the plurality of joints, a proximity sensing assembly coupled to the portion of the at least one of the plurality of links or the plurality of joints, the proximity sensing assembly operable to detect an object prior to the surgical robotic manipulator colliding with the object and to output a corresponding detection signal, and a processor operable to receive the corresponding detecting signal and cause the manipulator or the object to engage in a collision avoidance operation.

Abstract: User input devices (UIDs) for controlling a surgical robotic system are described. A UID can include one or more tracking sensors to generate respective spatial state signals in accordance with a pose of the UID. At least one of the tracking sensors can be a camera. In the case of multiple tracking sensors, the spatial state signals are processed by a sensor fusion algorithm to generate a more robust, single tracking signal and a quality measure. The tracking signal and the quality measure are then used by a digital control system to control motion of a surgical robotic system actuator that is associated with the UID. Other embodiments are also described and claimed.

Abstract: An immersive display for use in a robotic surgical system includes a support arm, a housing mounted to the support arm and configured to engage with a face of the user, at least two eyepiece assemblies disposed in the housing and configured to provide a three-dimensional display, and at least one sensor, wherein the sensor enables operation of the robotic surgical system, and wherein the support arm is actuatable to move the housing for ergonomic positioning.

Abstract: A surgical robotic system including a surgical table, a surgical robotic manipulator coupled to the surgical table and comprising a plurality of links coupled together by a plurality of joints that are operable to move with respect to one another to move the surgical robotic manipulator, at least one of the plurality of links or the plurality of joints having a portion that faces another of the plurality of links or the plurality of joints, a proximity sensing assembly coupled to the portion of the at least one of the plurality of links or the plurality of joints, the proximity sensing assembly operable to detect an object prior to the surgical robotic manipulator colliding with the object and to output a corresponding detection signal, and a processor operable to receive the corresponding detecting signal and cause the manipulator or the object to engage in a collision avoidance operation.

Abstract: Wearable user interface devices are described. A wearable user interface device can include a wearable base connected to a trackable device component by a linkage. The linkage can connect to a pivoted support that the trackable device is mounted on, and which maintains poses when the user interface device is not manipulated by a user's hand. The pivoted support has several orthogonal axes intersecting at a center of rotation located inside a device body of the trackable device. Other embodiments are also described and claimed.

Abstract: In some embodiments, an apparatus can include a surgical table and an adapter coupled thereto. The adapter includes an interface structure, a first link member coupled to a second link member, and a third link member coupled to a fourth link member. The first link member and the third link member are each pivotally coupled to the interface mechanism at a shared first pivot joint. The second link member and the fourth link member are each coupleable to a robotic arm. The first link member and the second link member collectively provide for movement of the first robotic arm in at least one of a lateral, longitudinal or vertical direction relative to the table top. The third link member and the fourth link member collectively provide for movement of the second robotic arm in at least one of a lateral, longitudinal or vertical direction relative to the table top.

Abstract: Assisting robotic arm setup in a surgical robotic system using augmented reality can include capturing a live video of a user setting up a robotic arm in a surgical robotic system. A visual guide representing a target pose of the robotic arm can be rendered onto the live video, resulting in an augmented live video for guiding the arm setup. The augmented live video can be displayed to the user while the user is following the visual guide to set up the robotic arm. The captured live video can be continuously processed to determine whether the robotic arm has reached the target pose.