Abstract: Systems and methods for compensating for observer movement during robotic surgery. An exemplary system includes an image capture device configured to capture images of a surgical site, a stereoscopic display device, a sensor configured to detect positions of an observer, and a computing device including a processor and a memory storing instructions. The instructions, when executed by the processor, cause the computing device to receive the images of the surgical site from the image capture device, receive data from the sensor indicating a position of the observer, process the received images of the surgical site based on the movement of the observer, and cause the stereoscopic display device to display the processed images of the surgical site.

Abstract: A system includes a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor is configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.

Abstract: The present disclosure is directed to systems and methods for amplifying a region of interest in a surgical environment. The system includes a stereo endoscope having a first camera and a second camera configured to obtain one or more images of the surgical environment. The system also includes a computer that has a central processing unit (CPU) configured to determine the region of interest in the surgical environment, a first controller configured to process the one or more images from the first camera to generate first amplified image(s), and a second controller configured to process the one or more images from the second camera to generate second amplified image(s). The first and second controllers process the one or more images based on the region of interest determined by the CPU. A display displays the one or more first amplified images and the one or more second amplified images.

Abstract: A method of visualizing a surgical site includes scanning a surgical site with an ultrasound system, marking a first area or point of interest within a cross-sectional view of the surgical site with a first tag, viewing the surgical site with a camera, and showing an image of the surgical site captured by the camera on a second display. The second display displays a first indicia representative of the first tag on the image of the surgical site captured by the camera.

Abstract: The present disclosure relates to surgical port assemblies including a plurality of inflatable members for applying a force to a portion of a shaft of a surgical instrument which is inserted through an interior space of the surgical port assembly, and to surgical systems including a surgical port assembly, an endoscopic camera, and a control mechanism for controlling inflation and deflation of the plurality of inflatable members of the surgical port assembly.

Abstract: The present disclosure is directed to an augmented reality head mounted device worn by a user. The device includes an image capture device configured to capture an image of a surgical environment and a transparent lens configured to display an augmented image based on the image of the surgical environment. An eye tracking module coupled to the transparent lens configured to determine a direction of a gaze of an eye of the user, wherein the direction of the gaze of the eye determined by the eye tracking module is used to manipulate the augmented image.

Abstract: A method of placing a surgical robotic cart assembly includes, determining a first position of a first surgical robotic cart assembly relative to a surgical table, calculating a path for the first surgical robotic cart assembly towards a second position of the first surgical robotic cart assembly relative to the surgical table, wherein in the second position, the first surgical robotic cart assembly is spaced-apart a first safe distance from the surgical table, moving the first surgical robotic cart assembly autonomously towards the second position thereof, and detecting a potential collision along the path of the first surgical robotic cart assembly as the first surgical robotic cart assembly moves towards the second position thereof.

Abstract: The present disclosure is directed to an augmented reality surgical system. The system includes an endoscope that captures an image of the region of interest of a patient and an ECG device that records an ECG of the patient. A controller receives the image and applies at least one image processing filter to the image. The image processing filter includes a decomposition filter that decomposes the image into frequency bands. A temporal filter is applied to the frequency bands to generate temporally filtered bands. An adder adds each band frequency band to a corresponding temporally filtered band to generate augmented bands. A reconstruction filter generates an augmented image by collapsing the augmented bands. The controller also receives the ECG and processes the augmented image with the ECG to generate an ECG filtered augmented image. A display displays the ECG filtered augmented image to a user.

Abstract: Systems, methods, and computer-readable media are provided for robotic surgical device control. A system is provided including a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.

Abstract: The present disclosure is directed to systems and methods for removing an occluding object from a surgical image. An image capture device is inserted into a patient and captures an initial image of a surgical site inside the patient during a surgical procedure. A controller receives the image and determines that the occluding object is present in the initial image. The controller executes a removal algorithm that includes controlling the image capture device to perform a plurality of movements, controlling the image capture device to capture a plurality of images, wherein each image among the plurality of images corresponds to a movement among the plurality of movements, and applying an image filter to combine the initial image and the plurality of images and generate a processed image where the occluding object is removed from the processed image.

Abstract: Robotic Surgical Systems and methods of controlling robotic surgical systems are disclosed herein. One disclosed method includes visually capturing a tool pose of a tool within a surgical site with an imaging device in a fixed frame of reference, determining an arm pose of a linkage supporting the tool from known geometries of the linkage in the fixed frame of reference, and manipulating the linkage to move the tool to a desired tool pose in response to a control signal in the fixed frame of reference.

Abstract: The present disclosure relates to surgical port assemblies including a plurality of inflatable members for applying a force to a portion of a shaft of a surgical instrument which is inserted through an interior space of the surgical port assembly, and to surgical systems including a surgical port assembly, an endoscopic camera, and a control mechanism for controlling inflation and deflation of the plurality of inflatable members of the surgical port assembly.

Abstract: A position and tracking system for radio-based localization in an operating room, includes a receiver, a mobile cart, a processor, and a memory coupled to the processor. The mobile cart includes a robotic arm and a transmitter in operable communication with the receiver. The memory has instructions stored thereon which, when executed by the processor, cause the system to receive, from the transmitter, a signal including a position of the mobile carts in a 3D space based on the signal communicated by the transmitter and determine a spatial pose of the mobile carts based on the received signal.

Abstract: The present disclosure is directed to an augmented reality surgical system. The system includes an endoscope that captures an image of the region of interest of a patient and an ECG device that records an ECG of the patient. A controller receives the image and applies at least one image processing filter to the image. The image processing filter includes a decomposition filter that decomposes the image into frequency bands. A temporal filter is applied to the frequency bands to generate temporally filtered bands. An adder adds each band frequency band to a corresponding temporally filtered band to generate augmented bands. A reconstruction filter generates an augmented image by collapsing the augmented bands. The controller also receives the ECG and processes the augmented image with the ECG to generate an ECG filtered augmented image. A display displays the ECG filtered augmented image to a user.

Abstract: The present disclosure is directed to an augmented reality head mounted device worn by a user. The device includes an image capture device configured to capture an image of a surgical environment and a transparent lens configured to display an augmented image based on the image of the surgical environment. An eye tracking module coupled to the transparent lens configured to determine a direction of a gaze of an eye of the user, wherein the direction of the gaze of the eye determined by the eye tracking module is used to manipulate the augmented image.

Abstract: Disclosed are systems, devices, and methods for synthesizing spatially-aware transitions between camera viewpoints. An exemplary method includes receiving images of a surgical site from a first camera, tracking a position of a robotic arm including a second camera coupled thereto, tracking the pose of the second camera, receiving images of the surgical site from the second camera that are different from the images received from the first camera as the robotic arm is moved to different positions, comparing a pose from which at least one of the images received from the second camera were captured to a pose from which at least one of the images received from the first camera were captured, generating a transition between the compared images, and displaying the transition when switching between displaying images received from the first and second cameras.

Abstract: A surgical port manipulator includes a body housing a motion source, an arm coupled to the body, a load sensor associated with the arm, and a controller in communication with the load sensor and the motion source. The arm has an end configured to rotatably couple a surgical port thereto such that the surgical port is rotatable relative to the arm in at least two degrees of freedom in response to a supply of power from the motion source. The load sensor is configured to sense a load exerted on the surgical port. The controller is configured to direct the motion source to move the surgical port in a direction in response to the load sensor sensing a threshold load oriented in the direction.

Abstract: A robotic surgical system includes an access port having a plurality of sensors incorporated therein and a surgical instrument having an end effector for use with, and connection to a robot arm. The sensors measure a loading parameter between tissue and the access port when the shaft is inserted through the access port. The sensors wirelessly transmit signals indicative of the loading parameter to a processing unit. The estimated loads at the tip of the end effector of the surgical instrument are provided in real-time to a haptic feedback interface for communicating haptic feedback to a user. The haptic feedback increases or decreases in intensity in response to a specific event, occurrence, or operational characteristic related to the estimated loads.

Abstract: The present disclosure is directed to systems and methods for removing an occluding object from a surgical image. An image capture device is inserted into a patient and captures an initial image of a surgical site inside the patient during a surgical procedure. A controller receives the image and determines that the occluding object is present in the initial image. The controller executes a removal algorithm that includes controlling the image capture device to perform a plurality of movements, controlling the image capture device to capture a plurality of images, wherein each image among the plurality of images corresponds to a movement among the plurality of movements, and applying an image filter to combine the initial image and the plurality of images and generate a processed image where the occluding object is removed from the processed image.

Abstract: An actuating system including at least one actuation section that includes a plurality of actuating supports. Each of the actuating supports includes a shaft assembly and configured to be actuated individually. The shaft assembly of each of the plurality of actuating supports is configured to translate between a first position and a second position. In the first position an actuated actuating support is aligned with the remaining of the plurality of actuating supports and in the second position the actuated actuating support is misaligned with the remaining of the plurality of actuating supports.