Abstract: Systems and methods for camera control within surgical robotic systems are provided. One system includes a computing device, multiple robot assemblies, and a surgeon console. Each robot assembly among the multiple robot assemblies includes a robotic arm. A robotic arm of a first robot assembly is coupled to an image capture device. Robotic arms of at least a subset of robot assemblies, different from the first robot assembly, are coupled to surgical instruments. The surgeon console includes multiple handles, each communicatively coupled to a robot assembly coupled to a surgical instrument. The surgeon console is configured to transmit to the computing device one or more packets that include data related to a movement of at least one handle. The computing device configured to calculate a new position of the image capture device and transmit instructions to the first robot assembly to move the image capture device to the new position.

Abstract: A robotic surgical system or simulator includes an input device, a display device, and a processing unit. The display device includes a representation of a surgical tool that is operably associated with the input device. The processing unit is in communication with the input device and is associated with the representation of a surgical tool to rotate the representation about a first axis of movement based on a scaled rotation of the input device about a first axis of rotation. In an aligned configuration, the input device is aligned with the representation about the first axis of rotation. When the input device is misaligned with the representation, the processing unit varies the scaled rotation of the input device to return the input device to the first aligned configuration until the input device is misaligned about the first axis of rotation a first predetermined offset from the aligned configuration.

Abstract: A robotic surgical system or simulator includes an input device, a display device, and a processing unit. The display device includes a representation of a surgical tool that is operably associated with the input device. The processing unit is in communication with the input device and is associated with the representation of a surgical tool to rotate the representation about a first axis of movement based on a scaled rotation of the input device about a first axis of rotation. In an aligned configuration, the input device is aligned with the representation about the first axis of rotation. When the input device is misaligned with the representation, the processing unit varies the scaled rotation of the input device to return the input device to the first aligned configuration until the input device is misaligned about the first axis of rotation a first predetermined offset from the aligned configuration.

Abstract: Systems and methods for camera control within surgical robotic systems are provided. One system includes a computing device, multiple robot assemblies, and a surgeon console. Each robot assembly among the multiple robot assemblies includes a robotic arm. A robotic arm of a first robot assembly is coupled to an image capture device. Robotic arms of at least a subset of robot assemblies, different from the first robot assembly, are coupled to surgical instruments. The surgeon console includes multiple handles, each communicatively coupled to a robot assembly coupled to a surgical instrument. The surgeon console is configured to transmit to the computing device one or more packets that include data related to a movement of at least one handle. The computing device configured to calculate a new position of the image capture device and transmit instructions to the first robot assembly to move the image capture device to the new position.

Abstract: A robotic surgical system includes a robot system, a user interface, a hand detection system, and a processing unit. The robot system includes a tool coupled to an arm. The user interface includes a handle assembly including a body portion having a proximal end portion, and a first actuator movable between open and closed positions. The hand detection system includes a first sensor disposed within the first actuator for detecting finger presence on the first actuator, a second sensor disposed on the proximal end portion for detecting palm presence about the proximal end portion, and an encoder disposed within the body portion for detecting position of the first actuator relative to the body portion. The processing unit is electrically coupled to the first, second, and third sensors for receiving and processing data from the first, second, and third sensors.

Abstract: Systems and methods for compensating for observer movement during robotic surgery. An exemplary system includes an image capture device configured to capture images of a surgical site, a stereoscopic display device, a sensor configured to detect positions of an observer, and a computing device including a processor and a memory storing instructions. The instructions, when executed by the processor, cause the computing device to receive the images of the surgical site from the image capture device, receive data from the sensor indicating a position of the observer, process the received images of the surgical site based on the movement of the observer, and cause the stereoscopic display device to display the processed images of the surgical site.

Abstract: Systems and methods for camera control within surgical robotic systems are provided. One system includes a computing device, multiple robot assemblies, and a surgeon console. Each robot assembly among the multiple robot assemblies includes a robotic arm. A robotic arm of a first robot assembly is coupled to an image capture device. Robotic arms of at least a subset of robot assemblies, different from the first robot assembly, are coupled to surgical instruments. The surgeon console includes multiple handles, each communicatively coupled to a robot assembly coupled to a surgical instrument. The surgeon console is configured to transmit to the computing device one or more packets that include data related to a movement of at least one handle. The computing device configured to calculate a new position of the image capture device and transmit instructions to the first robot assembly to move the image capture device to the new position.

Abstract: ( robotic surgical system with user engagement monitoring includes a surgeon console having a hand detection system and a tracking device including an image capture device configured to capture an image of a user position reference point, wherein information from the hand detection system and the tracking device are combined to control operation of the robotic surgical system.

Abstract: A system includes a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor is configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.

Abstract: Systems and methods for compensating for observer movement during robotic surgery. An exemplary system includes an image capture device configured to capture images of a surgical site, a stereoscopic display device, a sensor configured to detect positions of an observer, and a computing device including a processor and a memory storing instructions. The instructions, when executed by the processor, cause the computing device to receive the images of the surgical site from the image capture device, receive data from the sensor indicating a position of the observer, process the received images of the surgical site based on the movement of the observer, and cause the stereoscopic display device to display the processed images of the surgical site.

Abstract: A system includes a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor is configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.

Abstract: Systems, methods, and computer-readable media are provided for robotic surgical device control. A system is provided including a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.

Abstract: Systems and methods for camera control within surgical robotic systems are provided. One system includes a computing device, multiple robot assemblies, and a surgeon console. Each robot assembly among the multiple robot assemblies includes a robotic arm. A robotic arm of a first robot assembly is coupled to an image capture device. Robotic arms of at least a subset of robot assemblies, different from the first robot assembly, are coupled to surgical instruments. The surgeon console includes multiple handles, each communicatively coupled to a robot assembly coupled to a surgical instrument. The surgeon console is configured to transmit to the computing device one or more packets that include data related to a movement of at least one handle. The computing device configured to calculate a new position of the image capture device and transmit instructions to the first robot assembly to move the image capture device to the new position.

Abstract: Robotic surgical systems are operated in a manner that improves user experience and user control. The robotic surgical system systems are configured to have a carrying mode, a camera reposition mode, and/or a targeting mode, one or more of which is selectable by the user.

Abstract: A robotic surgical system or simulator includes an input device, a display device, and a processing unit. The display device includes a representation of a surgical tool that is operably associated with the input device. The processing unit is in communication with the input device and is associated with the representation of a surgical tool to rotate the representation about a first axis of movement based on a scaled rotation of the input device about a first axis of rotation. In an aligned configuration, the input device is aligned with the representation about the first axis of rotation. When the input device is misaligned with the representation, the processing unit varies the scaled rotation of the input device to return the input device to the first aligned configuration until the input device is misaligned about the first axis of rotation a first predetermined offset from the aligned configuration.

Abstract: Systems, methods, and computer-readable media are provided for robotic surgical device control. A system is provided including a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.

Abstract: A surgery simulator includes a physical surrogate surgical interface that represents an interface between a user and a simulated patient in a simulated surgical scenario that involves manipulation of both simulated hard and soft tissue. Sensor(s) sense the user's manipulation of the surrogate surgical interface. A surgical simulation generator generates a real time 3D surgical simulation of the surgical scenario based on the manipulation sensed by the sensor(s). The real time 3D surgical simulation comprises real time simulation state data. The surgical simulation generator renders the real time simulation state data into a real time computer graphics generated video representation of the surgical simulation and provides the real time video representation to a display for real time viewing by the user. The surgical simulation generator simulates effects of the manipulation on both simulated hard tissue and simulated soft tissue of the simulated patient.

Abstract: A microsurgery simulator simulates various microsurgical procedures (e.g., nerve reapproximation, ear drain deployment) that utilize a surgical microscope. A surrogate surgical microscope includes a mobile device and an eye piece. A physical surrogate surgical interface represents an interface between a user and a simulated surgical scenario. Sensors sense the user's manipulation of the surrogate surgical interface. A surgical simulation generator generates a real time 3D surgical simulation based on the sensed manipulation. The generator renders the real time surgical simulation into a real time computer graphics generated video representation that is displayed on a screen of the mobile device. A processor of the mobile device is configured to perform at least a portion of a computational analysis that is used to generate the real time computer graphics generated video representation.

Abstract: A surgery simulator includes a physical surrogate surgical interface that represents an interface between a user and a simulated patient in a simulated surgical scenario that involves manipulation of both simulated hard and soft tissue. Sensor(s) sense the user's manipulation of the surrogate surgical interface. A surgical simulation generator generates a real time 3D surgical simulation of the surgical scenario based on the manipulation sensed by the sensor(s). The real time 3D surgical simulation comprises real time simulation state data. The surgical simulation generator renders the real time simulation state data into a real time computer graphics generated video representation of the surgical simulation and provides the real time video representation to a display for real time viewing by the user. The surgical simulation generator simulates effects of the manipulation on both simulated hard tissue and simulated soft tissue of the simulated patient.

Abstract: A microsurgery simulator simulates various microsurgical procedures (e.g., nerve reapproximation, ear drain deployment) that utilize a surgical microscope. A surrogate surgical microscope includes a mobile device and an eye piece. A physical surrogate surgical interface represents an interface between a user and a simulated surgical scenario. Sensors sense the user's manipulation of the surrogate surgical interface. A surgical simulation generator generates a real time 3D surgical simulation based on the sensed manipulation. The generator renders the real time surgical simulation into a real time computer graphics generated video representation that is displayed on a screen of the mobile device. A processor of the mobile device is configured to perform at least a portion of a computational analysis that is used to generate the real time computer graphics generated video representation.