Abstract: Disclosed herein are devices, methods, and systems for controlling a robot or assistive device that allows the robot or device to find and manipulate objects in a real world environment. The disclosed devices, methods, and systems may, in many cases, receive control input through monitoring, tracking, and analyzing the 3D gaze of a user/controller. Using the described 3D eye tracking, a user can directly and naturally look at an object of interest in the real world, while the system monitors, tracks, and records the user's 3D gaze position. This information, in many cases, is then translated into input commands for the robot or assistive.

Abstract: The presently disclosed devices, methods, and systems involve direct and intuitive visualization using gaze-control in robotic laparoscopy. For example, when the system detects a new visual interest, the robot may guide the scope to approach or move toward the target view. In order to achieve the disclosed control, a system coordinate transformation is developed. The disclosed devices, methods, and systems may translates gaze positions on image (in pixels) to relative rotation angles and/or translation distances of the laparoscope. In most cases, this relationship, which may be built, in part, on the parameters of the laparoscope and the inserted laparoscope length in the patient's body, may allow the robot to directly follow the surgeon's gaze position on the monitor. The disclosed devices, methods, and systems may help to reduce cognitive and physical burdens on a laparoscopic surgeon.

Abstract: Disclosed herein are devices, methods, and systems for controlling a robot or assistive device that allows the robot or device to find and manipulate objects in a real world environment. The disclosed devices, methods, and systems may, in many cases, receive control input through monitoring, tracking, and analyzing the 3D gaze of a user/controller. Using the described 3D eye tracking, a user can directly and naturally look at an object of interest in the real world, while the system monitors, tracks, and records the user's 3D gaze position. This information, in many cases, is then translated into input commands for the robot or assistive.

Abstract: Disclosed herein are devices, methods, and systems for controlling a robot or assistive device that allows the robot or device to find and manipulate objects in a real world environment. The disclosed devices, methods, and systems may, in many cases, receive control input through monitoring, tracking, and analyzing the 3D gaze of a user/controller. Using the described 3D eye tracking, a user can directly and naturally look at an object of interest in the real world, while the system monitors, tracks, and records the user's 3D gaze position. This information, in many cases, is then translated into input commands for the robot or assistive.