Abstract: A retrofit interface apparatus interfaces with a target device to provide the target device with touchless user input. The apparatus comprises: a touchless sensing system comprising one or more sensors responsive to touchless input made by a human user and for generating one or more corresponding sensor input signals; a controller connected to receive the one or more sensor input signals from the touchless sensing system and configured to generate, based on the one or more sensor input signals, a corresponding control signal; and the controller connectable to the target device to bypass a touch-based input of the target device and to provide the control signal as an input to an existing control system of the target device to thereby cause the control system of the target device to operate the target device based on the control signal.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A system for permitting a medical practitioner to interact with medical information, the system including: a sensing unit for detecting a position of a reference object used to interact with the sensing unit; at least one control unit for determining a gesture performed by the medical practitioner, identifying a command relative to the medical information that corresponds to the gesture, and executing the command in order to display the medical information; generating a graphical user interface including a virtual representation of the reference object and at least one virtual icon and/or a virtual representation of the sensing unit, with each of the at least one virtual icon corresponding to one of a respective mode of operation, a respective user notification, and a respective system setting option; and displaying the GUI along with the medical information.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A system for permitting a medical practitioner to interact with medical information, the system including: a sensing unit for detecting a position of a reference object used to interact with the sensing unit; at least one control unit for determining a gesture performed by the medical practitioner, identifying a command relative to the medical information that corresponds to the gesture, and executing the command in order to display the medical information; generating a graphical user interface including a virtual representation of the reference object and at least one virtual icon and/or a virtual representation of the sensing unit, with each of the at least one virtual icon corresponding to one of a respective mode of operation, a respective user notification, and a respective system setting option; and displaying the GUI along with the medical information.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.