Abstract: Implementations selectively offload visual frames from a client device to an edge system for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to an edge system preloaded with a workload resource that corresponds to the requested data service. After the edge system processes the offloaded visual frames using the workload resource, the edge system can return the processed visual frame to the client device. In some implementations, the edge system and client device are situated in a network such that a latency for the offload communications support real-time video display. A cloud system can maintain a registry of edge systems and provide client devices with information about nearby edge systems. The cloud system can also preload the edge systems with workload resources that correspond to data services.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: Implementations offload visual frames from a client device to a gateway or edge device for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to a gateway or edge device preloaded with a resource that corresponds to the requested data service. After the gateway or edge device processes the visual frames using the resource, the processed visual frames can be returned to the client device. In implementations, the offload device and client device are situated in a network such that a latency for the offload communications supports real-time video display. A gateway device manager can locate a gateway connected to the client device, and resources can be deployed (or the gateway can be prepopulated) so that the device can perform gateway services and edge processing services for the client device.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A system for permitting a medical practitioner to interact with medical information, the system including: a sensing unit for detecting a position of a reference object used to interact with the sensing unit; at least one control unit for determining a gesture performed by the medical practitioner, identifying a command relative to the medical information that corresponds to the gesture, and executing the command in order to display the medical information; generating a graphical user interface including a virtual representation of the reference object and at least one virtual icon and/or a virtual representation of the sensing unit, with each of the at least one virtual icon corresponding to one of a respective mode of operation, a respective user notification, and a respective system setting option; and displaying the GUI along with the medical information.

Abstract: Implementations offload visual frames from a client device to a gateway or edge device for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to a gateway or edge device preloaded with a resource that corresponds to the requested data service. After the gateway or edge device processes the visual frames using the resource, the processed visual frames can be returned to the client device. In implementations, the offload device and client device are situated in a network such that a latency for the offload communications supports real-time video display. A gateway device manager can locate a gateway connected to the client device, and resources can be deployed (or the gateway can be prepopulated) so that the device can perform gateway services and edge processing services for the client device.

Abstract: Implementations augment images with depth information to support hologram display. An edge system can receive, from a source system, images of a user. For example, the images can be two-dimensional images captured by multiple cameras at different perspectives (e.g., stereoscopic images), or single perspective images. The edge system can estimate depth information using the images, for example by processing the images using an engine and one or more machine learning models, and generate depth encoded images. The edge system can then transmit the depth encoded images to a target system, which can ultimately display a hologram of the user using the depth encoded images. Accordingly, implementations can offload, from end-user devices (e.g., the source system and/or target system), hologram workloads to an edge system loaded with an engine and machine learning model(s).

Abstract: Implementations offload visual frames from a client device to a gateway or edge device for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to a gateway or edge device preloaded with a resource that corresponds to the requested data service. After the gateway or edge device processes the visual frames using the resource, the processed visual frames can be returned to the client device. In implementations, the offload device and client device are situated in a network such that a latency for the offload communications supports real-time video display. A gateway device manager can locate a gateway connected to the client device, and resources can be deployed (or the gateway can be prepopulated) so that the device can perform gateway services and edge processing services for the client device.

Abstract: Implementations selectively offload visual frames from a client device to an edge system for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to an edge system preloaded with a workload resource that corresponds to the requested data service. After the edge system processes the offloaded visual frames using the workload resource, the edge system can return the processed visual frame to the client device. In some implementations, the edge system and client device are situated in a network such that a latency for the offload communications support real-time video display. A cloud system can maintain a registry of edge systems and provide client devices with information about nearby edge systems. The cloud system can also preload the edge systems with workload resources that correspond to data services.

Abstract: Implementations selectively offload visual frames from a client device to an edge system for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to an edge system preloaded with a workload resource that corresponds to the requested data service. After the edge system processes the offloaded visual frames using the workload resource, the edge system can return the processed visual frame to the client device. In some implementations, the edge system and client device are situated in a network such that a latency for the offload communications support real-time video display. A cloud system can maintain a registry of edge systems and provide client devices with information about nearby edge systems. The cloud system can also preload the edge systems with workload resources that correspond to data services.

Abstract: Implementations offload visual frames from a client device to a gateway or edge device for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to a gateway or edge device preloaded with a resource that corresponds to the requested data service. After the gateway or edge device processes the visual frames using the resource, the processed visual frames can be returned to the client device. In implementations, the offload device and client device are situated in a network such that a latency for the offload communications supports real-time video display. A gateway device manager can locate a gateway connected to the client device, and resources can be deployed (or the gateway can be prepopulated) so that the device can perform gateway services and edge processing services for the client device.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A system for permitting a medical practitioner to interact with medical information, the system including: a sensing unit for detecting a position of a reference object used to interact with the sensing unit; at least one control unit for determining a gesture performed by the medical practitioner, identifying a command relative to the medical information that corresponds to the gesture, and executing the command in order to display the medical information; generating a graphical user interface including a virtual representation of the reference object and at least one virtual icon and/or a virtual representation of the sensing unit, with each of the at least one virtual icon corresponding to one of a respective mode of operation, a respective user notification, and a respective system setting option; and displaying the GUI along with the medical information.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A system for permitting a medical practitioner to interact with medical information, the system including: a sensing unit for detecting a position of a reference object used to interact with the sensing unit; at least one control unit for determining a gesture performed by the medical practitioner, identifying a command relative to the medical information that corresponds to the gesture, and executing the command in order to display the medical information; generating a graphical user interface including a virtual representation of the reference object and at least one virtual icon and/or a virtual representation of the sensing unit, with each of the at least one virtual icon corresponding to one of a respective mode of operation, a respective user notification, and a respective system setting option; and displaying the GUI along with the medical information.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A method facilitates touchless control of medical equipment devices in an OR. The method involves: providing a three-dimensional control menu, which comprises a plurality of menu items selectable by the practitioner by one or more gestures made in a volumetric spatial region corresponding to the menu item; displaying an interaction display unit (IDU) image corresponding to the three-dimensional control menu to provide indicia of any selected menu items; estimating a line of sight of a practitioner; and when the estimated line of sight is directed within a first spatial range around a first medical equipment device, determining that the practitioner is looking at the first medical equipment device. Then the method involves providing a first device-specific three-dimensional control menu displaying a first device-specific IDU image.

Abstract: A system for permitting a medical practitioner to interact with medical information, the system including: a sensing unit for detecting a position of a reference object used to interact with the sensing unit; at least one control unit for determining a gesture performed by the medical practitioner, identifying a command relative to the medical information that corresponds to the gesture, and executing the command in order to display the medical information; generating a graphical user interface including a virtual representation of the reference object and at least one virtual icon and/or a virtual representation of the sensing unit, with each of the at least one virtual icon corresponding to one of a respective mode of operation, a respective user notification, and a respective system setting option; and displaying the GUI along with the medical information.