Abstract: An artificial reality system includes a head mounted display (HMD) and a physical overlay engine that generates overlay image data, referred to herein as a physical overlay image, corresponding to the physical objects in a three-dimensional (3D) environment. In response to an activation condition, a rendering engine of the artificial reality system renders the overlay image data to overlay artificial reality content for display on the HMD, thereby apprising a user of the HMD of their position with respect to the physical objects in the 3D environment.

Abstract: Particular embodiments are directed to a passthrough feature. A computing system may display a virtual-reality scene on a device worn by a user. The system may receive a request to display a visual representation of at least a portion of a physical environment surrounding the user. The system may access data associated with the physical environment captured by camera(s) of the device. The system may generate, based the data, depth measurements of one or more objects in the physical environment. The system may generate, based on the depth measurements, one or more models of the one or more objects in the physical environment. The system may render an image based on a viewpoint of the user and the one or more models and, based on the image, generate the visual representation requested by the user. The visual representation may then be displayed with the virtual-reality scene to the user.

Abstract: Particular embodiments are directed to a passthrough feature. A computing system may display a virtual-reality scene on a device worn by a user. The system may receive a request to display a visual representation of at least a portion of a physical environment surrounding the user. The system may access data associated with the physical environment captured by camera(s) of the device. The system may generate, based the data, depth measurements of one or more objects in the physical environment. The system may generate, based on the depth measurements, one or more models of the one or more objects in the physical environment. The system may render an image based on a viewpoint of the user and the one or more models and, based on the image, generate the visual representation requested by the user. The visual representation may then be displayed with the virtual-reality scene to the user.

Abstract: An artificial reality system includes a head mounted display (HMD) and a physical overlay engine that generates overlay image data, referred to herein as a physical overlay image, corresponding to the physical objects in a three-dimensional (3D) environment. In response to an activation condition, a rendering engine of the artificial reality system renders the overlay image data to overlay artificial reality content for display on the HMD, thereby apprising a user of the HMD of their position with respect to the physical objects in the 3D environment.

Abstract: According to some embodiments, system and methods are provided, comprising a collaboration analytic module; a display; a memory storing processor-executable process steps; and a collaboration analytic processor coupled to the memory, and in communication with the collaboration analytic module and operative to execute the processor-executable process steps to cause the system to: initiate a collaboration session; receive input at the collaboration session, wherein the collaboration session is integrated with a source of the received input; generate a visualization based on the received input; receive selection from a user of at least one collaborator to participate in the collaboration session; present the visualization on the display, wherein the visualization is viewable by the user and at least one collaborator; receive a manipulation of the visualization; record the manipulation of the visualization; and associate the recorded manipulation with a manipulation source. Numerous other aspects are provided.

Abstract: The present disclosure is directed to a digital system for managing a wind farm having a plurality of wind turbines electrically coupled to a power grid. The system includes a farm-based first communication network having one or more individual wind turbine control systems communicatively coupled to the one or more wind turbines and an overall wind farm control system. The system also includes a cloud-based second communication network communicatively coupled to the first communication network via an industrial gateway. The second communication network includes a digital infrastructure having a plurality of digital models of the one or more wind turbines, wherein the plurality of digital models of the one or more wind turbines are continuously updated during operation of the wind farm via data supplied by the farm-based first communication network.

Abstract: The present disclosure is directed to a digital twin interface for managing a wind farm having a plurality of wind turbines. The digital twin interface includes a graphical user interface (GUI) displaying a digital equivalent of the wind farm. For example, the digital equivalent of the wind farm includes environmental information and a digital representation of each of the wind turbines arranged in the wind farm. The interface also includes a control icon arranged with each of the digital representations of the wind turbines. In certain embodiments, the control icons of each wind turbine may correspond to a control dial. More specifically, the control icon of each digital representation of the wind turbines includes information regarding current and optimum operating conditions of the digital wind turbine. The interface also includes one or more control features configured to optimize performance of the wind farm.

Abstract: Systems and methods are presented for visualizing a 3-dimensional (3-D) image and providing haptic feedback to a user when the user interacts with the 3-D image. In some embodiments, a method is presented. The method may include accessing, in a wearable visualization device, density data of a physical structure. The method may further include generating a three-dimensional image of the physical structure based on the density data, displaying the three-dimensional image in the wearable visualization device, receiving manipulation data associated with the three-dimensional image from a haptic device, and providing haptic feedback data associated with the three-dimensional image, to the haptic device, based on the manipulation data.

Abstract: A system and method for selective gesture interaction using spatial volumes is disclosed. The method includes processing data frames that each includes one or more body point locations of a collaborating user that is interfacing with an application at each time intervals, defining a spatial volume for each collaborating user based on the processed data frames, detecting a gesture performed by a first collaborating user based on the processed data frames, determining the gesture to be an input gesture performed by the first collaborating user in a first spatial volume, interpreting the input gesture based on a context of the first spatial volume that includes a role of the first collaborating user, a phase of the application, and an intersection volume between the first spatial volume and a second spatial volume for a second collaborating user, and providing an input command to the application based on the interpreted input gesture.

Abstract: The present disclosure is directed to a digital system for managing a wind farm having a plurality of wind turbines electrically coupled to a power grid. The system includes a farm-based first communication network having one or more individual wind turbine control systems communicatively coupled to the one or more wind turbines and an overall wind farm control system. The system also includes a cloud-based second communication network communicatively coupled to the first communication network via an industrial gateway. The second communication network includes a digital infrastructure having a plurality of digital models of the one or more wind turbines, wherein the plurality of digital models of the one or more wind turbines are continuously updated during operation of the wind farm via data supplied by the farm-based first communication network.

Abstract: The present disclosure is directed to a digital twin interface for managing a wind farm having a plurality of wind turbines. The digital twin interface includes a graphical user interface (GUI) displaying a digital equivalent of the wind farm. For example, the digital equivalent of the wind farm includes environmental information and a digital representation of each of the wind turbines arranged in the wind farm. The interface also includes a control icon arranged with each of the digital representations of the wind turbines. In certain embodiments, the control icons of each wind turbine may correspond to a control dial. More specifically, the control icon of each digital representation of the wind turbines includes information regarding current and optimum operating conditions of the digital wind turbine. The interface also includes one or more control features configured to optimize performance of the wind farm.

Abstract: One or more computers are used as a contextual intelligent assistant for obtaining operating condition information about a power plant, capturing at least two forms of context information about a human operator of the power plant, using the operating condition information and the context information to determine at least two of a type, a modality, a location, and a timing of at least one notification to provide for use in controlling the power plant, and providing the at least one notification to the operator and optionally to other personnel in the power plant for use in operating or maintaining the power plant.

Abstract: A method and system for improving user interface efficiency through muscle memory and a radial menu are disclosed. A computer device stores a list of reference commands. The computer device receives a first input component from a user. The computer device then determines whether the first input component matches a first component of at least one reference command in the list of reference commands. In accordance with a determination that the first input component matches the first component of the at least one reference command in the list of reference commands, the computer device continues to monitor user input without displaying a radial menu. In accordance with a determination that the first input component does not match the first component of the at least one reference command in the list of reference commands, the computer device displays the radial menu to the user.

Abstract: Systems and methods are presented for visualizing a 3-dimensional (3-D) image and providing haptic feedback to a user when the user interacts with the 3-D image. In some embodiments, a method is presented. The method may include accessing, in a wearable visualization device, density data of a physical structure. The method may further include generating a three-dimensional image of the physical structure based on the density data, displaying the three-dimensional image in the wearable visualization device, receiving manipulation data associated with the three-dimensional image from a haptic device, and providing haptic feedback data associated with the three-dimensional image, to the haptic device, based on the manipulation data.

Abstract: A system and method for facilitating an intelligent query for graphic pattern is provided. In example embodiments, a plurality of user interfaces is provided at a first device that is communicatively coupled to a second device having a visual analytics system. The plurality of user interfaces provides control of the visual analytics system of the second device at the first device. Sketch inputs are received via a sketch user interface of the plurality of user interfaces. The sketch inputs collectively generate a graphic pattern. A complex query is generated that includes the graphic pattern. The complex query is transmitted to the second device having the visual analytics system that performs a search for data that matches the complex query.

Abstract: A system and method for selective gesture interaction using spatial volumes is disclosed. The method includes processing data frames that each includes one or more body point locations of a collaborating user that is interfacing with an application at each time intervals, defining a spatial volume for each collaborating user based on the processed data frames, detecting a gesture performed by a first collaborating user based on the processed data frames, determining the gesture to be an input gesture performed by the first collaborating user in a first spatial volume, interpreting the input gesture based on a context of the first spatial volume that includes a role of the first collaborating user, a phase of the application, and an intersection volume between the first spatial volume and a second spatial volume for a second collaborating user, and providing an input command to the application based on the interpreted input gesture.

Abstract: The invention relates to a system comprising a speech processor for controlling an apparatus (101) with speech commands. The system according to the invention includes a remote control (102) having a microphone (104) for the input speech commands. The system also includes a further microphone (107) for enabling other users of the system to issue speech commands too. The system may have input designation means (105) for user operably designating said microphone (104) and/or said further microphone (170) as a signal source to the speech processor.