Abstract: Disclosed herein is an extended reality system, and associated techniques, whereby personalized usage data of a user in one or more extended reality environments over a period of time can be collected and provided to a predictive model to determine optimal shortcut assignments for presentation to and subsequent use by the user. Determining the optimal shortcut assignments can involve estimating a plurality of interaction times for the user in the one or more extended reality environments, generating an optimized graphical user interface within the one or more extended reality environments with the optimal shortcut assignments reflected in the optimized graphical user interface, and rendering the optimized graphical user interface in the one or more extended reality environments to the user. The system may collect additional personalized usage data and periodically update the optimal shortcut assignments based on ongoing use of the system by the user.

Abstract: The present disclosure pertains to techniques for reducing inaccuracies in context aware policies (CAP) with real-time feedforward validation in extended reality environments. In a particular aspect, a extended reality system is configured to author, by a user using the head-mounted device, a rule or policy or context aware policy (CAP) including one or more target actions and triggering context instances, capture, using one or more sensors, context history records for the user, render, by the head-mounted device, one or more validation scenes based on the rule or policy or CAP and the context history records, validate, by the user using the head-mounted device, the one or more validation scenes within an extended reality environment, and update, by the user using the head-mounted device, the rule or policy or CAP based on the validation.

Abstract: The present disclosure relates to defining and modifying behavior in an extended reality environment. The systems and methods include capturing, using the one or more audio sensors, a natural language explanation of a rule or policy from the user, extracting features from the natural language explanation of the rule or policy, wherein the features include one or more conditions, one or more actions, and connections between the one or more events, conditions, and actions, predicting a control structure comprised of one or more conditional statements based on the extracted features and model parameters learned from historical rules or policies, and generating the rule or policy based on the control structure, wherein the rule or policy comprises the one or more conditional statements for executing the one or more actions based on evaluation of the one or more conditions.

Abstract: An audio system and method for generating improved augmented hearing effects in real-time. The system includes a wearable audio device arranged to obtain audio that includes a voice signal associated with a user and an environmental signal associated with other audio picked up by the wearable audio device that does not includes the user's voice. In some implementations, at least one processor of the wearable audio device is configured to isolate the voice signal from the environmental signal such that augmented hearing effects can be applied to the voice signal and/or the environmental signal, independently. In some implementations, augmented hearing effects are designated by a signal augmentation profile generated or stored in the wearable audio device such that the total time between receipt of the audio signal and the modifications and/or transformations to the respective audio signals does not exceed 100 ms.

Abstract: An audio system and method for generating improved augmented hearing effects in real-time. The system includes a wearable audio device arranged to obtain audio that includes a voice signal associated with a user and an environmental signal associated with other audio picked up by the wearable audio device that does not includes the user's voice. In some implementations, at least one processor of the wearable audio device is configured to isolate the voice signal from the environmental signal such that augmented hearing effects can be applied to the voice signal and/or the environmental signal, independently. In some implementations, augmented hearing effects are designated by a signal augmentation profile generated or stored in the wearable audio device such that the total time between receipt of the audio signal and the modifications and/or transformations to the respective audio signals does not exceed 100 ms.

Abstract: An audio system and method for generating improved augmented hearing effects in real-time. The system includes a wearable audio device arranged to obtain audio that includes a voice signal associated with a user and an environmental signal associated with other audio picked up by the wearable audio device that does not includes the user's voice. In some implementations, at least one processor of the wearable audio device is configured to isolate the voice signal from the environmental signal such that augmented hearing effects can be applied to the voice signal and/or the environmental signal, independently. In some implementations, augmented hearing effects are designated by a signal augmentation profile generated or stored in the wearable audio device such that the total time between receipt of the audio signal and the modifications and/or transformations to the respective audio signals does not exceed 100 ms.