Abstract: A method for displaying a virtual control surface in an extended reality environment includes the virtual control surface showing a user a subset of interactive tools to a user in an extended reality environment associated with an activity or subject matter, such as an educational class activity or subject, that the user is interacting with in the extended reality environment. A secondary virtual sub-control surface or multiple sub-control surfaces can be displayed in the extended reality environment that includes complementary controls, such as tools or functions, that the user can use to interact with the activity or subject matter on a primary virtual control surface.

Abstract: A method is performed by a virtual reality display hardware device to control a virtual planar surface in a virtual reality environment. The method includes tracking a user's physical hand movement relative to a virtual planar surface displayed in the virtual reality environment and displaying movement of the virtual planar surface constrained along a defined plane based on the tracked hand movement.

Abstract: A method and system for monitoring a user during an educational activity in an extended reality (XR) environment are disclosed. An educational activity is presented in an XR environment using XR hardware, and one or more sensors associated with the XR hardware monitor physical characteristics or movements of the user during the activity. A deviation detection module determines that a physical deviation event has occurred based on a deviation from an expected physical parameter associated with the educational activity. In response to the physical deviation event, a notification is generated to an instructor system, enabling real-time or post-activity review of the user’s XR experience. The monitoring may include eye tracking, head orientation tracking, hand position tracking relative to defined boundary regions, and correlation of multiple sensor inputs.

Abstract: A system and method enable creation and modification of digital objects within an extended reality (XR) environment using voice commands in combination with detected physical user inputs. An XR hardware device detects a spoken command requesting creation or modification of a digital object and detects a physical input indicative of a spatial location within the XR environment. Spatial coordinates corresponding to the physical input are determined, and a representation of the digital object is displayed at the determined spatial coordinates. Visual attributes of the digital object may be assigned or modified based on additional spoken instructions and user interactions, including gesture-based inputs and measurement selection interfaces.

Abstract: A system and associated methods facilitate administration of assessments within an extended reality learning environment. Assessment recordings captured during administration of an assessment module to a first user in an extended reality environment produce an assessment record that is used for providing feedback information to the first user from a second user that can access the assessment record, such as including the first user's interactions with the assessment module.

Abstract: Embodiments described herein involve converting written assessments into oral assessments, which may be conversational in nature. The oral assessments may be better at determining the knowledge of an assessee. Additionally, the oral assessments are less vulnerable to academic dishonesty. Embodiments also generate an answer form similar to an answer form that would be used with the written assessment, thereby allowing assessors to seamlessly continue using their practiced assessment methods. In embodiments, a computer-implemented method of examination involves processing a written assessment through a machine learning model to generate an oral assessment, which is then transmitted to an assessee. The assessee responds to the oral assessment, and the response is analyzed using the machine learning model to determine one or more answers to the written assessment. A completed answer form to the written assessment is generated using these answers.

Abstract: Disclosed herein are methods, systems, and computer-readable media for causing a machine learning model to generate improved answer data based on an extended reality environment. In an embodiment, a method may include receiving the query, identifying at least one extended reality component associated with the extended reality environment as relating to the query, the at least one extended reality component comprising at least one of an object, a recording, or transcript information, and generating a prompt based on the query and the at least one extended reality component. The method may further include transmitting the prompt to a machine learning model, in response to the transmitted prompt, receiving answer data from the machine learning model, and based on the received answer data, generating content in the extended reality environment.

Abstract: Methods, systems, apparatuses, and non-transitory computer readable media are provided for providing answer data through external language models. Operations may include receiving, through a program having access to a first limited private dataset but not a second limited private dataset, an input from a first user device; transmitting, to an external language model, the input and digital information derived using the first limited private dataset, wherein the external language model has access to the second limited private dataset but not the first limited private dataset; receiving, from the external language model, answer data after transmitting the input and the digital information; generating response data based on the answer data received from the external language model; and outputting the response data at the first user device.

Abstract: Aspects of this present disclosure relate to systems and methods for dynamically updating a data structure of a group-based communication system. In one embodiment, a method is disclosed, comprising: detecting a text string with at least one digital indicator designated to automatically trigger generation of at least one removable indicator associated with the text string; generating a first removable indicator and a first graphical removal element within a first graphical user interface; generating a second removable indicator and a second graphical removal element within a second graphical user interface; detecting a single user interaction at the first graphical removal element or the second graphical removal element; and in response to detecting the single user interaction, removing both the first removable indicator from the first graphical user interface and the second removable indicator from the second graphical user interface.

Abstract: Cheating deterrence in electronic reality environments during a testing activity is improved over real-world anti-cheating and test monitoring by displaying and recording use of virtual scratch paper by user, such as student, that is wearing an electronic reality display device and engaged in the testing activity. A monitor of the testing activity, such as a teacher, can watch the recorded use of the virtual scratch paper by the user to help deter cheating.

Abstract: A method for displaying a virtual sub-tablet from a primary virtual tablet in an extended reality environment includes the primary virtual tablet showing a user in the virtual environment an activity or subject matter, such as an educational class subject. A virtual sub-tablet is displayed in the extended reality environment that includes complementary controls, such as tools or functions, that the user can use to interact with the activity or subject matter on the primary virtual tablet.

Abstract: A method to deter cheating by a user engaging in an examination activity in an extended reality (XR) environment includes restricting or providing access to disallowed or allowable applications, files and tools during an examination activity. The restriction or access to application, files and tools in the XR environment during the examination activity may be controlled on a question-by-question basis.

Abstract: A user with an extended reality hardware device creates and changes appearance of a digital object in extended reality environments by using voice commands including adverbs in conjunction with pointing action of a hand at location point. A representation of the digital object is retrieved for display at the location point pointed to by the user.

Abstract: Disclosed herein are methods, systems, and computer-readable media for causing a machine learning model to generate improved answer data based on an extended reality environment. In an embodiment, a method may include receiving the query, identifying at least one extended reality component associated with the extended reality environment as relating to the query, the at least one extended reality component comprising at least one of an object, a recording, or transcript information, and generating a prompt based on the query and the at least one extended reality component. The method may further include transmitting the prompt to a machine learning model, in response to the transmitted prompt, receiving answer data from the machine learning model, and based on the received answer data, generating content in the extended reality environment.

Abstract: Methods, systems, apparatuses, and non-transitory computer-readable media are provided for providing answer data through multiple connected large language models. Operations may include receiving, through a graphical user interface associated with a local large language model having access to a first limited private dataset but not a second limited private dataset, an input from a user device, identifying, based on the input, an external large language model from among a plurality of external large language models, transmitting the input to the external large language model, receiving, from the external large language model, the answer data responsive to the input, generating, by the local large language model, response data based on the answer data, and outputting the response data at the user device.

Abstract: Aspects of this present disclosure relate to systems and methods for dynamically updating a data structure of a group-based communication system. In one embodiment, a method is disclosed, comprising: detecting a text string with at least one digital indicator designated to automatically trigger generation of at least one removable indicator associated with the text string; generating a first removable indicator and a first graphical removal element within a first graphical user interface; generating a second removable indicator and a second graphical removal element within a second graphical user interface; detecting a single user interaction at the first graphical removal element or the second graphical removal element; and in response to detecting the single user interaction, removing both the first removable indicator from the first graphical user interface and the second removable indicator from the second graphical user interface.

Abstract: Methods, systems, apparatuses, and non-transitory computer readable media are provided for directing a user through an extended reality environment. Operations may include rendering a first extended reality zone, wherein the first extended reality zone comprises a first plurality of information boards configured to display virtual reality content, rendering a second extended reality zone adjacent to the first extended reality zone, wherein the second extended reality zone comprises a second plurality of information boards configured to display virtual reality content, providing a virtual barrier between the first extended reality zone and the second extended reality zone, wherein the virtual barrier prevents the user from virtually entering the second extended reality zone from the first extended reality zone, receiving, through an extended reality device, a progression input from the user, and removing the virtual barrier between the first extended reality zone and the second extended reality zone.

Abstract: Disclosed herein are methods, systems, and computer-readable media for prompting a machine learning model to generate answer data based on a recording. Some embodiments involve preprocessing a prompt corresponding to a query for a first system by receiving the prompt and a timestamp corresponding to a time position of the query in a recording, acquiring a text transcript based on the recording, and selecting, based on the timestamp and the text transcript, a first data domain from the text transcript. Some embodiments involve transmitting at least one of the prompt, the text transcript, and the first data domain to a second system, the second system including a machine learning model. Some embodiments involve generating answer data corresponding to the prompt by querying the machine learning model with the prompt, receiving answer data from the machine learning model, and transmitting the answer data to the first system.

Abstract: Aspects of this present disclosure relate to systems and methods for dynamically updating a data structure of a group-based communication system. In one embodiment, a method is disclosed, comprising: detecting a text string with at least one digital indicator designated to automatically trigger generation of at least one removable indicator associated with the text string; generating a first removable indicator and a first graphical removal element within a first graphical user interface; generating a second removable indicator and a second graphical removal element within a second graphical user interface; detecting a single user interaction at the first graphical removal element or the second graphical removal element; and in response to detecting the single user interaction, removing both the first removable indicator from the first graphical user interface and the second removable indicator from the second graphical user interface.

Abstract: Disclosed herein are methods, systems, and computer-readable media for causing a machine learning model to generate improved answer data based on an extended reality environment. In an embodiment, a method may include receiving the query, identifying at least one extended reality component associated with the extended reality environment as relating to the query, the at least one extended reality component comprising at least one of an object, a recording, or transcript information, and generating a prompt based on the query and the at least one extended reality component. The method may further include transmitting the prompt to a machine learning model, in response to the transmitted prompt, receiving answer data from the machine learning model, and based on the received answer data, generating content in the extended reality environment.