Abstract: Methods and systems for preventing motion sickness via postural analysis are provided. In response to a determination that the portable electronic device is in motion, that the portable electronic device is being used for visual activities, and that the user of the portable electronic device has an unhealthy posture, a time to implement an intervention is determined. The intervention is subsequently performed at the determined time.

Abstract: The present disclosure describes systems and methods for providing driver assistance. A current vehicle state of a vehicle at a current timestep and an environment map representing an environment of the vehicle at least at the current timestep are obtained. Augmented reality feedback is generated including a virtual vehicle representing a predicted future vehicle state, where the predicted future vehicle state is predicted for a given future timestep based on at least one of the current vehicle state or the current environment. The generated augmented reality feedback including the virtual vehicle is outputted to be displayed by a display device.

Abstract: Systems and methods of generate a classification of touch events are disclosed. A system may detect a first touch event, the first touch event being effected by a touch effector upon a touch receiver. The system may then determine a first touch gesture associated with the first touch event, determine an orientation associated with the touch effector, determine an orientation of the touch receiver, calculate a first relative orientation between the orientation associated with the touch effector and the orientation of the touch receiver, and generate a classification of the first touch event based on the first touch gesture and the first relative orientation.

Abstract: Methods and systems for selecting an object or location in an extended reality (XR) environment or physical environment are described. A first origin, including a first position and a first direction, and a second origin, including a second position and a second direction, are obtained by at least one sensor. An intersection of a first ray, casted from the first origin, and a second ray, casted from the second origin, is determined. A selected object or selected location is identified, based on the determined intersection. An identification of the selected object or the selected location is outputted.

Abstract: Methods and systems for rendering a virtual overlay in an extended reality (XR) environment are described. Image data is received, representing a current field of view (FOV) in the XR environment. A spatial boundary is defined in the current FOV, based on user input. An image label representing a region of interest (ROI) within the defined spatial boundary, and one or more object labels representing one or more objects within the defined spatial boundary are generated. At least one relevant virtual object is identified. The virtual object is relevant to a semantic meaning of the ROI based on the image label and/or the one or more object labels. Identification of the at least one relevant virtual object is outputted, to be renderable in the XR environment.

Abstract: The present disclosure describes systems and methods for providing driver assistance. A current vehicle state of a vehicle at a current timestep and an environment map representing an environment of the vehicle at least at the current timestep are obtained. Augmented reality feedback is generated including a virtual vehicle representing a predicted future vehicle state, where the predicted future vehicle state is predicted for a given future timestep based on at least one of the current vehicle state or the current environment. The generated augmented reality feedback including the virtual vehicle is outputted to be displayed by a display device.

Abstract: Methods and systems for selecting an object or location in an extended reality (XR) environment or physical environment are described. A first origin, including a first position and a first direction, and a second origin, including a second position and a second direction, are obtained by at least one sensor. An intersection of a first ray, casted from the first origin, and a second ray, casted from the second origin, is determined. A selected object or selected location is identified, based on the determined intersection. An identification of the selected object or the selected location is outputted.

Abstract: Methods and systems for selecting an object or location in an extended reality (XR) environment or physical environment are described. A first origin, including a first position and a first direction, and a second origin, including a second position and a second direction, are obtained by at least one sensor. An intersection of a first ray, casted from the first origin, and a second ray, casted from the second origin, is determined. A selected object or selected location is identified, based on the determined intersection. An identification of the selected object or the selected location is outputted.

Abstract: Devices, methods, systems, and media are described for providing an extended screen distributed user interface in an augmented reality environment. GUI layout information for laying out a conventional 2D GUI is processed in order to generate an extended screen DUI for display partially on a 2D display device and partially on one or more virtual screens of an AR environment viewed using an AR display device, such as a head mounted display. GUI elements are laid out in the DUI based on a primary modality of the GUI element (input or output), and/or based on spatial dependencies between GUI elements encoded in the GUI layout information. Methods for switching focus between two software application instances displayed in the DUI are also disclosed.

Abstract: Methods and systems for rendering a virtual overlay in an extended reality (XR) environment are described. Image data is received, representing a current field of view (FOV) in the XR environment. A spatial boundary is defined in the current FOV, based on user input. An image label representing a region of interest (ROI) within the defined spatial boundary, and one or more object labels representing one or more objects within the defined spatial boundary are generated. At least one relevant virtual object is identified. The virtual object is relevant to a semantic meaning of the ROI based on the image label and/or the one or more object labels. Identification of the at least one relevant virtual object is outputted, to be renderable in the XR environment.

Abstract: Methods and systems for selecting an object or location in an extended reality (XR) environment or physical environment are described. A first origin, including a first position and a first direction, and a second origin, including a second position and a second direction, are obtained by at least one sensor. An intersection of a first ray, casted from the first origin, and a second ray, casted from the second origin, is determined. A selected object or selected location is identified, based on the determined intersection. An identification of the selected object or the selected location is outputted.

Abstract: Devices, methods, systems, and media are described for selecting virtual objects for user interaction in an extended reality environment. Distant virtual objects are brought closer to the user within a virtual 3D space to situate the selected virtual object in virtual proximity to the user's hand for direct manipulation. A virtual object is selected by the user based on movements of the user's hand and/or head that are correlated or associated with an intent to select a specific virtual object within the virtual 3D space. As the user's hand moves in a way that is consistent with this intent, the virtual object is brought closer to the user's hand within the virtual 3D space. To predict the user's intent, hand and head trajectory data may be compared to a library of kinematic trajectory templates to identify a best-matched trajectory template.

Abstract: Systems and methods for processing an omnidirectional video (ODV) in virtual reality are provided. The method may include: recording virtual reality field of view (VRFOV) data corresponding to the ODV displayed by a VR display device, where the ODV has a plurality of ODV frames in chronological order, each of the ODV frames including ODV image data and a unique ODV frame timestamp, the VRFOV data representing, for each ODV frame, spatial parameters for a subset of the ODV image data corresponding to a field of view (FOV) presented by the VR display device and an ODV frame identifier for the ODV frame; for each ODV frame in the plurality of ODV frames, extracting the subset of the ODV image data indicated in the VRFOV data to generate a respective regular field of view (RFOV) video frame; and storing the generated RFOV video frames as a video file.