Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for rendering media in a mixed reality device moving in a non-inertial reference frame. Various aspects include identifying tracking points associated with a moving platform defined by a non-inertial reference frame; receiving a first and a second set of monitoring data from a mixed reality headset comprising: a camera device, a headset IMU, and a controller IMU; receiving a second set of tracking data from the mixed reality headset; predicting by a prediction model a movement of the tracking points; determining a discrepancy between the predicted movement of at least one of the tracking points and the second set of tracking data, wherein the discrepancy exceeds an error threshold; and in response to determining the discrepancy, generating display data for rendering a display image in the mixed reality headset.

Abstract: One embodiment is directed to controlling a user device based on an interpreted user intention. Another embodiment is directed to generating a three-dimensional first-resolution digital map of a geographic area in real world based on second-resolution observations on the geographic area using a machine-learning model, where the first resolution is higher than the second resolution. Another embodiment is directed to estimating a location and/or a pose of a camera with images captured by the camera and data from Inertial Measurement Unit (IMU) sensors. Another embodiment is directed to causing the content of an app running on a first device to be rendered by and displayed on a second device. Yet another embodiment is directed to an augmented reality device comprising a pair of glasses and a hat.