Abstract: Methods for performing a camera calibration process for outward-facing cameras on devices such as head-mounted display devices are disclosed. Using cameras with overlapping fields of view, relative rotational parameters of the cameras with respect to one another may be determined using an optimization technique such as a two-view bundle adjustment algorithm. A statistical analysis of the relative rotational parameters of the cameras, determined for a plurality of moments in time, may then be made to provide updated relative rotational parameters for recalibration of the cameras. A camera calibration process, such as those disclosed, may not depend on tracking points of interest over multiple moments in time, but rather on a convergence of the relative rotational parameters determined for respective moments in time.

Abstract: Methods for performing a calibration process for outward-facing cameras on devices such as head-mounted display devices are disclosed. Extrinsic parameters of the camera are first estimated using inputs to the calibration process such as information from an inertial measurement unit and points of interest within images captured by the camera that are tracked with time. Then, extrinsic and intrinsic parameters are concurrently determined in an optimization problem such that updated values of said parameters may be stored and used by applications that run on the device and make use of the camera. The calibration process may be extended to concurrently calibrate multiple cameras based, at least in part, on information from the inertial measurement unit that is local to the camera.

Abstract: Implementations of the subject technology provide extended reality display devices that can be used on and/or off of a moving platform. Systems and methods are disclosed for separating out the motion of the moving platform from other motions of the device so that virtual content can be displayed without erroneous motions caused by the motion of the moving platform. The subject technology can provide extended reality settings on any suitable moveable platform such as in a car, a watercraft, an aircraft, a train, or any other vehicle.

Abstract: A method includes: receiving sensor measurements from a pre-processing module, in which the sensor measurements include image data and inertial data for a device; transferring, using a processor, information derived from the sensor measurements, from a first set of variables associated with a first window of time to a second set of variables associated with a second window of time, in which the first and second windows consecutively overlap in time; and outputting, to a post-processing module, a state of the device based on the transferred information.

Abstract: A method includes: receiving sensor measurements from a pre-processing module, in which the sensor measurements include image data and inertial data for a device; transferring, using a processor, information derived from the sensor measurements, from a first set of variables associated with a first window of time to a second set of variables associated with a second window of time, in which the first and second windows consecutively overlap in time; and outputting, to a post-processing module, a state of the device based on the transferred information.

Abstract: A method includes: receiving sensor measurements from a pre-processing module, in which the sensor measurements include image data and inertial data for a device; transferring, using a processor, information derived from the sensor measurements, from a first set of variables associated with a first window of time to a second set of variables associated with a second window of time, in which the first and second windows consecutively overlap in time; and outputting, to a post-processing module, a state of the device based on the transferred information.

Abstract: A method includes: receiving sensor measurements from a pre-processing module, in which the sensor measurements include image data and inertial data for a device; transferring, using a processor, information derived from the sensor measurements, from a first set of variables associated with a first window of time to a second set of variables associated with a second window of time, in which the first and second windows consecutively overlap in time; and outputting, to a post-processing module, a state of the device based on the transferred information.