Abstract: An electronic device may include one or more sensors that capture sensor data for a physical environment around the electronic device. The sensor data may be used to determine a scene understanding data set for an extended reality environment including the electronic device. The scene understanding data set may include information such as spatial information, information regarding physical objects in the extended reality environment, and information regarding virtual objects in the extended reality environment. When providing scene understanding data to one or more applications running on the electronic device, spatial and/or temporal restrictions may be applied to the scene understanding data set. Scene understanding data that is associated with locations within a boundary and that is associated with times after a cutoff time may be provided to an application.

Abstract: In one implementation, a method includes: determining an interpupillary distance (IPD) measurement for a user based on a function of depth data obtained by the depth sensor and image data obtained by the image sensor; and calibrating a head-mounted device (HMD) provided to deliver augmented reality/virtual reality (AR/VR) content by setting one or more presentation parameters of the HMD based on the IPD measurement in order to tailor one or more AR/VR displays of the HMD to a field-of-view of the user.