Abstract: A method is provided that includes receiving content data captured by a sensor and receiving a context signal representing a user context. The received content data is scaled using a trained model, wherein the context signal is an input to the trained model, and the scaled content data is provided for presentation to a user.

Abstract: A system including a first integrated circuit configured to render image data and transport the image data. Further, the system includes a second integrated circuit configured to receive the image data, determine whether the image data is missing data that was expected to have been received, and generate placeholder data in response to determining that the image data is missing data that was expected to have been received.

Abstract: First integrated circuitry including image data rendering circuitry configured to generate image data and memory configured to store a dashboard including dashboard entries indicating a state of the image data to the image data rendering circuitry, wherein the image data rendering circuitry is configured to operate based at least in part on feedback from the dashboard.

Abstract: Implementations of the subject technology provide adaptive non-visual navigational guidance for electronic devices. The non-visual navigational guidance may be provided in the form of spatialized audio and/or spatialized haptic output from an electronic device. The non-visual navigational guidance may be based on a three-dimensional map of a portion of a physical environment, and may adapt to physical objects detected in the path of the guidance, in real time, during providing of the non-visual navigational guidance.

Abstract: An electronic device is provided that includes at least one image sensor for acquiring a video feed and one or more displays for presenting a passthrough video feed to a user. The electronic device can include a hierarchical failure detection scheme for detecting critical failures on the device. The hierarchical failure detection scheme may include monitoring a condition of a first subsystem with a second subsystem, monitoring a condition of the second subsystem with a third subsystem, monitoring a condition of the third subsystem with a fourth subsystem, and so on. The displays can operate in a first video passthrough mode or a second video passthrough mode based on the condition of the first subsystem as monitored by the second subsystem, the condition of the second subsystem as monitored by the third subsystem, and/or the condition of the third subsystem as monitored by the fourth subsystem.

Abstract: A method is provided that includes receiving content data captured by a sensor and receiving a context signal representing a user context. The received content data is scaled using a trained model, wherein the context signal is an input to the trained model, and the scaled content data is provided for presentation to a user.

Abstract: An electronic device may include software and hardware subsystems that are centrally controlled by a user experience manager. The user experience manager can identify a current user context and enforce a corresponding power and performance policy for the various subsystems that is optimized for the current user context. The user experience manager can provide a set of restrictions at the launch of a user experience, can allow the various subsystems to vary their dynamic behavior based on current operating conditions as long as the dynamic adjustments do not violate the restrictions, and can perform a series of thermal mitigation operations as the internal temperature of the electronic device varies. The centralized user experience manager can also be configured to predict a user context based on monitored states of the subsystems and monitored application usage on the electronic device.

Abstract: In some implementations, a method of synchronizing a content generation and delivery architecture to reduce the latency associated with image passthrough. The method includes: determining a temporal offset associated with the content generation and delivery architecture to reduce a photon-to-photon latency across the content generation and delivery architecture; obtaining a first reference rate associated with a portion of the content generation and delivery architecture; generating, via synchronization circuitry, a synchronization signal for the content generation and delivery architecture based at least in part on the first reference rate; and operating the content generation and delivery architecture according to the synchronization signal and the temporal offset.

Abstract: Generating synthesized data includes capturing one or more frames of a scene at a first frame rate by one or more cameras of a wearable device, determining body position parameters for the frames, and obtaining geometry data for the scene in accordance with the one or more frames. The frames, body position parameters, and geometry data are applied to a trained network which predicts one or more additional frames. With respect to virtual data, generating a synthesized frame includes determining current body position parameters in accordance with the one or more frames, predicting a future gaze position based on the current body position parameters, and rendering, at a first resolution, a gaze region of a frame in accordance with the future gaze position. A peripheral region is predicted for the frame at a second resolution, and the combined regions form a frame that is used to drive a display.

Abstract: A head-mounted device is provided that includes one or more cameras configured to acquire a raw video feed and one or more displays configured to present a passthrough video feed to a user. Generation of the passthrough video feed can involve processing the raw video feed using an image signal processor and auxiliary compute blocks. One or more of the auxiliary compute blocks can be bypassed in response to detecting one or more failures associated with the auxiliary compute blocks. Configured and operated in this way, the head-mounted device can fall back to a more reliable passthrough video feed without having to power cycle the head-mounted device when a failure occurs.

Abstract: A method is provided that includes receiving content data captured by a sensor and receiving a context signal representing a user context. The received content data is scaled using a trained model, wherein the context signal is an input to the trained model, and the scaled content data is provided for presentation to a user.

Abstract: A method is provided that includes determining a gaze position of a user relative to mixed-reality content displayed in a first frame, setting a binning mode for a first camera based on the determined gaze position, and capturing, using the first camera, passthrough content for a second frame at a resolution determined by the binning mode.

Abstract: A request to transition a computing system from a first state to a second state is received, and a respective manifest is compiled for each of a plurality of processors of the computing system. Each manifest comprises a transition identifier representing a command to transition from the first state to the second state and an action time for executing one or more operations associated with the transition identifier. The respective manifests are dispatched to the plurality of processors, and status reports are received from the plurality of processors regarding the transition from the first state to the second state.