Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

Abstract: A vehicle may have vehicle controls that are used in steering, braking, and accelerating the vehicle. The vehicle may have sensors that gather information on vehicle speed, orientation, and position. The sensors may also gather information on relative speed between the vehicle and a following vehicle, information on risks of a collision between a vehicle and an external object, and other vehicle status information and vehicle operating environment information. Control circuitry may use light-based devices to display braking information, information on vehicle speed, the relative speed between a vehicle and a following vehicle, autonomous driving mode status information, custom brake light information or other user-selected information, or other information on vehicle status and the operating environment of a vehicle.

Abstract: Lighting may be provided using light sources such as lighting systems with arrays of light-emitting diodes. A lighting system may be integrated into a seat, a door panel, a dashboard, or other interior portions of a system such as a vehicle. The interior portions of the vehicle may be illuminated using lighting systems to provide ambient light, to provide custom surface textures and other decorative patterns, to provide icons, text, and other information, and to provide custom gauges and other illuminated regions. Illuminated regions may overlap sensors such as capacitive touch sensors, force sensors, and other sensors. The light-emitting diodes in a lighting system may supply light that passes through openings in a cover layer. The layer may be formed from fabric, leather, or other materials. Lens structures may guide light through the openings.

Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

Abstract: Object detection may include transmitting, by a first device, a first pulse into an environment using a wide field configuration of an ultrasonic sensor array, detecting a presence of an object in the environment based on a detected echo based on the first pulse. In response to detecting the presence of the object, a targeted configuration of the ultrasonic sensor array is determined, and a second pulse is transmitted into the environment based on the second pulse, wherein a characteristic of the object is determined based on a detected echo from the second pulse.

Abstract: A vehicle may have optical structures such as windows and mirrors that have the potential to allow glare from external objects to shine into the eyes of a driver or other vehicle occupant. A control circuit may gather information on where the eyes of the driver are located using a camera mounted in the vehicle and may gather information on where the sun or other source of glare are located outside of the vehicle. Based on this information, the control circuit may direct a light modulator on a window or mirror to selectively darken an area that prevents the glare from reaching the eyes of the driver. The light modulator may have a photochromic layer that is adjusted by shining light onto the photochromic layer, may be a liquid crystal modulator, an electrochromic modulator, or other light modulator layer.

Abstract: A vehicle may have vehicle controls that are used in steering, braking, and accelerating the vehicle. The vehicle may have sensors that gather information on vehicle speed, orientation, and position. The sensors may also gather information on relative speed between the vehicle and a following vehicle, information on risks of a collision between a vehicle and an external object, and other vehicle status information and vehicle operating environment information. Control circuitry may use light-based devices to display braking information, information on vehicle speed, the relative speed between a vehicle and a following vehicle, autonomous driving mode status information, custom brake light information or other user-selected information, or other information on vehicle status and the operating environment of a vehicle.

Abstract: Lighting may be provided using light sources such as lighting systems with arrays of light-emitting diodes. A lighting system may be integrated into a seat, a door panel, a dashboard, or other interior portions of a system such as a vehicle. The interior portions of the vehicle may be illuminated using lighting systems to provide ambient light, to provide custom surface textures and other decorative patterns, to provide icons, text, and other information, and to provide custom gauges and other illuminated regions. Illuminated regions may overlap sensors such as capacitive touch sensors, force sensors, and other sensors. The light-emitting diodes in a lighting system may supply light that passes through openings in a cover layer. The layer may be formed from fabric, leather, or other materials. Lens structures may guide light through the openings.

Abstract: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of left eye frame transmissions and right eye frame transmissions. The device switches data transmissions schemes according to wireless commination link quality or eye gaze tracking. Adjusting transmission format based on transmission quality of the wireless communication link allows the devices to take advantage of greater bandwidth when available to save power. An additional transmission format is based on alternately transmitting left eye and right eye frames for very low bandwidth.

Abstract: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of interleaved left eye frame transmissions and right eye frame transmissions. The device loads the left eye frame into a left eye display device and loads the right eye frame into a right eye display device on the electronic device, where the loading includes sequentially loading left eye frame portions and right eye frame portions as the sequence of interleaved left eye frame transmissions and right eye frame transmissions is received. The device then concurrently displays the left eye frame and the right eye frame at the electronic device. The device switches data transmissions schemes according to wireless communication link quality and eye gaze tracking.

Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

Abstract: Object detection may include transmitting, by a first device, a first pulse into an environment using a wide field configuration of an ultrasonic sensor array, detecting a presence of an object in the environment based on a detected echo based on the first pulse. In response to detecting the presence of the object, a targeted configuration of the ultrasonic sensor array is determined, and a second pulse is transmitted into the environment based on the second pulse, wherein a characteristic of the object is determined based on a detected echo from the second pulse.

Abstract: Fiducial patterns that produce 2D Barker code-like diffraction patterns at a camera sensor are etched or otherwise provided on a cover glass in front of a camera. 2D Barker code kernels, when cross-correlated with the diffraction patterns captured in images by the camera, provide sharp cross-correlation peaks. Misalignment of the cover glass with respect to the camera can be derived by detecting shifts in the location of the detected peaks with respect to calibrated locations. Devices that include multiple cameras behind a cover glass with one or more fiducials on the cover glass in front of each camera are also described. The diffraction patterns caused by the fiducials at the various cameras may be analyzed to detect movement or distortion of the cover glass in multiple degrees of freedom.

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

Abstract: Methods and systems for relative inertial measurement may include a user device comprising an inertial measurement device and/or a camera. A second inertial measurement device may be configured to move with a reference frame. One or more processors may receive inertial measurements from the first and second inertial measurement devices and determine movement of the user device relative to the reference frame by comparing the received inertial measurements. Additionally reference objects in a view of a camera may be used to calibrate the determined motion of the user device within the reference frame.

Abstract: A system includes a processor and a non-transitory computer-readable medium storing instructions that, when executed by the processor, cause the processor to perform operations including determining a current state of a vehicle, the current state determined based on information from sensors, receiving a lighting control signal based on the information received from the sensors, and activating an adjustable and controllable spotlight based on the lighting control signal.

Abstract: A vehicle may have a head-up display that produces a display output allowing a viewer in the vehicle to observe two-dimensional or three-dimensional content. The head-up display may include a display unit that produces the display output and an optical combiner on a vehicle window that directs the display output towards the viewer. The optical combiner may be a holographic or diffractive optical element or may be an array of angled reflectors such as micromirrors embedded in an index-matching material. Optical combiners formed from holographic elements may be configured to reflect light at an angle of reflection that is different than the angle of incidence, thereby allowing light to reach a viewer's eyes even when the head-up display reflects light off of a side window on a vehicle door. A holographic optical element may include volume holographic media such as photopolymers or holographic polymer dispersed liquid crystal.

Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.

Abstract: A climate control system includes a fluid delivery module. The fluid delivery module includes a housing defining a fluid flow path between an inlet and an outlet with the outlet having an elongated, slit-like shape and is not visible within a sight line of a user. The fluid delivery module further includes a fluidic control device disposed within the housing between the inlet and the outlet and movable to vary a direction of the fluid flow path within the housing.

Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.