Abstract: A near-eye optical device includes a transparent layer, an in-field illuminator, and a diffractive optical element (DOE). The in-field illuminator is configured to emit near-infrared light centered around a first wavelength. The diffractive optical element is configured to be illuminated by the near-infrared light emitted by the in-field illuminator. The DOE generates a structured light projection that includes dots that expand as the structured light projection propagates farther from the DOE. The structured light projection is directed to illuminate an eyebox.

Abstract: An audio system comprises an array of transparent piezoelectric transducers on a transparent surface. Each transparent piezoelectric transducer includes one or more piezoelectric layers and one or more conductive layers that are substantially transparent to visible light. A transparent piezoelectric transducer may include, e.g., a first conductive layer, a first piezoelectric layer on the first conductive layer, and a second conductive layer on the first piezoelectric layer. Or in another example, the transparent piezoelectric transducer includes many (e.g., 20-30) piezoelectric layers and many (e.g., 20-30) conductive layers.

Abstract: The disclosure is directed to techniques for dynamically managing memory in mixed mode cache and shared memory systems. For example, a system on a chip (SoC) comprises: a plurality of memories, including a first memory and a second memory, where each of the memories includes one or more cache lines; a first subsystem comprising a first compute element and the first memory; a second subsystem comprising a second compute element and the second memory; and a memory control unit of the SoC comprising processing circuitry and configured to: configure a shared memory with one or more cache lines of at least one of the plurality of memories; and flush, based on one or more tag control bits for the one or more cache lines of the shared memory, data from the shared memory to a backend storage separate from the SoC.

Abstract: Illumination light is emitted from a light source. The illumination light is directed to an eyebox region via a lightguide. Illumination light and visible light beams are incoupled into the lightguide by a tiltable reflector. A tracking signal is generated with a sensor in response to a returning light becoming incident on the sensor.

Abstract: Described embodiments provide devices and methods for operating a multilink device (MLD) and a wireless node using wireless local area network (WLAN) channels and non-WLAN channels. The wireless node may transmit a first message to reserve at least a first WLAN channel. Via a non-WLAN channel, the wireless node may transmit a second message identifying the first WLAN channel to a wireless device, to cause a plurality of receivers of the wireless device to receive on the first WLAN channel. The wireless device may comprise a WLAN-based MLD. At least a defined duration after the second message, the wireless node may transmit at least one data frame to the plurality of receivers of the wireless device, via the first WLAN channel.

Abstract: A device may include a controller and a modem of a first wireless network. The controller may determine that the modem is in active mode and the device is using a second wireless network for communication instead of the first wireless network. In response to the determining, the controller may switch the modem into power-save mode. In response to a handover triggering event, the controller may switch the modem to the active mode and acquire a service of the first wireless network without registering with the first wireless network. The controller may determine that a communication service is to be handed over to the service of the first wireless network. In response to determining that the communication service is to be handed over, the controller may perform registration with the first wireless network, and perform handover of the communication service to the service of the first wireless network.

Abstract: Methods and systems used in calibrating the position and/or orientation of a wearable device configured to be worn on a wrist or forearm of a user, the method comprises sensing a plurality of neuromuscular signals from the user using a plurality of sensors arranged on the wearable device, and providing the plurality of neuromuscular signals and/or signals derived from the plurality of neuromuscular signals as inputs to one or more trained autocalibration models, determining based, at least in part, on the output of the one or more trained autocalibration models, a current position and/or orientation of the wearable device on the user, and generating a control signal based, at least in part, on the current position and/or orientation of the wearable device on the user and the plurality of neuromuscular signals.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: A headset includes a housing, an optical assembly disposed in the housing, and an adjustment assembly coupling the optical assembly to the housing. The optical assembly includes a first lens and a second lens spaced from the first lens by a first distance. The adjustment assembly includes an interpupillary distance adjustment mechanism and an eye relief distance adjustment mechanism. The interpupillary distance adjustment mechanism is configured to adjust the first distance between the first lens and the second lens along a first axis. The eye relief distance adjustment mechanism configured to adjust the optical assembly a second distance along a second axis orthogonal to the first axis.

Abstract: Neural representations may be used for multi-view reconstruction of scenes. A plurality of color images representing a scene from a plurality of camera poses may be received. For each point of a plurality of points along a ray, a signed distance and a color value may be determined as a function of a feature volume, a first neural network, and a second neural network. A predicted output color may be determined as a function of the density. At least one of the first neural network, the second neural network, the feature volume, or the transformation parameter may be adjusted based on the predicted output color and a corresponding target color obtained based on one of the color images. A three-dimensional representation of the scene may be displayed based on at least one of the first neural network, the second neural network, the feature volume, or the transformation parameter.

Abstract: According to examples, an optical assembly for a head-mounted display (HMD) device may include a compensation element to modify a phase of a first light arriving from an environment outside the head-mounted display (HMD) device; a transparent display to present an image or a video and to pass through the phase-modified first light; and a focus element to focus the phase-modified first light and a second light from the transparent display on an eyebox. The optical assembly may reduce one or more aberrations in the first light or the second light. The focus element may be a metalens, a light field lens, a solid optical lens, or an optical configuration with two optical elements including an air gap between the two optical elements. The compensation element may be a free-form phase plate.

Abstract: An in-ear device occludes an ear canal of an ear of a user. The in-ear device is configured to be calibrated such that the user perceives audio content as though the in-ear device is not occluding the ear canal. A transducer of the in-ear device presents audio content, and an inner microphone of the in-ear device detects sound pressure data within the ear canal. A controller of the in-ear device determines a blocked sound pressure at the entrance to the ear canal based on sound pressure data from an outer microphone. The controller generates sound filters custom to the user based in part on the detected sound pressure within the ear canal and the blocked sound pressure at the entrance to the ear canal. The controller adjusts audio content using the sound filter, and the transducer presents the adjusted audio content to the user.

Abstract: A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.

Abstract: A Head Mounted Display (HMD) includes a pixel array having multiple pixels configured in a two-dimensional surface, each pixel providing multiple light beams forming an image provided to a user. The HMD also includes a first optical element configured to provide a central portion of a field of view for the image through an eyebox that limits a volume including a pupil of the user, and a second optical element configured to provide a peripheral portion of the field of view for the image through the eyebox, wherein the peripheral portion of the field of view comprises at least one steradian of a user's field of view at a resolution of at least fifteen arcminutes.

Abstract: The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An automated messaging reply-to system can automatically select which message a potential reply message is replying to. The automated messaging reply-to system can obtain a message thread, a potential reply message, and a context. The automated messaging reply-to system can filter the message thread and generate model inputs based on the remaining messages, the potential reply message, and the context. The automated messaging reply-to system can apply the model input to a machine learning model, which can generate reply scores for the remaining messages. After generating reply scores, the automated messaging reply-to system can determine whether the remaining message with the highest reply score qualifies as an originating message being replied to. The automated messaging reply-to system can cause display of the potential reply message as a reply-to for the determined originating message.

Abstract: According to examples, apparatuses, systems, and methods for simulating the color appearance of coatings on three-dimensional objects are described. Geometric data relating to a geometry of an object characterized by a curved surface is received. A substrate representation of a substrate color associated with the object is determined based on the geometric data. A coating representation of a coating applied to the object is determined based on the geometric data and a thin film model of the coating. An appearance of the coating applied to the object is simulated by displaying the coating representation superimposed on the substrate representation.

Abstract: In some implementations, the disclosed systems and methods can provide a set of triggers that cause the degradation system to degrade output graphics. In further implementations, the disclosed systems and methods can display a virtual object in an artificial reality environment to a user, where the displayed virtual object corresponds to the captured video. In yet further implementations, the disclosed systems and methods can evaluate one or more contexts corresponding to activity of a user while using the artificial reality device to view images.

Abstract: Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in one or more of the modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.

Abstract: A headset includes a thermal frame disposed within a housing. A printed circuit board (PCB) is thermally coupled to the thermal frame. Heat generated by one or more electrical components on the PCB is transmitted to the thermal frame, which distributes the heat uniformly throughout the headset. A first heat pipe is disposed on a first side of the PCB in contact with at least a portion of the thermal frame, the PCB, and/or an electrical component disposed on the PCB to draw heat from the electrical component, and a second heat pipe is disposed proximate a second side of the PCB and is configured to draw heat from second side of the PCB.