Abstract: Optical assemblies may include a projector assembly, a waveguide, and a mounting mechanism. The projector assembly may be configured for generating an image, and the waveguide may be configured for transmitting the image to a location in front of a user's eye. The mounting mechanism may removably couple the waveguide to an underlying frame. The mounting mechanism may include a detachable coupling, at least one flexure secured to a peripheral edge of the waveguide, and at least one flexure support coupled to the at least one flexure. The flexure support may be removably secured to the detachable coupling by a removable retainer. Various other related systems, methods, and devices are also disclosed.

Abstract: A waveguide display includes a waveguide transparent to visible light, a first volume Bragg grating (VBG) on the waveguide and characterized by a first refractive index modulation, and a second reflection VBG on the waveguide and including a plurality of regions characterized by different respective refractive index modulations. The first reflection VBG is configured to diffract display light in a first wavelength range and a first field of view (FOV) range such that the display light in the first wavelength range and the first FOV range propagates in the waveguide through total internal reflection to the plurality of regions of the second reflection VBG. The plurality of regions of the second reflection VBG are configured to diffract the display light in different respective wavelength ranges within the first wavelength range and the first FOV range.

Abstract: A conversation augmentation system can automatically augment a conversation with content items based on natural language from the conversation. The conversation augmentation system can select content items to add to the conversation based on determined user “intents” generated using machine learning models. The conversation augmentation system can generate intents for natural language from various sources, such as video chats, audio conversations, textual conversations, virtual reality environments, etc. The conversation augmentation system can identify constraints for mapping the intents to content items or context signals for selecting appropriate content items. In various implementations, the conversation augmentation system can add selected content items to a storyline the conversation describes or can augment a platform in which an unstructured conversation is occurring.

Abstract: A system on a chip includes a first subsystem comprising a first memory; a second subsystem comprising a second memory; and an always-on subsystem. The always-on subsystem can comprise processing circuitry configured to: in response to a first activation event, signal the first subsystem to initiate repair operations on the first memory, and in response to a second activation event occurring after the first event, signal the second subsystem to initiate repair operations on the second memory.

Abstract: Aspects of the present disclosure are directed to streaming interactive content from a native application executing at an artificial reality (XR) device into an artificial reality environment and/or to nearby XR device(s). A shell environment at an XR system can manage the software components of the system. The shell environment can include a shell application and a three-dimensional shell XR environment displayed to a user. An additional application, natively executing at the XR system, can provide a host version of content and a remote version of content. A two-dimensional virtual object displayed in the shell XR environment can display the host version of the content, and the remote version of the content can be streamed to a remote XR system. The remote XR system can display the remote content within another two-dimensional virtual object, for example in another shell XR environment displayed by the remote XR system.

Abstract: In one example, an apparatus comprises: an image sensor comprising a plurality of pixel cells; a frame buffer; and a sensor compute circuit configured to: receive, from the frame buffer, a first image frame comprising first active pixels and first inactive pixels, the first active pixels being generated by a first subset of the pixel cells selected based on first programming data; perform an image-processing operation on a first subset of pixels of the first image frame, whereby a second subset of pixels of the first image frame are excluded from the image-processing operation, to generate a processing output; based on the processing output, generate second programming data; and transmit the second programming data to the image sensor to select a second subset of the pixel cells to generate second active pixels for a second image frame.

Abstract: Methods, systems, and storage media for auto-generating an artificial reality environment based on access to personal user content are disclosed. Exemplary implementations may: receive consent from a user to access user content on a user device, the user content comprising digital media; generate a user profile based at least in part on the user content; determine user preferences based at least in part on the user profile; generate an artificial reality environment based at least in part on the user preferences; and share the artificial reality environment with contacts of the user.

Abstract: A method for audio beam steering, tracking, and audio effects for an immersive reality application is provided. The method includes receiving, from an immersive reality application, a first audio waveform from a first acoustic source to provide to a user of a headset, identifying a perceived direction for the first acoustic source relative to the headset based on a location of the first acoustic source, and providing, to a first speaker in a client device, an audio signal including the first audio waveform, wherein the audio signal includes a time delay and an amplitude of the first audio waveform based on the perceived direction. A non-transitory, computer-readable medium storing instructions which, when executed by a processor, cause a system to perform the above method, and the system, are also provided.

Abstract: In one embodiment, a computing system may access a first value associated with a first pixel of the first color channel from a first bitmap associated with a first color channel. The system may select a first mask comprising a plurality of first scaling factors based on the first value of the first bitmap. The system may access a second value associated with a second pixel of the second color channel from a second bitmap associated with a second color channel. The system may select a second mask comprising a plurality of second scaling factors based on the second value of the second bitmap. The system may modify each of first and second component values of the corresponding color channel using the corresponding plurality of scaling factors of the corresponding mask. The system may output the modified first and second component values to a display.

Abstract: In one example, an apparatus comprises: a photodiode to generate a charge in response to light within an exposure period having a first duration; a charge sensing unit to accumulate at least a part of the charge within the exposure period; a quantizer; and a controller to: determine, using the quantizer and within a measurement period having a second duration, whether a first quantity of the at least a part of the charge accumulated at the charge sensing unit exceeds a threshold, and a time it takes for the first quantity to exceed the threshold, wherein the first duration and the second duration are individually programmable; and based on whether the first quantity exceeds the threshold, output a first value representing the time or a second value representing a second quantity of the charge generated by the photodiode within the exposure period to represent an intensity of the light.

Abstract: In one embodiment, a method includes, by an operating system of a first artificial-reality device, receiving a notification that virtual objects are shared with the first artificial-reality device by a second artificial-reality device, where the virtual objects are shared by being placed inside a sender-side shared space anchored to a physical object. The method further includes the first artificial-reality device accessing descriptors of a physical object and a spatial-relationship definition between the physical object and a receiver-side shared space, detecting physical objects based on the descriptors, determining pose of the receiver-side shared space, detecting physical constraints within the receiver-side shares space, receiving display instructions for the virtual objects, and rendering the virtual objects on the first artificial-reality device in the receiver-side shared space.

Abstract: A system can include a position sensor configured to output position data of a HWD. The system can include one or more processors configured to identify a first head angle of the HWD using the position sensor, generate an audio signal using the first head angle, identify a second head angle of the HWD using the position sensor, determine an angle error based at least on the first head angle and the second head angle, and apply at least one of a time difference or a level difference to the audio signal based at least on the angle error to adjust the audio signal. The system can include an audio output device configured to output the adjusted audio signal. By adjusting the audio signal using the angle error, the system can correct for long spatial update latencies and reduce the perceptual impact of such latencies for the user.

Abstract: In one embodiment, a system includes at least one projector configured to project a plurality of projected patterns, where a projected lighting characteristic of each of the projected patterns varies over a time period in accordance with an associated predetermined temporal lighting-characteristic pattern, a camera configured to capture images of detected patterns during the time period, and one or more processors configured to: determine, for each detected pattern, a detected temporal lighting-characteristic pattern based on variations in a detected lighting characteristic of the detected pattern, identify a detected pattern that corresponds to one of the projected patterns by comparing at least one of the detected temporal lighting-characteristic patterns to at least one of the temporal lighting-characteristic patterns, and compute a depth associated with the detected patterns based on the one or more of the projected patterns, the detected pattern, and a relative position between the camera and the project

Abstract: The disclosed system may include a support structure dimensioned for a user's hand. The system may also include transmitting electrodes coupled to a first finger portion of the support structure and may further include receiving electrodes coupled to a second, different finger portion of the support structure. The system may also include a controller that is coupled to the support structure and that is communicatively connected to the transmitting and receiving electrodes. The controller may also be configured to cause the transmitting electrodes to transmit a signal, detect at least some of the transmitted signal at the receiving electrodes and, based on the detected signal, determine that at least two fingers of the user's hand are touching each other. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An example method for execution on a system on a chip (SoC) having a plurality of subsystems includes receiving, by a storage controller from a subsystem of the plurality of subsystems, a command to fetch, from a local memory, task descriptor data comprising access parameters for accessing a storage device, the access parameters including a storage device address; obtaining, by an encryption engine of the SoC, the command to fetch the task descriptor data; determining, by the encryption engine based on an access rule, whether the subsystem has sufficient privilege to access the storage device address; in response to determining that the subsystem has sufficient privilege to access the storage device, encrypting, source data in the local memory according to an encryption key associated with the subsystem; and providing the encrypted source data to the storage controller for writing to the storage device at the storage device address.

Abstract: Disclosed herein is an LED device that includes a display package and a plurality of LED dies arranged on a top surface of the display package. The display package includes a molding compound, a backplane die, and at least one spacer structure, with the backplane die and the at least one spacer structure being embedded within the molding compound. In some embodiments, the plurality of LED dies includes a first die containing red LEDs, a second die containing green LEDs, and a third die containing blue LEDs. The backplane die includes driver circuits configured to drive LEDs in the plurality of LED dies, for example, LEDs of the first die, the second die, and the third die. The at least one spacer structure has a higher thermal conductivity than the molding compound and is configured to dissipate heat generated by the LEDs in the plurality of LED dies.

Abstract: Methods and systems used in calibrating the position and/or orientation of a wearable device configured to be worn on a wrist or forearm of a user, the method comprises sensing a plurality of neuromuscular signals from the user using a plurality of sensors arranged on the wearable device, and providing the plurality of neuromuscular signals and/or signals derived from the plurality of neuromuscular signals as inputs to one or more trained autocalibration models, determining based, at least in part, on the output of the one or more trained autocalibration models, a current position and/or orientation of the wearable device on the user, and generating a control signal based, at least in part, on the current position and/or orientation of the wearable device on the user and the plurality of neuromuscular signals.

Abstract: A first wireless communication device may send, to a second wireless communication device, a request message including a traffic stream identifier (TID) and a first value, the first value indicating that a traffic stream between the first wireless communication device and the second wireless communication device and corresponding to the TID is latency sensitive.

Abstract: Features described herein generally relate to providing spatiotemporal guidance within a 360-degree video. Particularly, while a 360-degree video is being displayed to a user, a current location of the view of the user within the 360-degree video is determined. Additionally, regions of interest may be identified within the 360-degree video, along with their location and a time in which the regions of interest are active within the 360-degree video. A visual guide is then overlaid onto the 360-degree video that indicates a current location of the view of the user, as well as locations of one or more regions of interest, as well as the time during which each region of interest is active (able to be viewed) within the 360-degree video. By viewing the visual guide, the user may be able to anticipate a location and timing of regions of interest within the 360-degree video and adjust their gaze to the correct location at the correct time to view such regions of interest.

Abstract: Disclosed herein are related to devices and methods for communication. In one aspect, a device includes a first processor and a second processor. The first processor may be configured to generate a first set of packets associated with an application data unit in a first layer corresponding to content data. Each packet of the first set of packets may include a flag indicative of an association with the application data unit. The second processor may be configured to generate a second set of one or more packets in a second layer for transmission, in response to determining that the first set of packets is associated with the application data unit according to flags of the first set of packets. The second processor may be configured to schedule to transmit the second set of one or more packets in the second layer within a defined time period.