Abstract: The disclosed systems and methods are generally directed to interpreting neuromuscular signals. The system includes (A) a plurality of neuromuscular sensors that detect a plurality of neuromuscular signals from a user and (B) at least one multiplexer in communication with the plurality of neuromuscular sensors and that is capable of dynamically adjusting neuromuscular sensor processing based on neuromuscular signal characteristics. A computer processor is programmed to (i) receive a set of neuromuscular signals from the plurality of neuromuscular sensors, (ii) determine, via a real-time system, at least one signal characteristic included in a neuromuscular signal, where the neuromuscular signal is associated with a first neuromuscular sensor included in the plurality of neuromuscular sensors; and (iii) dynamically reconfigure the processing of neuromuscular signals from the plurality of neuromuscular sensors based on an output from the multiplexer.

Abstract: In one embodiment, a computing system may determine a quantization range having a first quantization endpoint and a second quantization endpoint. While fixing the second quantization endpoint to an initial value determined based on the color range, one of a plurality of first candidate values for the first quantization endpoint is selected based on a plurality of corresponding first quantization errors. While fixing the first quantization endpoint to the selected first candidate value, one of a plurality of second candidate values for the second quantization endpoint is selected based on a plurality of corresponding second quantization errors. The computing system may define quantization levels corresponding to the bit depth using the quantization range defined by the first quantization endpoint and the second quantization endpoint, and then encode the one or more color components of the pixel region using the quantization levels.

Abstract: A head mounted display (HMD) includes an electronic display, an optical element, and a light sensor. The electronic display is configured to generate a pixel pattern of display light and the optical element is disposed to pass the display light to a user of the HMD. The light sensor is disposed proximate to the optical element to generate light measurements in response to the pixel pattern. The light measurements are representative of a lateral position of the optical element with respect to the electronic display.

Abstract: In one embodiment, a method includes generating a visual interaction tool that moves and extends in a three-dimensional artificial-reality environment according to hand and arm movements of a user. It may be detected that the visual interaction tool intersects a predefined region associated with a virtual item of a first type in the AR environment. The visual interaction tool may attach to the first virtual item. A first operating mode for the visual interaction tool may be selected based on the first type of the first virtual item. The first operating mode may be selected from multiple operating modes for the visual interaction tool. A first input from the user may be received while the visual interaction tool is attached to the first virtual item. First operations with the first virtual item may be performed according to the first operating mode and the first input.

Abstract: A method includes receiving an image of a real environment using a camera worn by a user, and determining a portion of the image that comprises an object of interest. Based on the portion of the image that comprises the object of interest, a surface representing the object of interest is generated. Depth measurements of the real environment corresponding to the portion of the image comprising the object of interest are received and used to determine a depth of the surface representing the object of interest. The surface is posed in a coordinate system corresponding to the real environment based on the depth of the surface and a visibility of a virtual object is determined relative to the object of interest by comparing a model of the virtual object with the surface. The output image is generated based on the determined visibility of the virtual object.

Abstract: A wearable device and system for detecting data generated by a user's contact with a surface and using that data to determine that a user contacted the surface and, in some examples, the location of the contact. The location of the contact may then be used by another device, such as an artificial reality headset, to select a user interface element, activate a function or perform a task in an artificial reality environment, or execute another type of function typically performed in response to an input to a user interface. In one example, the wearable device includes an ultrasound transmitter (Tx) and an ultrasound receiver (Rx). In some embodiments, the wearable device may also include a processing element capable of processing the signals detected or received by the receiver to determine that a contact occurred.

Abstract: In one embodiment, a method includes, by one or more computing systems, receiving, from a client system, an input in a multi-turn message thread, parsing the input to identify a plurality of hypothesis dialog states associated with the input, generating a plurality of functions corresponding to the plurality of hypothesis dialog states, calculating a plurality of probability scores for the plurality of functions, respectively, based on a prior dialog state associated with the message thread and a current user context, wherein each probability score represents a likelihood that the respective function is associated with an intended dialog state, and storing the plurality of functions if each of the probability scores is below a threshold probability score, wherein the plurality of functions is stored as a hierarchical set of functions that is used as the prior dialog state in response to a next input in the message thread.

Abstract: Disclosed herein includes a system, a method, and a device for rendering an image through adaptive reprojection. A first reprojection can be performed to generate a portion of a first image of a first view of a virtual space at a first rate. An amount of change from the first view to a second view of the virtual space can be determined. A portion of a second image of the second view of the virtual space can be determined to generate through a second reprojection. The second reprojection can be performed at a second rate to the portion of the second image according to the amount of change from the first view to the second view of the virtual space.

Abstract: The disclosed system may include (1) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack generates, in response to incoming light received at a first side of the DOE stack, structured light from a second side of the DOE stack opposite the first side, (2) a primary light source that emits the incoming light toward the first side of the DOE stack, and (3) at least one photodetector that detects light emitted from an edge of each of at least one of the DOEs of the DOE stack, where the edge is located between the first side and the second side of the DOE stack. Various other methods and systems are also disclosed.

Abstract: The disclosed flexible vibrotactile devices may include a flexible electroactive material that has a substantially spiral shape, a first electrode electrically coupled to a first side of the flexible electroactive material, and a second electrode electrically coupled to a second, opposite side of the flexible electroactive material. The first electrode and the second electrode may be positioned and configured to apply an electrical voltage to the flexible electroactive material to induce haptic vibration in the flexible electroactive material. Various other related methods and systems are also disclosed.

Abstract: According to examples, a system for generating and delivering enhanced content utilizing remote rendering and data streaming is described. The system may include a processor and a memory storing instructions. The processor, when executing the instructions, may cause the system to transmit a selected engagement content item for transmission to a user device and receive an indication of interest relating to the selected engagement content item. The processor, when executing the instructions, may then select, based on the received indication of interest, an enhanced content item, process the enhanced to content item to generate a stream of content data associated with the enhanced content item and transmit the stream of content data associated with the enhanced content item to the user device.

Abstract: Disclosed herein are related to systems and methods for providing inputs through a virtual keyboard with an adaptive language model. In one approach, one or more processors determine whether a user intended to provide semantically meaningful characters or not, when providing a hand motion or a hand pose with respect to a virtual keyboard. The virtual keyboard may be located on a surface without physical keys. In one approach, the one or more processors determine an input to the virtual keyboard based on the hand motion or the hand pose. In one approach, the one or more processors determine weight of a language model according to the determined user intention. In one approach, the one or more processors modify the detected input according to the determined weight of the language model.

Abstract: A method for classifying a gesture made in proximity to a touch interface. A system receives data related to the position and/or movement of hand. The data is delimited by identifying a variable length window of touch frames. The variable length window of touch frames is selected to include touch frames indicative of feature data. The variable length window of touch frames is classified based upon classifications learned by the classifying module to identify gestures.

Abstract: A housing assembly for mounting a first lens and a second lens includes a first lens holder. The first lens holder includes a ring-shaped structure configured to mount the first lens. The housing assembly also includes a second lens holder including a cup-shaped structure. The cup-shaped structure includes an upper portion configured to mount the first lens holder, and a lower portion configured to mount the second lens.

Abstract: A near eye display (NED) includes multiple PBP optical elements combined with one or more C-plates to improve optical angular performance. The PBP optical elements may be configured for beam steering or for focusing light to a point. A C-plate may reduce or eliminate an undesirable polarization phase shift introduced by the PBP optical elements to angular, off-axis light. Birefringence of the PBP optical elements produces such a polarization phase shift. A C-plate provides an additional polarization phase shift that is opposite to the extra polarization phase shift by the PBP optical elements. Thus, the additional polarization phase shift by the C-plate at least partially reduces the phase shift by the PBP element.

Abstract: Disclosed herein are related to a system and a method of reducing contention in accessing a wireless link. In one aspect, a first device includes a transceiver configured to communicate with a second device via a wireless link. In one aspect, the first device includes a processor configured to determine that a type of content to be transferred between the first device and the second device through the wireless link. In one aspect, the processor is configured to modify one or more parameters for the first device to access the wireless link, from a first set of values to a second set of values, in response to determining that the type of content is artificial reality. In one aspect, the processor is configured to cause the transceiver to access the wireless link using the second set of values.

Abstract: The disclosed method may include receiving neuromuscular activity data over a first time series from a first sensor on a wearable device donned by a user receiving ground truth data over a second time series from a second sensor that indicates a body part state of a body part of the user, generating one or more training datasets by time-shifting at least a portion of the neuromuscular activity data over the first time series relative to the second time series, to associate the neuromuscular activity data with at least a portion of the ground truth data, and training one or more inferential models based on the one or more training datasets. Various other related methods and systems are also disclosed.

Abstract: A display device including a laser-based light engine is disclosed. Optical interference effects due to the coherent nature of a laser light source are mitigated by shortening a coherence length of the laser source. The coherence length shortening is achieved by at least one of the following: providing a multiple longitudinal mode laser source, pulsing a laser source to achieve spectral broadening, or providing multi-emitter laser source(s) with emission wavelength varying from emitter to emitter.

Abstract: Techniques disclosed herein relate to modifying refractive index modulation in a holographic optical element, such as a holographic grating. According to certain embodiments, a holographic optical element or apodized grating includes a polymer layer comprising a first region characterized by a first refractive index and a second region characterized by a second refractive index. The holographic optical element or apodized grating includes a plurality of nanoparticles dispersed in the polymer layer. The nanoparticles have a higher concentration in either the first region or the second region. In some embodiments, the nanoparticles may be configured to increase the refractive index modulation. In some embodiments, the nanoparticles may be configured to apodize the grating by decreasing the refractive index modulation proximate to sides of the grating. The refractive index may be modulated by applying a monomer reservoir buffer layer to the polymer layer, either before or after hologram fabrication.

Abstract: A head mounted display (HMD) includes a field curvature corrected (FC) display to mitigate field curvature in an image that is output to a user's eyes. The FC display includes elements that generate the image light and elements to mitigate field curvature from the image light. The FC display may include a display panel with lenses, a display panel with a reflective polarizer and reflective surface, or other optical elements. The FC display may include a pancake lens configuration including a polarized display with a quarter wave plate, a reflective mirror, and a polarization reflective mirror.