Abstract: Computerized systems, methods, apparatuses, and computer-readable storage media are provided for generating a 3D map of an environment and/or for utilizing the 3D map to enable a user to control smart devices in the environment and/or to interact with a person in the environment. To generate the 3D map, perform the control, and/or interact with the person, a plurality of neuromuscular sensors may be worn by the user. The sensors may be arranged on a carrier worn by the user, and may be configured to sense neuromuscular signals from the user. A camera configured to capture information about the environment may be arranged on the carrier worn by the user. The sensors and the camera provide data to a computer processor coupled to a memory.

Abstract: The present disclosure relates to techniques for using interface mechanisms to recover from inaccurate predictions. Particularly, aspects are directed to collecting input data from a user that includes characteristics of activities performed by the user, extracting features from the input data, predicting a recommendation for the user based on the features, generating a user interface comprising one or more graphical user interface elements configured to enable the user to recovery from the recommendation when the recommendation is inaccurate, rendering the recommendation and the user interface on the display, receiving a request from the user via the user interface to recovery from the inaccurate recommendation, where the request includes selection of an option to generate a new recommendation, modify the recommendation, or a combination thereof, generate a response based on the received request from the user, and render the response to the user on the display.

Abstract: Disclosed herein are related to systems and methods for providing inputs through a virtual keyboard with an adaptive language model. In one approach, one or more processors determine whether a user intended to provide semantically meaningful characters or not, when providing a hand motion or a hand pose with respect to a virtual keyboard. The virtual keyboard may be located on a surface without physical keys. In one approach, the one or more processors determine an input to the virtual keyboard based on the hand motion or the hand pose. In one approach, the one or more processors determine weight of a language model according to the determined user intention. In one approach, the one or more processors modify the detected input according to the determined weight of the language model.

Abstract: In one example, an apparatus comprises an array of pixel cells, each pixel cell including: a photodiode to generate a charge in response to incident light, a charge sensing unit configured to generate a voltage based on the charge, a quantizer configured to generate a digital output based on quantizing the voltage, and an in-pixel memory configured to store the digital output. The apparatus further includes a bus interface, an off-array frame memory, and a frame memory controller configured to: control the frame memory to receive, via the set of parallel interconnects, the digital outputs from the in-pixel memory of each pixel cell of the array of pixel cells; store the digital outputs in the frame memory; fetch the digital outputs from the frame memory; and transmit the digital outputs to a host device via the bus interface.

Abstract: An example method of adjusting a detachable display capsule of a wrist-wearable device to operationally complement a wearable-structure attachment is disclosed. The method includes, while a display capsule is configured to use a default set of display characteristics for operating-system or application-level user interfaces, receiving identifying information for a respective wearable structure, the display capsule being configured to detachably couple to one of a plurality of wearable structures to form a wrist-wearable device. In accordance with a determination that the display capsule should be adjusted based on the identifying information, the method further includes adjusting the display capsule (i) to cease using the first set of display characteristics and (ii) to instead use a customized set of display characteristics associated with the respective wearable structure.

Abstract: Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.

Abstract: Disclosed herein includes a system, a method, and a device for processing and converting data using matrix operations. Circuitry can partition an input of a first data format across a plurality of lookup tables each residing in a respective memory. The circuitry can access weight information from a load store memory, and the partitioned input on a per column basis from the plurality of lookup tables. The circuitry can perform a number of multiply-accumulate (MAC) operations per cycle between the weight information from the load store memory and the partitioned input read on a per column basis from the plurality of lookup tables. The number of MAC operations performed per cycle can correspond to a total number of columns of the plurality of lookup tables. The circuitry can generate, responsive to the MAC operations on the partitioned input, a plurality of outputs in a second data format.

Abstract: Haptic actuators may include a first active material coupled to a first side of an inactive substrate and a second active material coupled to a second side of the inactive substrate. The inactive substrate may be formed to initially exhibit a nonplanar shape when the first active material and the second active material are not actuated. Various other methods, systems, and devices are also disclosed.

Abstract: An artificial-reality device for audio playback is provided. The artificial-reality device includes: (i) a head-mounted display including at least one lens, and (ii) one or more transducers, coupled to the head-mounted display. The transducers are configured to generate signals that vibrate the at least one lens of the head-mounted display. The at least one lens generates acoustic waves that correspond to media presented by the head-mounted display when vibrated by the one or more transducers. Characteristics of the signals generated by the one or more transducers cause the acoustic waves generated by the at least one lens to be directed towards at least one ear of a user of the artificial reality device. Values of the characteristics for the signals are determined based on: (i) the media presented by the head-mounted display and (ii) characteristics of the at least one lens.

Abstract: Disclosed herein are related to a system and a method for determining an Angle of Approach (AoA) of a device. A first device may receive a report from a second device having a plurality of ultra-wideband (UWB) devices. The report may include a plurality of values comprising an elevation component and an azimuth component of the AoA from the first device. At least some of the plurality of values may be obtained according to measurements between the plurality of UWB devices of the second devices and the at least one UWB device of the first device. The first device may determine an AoA from the second device, using the plurality of values from the report received from the second device.

Abstract: Aspects of this technical solution can include identifying, by a wireless communication device, one or more of a plurality of data units corresponding to a set, the set configured according to a heuristic indicating a quality of service (QoS) level corresponding to the set. The wireless communication device can determine one or more metrics indicating respective states of the received plurality of data units. The wireless communication device can select according to the one or more metrics satisfying the heuristic, the set including the plurality of received data units corresponding to the set, from among a plurality of sets each having a corresponding QoS level. The wireless communication device can transmit, according to a set of one or more of the metrics satisfying the heuristic and according to the QoS level corresponding to the set, a set of one or more of the plurality of received data units corresponding to the one or more of the metrics.

Abstract: Systems and methods for slot scheduling may include a first wireless communication device that generates an information element (IE) for scheduling slots for one or more functionalities of a plurality of functionalities, for ultra-wideband (UWB) transmissions between the first wireless communication device and a second wireless communication device. The IE may include, for each respective functionality of the one or more functionalities, a corresponding scheduling list element defining slot scheduling for the respective functionality. The first wireless communication device may transmit the IE to the second wireless communication device.

Abstract: Systems and methods for slot scheduling may include a first wireless communication device that generates an information element (IE) for scheduling slots for one or more functionalities of a plurality of functionalities, for ultra-wideband (UWB) transmissions between the first wireless communication device and a second wireless communication device. The IE may include, for each respective functionality of the one or more functionalities, a corresponding scheduling list element defining slot scheduling for the respective functionality. The first wireless communication device may transmit the IE to the second wireless communication device.

Abstract: Aspects of this technical solution can include receiving, by a wireless communication device, one or more of a plurality of data units corresponding to a first set configured according to a heuristic indicating a quality-of-service (QoS) level corresponding to the first set, determining, by the wireless communication device, a first parameter from one or more of the received plurality of data units, determining, by the wireless communication device, a second parameter from one or more of the received plurality of data units, selecting, by the wireless communication device, a second set including at least a subset of the received plurality of data units satisfying the second parameter, and transmitting, by the wireless communication device and according to the QoS level corresponding to the first set, the second set according to the second parameter.

Abstract: This disclosure describes techniques for recognizing gestures performed by a user, including techniques for conserving power when performing finger or hand gesture recognition operations that involve processing electromyography (EMG) data. In one example, a wearable device capable of being worn by a user comprises: a motion detector configured to detect motion of the wearable device; a tissue movement sensor configured to collect tissue movement information associated with motion of muscles or tissues beneath the user's skin; and a gesture detection module.

Abstract: In one embodiment, a computing system may store, by first buffer blocks, texels organized into a texel array including a number of N×N texel sub-arrays. Each texel may fall within a corresponding N×N texel sub-array and may be associated with a two-dimensional sub-array coordinate indicating a position of that texel within the corresponding N×N texel sub-array. Each first buffer block of may be assigned a particular two-dimensional sub-array coordinate and stores a texel subset having the particular two-dimensional sub-array coordinate. The system may receive, by filter blocks, texels from the first buffer blocks. Each filter block may receive a texel from each first buffer block to form a corresponding N×N texel sub-array. The system may perform, by filter blocks, sampling operations parallelly on their respective N×N texel sub-arrays.

Abstract: A near-eye imaging system includes a light source, a waveguide, a scanner, and a sensor. The light source is configured to emit light. The waveguide includes an output coupler. The scanner is configured to direct the light to the output coupler at varying scan angles. The waveguide confines the light to guide the light to the output coupler. The output coupler has negative optical power and is configured to direct the light to exit the waveguide as expanding illumination light toward an eyebox region. The sensor is configured to generate a tracking signal in response to returning light incident on the sensor via the scanner and via the output coupler.

Abstract: Aspects of the present disclosure are directed to creating interactive avatars that can be pinned as world-locked artificial reality content. Once pinned, an avatar can interact with the environment according to contextual queues and rules, without active control by the avatar owner. An interactive avatar system can configure the avatar with action rules, visual elements, and settings based on user selections. Once an avatar is configured and pinned to a location by an avatar owner, when other XR devices are at that location, a central system can provide the avatar (with its configurations) to the other XR device. This allows a user of that other XR device to discover and interact with the avatar according to the configurations established by the avatar owner.

Abstract: A liquid lens includes a transparent substrate, a multilayer polyurethane-based membrane overlying the transparent substrate, and a liquid layer disposed between and abutting the transparent substrate and the multilayer polyurethane-based membrane. The multilayer polyurethane-based membrane, which may include thermoplastic and/or thermoset polymer layers, may be formed by slot die coating or gravure coating one or more constituent layers and may exhibit a reversible elastic response to imposed strains of up to approximately 5% while limiting the transpiration of fluid therethrough to less than approximately 10?2 g/m2/day.