Abstract: A method for using cameras in an augmented reality headset is provided. The method includes receiving a signal from a sensor mounted on a headset worn by a user, the signal being indicative of a user intention for capturing an image. The method also includes identifying the user intention for capturing the image, based on a model to classify the signal from the sensor according to the user intention, selecting a first image capturing device in the headset based on a specification of the first image capturing device and the user intention for capturing the image, and capturing the image with the first image capturing device. An augmented reality headset, a memory storing instructions, and a processor to execute the instructions to cause the augmented reality headset as above are also provided.

Abstract: Controlling an avatar in an XR environment can be based on input(s) from external, non-XR computing devices, such as mobile devices. An external device can capture sensor data, audio data, and/or image data, which are processed by an avatar control system to determine a gesture performed by the user, gauge the level of intensity or excitement of the user, and/or infer the user's sentiment or emotional state. The avatar control system can generate a motion plan based on these inferences drawn from the external device sensor data based on a baseline animation or motion template. The system can generate avatar animations that have exaggerated or understated expressions relative to the user's real-world gestures, possibly exceeding limitations of a kinematic model that otherwise constrain the avatar's animations. The technology can enable users to control an avatar in an XR environment without specialized XR equipment.

Abstract: A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.

Abstract: A waveguide is provided. The waveguide includes a substrate having two outer surfaces for propagating a beam of light in the substrate by reflecting the beam from the two outer surfaces. The waveguide includes at least one polarization volume hologram (PVH) grating to couple light in and/or out of the waveguide. The PVH grating may be a multi-layer PVH grating with graded birefringence.

Abstract: In one embodiment, a computing system executes an application defining a bound variable that references a bound value. The bound value references computation instructions to derive a corresponding current value of the bound variable and the application lacks access permission to the current value of the bound variable. An operating system of the computing system receives a request to perform an operation that references the bound variable. The operating system identifies, based on computation instructions, one or more services separate from a process running the application to process the computation instructions referenced by the bound value. At least one of the one or more services has access permission to the current value of the bound variable. The operating system computes, using the one or more identified services, the current value of the bound variable according to the computation instructions of the bound value.

Abstract: A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.

Abstract: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises an image capture device configured to capture image data representative of a physical environment; a head-mounted display (HMD) configured to output artificial reality content; a gesture detector configured to identify, from the image data, a gesture comprising a motion of two fingers from a hand to form a pinching configuration and a subsequent pulling motion while in the pinching configuration; a user interface (UI) engine configured to generate a UI input element in response to identifying the gesture; and a rendering engine configured to render the UI input element as an overlay to at least some of the artificial reality content.

Abstract: Disclosed herein are related to resuming a wireless communication between a first device and a second device. In one aspect, the first deice enters a wake up mode from a sleep mode. In one aspect, the first device obtains, in response to entering the wake up mode, stored information indicating a wireless channel previously used to communicate with a second device, to monitor for a beacon frame from the second device. In one aspect, the first device receives the beacon frame from the second device, according to the stored information. In one aspect, the first device transmits to the second device, an association frame in response to receiving the beacon frame.

Abstract: A high frequency, high efficiency, near field wireless charging system and interface for battery-powered wearable devices are provided. A number of various magnetic core, multi-winding transmitter coil, receiver coil configurations may be used with the transmitter coils generating a charge voltage at the receiver coils through magnetic flux. In some configurations, a buck-boost assisted transmitter, or a buck-boost split between transmitter and receiver charging system may be used. In other configurations, a switch-cap boost block on the transmitter side may be used to increase efficiency. In yet other configurations, a dual path charging system (e.g., for smart glass temples) or a dual transmitter—single receiver charging system with buck-boost or switch-cap blocks may be used. The transmitter-receiver pair configurations may also be used to charge a battery module to be inserted into a wearable device.

Abstract: Disclosed herein are aspects related to a device that can include a wireless communication interface and one or more processors. The wireless communication interface can transmit, using a wireless connection with a remote device, one or more data elements to the remote device. The one or more processors can identify a condition of the wireless connection, determine a rate, for transmission of the one or more data elements, based at least on the condition, retrieve a signal from the remote device indicative of at least one criterion for use of the one or more data elements, update the rate based at least on the at least one criterion to determine an updated rate for transmission of the one or more data elements to the remote device, and cause the wireless communication interface to transmit, at the updated rate, the one or more data elements to the remote device.

Abstract: An audio system for spatializing virtual sound sources is described. A microphone array of the audio system is configured to monitor sound in a local area. A controller of the audio system identifies sound sources within the local area using the monitored sound from the microphone array and determines their locations. The controller of the audio system generates a target position for a virtual sound source based on one or more constraints. The one or more constraints include that the target position be at least a threshold distance away from each of the determined locations of the identified sound sources. The controller generates one or more sound filters based in part on the target position to spatialize the virtual sound source. A transducer array of the audio system presents spatialized audio including the virtual sound source content based in part on the one or more sound filters.

Abstract: In one embodiment, a method includes instructing sensors on an AR headset to capture data of a real-world environment, discovering a 3D location where a native application configured to run natively on an operating system is downloadable, generating and displaying a virtual object representing the native application at the 3D location, detecting a user of the AR system interacting with the virtual object, downloading a first executable portion of the native application, executing the first executable portion within a sandbox process having a predetermined set of access permissions, progressively downloading a remaining executable portion of the native application while the user is interacting with the executed first executable portion, and in response to a determination that the native application is completely downloaded, installing the native application on the operating system.

Abstract: The disclosed computer-implemented method may include accessing various portions of contextual information based on at least one touch input from a touch-based sensor on a mobile electronic device. The method may next include determining, based on the contextual information, which of different operational antenna parameters associated with at least one antenna of the mobile electronic device are to be changed. The method may then include changing the specified operational parameters associated with the antenna on the mobile electronic device according to the determination. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A first layer of anisotropic material extends along a first plane and includes anisotropic components being parallel to a second plane non-parallel and non-perpendicular to the first plane. The anisotropic components are arranged in cycloidal or helical patterns. The cycloidal or helical patterns define one or more Bragg planes that are non-parallel and non-perpendicular to the first plane and either substantially parallel or substantially perpendicular to the second plane.

Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.

Abstract: Image light is generated with a display light source. The image light is visible. An infrared light source emits infrared light. A scan directs the image light and the infrared light to an input coupler of a display waveguide and the display waveguide presents the image light to an eyebox region as a virtual image.

Abstract: A liquid lens includes a substrate, a transparent elastic membrane forming a cavity with the substrate, and a transparent fluid filling the cavity between the substrate and the membrane. The membrane has a pre-distorted, rotationally asymmetric shape in absence of the fluid in the cavity. When the cavity is filled with the fluid and the substrate is disposed vertically w.r.t. gravity at a pre-defined clocking angle, the membrane adopts a substantially rotationally symmetric shape due to elasticity of the membrane counteracting gravity exerting a downward force on the fluid in the cavity, reducing the effect of the gravity sag on optical performance of the liquid lens.

Abstract: The disclosed computer-implemented method may include (1) sampling an output signal of an amplifier that amplifies a voltage difference between two electrodes, (2) calculating, based on a power spectral density of the output signal, a noise power of the output signal over a predetermined frequency band, (3) estimating an interface impedance of at least one of the two electrodes based on the noise power and a predetermined intrinsic current noise of the amplifier, and (4) performing an operation based at least in part on the estimated interface impedance. Various other methods, systems, and devices are also disclosed.

Abstract: The disclosed computer-implemented method may include detecting an amount of energy being discharged from a battery of a computing device. The method may further include predicting, based on the amount of energy being discharged from the battery, a thermal response of the computing device. Furthermore, the method may include performing thermal management of the computing device based on the predicted thermal response. Various other methods, systems, and computer-readable media are also disclosed.