Abstract: A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.

Abstract: In one embodiment, a computing system executes an application defining a bound variable that references a bound value. The bound value references computation instructions to derive a corresponding current value of the bound variable and the application lacks access permission to the current value of the bound variable. An operating system of the computing system receives a request to perform an operation that references the bound variable. The operating system identifies, based on computation instructions, one or more services separate from a process running the application to process the computation instructions referenced by the bound value. At least one of the one or more services has access permission to the current value of the bound variable. The operating system computes, using the one or more identified services, the current value of the bound variable according to the computation instructions of the bound value.

Abstract: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises an image capture device configured to capture image data representative of a physical environment; a head-mounted display (HMD) configured to output artificial reality content; a gesture detector configured to identify, from the image data, a gesture comprising a motion of two fingers from a hand to form a pinching configuration and a subsequent pulling motion while in the pinching configuration; a user interface (UI) engine configured to generate a UI input element in response to identifying the gesture; and a rendering engine configured to render the UI input element as an overlay to at least some of the artificial reality content.

Abstract: Controlling an avatar in an XR environment can be based on input(s) from external, non-XR computing devices, such as mobile devices. An external device can capture sensor data, audio data, and/or image data, which are processed by an avatar control system to determine a gesture performed by the user, gauge the level of intensity or excitement of the user, and/or infer the user's sentiment or emotional state. The avatar control system can generate a motion plan based on these inferences drawn from the external device sensor data based on a baseline animation or motion template. The system can generate avatar animations that have exaggerated or understated expressions relative to the user's real-world gestures, possibly exceeding limitations of a kinematic model that otherwise constrain the avatar's animations. The technology can enable users to control an avatar in an XR environment without specialized XR equipment.

Abstract: Disclosed herein are related to resuming a wireless communication between a first device and a second device. In one aspect, the first deice enters a wake up mode from a sleep mode. In one aspect, the first device obtains, in response to entering the wake up mode, stored information indicating a wireless channel previously used to communicate with a second device, to monitor for a beacon frame from the second device. In one aspect, the first device receives the beacon frame from the second device, according to the stored information. In one aspect, the first device transmits to the second device, an association frame in response to receiving the beacon frame.

Abstract: Disclosed herein are aspects related to a device that can include a wireless communication interface and one or more processors. The wireless communication interface can transmit, using a wireless connection with a remote device, one or more data elements to the remote device. The one or more processors can identify a condition of the wireless connection, determine a rate, for transmission of the one or more data elements, based at least on the condition, retrieve a signal from the remote device indicative of at least one criterion for use of the one or more data elements, update the rate based at least on the at least one criterion to determine an updated rate for transmission of the one or more data elements to the remote device, and cause the wireless communication interface to transmit, at the updated rate, the one or more data elements to the remote device.

Abstract: A high frequency, high efficiency, near field wireless charging system and interface for battery-powered wearable devices are provided. A number of various magnetic core, multi-winding transmitter coil, receiver coil configurations may be used with the transmitter coils generating a charge voltage at the receiver coils through magnetic flux. In some configurations, a buck-boost assisted transmitter, or a buck-boost split between transmitter and receiver charging system may be used. In other configurations, a switch-cap boost block on the transmitter side may be used to increase efficiency. In yet other configurations, a dual path charging system (e.g., for smart glass temples) or a dual transmitter—single receiver charging system with buck-boost or switch-cap blocks may be used. The transmitter-receiver pair configurations may also be used to charge a battery module to be inserted into a wearable device.

Abstract: Systems and methods for peak power control include control circuitry which identifies a condition for a device. The control circuitry can apply the condition for the device to one or more models maintained for a plurality of device processing units of the device to determine one or more performance characteristics for the plurality of processing units. The control circuitry can distribute power credits to the plurality of device processing units of the device according to the determined performance characteristics for the plurality of device processing units, to manage a respective peak power for each respective device processing unit according to a number of the power credits distributed to the respective device processing unit.

Abstract: Image light is generated with a display light source. The image light is visible. An infrared light source emits infrared light. A scan directs the image light and the infrared light to an input coupler of a display waveguide and the display waveguide presents the image light to an eyebox region as a virtual image.

Abstract: The disclosed computer-implemented method may include detecting an amount of energy being discharged from a battery of a computing device. The method may further include predicting, based on the amount of energy being discharged from the battery, a thermal response of the computing device. Furthermore, the method may include performing thermal management of the computing device based on the predicted thermal response. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A wearable device for use in immersive reality applications is provided. The wearable device has a frame including an eyepiece to provide a forward-image to a user, a first forward-looking camera mounted on the frame, the first forward-looking camera having a field of view within the forward-image, a sensor configured to receive a command from the user, the command indicative of a region of interest within the field of view, and an interface device to indicate to the user that a field of view of the first forward-looking camera is aligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

Abstract: A liquid lens includes a substrate, a transparent elastic membrane forming a cavity with the substrate, and a transparent fluid filling the cavity between the substrate and the membrane. The membrane has a pre-distorted, rotationally asymmetric shape in absence of the fluid in the cavity. When the cavity is filled with the fluid and the substrate is disposed vertically w.r.t. gravity at a pre-defined clocking angle, the membrane adopts a substantially rotationally symmetric shape due to elasticity of the membrane counteracting gravity exerting a downward force on the fluid in the cavity, reducing the effect of the gravity sag on optical performance of the liquid lens.

Abstract: The disclosed computer-implemented method may include accessing various portions of contextual information based on at least one touch input from a touch-based sensor on a mobile electronic device. The method may next include determining, based on the contextual information, which of different operational antenna parameters associated with at least one antenna of the mobile electronic device are to be changed. The method may then include changing the specified operational parameters associated with the antenna on the mobile electronic device according to the determination. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A device for providing a reverse pass-through view of a user of a headset display to an onlooker includes an eyepiece comprising an optical surface configured to provide an image to a user on a first side of the optical surface. The device also includes a first camera configured to collect an image of a portion of a face of the user reflected from the optical surface in a first field of view, a display adjacent to the optical surface and configured to project forward an image of the face of the user, and a screen configured to receive light from the display and provide the image of the face of the user to an onlooker.

Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.

Abstract: A wearable device such as an augmented reality (AR)/virtual reality (VR) near-eye display device employs wireless communication technology to facilitate “walkie-talkie” style line-of-sight (LoS) communication between two users or one user and a group of users (unidirectional or bidirectional broadcast mode). The wireless communication may be facilitated by an ultra-wide band (UWB) or comparable wireless communication sub-system. The system may detect another user(s) within range of communication and within a predefined angle-of-arrival (AoA). The communication may be initiated by the user through an input allowing the user to communicate with the other user(s) discretely through audio and/or video modes. In a “walkie talkie selfie” mode, two or more users may capture images of each other, and the images may be superimposed generating a “selfie” of the entire group.

Abstract: An achromatic wave plate using multiple twisted nematic liquid crystal polymer films or negative dispersion A-plate films is described. Each layer of twisted nematic liquid crystal polymer film aligns a next layer during forming achieving a monolithic structure. The achromatic wave plate with multiple layers of negative dispersion A-plate material has a non-continuous, easy to fabricate structure. Both types of films may be flexible and allow application to curved surfaces. The films of both examples also allow for high achromaticity in forward and backward propagation, thus, permitting the wave plate to operate as an optical isolator. A quarter wave of retardance across the entire visible spectrum and up to a 30-degree angle of incidence may be achieved.

Abstract: A system may include one or more processors. The one or more processors may be configured to obtain, from a device configured to perform communication in a wireless local area network (WLAN), a transmission (Tx) time for which the device is transmitting one or more signals during a period of time, a receive (Rx) time for which the device is receiving one or more signals during the period of time, and/or a listen time for which the device is in a listen state during the period of time. The one or more processors may be configured to estimate, based at least on the Tx time, the Rx time and the listen time, an average power consumption value of the device during the period of time. The one or more processors may be configured to control the device based at least on the average power consumption value.

Abstract: Systems and methods for providing interactive content may include one or more processors which receive first content of a content stream from a content provider, where the first content is for rendering via a media player of one or more user devices. The processor(s) may determine a context of the first content, and generate, via one or more machine learning models, second content which corresponds to the first content. The processor(s) may transmit the second content to an application of the one or more user devices, for rendering the second content via the application.

Abstract: In one embodiment, a method includes generating, through a first transistor of an impedance trimming circuit, a precision current based on a reference voltage and an automatic test equipment (ATE) in a first phase of the impedance trimming circuit, wherein the ATE is coupled to the impedance trimming circuit to receive the precision current; mirroring the precision current into a second transistor and a first on-die resistor; sending a first internal voltage feedback at an internal node VFBINT to the ATE, wherein the internal node VFBINT is coupled to the second transistor and the first on-die resistor; and receiving a first trimming code to trim the first on-die resistor, wherein the first trimming code is based on a comparison of the first on-die resistor and a target on-die resistor by the ATE.