Abstract: Each pixel of a plurality of pixels captures a portion of outgoing light illuminating a local area reflected from the one or more objects in the local area. A flag is generated via a flag determination logic circuit coupled to each pixel of the plurality of pixels. The flag indicates whether the reflected light was captured within a threshold amount of time from a current time. A time to digital converter is enabled via a flag determination logic circuit. The time to digital converter is associated with each pixel of the plurality of pixels to generate a digital representation of time when each pixel of the plurality of pixels captured the reflected light. Depth information is determined for the one or more objects in the local area based in part on the generated flag and the digital representation of time.

Abstract: An augmented reality (AR) effect system can improve application of AR effects by sharing resources between AR effects. The AR effect system can employ manifests for AR effects that define which resources are required to render each AR effect. The AR effect system can organize rendering operations used by selected AR effects into a pipeline and can use the manifests of the AR effects to determine when each resource will be needed. Based on this pipeline, the AR effect system can create a cache order defining a resource schedule which specifies, when a resource is freed, conditions for whether to save the resource to a local cache or unload the resource. As rendering of the video with the AR effects progresses, the resource schedule can control whether resources not currently being used to render an AR effect should be unloaded or cached for fast access for future render operations.

Abstract: Aspects of the present disclosure are directed to simulating weight for a virtual object in artificial reality. Implementations of a weight simulator can simulate weight for a virtual object during interactions with a user in an artificial reality environment. For example, when a user picks up a virtual object with simulated weight, a spring dynamics model may take, as input, the user movement (e.g., had movement while grasping the virtual object) and control the virtual object movement using outputs from the spring dynamics model. The spring dynamics model's control of the virtual object's movement can give the appearance of lag relative to the user's movements. For example, the user may pick up and move the virtual object, and the virtual object may lag (e.g., behind and/or in a rotation) relative the user's hand movements, as if the user's hand and virtual object were connected by one or more virtual springs.

Abstract: Can battery cells are described. The can battery cell includes a battery cell core that is housed in a rigid enclosure. The enclosure can be made of metal or other rigid material. A front face of the enclosure includes an anode tab and a cathode tab extending from the front face. A circuit module is electrically coupled to the anode tab and the cathode tab, and overlies at least a portion of the front face of the enclosure. One of the anode tab or the cathode tab is electrically coupled to the battery enclosure. The other of the anode tab or the cathode tab is electrically insulated from the enclosure. The front face includes a protrusion portion that forms a step-like structure in the front face of the enclosure.

Abstract: A three-dimensional (3D) compressive sensing based eye tracking system using single photon avalanche diode (SPAD) sensors achieves high resolution depth measurement by using low resolution SPAD sensors and active encoded illumination such as two- or three-dimensional fringe patterns, random speckles, random patterns, and/or superimposed patterns projected onto a surface of an eye. The patterns may be projected by high speed illuminators such as a digital micromirror device (DMD) or micro-electromechanical system (MEMS) projector in series changing at the same rate as the SPAD sensor capture rate. A processor may employ compressive sensing techniques to obtain a high resolution image and depth information from the captured images of varying patterns.

Abstract: An illumination system for eye tracking is described herein. The illumination system may include a laser light source and an ultra-fast scanning micro-electromechanical system (MEMS) operating at a frequency range from about 10 kHz to about 100 kHz to reflect laser light to the eye and generating a desired fringe pattern controlling intensity and timing. A surface of the MEMS may include diffractive optical element (DOE) to reflect the laser light as a concentrated optical beam. The light may also be projected by grating-based illuminators on a photonic integrated circuit (PIC) controlled through adiabatic couplers projecting multiple binary/grayscale images onto the eye. On the detection side, a 2D single-photon avalanche diode (SPAD) sensor or a SPAD array detector and an active MEMS shutter array may be used. Compressive sensing techniques may be applied on the detection side.

Abstract: The disclosed system may include a fluidic system including a connector including a first side and a second side, each of the first side and the second side including a plurality of pins, a fluidic breakout configured to interface pneumatic tubing with a fluidic control system, pneumatic tubing including a plurality of fluidic channels, a first end configured to interface with the first side of the connector, and a second end configured to interface with the fluidic breakout, and a haptic feedback system including a plurality of actuators, each actuator coupled to a respective actuation tube configured to interface with a respective pin on the second side of the connector. Various other systems and methods are also disclosed.

Abstract: A volumetric display may include a two-dimensional display; a varifocal optical system configured to receive image light from the two-dimensional display and focus the image light; and at least one processor configured to: control the two-dimensional display to cause a plurality of sub-frames associated with an image frame to be displayed by the display, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame; and control the varifocal optical system to a corresponding focal state for each respective sub-frame.

Abstract: The disclosed distributed monopole antenna may include a first conductive plate and a second conductive plate. The distributed monopole antenna may also include multiple different vias that electrically connect the first conductive plate to the second conductive plate. Still further, the distributed monopole antenna may include an antenna feed electrically connected to at least one of the vias. Various other systems, methods of manufacturing, and wearable electronic devices that implement distributed monopole antennas are also disclosed.

Abstract: One example described herein includes the digital image sensor having a pixel cell with a photodiode and a quantizer circuit coupled to the pixel cell. The quantizer circuit includes a charge storage device that generates a voltage based on electric charge from the photodiode. The quantizer circuit also includes a single-input comparator that can switch from a first output state to a second output state in response to a ramp signal provided by a ramp generator. The quantizer circuit further includes a memory switch that can cause a counter value from a digital counter to be stored in a digital memory in response to the single-input comparator switching from the first output state to the second output state. The counter value can serve as a digital pixel value associated with the pixel cell.

Abstract: A computing system may receive an image captured by a camera, and determine based on (1) one or more regions in the image that include a portion of a body of a user, and (2) a camera pose of the camera, a three-dimensional volume constraint that stems from the camera pose in which an elbow of the user is likely to be located. The system may infer, based on at least the three-dimensional volume constraint, an elbow pose of the user, wherein the elbow pose includes a location associated with an elbow of the user in three-dimensional space. The system may determine the location associated with the elbow is outside the three-dimensional volume constraint, and in response to the determination, adjust the inferred elbow pose. The system may generate, based on the adjusted elbow pose, a body pose of the user that includes at least the adjusted elbow pose.

Abstract: In one embodiment, a method includes maintaining contextual information from a first user request associated with a first task by a context engine, wherein the first task is associated with a first agent, receiving a second user request associated with a second task from a client system, wherein the second user request comprises an ambiguous mention and the second task is associated with a second agent, determining a context carryover is required for the second agent to execute the second task, determining the ambiguous mention corresponds to one or more data items associated with the contextual information from the first user request, and providing the one or more data items to the second agent for execution of the second task.

Abstract: The disclosed device may include an optical structure configured to house various sensors directed toward a user. The sensors may be configured to gather data through at least one layer of the optical structure. The device may also a vent bracket positioned between the optical structure and an outer covering of the device. The vent bracket may be positioned to provide an opening between the optical structure and the vent bracket, allowing air to flow through the opening. The device may also include various microphones positioned in recessed ports between the optical structure and the vent bracket. These openings may allow external sounds to reach the microphones in the device. Various other methods of manufacturing, systems, and computer-readable media are also disclosed.

Abstract: A near-eye optical assembly includes a display waveguide and an optical structure. The display waveguide is configured to receive display light and to direct the display light to an eye of a user. The optical structure includes an input coupler, an optical path, and an output coupler. The input coupler is disposed to receive a portion of the display light that propagates through the waveguide. The optical path directs the portion of the display light from the input coupler to an output coupler that is configured to provide the received portion of the display light to a disparity sense circuit.

Abstract: In some implementations, the disclosed systems and methods can compute the position of the user interface elements in three-dimensional space, project the position into two-dimensional camera space, and dynamically determine the scale of the user interface elements per frame as either static or dynamic based on the distance between the user and the virtual object. In some implementations, the disclosed systems and methods can simulate a three-dimensional (3D) XR experience on the 2D interface (such as a laptop, mobile phone, tablet, etc.), by placing a virtual XR head-mounted display (HMD) into the XR environment, and providing feeds of the field-of view of the virtual XR HMD to the 2D interface.

Abstract: According to examples, a hybrid emissive display may include a first ?LED subpixel, a second ?OLED subpixel, and a third ?OLED or ?LED subpixel. The hybrid emissive display may also include at least one digital driving component to digitally drive the first ?LED subpixel, the second ?OLED subpixel, and the third ?OLED or ?LED subpixel. For instance, the subpixels may be driven through pulse width modulation. In this regard, the ?LED subpixels and the ?OLED subpixels in a hybrid emissive display may be driven through at least one digital driving component that may be provided in a common backplane, which may be a CMOS backplane. As a result, for instance, hybrid emissive displays may be fabricated to include blue ?LEDs and red ?OLEDs.

Abstract: Systems and methods for configuring a spectral mask include a transmitting device which maintains a plurality of spectral masks for signal transmissions. The transmitting device determines a channel to transmit a signal. The transmitting device selects a first spectral mask from the plurality of spectral masks according to the determined channel to transmit the signal. The transmitting device transmits the signal in the determined channel to a receiving device according to the first spectral mask.

Abstract: Three-dimensional (3D) resolution of a single photon avalanche diode (SPAD) based eye tracking system is enhanced through sensor and/or light source steering. The light source may illuminate the whole eye, while the sensor and/or one or more mirrors associated with the sensor may be steered to capture images of different portions of the eye. The images are stitched to achieve a high-resolution, full view of the eye. Alternatively, the sensor may capture a low-resolution image of the whole eye and be steered to capture multiple low-resolution images, which may be used for interpolation and creation of a high-resolution image of the eye. Both the light source and the sensor (and/or the mirrors) may be steered to illuminate and capture images of different portions of the eye, which may then be stitched to achieve a high-resolution, full view of the eye.

Abstract: According to examples, an apparatus may include a memory on which is stored machine-readable instructions that when executed by a processor, cause the processor to identify an object of interest in at least one first image of an environment captured by a wearable eyewear device during a first time period and identify the object of interest in at least one second image of the environment captured by a wearable eyewear device during a second time period. The processor may also determine a pattern associated with the object of interest based on the at least one first image of the identified object of interest and the at least one second image. In one regard, the processor may determine patterns associated with the object of interest, which may be hidden to or otherwise undetected by a user of the wearable eyewear device.

Abstract: An artificial reality environment (XRE) schema is defined that supports anel-controlling interactions between various artificial reality actors. The XRE schema includes a set of definitions for an XRE, independent of type of artificial reality device. The definitions in the XRE schema can include standards for both interfaces and data objects. The XRE schema can define XR elements in terms of entities and components of a space, organized according to a hierarchy. Each entity can represent a real or virtual object or space, within the XRE, defined by a name and a collection of one or more components. Each component (as part of an entity) can define aspects and expose information about the entity. The XRE schema can specify structures that that allow actors (e.g., producers, instantiators, and consumers) to define and perform actions in relation to XRE elements.