Abstract: A multipass scanner usable e.g. in a near-eye display is disclosed. The multipass scanner scans a light beam angularly, forming an image in angular domain. The multipass scanner includes a light source, a tiltable reflector, and a multipass coupler that couples light emitted by the light source to the tiltable reflector, receives the reflected light and couples it back to the tiltable reflector to double the scanning angle. Then, the multipass coupler couples the light reflected at least twice from the tiltable reflector to an exit pupil of the scanner. A pupil-replicating waveguide disposed at the exit pupil of the scanner extends the image in angular domain. Multiple reflections of the light beam from the tiltable reflector enable one to increase the angular scanning range and associated field of view of the display without having to increase the angular scanning range of the tiltable reflector.

Abstract: A depth camera assembly (DCA) includes a light generator emitting a beam of light into a local area and a detector. The detector captures light from the beam reflected by objects in the local area to a portion of an array of pixels that each include a single photon avalanche diode (SPAD). The location of the portion of the array is based in part on the angle of the beam emitted from the projector. The DCA identifies a set of pixels of the array corresponding to the portion and selectively retrieves current generated from the reflected light by the pixels in the portion of the array without retrieving current generated by pixels in other portions of the array.

Abstract: A light-emitting diode (LED) array is formed by bonding an LED chip or wafer to a backplane substrate via curved interconnects. The backplane substrate may include circuits for driving the LED's. One or more curved interconnects are formed on the backplane substrate. A curved interconnect may be electrically connected to a corresponding circuit of the backplane substrate, and may include at least a portion with curvature. The LED chip or wafer may include one or more LED devices. Each LED device may have one or more electrical contacts. The LED chip or wafer is positioned above the backplane substrate to spatially align electrical contacts of the LED devices with the curved interconnects on the backplane substrate. The electrical contacts are bonded to the curved interconnects to electrically connect the LED devices to corresponding circuits of the backplane substrate.

Abstract: A method and a system for reconstructing obstructed face portions are provided herein. The method may include the following steps: obtaining off-line 3D data, being 3D data of a head of a person not wearing a face-obstructing object, being an object which obstructs a portion of the face of the person; obtaining in real time, real-time 3D data, being 3D data of said head, wherein said person wears said face-obstructing object; applying a 3D transformation to at least a portion of the off-line 3D data, based on the real-time 3D data, to yield reconstructed real time 3D data, being real-time 3D data related to the obstructed face portions; and merging the reconstructed real time 3D data into the real-time 3D data. The system may implement the aforementioned steps over a computer processor.

Abstract: Disclosed herein are techniques for eye illumination for eye position tracking. An illumination system includes a light source configured to emit a light beam in a first wavelength range, a beam splitter configured to split the light beam emitted by the light source into a plurality of light beams, a substrate configured to be placed in front of an eye of a user, and a plurality of reflectors located within the substrate. Each of the plurality of reflectors is configured to intercept one or more light beams from the plurality of light beams, reflect light in the one or more light beams from the plurality of light beams to the eye of the user, and transmit light in a second wavelength range different from the first wavelength range to the eye of the user. The substrate is transparent to both light in the first wavelength range and light in the second wavelength range.

Abstract: A scanning display includes a light source and a scanning assembly. The light source is configured to emit source light from a plurality of rows of emitters that are arranged parallel to a first dimension. The scanning assembly includes at least one optical element that conditions the source light. The scanning assembly is configured to scan the conditioned source light along a second dimension that is orthogonal to the first dimension. The scanning assembly configured to output the scanned light over a portion of a target area of an output waveguide. And a brightness of the scanned image light offsets dimming caused by the output waveguide expanding the scanned light in at least one dimension.

Abstract: A volumetric display may include a two-dimensional display; a varifocal optical system configured to receive image light from the two-dimensional display and focus the image light; and at least one processor configured to: control the two-dimensional display to cause a plurality of sub-frames associated with an image frame to be displayed by the display, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame; and control the varifocal optical system to a corresponding focal state for each respective sub-frame.

Abstract: In general, techniques are described for improving security of a boot sequence of an application processor. In some examples, a computing device includes a first processor coupled to a first storage device, the first processor and first storage device configured to obtain firmware from a storage device external to the first processor; run a verification routine on the firmware; and in response to validation of the firmware with the verification routine, communicate the firmware to a second processor; and the second processor coupled to a second storage device, the second processor and second storage device configured to load the firmware.

Abstract: In one embodiment, a method includes establishing a video call between multiple client systems while persistently maintaining access to an assistant system during the video call. A request to be performed by the assistant system during the video call may then be received from a first client system; this request may reference one or more second users in the video call. An intent of the request and one or more user identifiers of these one or more second users referenced by the request may be determined, and the assistant system may be instructed to execute the request based on the determined intent and user identifiers. Finally, a response to the request may be sent to one more of the multiple client systems while maintaining the video call between these client systems.

Abstract: A system predicts future positions or vergence depth of the user's eyes and generates gaze contingent content, such as for a head-mounted display (HMD), based on the predicted positions or vergence depth. The system includes an eye tracking controller that creates eye tracking information defining positions of a first eye and a second eye of a user over time. The eye tracking information is input to a neural network model that outputs the predicted positions or vergence depth. The predicted positions or vergence depth is then used to render the gaze contingent content, or to change other configurations of the HMD. Latency between the detection of user eye movement and the output of corresponding content is reduced to provide a more immersive real-time user experience.

Abstract: A head mounted display comprises an eye tracking system configured to enable eye tracking using polarization. The eye tracking system includes one or more illumination sources and an optical detector comprising polarization sensitive pixels. The one or more illumination sources are configured to illuminate a user's eye and generate reflections directed towards the optical detector. The eye tracking system determines, for each polarization sensitive pixel in a subset of the polarization sensitive pixels, one or more estimation parameters. The eye tracking system determines, for the subset of the polarization sensitive pixels, depth information for one or more glints associated with one or more surfaces of the eye, based in part on the polarization of the reflections and the one or more estimation parameters. The determined depth information is used to update a model of the eye. The eye tracking system determines eye tracking information based on the updated model.

Abstract: The disclosed apparatus may include a fluidic channel connecting an inlet port and an outlet port. The apparatus may further include a gate transmission element configured to limit fluid flow between the inlet port and the outlet port. Still further, the apparatus may include a primary gate terminal connected to a second fluidic inlet port, where pressure or force at the primary gate may at least partially control movement of the gate transmission element. The apparatus may also include a secondary gate terminal connected to the second fluidic inlet port. Pressure or force at the secondary gate may at least partially control movement of the gate transmission element. Various other associated methods, systems, and computer-readable media are also disclosed.

Abstract: A rhythm-based video game (“game”) is disclosed. In the game, a player slashes blocks representing musical beats using a pair of energy blades resembling a lightsaber. A gaming console renders multiple digital objects, e.g., digital blocks, digital mines and digital obstacles, that are approaching a player in a virtual space. The gaming console also renders a digital representation of an instrument, e.g., a lightsaber (“digital saber”), using which the player slashes, cuts or otherwise interacts with the digital blocks to cause a digital collision between the digital saber and the digital blocks. The player can score by slashing the digital blocks, not hitting the digital mines and avoiding the digital obstacles. The game presents the player with a stream of approaching digital objects in synchronization with music, e.g., a song's beats, being played in the game. The pace at which the digital blocks approach the player increases with the beats.

Abstract: A method for manufacturing a cartilage conduction audio device is disclosed. A manufacturing system receives data describing a three-dimensional shape of an ear (e.g., the outer ear, behind the ear, the concha bowel, etc.) of a user. The system identifies one or more locations for one or more transducers along a back of an auricle of the ear for the user that vibrate the auricle over a frequency range causing the auricle to create an acoustic pressure wave at an entrance of the ear canal. The system then generates a design for a cartilage conduction audio device for the user based on the one or more identified locations of the transducers at which acoustic pressure waves generated by the one or more transducers satisfy a threshold performance metric for the user. The design may then be used to fabricate the cartilage conduction audio device.

Abstract: A system generates a user hand shape model from a single depth camera. The system includes the single depth camera and a hand tracking unit. The single depth camera generates single depth image data of a user's hand. The hand tracking unit applies the single depth image data to a neural network model to generate heat maps indicating locations of hand features. The locations of hand features are used to generate a user hand shape model customized to the size and shape of the user's hand. The user hand shape model is defined by a set of principal component hand shapes defining a hand shape variation space. The limited number of principal component hand shape models reduces determination of user hand shape to a smaller number of variables, and thus provides for a fast calibration of the user hand shape model.

Abstract: A headset comprises a frame and an audio system. The audio system includes a microphone assembly positioned on the frame in a detection region, the detection region external to an ear of a user wearing the headset, and within a threshold distance from an ear canal of the ear, the microphone assembly configured to detect an audio signal emitted from an audio source, wherein the audio signal detected at the detection region is within a threshold degree of similarity of a sound pressure wave at the ear canal of the user, and an audio controller configured to determine a set of head-related transfer functions (HRTFs) based in part on the detected audio signal.

Abstract: The disclosed computer-implemented method may include accessing environment information identifying an undesired sound source within an environment. The method may further include determining, based on the accessed environment information, a spatial location of the undesired sound source in the environment that is to be attenuated using an active noise cancelling (ANC) signal. The method may also include forming a microphone beam, using two or more microphones, directed at the determined spatial location, where the microphone beam is configured to capture audio information from the determined spatial location. Still further, the method may include generating an ANC signal using the audio information captured using the microphone beam, and playing back the generated ANC signal to attenuate the undesired sound source at the determined spatial location. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A powering circuit for a diode light source includes an inductor charged through an on/off switch. The charging occurs during a charging cycle for a controllable amount of time when the on/off switch is closed. The energy of the charged inductor is used to power the semiconductor light source by opening the on/off switch. In such a driving configuration, the ringing is nearly constant and thus may be suppressed using an appropriately configured circuit.

Abstract: In some examples, a device includes a first fluidic amplifier stage, configured to receive a fluidic input and provide a first stage fluidic output, and a second fluidic amplifier stage, configured to receive the first stage fluidic output and provide a second stage fluidic output. The first fluidic amplifier stage may include a fluidic valve, for example having a source, a gate, and a drain. The fluidic input may be connected to the gate of the fluidic valve through a fluid channel, and a fluid flow between the source and the drain of the fluidic valve may be controlled by the fluidic input. An example device may be configured to provide a fluidic output, wherein the fluidic output is based on the fluidic input, and the fluidic output may be provided to a fluidic load such as an actuator.

Abstract: An audio system (e.g., of an artificial reality headset) determines a position of the headset relative to a position of a head of a user wearing the headset. The determination is based in part on an image of a portion of the head from a tracking camera (e.g., eye tracking and/or face tracking) on the headset. The audio system adjusts an acoustic parameter based in part on the determined position of the headset. The audio system performs an action that uses the adjusted acoustic parameter.