Abstract: A system for generating individualized HRTFs that are customized to a user of a headset. The system includes a server and an audio system. The server determines the individualized HRTFs based in part on acoustic features data (e.g., image data, anthropometric features, etc.) of the user and a template HRTF. The server provides the individualized HRTFs to the audio system. The audio system presents spatialized audio content to the user using the individualized HRTFs.

Abstract: An optical profiling system characterizes distortion of a head-mounted display (HMD) under test. The optical profiling system includes a camera assembly and a controller. The controller provides presenting instructions that cause the HMD under test to present test patterns and also provides imaging instructions that cause the camera assembly to capture images of the test patterns presented by the HMD under test. The camera assembly includes one or more characterization cameras. A characterization camera is configured to mimic movement of a human eye and is positioned in an eye box region of the HMD under test. Using the images captured by the camera assembly, the controller measures distortion of the HMD under test. The controller may generate a report charactering the HMD under test based on the measured distortion.

Abstract: In one embodiment, a method includes receiving a user request from a first user from a client system associated with a first user, wherein the user request comprise a gesture-input from the first user and a speech-input from the first user, determining an intent corresponding to the user request based on the gesture-input by a personalized gesture-classification model associated with the first user, executing one or more tasks based on the determined intent and the speech-input, and sending instructions for presenting execution results of the one or more tasks to the client system responsive the user request.

Abstract: A wearable device comprises one or more deformable signaling pathways wherein each deformable signaling pathway is configured to enable an electrical connection between two devices electrically connected to each other via the deformable signaling pathway. Deformable signaling pathways enable the conduction of electrical signals between various circuit elements similar to one or more circuit elements such as electronic traces or wires. A deformable signaling pathway includes one or more conductive elements surrounded by a conductive gel. Both the conductive gel and the one or more conductive elements are encased in an elastomeric shell. The elastomeric shell is attached to terminals (e.g., one on either end). The one or more connectors are attached to one another such that the one or more connectors span the length of the elastomeric shell and form a low resistance contact between the terminals of the deformable signaling pathway.

Abstract: An apparatus is provided. The apparatus includes a semiconductor substrate including a first photodiode to generate a first charge, a second photodiode to generate a second charge, a barrier layer between the first photodiode and the second photodiode, wherein the first photodiode, the barrier layer, and the second photodiode form a stack. The apparatus further includes a floating drain and one or more gates including: a first gate portion on the semiconductor substrate and a second gate portion extending from the front side surface through the first photodiode and reaching the barrier layer. The first gate portion is configured to conduct a first signal to control flow of charge from the first photodiode to the floating drain, and the second gate portion is configured to conduct a second signal to control the barrier layer to control the flow of the second charge.

Abstract: An audio-video correspondence system performs a correspondence analysis between audio and video content. The system obtains video content that includes audio content, the video content comprising a plurality of frames. The system identifies a first set of pixels within the video content associated with changes in pixel values over a first set of frames of the video content. The system subsequently identifies, from the audio content, first audio associated with the first set of frames corresponding to changes in pixel values of the first set of pixels. The system finally assigns the first audio over the first set of frames to the first set of pixels.

Abstract: A suspension component may be used within a system for isolating vibrations produced by an electrical component. A body of the suspension component may be formed from a single piece of planar material. A suspension component includes a plurality of flexures. The plurality of flexures includes a first set of flexures configured to suspend a first sub-assembly of a transducer from support brackets, a second set of flexures configured to suspend a second sub-assembly of the transducer from the first sub-assembly, and a third set of flexures configured to suspend the second sub-assembly from the support brackets.

Abstract: The disclosed handheld controllers may include a multi-degree of freedom sensor module, a mouse module, and a switch. The mouse module may include a mouse sensor and a proximity sensor. The switch may be configured to activate the mouse sensor and deactivate the multi-degree of freedom sensor module when the proximity sensor indicates that the mouse sensor is proximate to a physical surface and to deactivate the mouse sensor and activate the multi-degree of freedom sensor when the proximity sensor indicates that the mouse sensor is not proximate to the physical surface. Various other related methods, systems, and devices are also disclosed.

Abstract: The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Abstract: Methods, Apparatus, and Systems are discussed for a sequencer-based protocol adapter that executes a limited instruction set. The sequencer-based protocol adapter is implemented in electronic hardware and programmable registers in an integrated circuit and configured to transition a set of 1) one or more voltage sources, 2) one or more frequency sources, or 3) a combination of voltage sources and frequency sources, coupled with that sequencer-based protocol adapter. The sequencer-based protocol adapter manages power on the integrated circuit, via receiving a desired performance index at an input and then executing one or more of the limited instructions stored in the programmable registers in a proper sequence of steps in order to transition the coupled voltage sources and/or frequency sources from a current operational state to a desired operational state. Note, the desired operational state the coupled voltage sources and/or frequency sources corresponds to the received desired performance index.

Abstract: A head-mounted display device for providing images to a wearer includes a focus-supporting light projector and a beam steerer. The focus-supporting light projector is configured to project light for rendering images based at least on virtual reality contents and/or augmented reality contents. The light projected from the focus-supporting light projector corresponds to an image plane that is selected based at least in part on a position of a pupil of an eye of the wearer. The beam steerer is configured to change a path of the light projected from the focus-supporting light projector based on the position of the pupil of the eye of the wearer.

Abstract: In one embodiment, a method includes rendering, for one or more displays of a VR device, a first output image of a VR environment based on a user's field of view. The VR environment has a virtual boundary corresponding to a real-world environment. The method further includes determining whether the user is approaching a threshold distance of the virtual boundary and determines the user's direction of movement and field of view, accessing one or more images of the real-world environment captured by one or more cameras of the VR device, and rendering a second output image comprising a portion of the VR environment and a portion of a passthrough view of the real-world environment based on the accessed images. The portion of the passthrough view is based on the determined direction of movement and the field of view of the user.

Abstract: The present embodiments relate to generating 3D objects in an artificial reality environment and collapsing 3D objects into 2D images representing the 3D objects. Users operating extra reality (XR) devices controlling the artificial reality environment can collaboratively create or modify content in the artificial reality environment, using real-world creation objects (such as a hand of the user or a pen held by the user) to create 3D objects. In response to a user triggering a collapse for a 3D object, a 2D image of the 3D object can created, from the user's perspective. The 2D image can replace the 3D object in the artificial reality environment. Presenting the 2D image can reduce the amount of data, processing resources, and power needed to provide the artificial reality environment while also reducing clutter and cognitive load on the user.

Abstract: A form birefringent optical element includes a structured layer and a dielectric environment disposed over the structured layer. At least one of the structured layer and the dielectric environment includes a nanovoided polymer, the nanovoided polymer having a first refractive index in an unactuated state and a second refractive index different than the first refractive index in an actuated state. Actuation of the nanovoided polymer can be used to reversibly control the form birefringence of the optical element. Various other apparatuses, systems, materials, and methods are also disclosed.

Abstract: A waveguide assembly is provided. The waveguide assembly includes a pair of pupil-replicating waveguides. The first pupil-replicating waveguide is configured for receiving an input beam of image light and providing an intermediate beam comprising multiple offset portions of the input beam. The second pupil-replicating waveguide is configured for receiving the intermediate beam from the first pupil-replicating waveguide and providing an output beam comprising multiple offset portions of the intermediate beam. The input beam may be expanded by the waveguide assembly in such a manner that pupil gaps are reduced or eliminated.

Abstract: A Pancharatnam Berry Phase (PBP) color corrected structure is presented that comprises a plurality of switchable gratings and a plurality of PBP active elements. Each switchable grating has an inactive mode when reflects light of a specific color channel, of a set of color channels, and transmits light of other color channels in the set of color channels, wherein the specific color channel is different for each of the plurality of switchable gratings, and to have an active mode to transmit light that is inclusive of the set of color channels. The PBP active elements receive light output from at least one of the plurality of switchable gratings. Each of the PBP active elements is configured to adjust light of a different color channel of the set of color channels by a same amount to output light corrected for chromatic aberration for the set of color channels.

Abstract: A diffraction grating includes a substrate and an array of triangular ridges extending from the substrate. The ridges run parallel to one another and have triangular cross-sections such that first sides of the ridges face in a first direction and adjacent second sides of the ridges face in a second, different direction. An array of grating lines is disposed over the first sides of the array of ridges, each grating line of the array of grating lines comprising a slab of transparent material supported by the first side of a corresponding ridge of the array of ridges. A refractive index of the array of grating lines is different from a refractive index of the array of ridges.

Abstract: Embodiments herein address these and other issues by providing a display assembly system with a pick-up tool having 6 degrees of freedom (6DOF) coupled with a pick-up head having an at least partially transparent adhesive element to which light-emitting structures may be adhered for picking and placement during the display manufacture process. Embodiments further include a touchdown sensor coupled with the pick-up tool and pick-up head that allow sensing of a force applied to the pick-up head in an upward direction.

Abstract: This disclosure describes transcribing speech using audio, image, and other data. A system is described that includes an audio capture system configured to capture audio data associated with a plurality of speakers, an image capture system configured to capture images of one or more of the plurality of speakers, and a speech processing engine. The speech processing engine may be configured to recognize a plurality of speech segments in the audio data, identify, for each speech segment of the plurality of speech segments and based on the images, a speaker associated with the speech segment, transcribe each of the plurality of speech segments to produce a transcription of the plurality of speech segments including, for each speech segment in the plurality of speech segments, an indication of the speaker associated with the speech segment, and analyze the transcription to produce additional data derived from the transcription.

Abstract: A surface-relief structure and techniques for fabricating the surface-relief structure are disclosed. The surface-relief structure includes a substrate, a plurality of ridges on the substrate, and a plurality of grooves each between two adjacent ridges. The plurality of ridges are slanted with respect to the substrate, and include a material having a refractive index at least 2.3. Regions of the substrate at bottoms of the plurality of grooves include at least one of hydrogen or nitrogen at a concentration of at least 1010/cm3.