Abstract: Examples of an apparatus are disclosed. In some example, an apparatus may include an array of digital pixel cells, each digital pixel cell including a photodiode and a memory device to store a digital output generated based on charge generated by the photodiode in an exposure period. The apparatus may also include an image processor configured to: receive first digital outputs from the memory devices of a first set of digital pixel cells of the array of digital pixel cells; determine, from the first set of digital pixel cells, a second set of digital pixel cells of which the first digital outputs satisfy one or more pre-determined conditions; identify, based on the second set of digital pixel cells, a third set of digital pixel cells; receive the second digital outputs generated by the third set of digital pixel cells; and perform image processing operations based on the second digital outputs.

Abstract: A fluidic valve may include an inlet, a control port, an additional control port, an outlet, a fluid channel configured to convey fluid from the inlet to the outlet, and a piston that includes (1) a restricting gate transmission element configured to block, when the piston is in a first position, the fluid channel and unblock, when the piston is in a second position, the fluid channel, (2) a controlling gate transmission element configured to interface with a control pressure from the control port that forces the piston towards the first position when applied to the controlling gate transmission element, and (3) an additional controlling gate transmission element configured to interface with an additional control pressure from the additional control port that forces the piston towards the second position when applied to the additional controlling gate transmission element. Various other related devices, systems, and methods are also disclosed.

Abstract: In one embodiment, a computing system may determine that a target grayscale value for a frame falls within a predetermined grayscale range. The system may compute, based on the target grayscale value, barycentric weights for a predetermined barycentric coordinate system associated with vertices that each represents a subframe combination of zero or more subframe identifiers. The system select, using the barycentric weights and threshold values associated with respective dots in a dithering mask, a set of non-overlapping dot patterns from the dithering mask corresponding to the vertices of the barycentric coordinate system. The dots in the dithering mask may satisfy a spatial stacking constraint. The system may generate subframes to represent the frame based on the set of non-overlapping dot patterns and the subframe combination represented by each of the vertices.

Abstract: A display operates a plurality of light emitters using pulse width modulations (PWM). Pixel data for a pixel location may be separated into a first subset of bits and a second subset of bits. The display device turns on first light emitters for first PWM turn-on times in accordance with the first subset of bits within a PWM cycle. The display device turns on second light emitters for PWM on time second PWM turn-on times in accordance with the second subset of bits within the PWM cycle. The current level that drives the first emitters may remain constant during the first turn-on times but may be higher than the current level that drives the second emitters. The first emitters may generate light in accordance with the most significant bits of pixel data while the second emitters may generate light in accordance with the least significant bits of the pixel data.

Abstract: A waveguide display includes light sources, a source waveguide, an output waveguide, and a controller. Light from each of the light sources is coupled into the source waveguide. The source waveguide includes gratings with a constant period determined based on the conditions for total internal reflection and first order diffraction of the received image light. The emitted image light is coupled into the output waveguide at several entrance locations. The output waveguide outputs expanded image lights at a location offset from the entrance location, and the location/direction of the emitted expanded image light is based in part on the orientation of the light sources. Each of the expanded image light is associated with a field of view of the expanded image light emitted by the output waveguide.

Abstract: An image generator is configured to generate display light. A first waveguide is configured to generate wide-field image light from a first portion of the display light. A first outcoupling element of the first waveguide extends to a boundary of the frame to provide the wide-field display to substantially all of the augmented FOV of the user. A second waveguide is configured to generate inset image light from a second portion of the display light received from the image generator.

Abstract: Adjusted overlaid images are generated in response to at least one color reference object or color reference point.

Abstract: Example methods include depositing a precursor layer onto a substrate where the precursor layer includes droplets comprising a polymerizable material, inducing a phase inversion in the precursor layer to obtain a modified precursor layer including droplets of a non-polymerizable liquid within a polymerizable liquid mixture, and polymerizing the polymerizable liquid mixture to obtain a nanovoided polymer element. Examples include devices fabricated using nanovoided polymer elements fabricated using such methods, including electroactive devices such as actuators and sensors.

Abstract: Arrangements for improving neuromuscular recording electrode contact with a body surface are described. According to some aspects, a sensor assembly may include a housing and one or more electrodes that are moveable relative to the housing. The electrodes may rotate and/or translate relative to the housing and/or have at least two degrees of freedom relative to the housing. The sensor may include a spring element that stores potential energy and biases the electrodes toward a starting position in which the electrodes extend at least partially out of the sensor housing. In some embodiments, application of a contact force to one or more of the electrodes of the sensor compresses the spring element, causing the spring element to store potential energy.

Abstract: The disclosed optical lens assemblies may include a structural support element, a deformable element coupled to the structural support element, and a deformable medium positioned between the deformable element and the structural support element. The deformable element may include a base element that, when deformed, alters an optical property of the optical lens assembly. The deformable element may have a non-uniform stiffness. Related methods of fabricating an optical lens assembly are also disclosed.

Abstract: A system is describes that includes a head mounted display (HMD) and a portable docking station configured to receive the HMD for calibration of one or more components of the HMD. The portable docking station includes at least one calibration target, e.g., a checkerboard pattern and/or a convex reflector. Techniques of this disclosure include calibrating an image capture device of the HMD based on one or more images of the calibration target captured by the image capture device when the HMD is placed in the portable docking station. The disclosed techniques may be applied to calibrate multiple different components of the HMD, including image capture devices such as eye-tracking cameras and inside-out cameras, displays, illuminators, sensors, and the like. In some examples, a rechargeable battery of the HMD may be charged when the HMD is placed in the portable docking station.

Abstract: An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. The artificial reality system includes an image capture device, a head-mounted display (HMD), a gesture detector, a user interface (UI) engine, and a rendering engine. The image capture device captures image data representative of a physical environment. The HMD outputs artificial reality content. The gesture detector identifies, from the image data, a gesture including a configuration of a hand that is substantially stationary for at least a threshold period of time and positioned such that an index finger and a thumb of the hand form approximately a right angle. The UI engine generates a UI element in response to the identified gesture. The rendering engine renders the UI element as an overlay to the artificial reality content.

Abstract: The disclosed computer-implemented method may include receiving, from devices in an environment, real-time data associated with the environment and determining, from the real-time data, current object data for the environment. The current object data may include both state data and relationship data for objects in the environment. The method may also include determining object deltas between the current object data and prior object data from an event graph. The prior object data may include prior state data and prior relationship data for the objects. The method may include detecting an unknown state for one of the objects, inferring a state for the object based on the event graph, and updating the event graph based on the object deltas and the inferred state. The method may further include sending updated event graph data to the devices. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A head-mounted-display includes an electronic display emitting image light and a varifocal block receiving the image light and outputting the image light in at least one of the focal planes of the varifocal block. The varifocal block includes a back optical element, a front optical element, and an actuator assembly coupled to the back and front optical element. The front optical element is positioned closer to an exit pupil than the back optical element, and separated from the back optical element by an adjustable distance, the magnitude of which determines in which of the focal planes the image light is presented. The actuator assembly simultaneously adjusts positions of the back optical element and the front optical element to vary the adjustable distance between the back optical element and the front optical element in accordance with an estimated vergence depth of the user.

Abstract: A head mounted display (HMD) includes a set of one or more lenses defining an optical axis, a display configured to project light through the set of the one or more lenses, a voice coil actuator coupled with the display and configured to move the display along the optical axis, and a first guide that is separate from the first voice coil actuator and coupled with the first display to guide the movement of the first display. The HMD additionally includes a set of one or more position sensors configured to determine a position of the display long the optical axis and an electronic controller configured to receive information identifying a reference position of the display along the optical axis and generate one or more electrical signals for initiating a movement of the first display toward the first reference point along the optical axis.

Abstract: The disclosed artificial reality hat may include a crown portion dimensioned to at least partially cover a head of a user, a brim portion that extends from the crown portion in at least a forward direction away from the crown portion, and a display subsystem, coupled to the brim portion, that is configured to present computer-generated images. Various other systems and methods are also disclosed.

Abstract: This disclosure describes systems on a chip (SOCs) that prevent side channel attacks (SCAs). An example SoC includes an encryption engine, a key store, and a security processor. The key store is configured to store a plurality of encryption keys. The encryption engine is configured to encrypt transmit (Tx) channel data using any encryption key of the plurality of encryption keys stored to the key store. The security processor is configured to activate SCA mitigation logic of the SoC based on a determination that the encryption engine encrypts the Tx channel data using a strong key selected from the plurality of encryption keys stored to the key store, and to operate the SCA mitigation logic in a deactivated state based on a determination that the encryption engine encrypts the Tx channel data using a weak key selected from the plurality of encryption keys stored to the key store.

Abstract: This disclosure describes an artificial reality system that presents artificial reality content in the context of a physical environment that includes a mirror or other reflective surface. In one example, this disclosure describes a method that includes capturing capture data representative of a physical environment, wherein the physical environment includes a reflective surface and a plurality of objects, determining a pose of the HMD, determining a map of the physical environment, wherein the map includes position information about the reflective surface and position information about each of the plurality of physical objects in the physical environment, identifying a visible object from among the plurality of physical objects, and generating artificial reality content associated with the visible object.

Abstract: The disclosed head-mounted display system may include (1) a display for displaying computer-generated imagery, (2) a lens, (3) a peripheral wall extending from a back end to a front end, with the back end coupled to the lens and the front end coupled to the display such that the lens, the peripheral wall, and the display together define an enclosure, and (4) a speaker housed by the enclosure. Various other systems and methods of assembling the same are also disclosed.

Abstract: Systems and methods for using neuromuscular information to improve speech recognition. The system includes a plurality of neuromuscular sensors, arranged on one or more wearable devices, wherein the plurality of neuromuscular sensors is configured to continuously record a plurality of neuromuscular signals from a user, at least one storage device configured to store one or more trained statistical models, and at least one computer processor programmed to provide as an input to the one or more trained statistical models, the plurality of neuromuscular signals or signals derived from the plurality of neuromuscular signals, determine based, at least in part, on an output of the one or more trained statistical models, at least one instruction for modifying an operation of a speech recognizer, and provide the at least one instruction to the speech recognizer.