Abstract: A liquid lens with flexible transparent active layers on both sides of a fluid is transformed along two distinct deformation axes. The flexible transparent active layers include piezoelectric materials that actuate the lens in response to applied voltage(s). The piezoelectric properties and actuation mechanism of the transparent layers are arranged to deform the lens cylindrically along different axes resulting in a net spherical deformation or a combination of spherical and cylindrical deformation with substantially less distortion than spherically deforming layers. The piezoelectric active layers may be polymer or ceramic with isotropic or anisotropic mechanical stiffness. Alternatively, a pair of transparent, internal layers are positioned between the front and rear surfaces. The active layers, front and/or rear, are dual layers affixed together with an adhesive or single layers.

Abstract: Features described herein generally relate to providing spatiotemporal guidance within a 360-degree video. Particularly, while a 360-degree video is being displayed to a user, a current location of the view of the user within the 360-degree video is determined. Additionally, regions of interest may be identified within the 360-degree video, along with their location and a time in which the regions of interest are active within the 360-degree video. A visual guide is then overlaid onto the 360-degree video that indicates a current location of the view of the user, as well as locations of one or more regions of interest, as well as the time during which each region of interest is active (able to be viewed) within the 360-degree video. By viewing the visual guide, the user may be able to anticipate a location and timing of regions of interest within the 360-degree video and adjust their gaze to the correct location at the correct time to view such regions of interest.

Abstract: An eye tracking system with in-optical-assembly plane illumination is described. Side-emitting light emitting diodes (LEDs) aligned with a plane of an optical assembly of a near-eye display device are used to illuminate the eye of a user and generate glints that can be detected by an eye tracking camera. When a corrective optical lens or similar element is included in the optical assembly that may distort illumination beams from the light emitting diodes (LEDs), the distortion is mitigated by using in-package or externally modified LEDs that provide angled beams. In addition to in-package level mitigations such as reflectors or labels, edge portions of the distorting optical elements may be shaped or complemented with refractive elements to redirect the beams toward the eye.

Abstract: An automatic memory system can automatically identify and present content items that match a user's natural language (NL) input. The automatic memory system can compute a match score between the NL input and each of multiple potential memory content items. The automatic memory system can compute the match score using a variety of algorithms and/or machine learning models such as an image/NL matching process to get a first match score, a tag matching process to get a second match score, and/or a combination match score from the first and second match scores. The automatic memory system can select one or more of the content items with the highest match score(s). The automatic memory system can provide the selected content items, such as by suggesting them to the NL providing user, automatically displaying or playing them, inserting them into the conversation thread, etc.

Abstract: An example apparatus having a heterogenous memory system includes a first sensor layer, of a plurality of stacked sensor layers, including an array of pixels; and one or more semiconductor layers of the plurality of stacked sensor layers located beneath the first sensor layer, the one or more semiconductor layers configured to process pixel data output by the array of pixels, the one or more semiconductor layers including a first memory to store most significant bits (“MSBs”) of data involved in the processing of the pixel data; a second memory to store least significant bits (“LSBs”) of the data; and wherein the first memory has a lower bit error rate (“BER”) than the second memory.

Abstract: In one example, an apparatus comprises: a photodiode configured to generate a charge in response to light within an exposure period, a charge sensing unit configured to accumulate at least a part of the charge as an overflow charge, a quantizer, and a controller configured to: within a first time within the exposure period, control the quantizer to perform a first quantization operation to quantize the overflow charge accumulated at the charge sensing unit to generate a first measurement output; within a second time after the first time, and within the exposure period, control the quantizer to perform a second quantization operation to quantize the overflow charge accumulated at the charge sensing unit to generate a second measurement output; and generate a digital output to represent an intensity of the light based on at least one of the first measurement output or the second measurement output.

Abstract: The disclosed haptic feedback system may include an actuator, a supply valve coupled to the actuator, an exhaust valve, and a fluidic mass controller communicatively coupled to the supply valve and the exhaust valve. The fluidic mass controller may (1) place the exhaust valve in a state that prevents a fluid from escaping the actuator, (2) activate the supply valve to fill the actuator with an amount of the fluid, (3) determine that the actuator has filled with the amount of the fluid, and then in response to that determination, (4) deactivate the supply valve to trap the amount of the fluid in the actuator. Various other apparatuses, methods, and systems are also disclosed.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: The disclosed technology is a system and computer-implemented method for assembling and editing a video program from spoken words or soundbites. The disclosed technology imports source audio/video clips and any of multiple formats. Spoken audio is transcribed into searchable text. The text transcript is synchronized to the video track by timecode markers. Each spoken word corresponds to a timecode marker, which in turn corresponds to a video frame or frames. Using word processing operations and text editing functions, a user selects video segments by selecting corresponding transcribed text segments. By selecting text and arranging that text, a corresponding video program is assembled. The selected video segments are assembled on a timeline display in any chosen order by the user. The sequence of video segments may be reordered and edited, as desired, to produce a finished video program for export.

Abstract: Aspects of the present disclosure are directed to an artificial reality system orchestrating interactions between virtual object “augments.” The orchestration can include linking, which can be forming two or more augments into a combination, embedding an augment within an existing combination, or triggering an action mapped to the linking of those augments. Another type of orchestration can include extracting, which can refer to taking an augment out of an existing combination, either by removing it from the combination or copying the augment to leave a version in the combination and having another version outside the combination.

Abstract: Disclosed herein a system, a method and a device for selecting between a primary link and a secondary link for AR/VR applications. A console can provide a VR/AR session to a user through a head wearable display. The console can determine that a first measurement of a primary link between the console and a head wearable display is less than a first threshold. The first measurement can include a quality metric of the primary link. The console can activate a secondary link between the console and the head wearable display. The console can determine whether a second measurement of the primary link between the console and the head wearable display is less than a second threshold. The console can transition when the second measurement is less than the second threshold, traffic on the primary link to the activated secondary link.

Abstract: Methods and systems described herein are directed to a virtual web browser for providing access to multiple virtual worlds interchangeably. Browser tabs for corresponding website and virtual world pairs can be displayed along with associated controls, the selection of such controls effecting the instantiation of 3D content for the virtual worlds. One or more of the tabs can be automatically generated as a result of interactions with objects in the virtual worlds, such that travel to a world, corresponding to an object to which an interaction was directed, is facilitated.

Abstract: In one example, an apparatus comprises: a photodiode configured to generate charge in response to incident light within an exposure period; and a quantizer configured to perform at least one of a first quantization operation to generate a first digital output or a second quantization to generate a second digital output, and output, based on a range of an intensity of the incident light, one of the first digital output or the second digital output to represent the intensity of the incident light. The first quantization operation comprises quantizing at least a first part of the charge during the exposure period to generate the first digital output. The second quantization operation comprises quantizing at least a second part of the charge after the exposure period to generate the second digital output.

Abstract: An apparatus, system, and method for an imaging system that may be used to support eye tracking in a head mounted display. The imaging system may include an image sensor positioned in a user's field of view and within a lens assembly to capture light that is reflected from an eye. The imaging system may include two optical elements that are configured to at least partially direct scene light around the image sensor to conceal the image sensor from the user's eye. The image sensor is positioned between the two optical elements within the lens assembly.

Abstract: The present disclosure pertains to techniques for reducing inaccuracies in context aware policies (CAP) with real-time feedforward validation in extended reality environments. In a particular aspect, a extended reality system is configured to author, by a user using the head-mounted device, a rule or policy or context aware policy (CAP) including one or more target actions and triggering context instances, capture, using one or more sensors, context history records for the user, render, by the head-mounted device, one or more validation scenes based on the rule or policy or CAP and the context history records, validate, by the user using the head-mounted device, the one or more validation scenes within an extended reality environment, and update, by the user using the head-mounted device, the rule or policy or CAP based on the validation.

Abstract: An Adaptive Tangible User Interface (ATUI) for use in an extended reality environment in which tangible interfaces are composed in real time based on identified affordances of existing objects in the physical environment and the input tasks of a user. An extended reality system can be provided with instructions executable by one or more processors to perform processing including: generating a representation of the real-world environment within a field of view of the user; identifying physical objects within the real-world environment; generating a set of possible performable gestures afforded by available object affordance factors; determining potential input tasks; composing performable gestures for the potential input tasks; and selecting a physical object for use as an adaptive tangible user interface. Techniques for designing a virtual user interface, overlaying the virtual user interface on a selected ATUI physical object, and maintaining alignment of the virtual user interface, are also provided.

Abstract: The disclosed devices may include a driver circuit including a voltage boost circuit, a pulse modulation controller, and optionally a headroom processor. The voltage boost circuit may be configured to receive a device input voltage (such as a battery voltage) and generate a backlight drive voltage. The pulse modulation controller may be configured to provide a pulse modulation signal to the voltage boost circuit, and may include a digital circuit or an analog circuit. Example devices may include a backlight unit receiving the backlight voltage. The optional headroom processor may provide a headroom signal to the pulse modulation controller based on a headroom voltage determined from the backlight unit. Devices may further include a backlight unit including an arrangement of light-emissive elements, and may include display devices such as head-mounted devices. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A depth camera assembly (DCA) includes a light generator emitting a beam of light into a local area and a detector. The detector captures light from the beam reflected by objects in the local area to a portion of an array of pixels that each include a single photon avalanche diode (SPAD). The location of the portion of the array is based in part on the angle of the beam emitted from the projector. The DCA identifies a set of pixels of the array corresponding to the portion and selectively retrieves current generated from the reflected light by the pixels in the portion of the array without retrieving current generated by pixels in other portions of the array.

Abstract: Embodiments relate to tracking and determining a location of an object in an environment surrounding a user. A system includes one or more imaging devices and an object tracking unit. The system identifies an object in a search region, determines a tracking region that is smaller than the search region corresponding to the object, and scans the tracking region to determine a location associated with the object. The system may generate a ranking of objects, determine locations associated with the objects, and generate a model of the search region based on the locations associated with the objects.

Abstract: Wearable devices having a primary and secondary power source are disclosed, wherein the secondary power sources are located in links of a band portion of the wearable device and the secondary power sources provide a secondary source of power beyond that provided by the primary power source. One exemplary wrist-wearable device includes a centralized processor pod having a primary power source, a wireless communication radio, and one or more sensors. The exemplary wrist-wearable device further includes a band with a plurality of links. Each of the plurality of links can include a secondary power source. The exemplary wrist-wearable device further includes communicative pathways that can be configured to convey at least power and data between the links and centralized processor pod. The communicative pathways can be configured to convey power from the secondary sources of power to the centralized processor pod beyond the power provided by the primary power source.