Abstract: Systems, methods, and non-transitory computer-readable media can determine one or more graphical overlays to be applied to at least one object represented in a media content item; determine that a depth of the object as represented in one or more frames of the media content item satisfies a first threshold depth; and augment a representation of the object based at least in part on a first graphical overlay that corresponds to the first threshold depth.

Abstract: A computer-implemented method may include maintaining, within a local memory device (LMD) in a hardware accelerator (1) a filter matrix that may include a set of filter vectors corresponding to a filter location in each of a set of filters of a convolutional layer of an artificial neural network, and (2) an activation matrix that may include a primary and a secondary set of activation vectors, each activation vector included in an activation volume. The method may also include (1) directing a matrix multiplication unit (MMU) in the hardware accelerator to execute a matrix multiplication operation (MMO) using the filter matrix and the activation matrix, (2) replacing (i) the filter matrix with an additional filter matrix, and (ii) the secondary set of activation vectors with an additional set of activation vectors, and (3) directing the MMU to execute an additional MMO using the additional filter matrix and the activation matrix.

Abstract: In general, this disclosure describes a suspend mode feature for artificial reality systems and, more specifically, system configurations and techniques for generating a suspend mode environment during execution of an artificial reality application, and presenting and controlling user interface (UI) elements within the suspend mode environment. The suspend mode feature enables a user interacting with one or more other users (or one or more avatars corresponding to the one or more other users) within an artificial reality (AR) environment to suspend the AR environment from the user's perspective. While in the suspend mode environment, the user is able to view and select the other users from the AR environment. For example, the user may select another user to friend, message, mute, block, or report that user from the suspend mode environment.

Abstract: Systems, methods, and non-transitory computer readable media can obtain a user interface (UI) component of a production system, wherein the UI component is associated with one or more properties. Each of the one or more properties can be mapped to a graphical user interface (GUI) element for display in a user interface of a design application. A value of a property of the one or more properties can be set based on user input from a GUI element associated with the property. A rendering of the UI component can presented in the user interface based on the set value of the property.

Abstract: Systems, methods, and non-transitory computer-readable media can receive a query that includes at least one operation for aggregating data stored in one or more database tables. A determination is made that at least a portion of the data being aggregated by the operation has been pre-computed. The query is optimized so that the operation uses the pre-computed data when executed.

Abstract: Determination of a set of acoustic parameters for a headset is presented herein. The set of acoustic parameters can be determined based on a virtual model of physical locations stored at a mapping server. The virtual model describes a plurality of spaces and acoustic properties of those spaces, wherein the location in the virtual model corresponds to a physical location of the headset. A location in the virtual model for the headset is determined based on information describing at least a portion of the local area received from the headset. The set of acoustic parameters associated with the physical location of the headset is determined based in part on the determined location in the virtual model and any acoustic parameters associated with the determined location. The headset presents audio content using the set of acoustic parameters received from the mapping server.

Abstract: A disclosed apparatus may include a line source configured to produce a line of light and a scanning device configured to scan the line of light across a scanning field in a scanning direction. The scanning field may include a receiving portion configured to receive an eye. The apparatus may also include a reflector positioned within the scanning field. During a primary period of a scan, the line of light may scan the receiving portion in a primary direction. During a secondary period of the scan, the reflector may reflect the line of light such that a reflection of the line of light scans the receiving portion in a secondary direction. The apparatus may also include a photodetector positioned to receive (1) an initial reflection during the primary period, and (2) a subsequent reflection during the secondary period. Various other methods, apparatuses, and computer-readable media are also disclosed.

Abstract: An optical device for providing illumination light includes an optical waveguide and a plurality of polarization selective elements. The plurality of polarization selective elements is disposed adjacent to the optical waveguide so that a respective polarization selective element receives light in a first direction, and redirects a first portion of the light in a second direction. A second portion, distinct from the first portion, of the light undergoes total internal reflection, thereby continuing to propagate inside the optical waveguide.

Abstract: In one embodiment, a computing system may access a dead pixel position corresponding to a dead pixel of a display. The system may access an image and modify the image by applying a mask to a pixel region of the image containing a particular pixel value with a position that corresponds to the dead pixel position. The mask may include an array of first scaling factors for scaling pixels values in the pixel region. The array of first scaling factors may be configured to brighten one or more of the pixel values surrounding the particular pixel value. The system may cause the modified image to be output by the display.

Abstract: In one embodiment, a method includes receiving a request to create a data pipeline by an operating system executing on a computing device. The operating system allocates a shared virtual memory region for the data pipeline. The shared virtual memory region is mapped to a first virtual address space of a first process and a second virtual address space of a second process. The mapping enables the first process and the second process to share data through the shared virtual memory region. Membership information associated with the data pipeline is updated to include the first process and the second process. An access request for accessing the shared virtual memory region is received from the first process, and the access request is granted or denied based on one or more protection policies.

Abstract: A device, such as an electroactive device, may include primary electrode and a secondary electrode overlapping at least a portion of the primary electrode. An electroactive polymer element may include a composite polymer material and is disposed between and abuts each of the primary electrode and the secondary electrode. A phase change or other deformable medium such as a liquid, a gas, or a liquid-gas mixture may be disposed as inclusions within the polymer material. The device can be actuated by the application of a voltage between the electrodes and the attendant formation of a Maxwell stress, exposing the deformable medium to a source of radiation, changing a pressure of the deformable medium, or changing a temperature of the deformable medium, e.g., about a phase transformation temperature of the phase change medium.

Abstract: The disclosed apparatus may include a waveguide configuration that may include (1) a coupling area having at least one coupling element configured to receive a plurality of monochromatic images, where each of the monochromatic images is of a predetermined wavelength of light, (2) a propagation area in which light, received via the at least one coupling element, moves within a length of the waveguide configuration, and (3) a decoupling area that extends along the propagation area and includes decoupling elements that project a polychromatic image toward an eyebox, where the polychromatic image includes the monochromatic images of the predetermined wavelengths of light. Associated systems and devices are also provided herein.

Abstract: A head-mounted display device for providing augmented reality contents to a wearer includes an eye tracker, a light projector, a beam steerer and a combiner. The eye tracker is configured to determine a position of a pupil of an eye of the wearer. The light projector is configured to project light for rendering images. The beam steerer is configured to change a direction of the light from the light projector based on the position of the pupil. The combiner is configured to combine the light from the light projector and light from an outside of the head-mounted display device for providing an overlap of the rendered image and a real image that corresponds to the light from the outside of the head-mounted display device.

Abstract: The disclosed eye-tracking systems may include a visible light display having visible light pixels, at least one infrared pixel positioned within bounds of the visible light display, and an infrared sensor positioned and configured to detect infrared light originating from the at least one infrared pixel and reflected from an eye of the user. Related head-mounted display systems and methods for eye tracking are also disclosed.

Abstract: The present disclosure is directed toward systems and methods for providing a live poll with a video presentation. In particular, the systems and methods described herein provide a video stream received from a broadcaster client device to one or more viewer client devices. Additionally, the systems and methods described herein provide a live poll to the one or more viewer client devices together with the video stream. The systems and methods receive poll responses from the one or more viewer client devices, compile poll results based on the received responses, and provide the poll responses to the broadcaster client device and the one or more viewer client devices.

Abstract: Disclosed herein includes a system, a method, and a non-transitory computer readable medium for rendering a three-dimensional (3D) model of an avatar according to an audio stream including a vocal output of a person and image data capturing a face of the person. In one aspect, phonemes of the vocal output are predicted according to the audio stream, and the predicted phonemes of the vocal output are translated into visemes. In one aspect, a plurality of blendshapes and corresponding weights are determined, according to the corresponding image data of the face, to form the 3D model of the avatar of the person. The visemes may be combined with the 3D model of the avatar to form a 3D representation of the avatar, by synchronizing the visemes with the 3D model of the avatar in time.

Abstract: Instructions to be executed by a processing unit that is configured to handle a predefined instruction set are prefetched. A set of instructions in the prefetched instructions to be combined as a macro instruction to be executed by a reconfigurable logic unit is identified. The macro instruction is issued to the reconfigurable logic unit rather than issuing the identified set of instructions to the processing unit.

Abstract: A waveguide display includes a source assembly, an output waveguide, and a controller. The source assembly includes a light source and an optics system. The light source includes source elements arranged in a 1D or 2D array that emit image light. The optics system includes a scanning mirror assembly that scans the image light to particular locations based on scanning instructions. The output waveguide receives the scanned image light from the scanning mirror assembly and outputs an expanded image light. In some embodiments, the waveguide display includes a source waveguide and the 1D array of source elements. The source waveguide receives a conditioned image light from the source assembly. The controller generates the scanning instructions and provides the scanning instructions to the scanning mirror assembly. In some embodiments, the controller provides the scanning instructions to an actuator assembly of the source waveguide.

Abstract: Particular embodiments described herein present a technique for mesh simplification. A computing system may receive a request to render an image of a virtual scene including a virtual object. The system may determine one or more positions of the virtual object relative to one or more of a foveal focus point or a lens, respectively. The system may determine a screen coverage size of the virtual object. The system may then determine a simplification level for the virtual object based on the determined position(s) and the screen coverage size of the virtual object. The system may generate a mesh representation of the virtual object based on the determined simplification level, where the number of polygons used in the mesh representation depends on the determined simplification level. The system may render the image of the virtual scene using at least the generated mesh representation of the virtual object.