Abstract: In one embodiment, a computing device may determine a virtual content to be displayed with a scene of a real-world environment. The device may generate an image depicting the virtual content. Using one or more sensors, the device may detect characteristics of the scene of the real-world environment. Based on the image and the characteristics of the scene, the device may determine that a visual enhancement is to be applied to the virtual content depicted in the image to enhance a contrast between the depicted virtual content and the scene. The device may generate a visually-enhanced image depicting the virtual content by applying the visual enhancement to the virtual content depicted in the image. The device may display the visually-enhanced image of the virtual content on a display of the computing device, wherein the scene of the real-world environment is visible through the display.

Abstract: In one embodiment, a computing system may capture a first grayscale image using a first camera at a first camera pose and a second grayscale image using a second camera at a second camera pose. The computing system may capture a reference color image using an RGB camera at a third camera pose. The computing system may generate, using a colorization machine-learning model, a first color image with a same camera pose as the first camera pose based on the reference color image and the first grayscale image. The computing system may generate, using the colorization machine-learning model, a second color image with a same camera pose as the second camera pose based on the reference color image, the second grayscale image, and the first color image.

Abstract: In one embodiment, a computing device may determine a virtual content to be displayed with a scene of a real-world environment. The device may generate an image depicting the virtual content. Using one or more sensors, the device may detect characteristics of the scene of the real-world environment. Based on the image and the characteristics of the scene, the device may determine that a visual enhancement is to be applied to the virtual content depicted in the image to enhance a contrast between the depicted virtual content and the scene. The device may generate a visually-enhanced image depicting the virtual content by applying the visual enhancement to the virtual content depicted in the image. The device may display the visually-enhanced image of the virtual content on a display of the computing device, wherein the scene of the real-world environment is visible through the display.

Abstract: In one embodiment, a computing system may determine, a predicted eye position of a viewer corresponding to a future time moment for displaying a frame. The system may generate a first correction map for the frame based on the predicted eye position of the viewer. The system may retrieve one or more second correction maps used for correcting one or more proceeding frames. The system may generate a third correction map based on the first correction map generated based on the predicted eye position of the viewer and the one or more second correction maps used for correcting the one or more proceeding frames. The system may adjust pixel values of the frame based at least on the third correction map. The system may output the frame with the adjusted pixel values to a display.

Abstract: In one embodiment, a computing system may determine, a predicted eye position of a viewer corresponding to a future time moment for displaying a frame. The system may generate a first correction map for the frame based on the predicted eye position of the viewer. The system may retrieve one or more second correction maps used for correcting one or more proceeding frames. The system may generate a third correction map based on the first correction map generated based on the predicted eye position of the viewer and the one or more second correction maps used for correcting the one or more proceeding frames. The system may adjust pixel values of the frame based at least on the third correction map. The system may output the frame with the adjusted pixel values to a display.

Abstract: In one embodiment, a computing system may determine, a predicted eye position of a viewer corresponding to a future time moment for displaying a frame. The system may generate a first correction map for the frame based on the predicted eye position of the viewer. The system may retrieve one or more second correction maps used for correcting one or more proceeding frames. The system may generate a third correction map based on the first correction map generated based on the predicted eye position of the viewer and the one or more second correction maps used for correcting the one or more proceeding frames. The system may adjust pixel values of the frame based at least on the third correction map. The system may output the frame with the adjusted pixel values to a display.

Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Abstract: In one embodiment, a method includes projecting a source image onto a surface using a lens approximation component, where the surface is associated with sampling points approximating photoreceptors of an eye, where each sampling point has a corresponding photoreceptor type, sampling color information from the projected source image at the sampling points, where the color information sampled at each sampling point depends on the corresponding photoreceptor type, accessing pooling units approximating retinal ganglion cells (RGCs) of the eye, where each pooling unit is associated with groups of one or more of the sampling points, calculating weighted aggregations of the sampled color information associated with the groups of one or more sampling points associated with each pooling unit, and computing a perception profile for the source image based on the weighted aggregations associated with each of the pooling units.

Abstract: Adjusted overlaid images are generated in response to at least one color reference object or color reference point. A display is driven to present the adjusted overlaid image.

Abstract: In one embodiment, a computing device may determine a virtual content to be displayed with a scene of a real-world environment. The device may generate an image depicting the virtual content. Using one or more sensors, the device may detect characteristics of the scene of the real-world environment. Based on the image and the characteristics of the scene, the device may determine that a visual enhancement is to be applied to the virtual content depicted in the image to enhance a contrast between the depicted virtual content and the scene. The device may generate a visually-enhanced image depicting the virtual content by applying the visual enhancement to the virtual content depicted in the image. The device may display the visually-enhanced image of the virtual content on a display of the computing device, wherein the scene of the real-world environment is visible through the display.

Abstract: In one embodiment, a computing system may determine, for a current frame to be displayed and using an eye tracking system, a current eye position of a viewer. The system may determine a first array of scaling factors based on the determined current eye position of the viewer. The system may retrieve one or more second arrays of scaling factors used for correcting one or more proceeding frames of the current frame. The system may determine a third array of scaling factors based on the first array of scaling factors determined based on the current eye position and the one or more second arrays of scaling factors used for correcting the proceeding frames. The system may adjust pixel values of the current frame based at least on the third array of scaling factors. The system may output the current frame with the adjusted pixel values to a display.

Abstract: One embodiment is directed to controlling a computing system based on an interpreted user intention. Another embodiment is directed to generating a smoothed position of a feature based upon detected and reprojected positions of the feature. Another embodiment is directed to performing one or more image treatments on a facial region of a user until the perceived SQS satisfies the predetermined target SQS. Another embodiment is directed to video conferencing monitoring the quality of video feed coming from the participants of the video conferencing and creating an image or video from the feed when that participant's feed is good and replacing the live video with the newly created good quality image or video when the feed is bad. Another embodiment is directed to a process of baked triplanar projection using triangles generated from a tessellation, where the baked triplanar projection can generate a 2D mesh including UV coordinates.

Abstract: In one embodiment, a method includes projecting a source image onto a surface using a lens approximation component, where the surface is associated with sampling points approximating photoreceptors of an eye, where each sampling point has a corresponding photoreceptor type, sampling color information from the projected source image at the sampling points, where the color information sampled at each sampling point depends on the corresponding photoreceptor type, accessing pooling units approximating retinal ganglion cells (RGCs) of the eye, where each pooling unit is associated with groups of one or more of the sampling points, calculating weighted aggregations of the sampled color information associated with the groups of one or more sampling points associated with each pooling unit, and computing a perception profile for the source image based on the weighted aggregations associated with each of the pooling units.

Abstract: In one embodiment, a computing system may determine, for a current frame to be displayed and using an eye tracking system, a current eye position of a viewer. The system may determine a first array of scaling factors based on the determined current eye position of the viewer. The system may retrieve one or more second arrays of scaling factors used for correcting one or more proceeding frames of the current frame. The system may determine a third array of scaling factors based on the first array of scaling factors determined based on the current eye position and the one or more second arrays of scaling factors used for correcting the proceeding frames. The system may adjust pixel values of the current frame based at least on the third array of scaling factors. The system may output the current frame with the adjusted pixel values to a display.

Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Abstract: In one embodiment, a computing system may access a dead pixel position corresponding to a dead pixel of a display. The system may access an image and modify the image by applying a mask to a pixel region of the image containing a particular pixel value with a position that corresponds to the dead pixel position. The mask may include an array of first scaling factors for scaling pixels values in the pixel region. The array of first scaling factors may be configured to brighten one or more of the pixel values surrounding the particular pixel value. The system may cause the modified image to be output by the display.

Abstract: Adjusted overlaid images are generated in response to at least one color reference object or color reference point. A display is driven to present the adjusted overlaid image.

Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Abstract: Adjusted overlaid images are generated in response to at least one color reference object or color reference point.

Abstract: In one embodiment, a computing system may access a dead pixel position corresponding to a dead pixel of a display. The system may access an image and modify the image by applying a mask to a pixel region of the image containing a particular pixel value with a position that corresponds to the dead pixel position. The mask may include an array of first scaling factors for scaling pixels values in the pixel region. The array of first scaling factors may be configured to brighten one or more of the pixel values surrounding the particular pixel value. The system may cause the modified image to be output by the display.