Abstract: Information relating to gaze direction is used, e.g., with other information, to perform tone mapping, brightness adaptation, and/or sparkle generation/management for virtual or augmented reality displays. For example, speed of light adaptation may be increased as a user's gaze moves from a darker scene to a brighter scene and decreased in opposite direction to match human perception dynamics in real world. Sparkles from smaller objects may be adjusted depending on an object size, a brightness of the object's background, and/or the object's location relative to the user's gaze—that is, whether the object in the user's focus or in a periphery. Specularity of the objects may be obtained from a specularity map (e.g., metadata associated with each object) or from image processing a scene. Local sparkles may be shimmered as the user's head rotates deterministically or randomly to provide a sense of real-life glistening.

Abstract: According to examples, a system may use gaze direction information to perform tone mapping or chromatic adaptation for virtual reality (VR) environments. The system may include a processor and a memory storing instructions. When the processor executes the instructions, the system may determine a user focus location within a physical environment. An image corresponding to the physical environment may be received. The system may determine a visual property of the physical environment corresponding to the user focus location. The system may modify a color mapping of a region of the image based on the determined visual property to generate an output image.