Abstract: A digital medium environment includes at least one computing device (e.g., a user's mobile device) in an environment. Systems and techniques are described for presenting a photorealistic augmented reality experience in real time on the computing device. A lighting representation of the environment is obtained from a partial view of the environment, such as from an image of the environment, and used to render a 3D asset (e.g., graphics of a synthetic object). The 3D asset is inserted into the environment by compositing the rendered 3D asset with the image of the environment accounting for occlusion and based on the lighting representation to form a composite image. Photorealistic processing is applied to the composite image by adding lighting for the rendered 3D asset to a portion of the background of the composite image. Consequently, the inserted graphic is indistinguishable from the real-world scene.

Abstract: A digital medium environment includes at least one computing device (e.g., a user's mobile device) in an environment. Systems and techniques are described for presenting a photorealistic augmented reality experience in real time on the computing device. A lighting representation of the environment is obtained from a partial view of the environment, such as from an image of the environment, and used to render a 3D asset (e.g., graphics of a synthetic object). The 3D asset is inserted into the environment by compositing the rendered 3D asset with the image of the environment accounting for occlusion and based on the lighting representation to form a composite image. Photorealistic processing is applied to the composite image by adding lighting for the rendered 3D asset to a portion of the background of the composite image. Consequently, the inserted graphic is indistinguishable from the real-world scene.