Abstract: A computer-implemented method is disclosed. The method includes selecting one or more target surfaces portrayed in at least one video frame, generating a video data latent space representation of the at least one video frame, accessing a plurality of supplemental data latent space representations of a plurality of supplemental data sets, identifying a particular supplemental data latent space representation based at least in part on the video data latent space representation, selecting a particular supplemental data set in response to identifying the particular supplemental data latent space representation, the particular supplemental data set corresponding with the particular supplemental data latent space representation, and inserting the particular supplemental data set into the at least one video frame.

Abstract: A computer implemented method of generating a three-dimensional facial rendering from a two-dimensional image having a facial image includes: generating a three-dimensional shape model of the facial image and a low resolution two-dimensional texture map of the facial image from the two-dimensional image using a fitting neural network; applying a super-resolution model to the low resolution two-dimensional texture map to generate a high resolution two-dimensional texture map; generating a two-dimensional diffuse albedo map from the high resolution texture map using a de-lighting image-to-image translation neural network; and rendering a high resolution three-dimensional model of the facial image using the two-dimensional diffuse albedo map and the three dimensional shape model.