Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an inpainted image of a replacement individual in the place of a reference individual in a reference image using a metadata comparison. In one aspect, a system comprises receiving a first image comprising one or more reference individuals and a second image comprising one or more replacement individuals; obtaining replacement metadata and reference metadata; determining, based on the obtained replacement metadata and reference metadata, at least one portion of the first image for replacing corresponding with the one or more reference individuals; and generating a third image that comprises a modification of the first image wherein the at least one portion of the first image is replaced with replacement content, the replacement content being generated based on (i) the one or more replacement individuals, (ii) the replacement metadata, and (iii) the reference metadata.