Abstract: Fill techniques as implemented by a computing device are described to perform hole filling of a digital image. In one example, deeply learned features of a digital image using machine learning are used by a computing device as a basis to search a digital image repository to locate the guidance digital image. Once located, machine learning techniques are then used to align the guidance digital image with the hole to be filled in the digital image. Once aligned, the guidance digital image is then used to guide generation of fill for the hole in the digital image. Machine learning techniques are used to determine which parts of the guidance digital image are to be blended to fill the hole in the digital image and which parts of the hole are to receive new content that is synthesized by the computing device.

Abstract: Systems and techniques are described herein for directing a user conversation to obtain an editing query, and removing and replacing objects in an image based on the editing query. Pixels corresponding to an object in the image indicated by the editing query are ascertained. The editing query is processed to determine whether it includes a remove request or a replace request. A search query is constructed to obtain images, such as from a database of stock images, including fill material or replacement material to fulfill the remove request or replace request, respectively. Composite images are generated from the fill material or the replacement material and the image to be edited. Composite images are harmonized to remove editing artifacts and make the images look natural. A user interface exposes images, and the user interface accepts multi-modal user input during the directed user conversation.

Abstract: A method and systems of identifying one or more patches in three or more frames in a video are provided. A region in a reference frame of the video may be detected. A set of regions in a prior frame and subsequent frame that are similar to the region in the reference frame may then be identified. Temporal consistency between the region in the reference frame and two or more regions in the set of regions in the prior and subsequent frames may then be calculated. Patches of regions in the first, reference, and third frames may be identified based at least in part on the calculated temporal consistencies, with each patch identifying a region in the reference frame that can be mapped to a similar region in the prior and subsequent frames.

Abstract: A method and systems of enhancing a video using a related image are provided. One or more patches are identified in the video, with each patch identifying a region that is present in one of the frames of the video that can be mapped to a similar region in at least one other frame of the video. For each identified patch in the video, a best matching patch in the related image is found. The video is enhanced using the best matching patch in the related image for each identified patch in the video.

Abstract: A method and systems of enhancing a video using a related image are provided. One or more patches are identified in the video, with each patch identifying a region that is present in one of the frames of the video that can be mapped to a similar region in at least one other frame of the video. For each identified patch in the video, a best matching patch in the related image is found. The video is enhanced using the best matching patch in the related image for each identified patch in the video.

Abstract: A method and systems of identifying one or more patches in three or more frames in a video are provided. A region in a reference frame of the video may be detected. A set of regions in a prior frame and subsequent frame that are similar to the region in the reference frame may then be identified. Temporal consistency between the region in the reference frame and two or more regions in the set of regions in the prior and subsequent frames may then be calculated. Patches of regions in the first, reference, and third frames may be identified based at least in part on the calculated temporal consistencies, with each patch identifying a region in the reference frame that can be mapped to a similar region in the prior and subsequent frames.