Abstract: Methods, non-transitory computer readable media, apparatuses, and systems for high-resolution image generation using diffusion models include obtaining a prompt and generating, using a first diffusion model, a predicted denoised image at a first resolution based on the prompt. The predicted denoised image is generated at a first intermediate diffusion step of the first diffusion model. The predicted denoised image is upsampled to obtain an upsampled denoised image at a second resolution that is higher than the first resolution. A second diffusion model then generates an output image at the second resolution based on the prompt and the upsampled denoised image.

Abstract: Systems and methods for generating images using hybrid sampling include obtaining a noisy image and generating a first denoised image during a first reverse diffusion phase using a diffusion neural network. The first denoised image is generated based on a first sampler that uses a first sampling density during at least a portion of the first reverse diffusion phase. Subsequently, a second denoised image is generated based on the first denoised image during a second reverse diffusion phase using the diffusion neural network. The second denoised image is generated based on a second sampler that uses a second sampling density different from the first sampling density during at least a portion of the second reverse diffusion phase.

Abstract: Embodiments of the present disclosure include obtaining an input image and an approximate mask that approximately indicates a foreground region of the input image. Some embodiments generate an unconditional mask of the foreground region based on the input image. A conditional mask of the foreground region is generated based on the input image and the approximate mask. Then, an output image is generated based on the unconditional mask and the conditional mask. In some cases, the output image includes the foreground region of the input image.

Abstract: A method, apparatus, and non-transitory computer readable medium for image generation are described. Embodiments of the present disclosure obtain, via a user interface, an input text. The user interface also obtains a text effect prompt that describes a text effect for the input text. An image generation model generates an output image depicting the input text with the text effect described by the text effect prompt.