Abstract: A sample batch is accessed and a conditioning is computed based on given constraints. A dense relaxation is computed based on the computed conditioning and the sample batch to generate kernels for conditioning a diffusion optimization model. A sample is selected from the sample batch based on a randomly sampled timestep and random noise is sampled from a Gaussian distribution. A noisy representation of the selected sample is sampled based on the randomly sampled timestep and the sampled random noise. The diffusion optimization model is run in a forward direction using the noisy representation of the selected sample to generate a prediction. An error loss is computed to minimize an error between the prediction and a target; the target is the sampled random noise. A diffusion optimization loss is computed based on the error loss and the diffusion optimization model is updated based on the diffusion optimization loss using backpropagation.

Abstract: A computer-implemented method for generating a semantically segmented image and a depth completion image using a convolutional neural network (CNN) from an input visible image and/or an input depth image. A central component of the CNN for semantic segmentation and depth completion is a common representation that allows both tasks to be performed when given any of these combinations of input images (i) both an input visible image and an input depth image, (ii) only an input visible image, or (iii) only an input depth image.

Abstract: A computer-implemented method for generating a semantically segmented image and a depth completion image using a convolutional neural network (CNN) from an input visible image and/or an input depth image. A central component of the CNN for semantic segmentation and depth completion is a common representation that allows both tasks to be performed when given any of these combinations of input images (i) both an input visible image and an input depth image, (ii) only an input visible image, or (iii) only an input depth image.