Abstract: Methods, systems, and apparatuses are provided to determine object depth within captured images. For example, an imaging device, such as a VR or AR device, captures an image. The imaging device applies a first encoding process to the image to generate a first set of features. The imaging device also generates a sparse depth map based on the image, and applies a second encoding process to the sparse depth map to generate a second set of features. Further, the imaging device applies a decoding process to the first set of features and the second set of features to generate predicted depth values. In some examples, the decoding process receives skip connections from layers of the second encoding process as inputs to corresponding layers of the decoding process. The imaging device generates an output image, such as a 3D image, based on the predicted depth values.

Abstract: The present disclosure generally relates to depth estimation. For example, aspects of the present disclosure include systems and techniques for performing depth estimation using filtered image data. Certain aspects provide an apparatus for processing frame data. The apparatus generally includes at least one memory; and at least one processor coupled to the at least one memory. The at least one processor may obtain a plurality of images for image processing, extract one or more features associated with each of the plurality of images, and analyze whether each of the plurality of images is a candidate for the image processing based on the one or more features. The at least one processor may also select a subset of the plurality of images based on analyzing the plurality of images and perform the image processing based on the selected subset of the plurality of images.