Abstract: A method, apparatus, and computer-readable medium for foreground object deletion and inpainting, including storing contextual information corresponding to an image of a scene, identifying one or more foreground objects in the scene based at least in part on the contextual information, each foreground object having a corresponding object mask, identifying at least one foreground object in the one or more foreground objects for removal from the image, generating a removal mask corresponding to the at least one foreground object based at least in part on at least one object mask corresponding to the at least one foreground object, determining an estimated geometry of the scene behind the at least one foreground object based at least in part on the contextual information, and inpainting pixels corresponding to the removal mask with a replacement texture omitting the foreground object based at least in part on the estimated geometry of the scene.

Abstract: Systems and methods for generating a panorama image. Captured images are coarsely aligned, and then finely aligned based on a combination of constraint values. The panorama image is generated from the finely aligned images.

Abstract: A method for layout extraction is provided. The method can include storing a plurality of scene priors corresponding to an image of a scene, detecting a plurality of borders in the scene, generating a plurality of initial plane masks and a plurality of plane connectivity values based at least in part on the plurality of borders, and generating a plurality of optimized plane masks by refining the plurality of initial plane masks based at least in part on an estimated geometry of the plurality of layout planes.

Abstract: A method and system for generating a virtual representation of a physical scene, including receiving scene data corresponding to the physical scene, processing the scene data to determine scene components and scene priors corresponding to the scene components, generating, by a plurality of neural networks, dense geometric representations based at least in part on the scene priors, where each dense geometric representation corresponds to a scene component in the scene components, generating a virtual model of the physical scene based at least in part on the dense geometric representations, and generating a virtual representation of the physical scene based at least in part on the scene data, the virtual representation being aligned with the virtual model.

Abstract: System and method for rendering virtual objects onto an image.

Abstract: Systems and methods for generating a panorama image. Captured images are coarsely aligned, and then finely aligned based on a combination of constraint values. The panorama image is generated from the finely aligned images.

Abstract: System and method for rendering virtual objects onto an image.

Abstract: A method and system for generating a virtual representation of a physical scene, including receiving scene data corresponding to the physical scene, processing the scene data to determine scene components and scene priors corresponding to the scene components, generating, by a plurality of neural networks, dense geometric representations based at least in part on the scene priors, where each dense geometric representation corresponds to a scene component in the scene components, generating a virtual model of the physical scene based at least in part on the dense geometric representations, and generating a virtual representation of the physical scene based at least in part on the scene data, the virtual representation being aligned with the virtual model.

Abstract: A method and system for generating a virtual representation of a physical scene, including receiving scene data corresponding to the physical scene, processing the scene data to determine scene components and scene priors corresponding to the scene components, generating, by a plurality of neural networks, dense geometric representations based at least in part on the scene priors, where each dense geometric representation corresponds to a scene component in the scene components, generating a virtual model of the physical scene based at least in part on the dense geometric representations, and generating a virtual representation of the physical scene based at least in part on the scene data, the virtual representation being aligned with the virtual model.

Abstract: A method for determining a visual scene virtual representation and a highly accurate visual scene-aligned geometric representation for virtual interaction.

Abstract: System and method for rendering virtual objects onto an image.

Abstract: Systems and methods for generating a panorama image. Captured images are coarsely aligned, and then finely aligned based on a combination of constraint values. The panorama image is generated from the finely aligned images.

Abstract: A method for determining a visual scene virtual representation and a highly accurate visual scene-aligned geometric representation for virtual interaction.