Abstract: Systems, methods, and devices are described for constructing a digital representation of a physical scene by obtaining information about the physical scene. Based on the information, an initial portion of a planar surface within the physical scene may be identified. In one aspect of the disclosure, constructing a digital representation of a physical scene may include obtaining information about the physical scene, identifying a planar surface within the physical scene, selecting a physical object within the physical scene, placed above the planar surface, detecting properties associated with the physical object, generating a three-dimensional (3D) reconstructed object using the properties associated with the physical object, and representing the planar surface as an augmented reality (AR) plane in an augmented reality environment, wherein the AR plane in the AR environment is capable of supporting 3D reconstructed objects on top of it.

Abstract: Disclosed is a method and apparatus for providing visual guidance to a user capturing images of a three-dimensional object. In one embodiment, the operations implemented may include: generating a virtual registered sphere comprising a plurality of contiguous patches, wherein each of the plurality of patches corresponds to a continuous range of image capture angles; rendering at least a portion of the virtual registered sphere in an image capture camera view; determining whether images of the three-dimensional object have been captured to a predetermined satisfactory degree from a particular range of image capture angles associated with a particular patch; and assigning a color to the particular patch based at least in part on the determination of whether images of the three-dimensional object have been captured to the predetermined satisfactory degree from the particular range of image capture angles associated with the particular patch.

Abstract: Techniques described herein provide a method for defining virtual content for real objects that are unknown or unidentified at the time of the development of the application for an augmented reality (AR) environment. For example, at the time of development of an AR application, the application developer may not know the context that the mobile device may operate in and consequently the types or classes of real object and the number of real objects that the AR application may encounter. In one embodiment, the mobile device may detect unknown objects from a physical scene. The mobile device may then associate an object template with the unknown object based on the physical attributes, such as height, shape, size, etc., associated with the unknown object. The mobile device may render a display object at the pose of the unknown object using at least one display property of the object template.

Abstract: Techniques are presented for expanding a digital representation of a physical plane from a physical scene. In some aspects, a method may include determining an orientation and an initial portion of a physical plane in the scene, and subdividing a rectified image for the scene into a plurality of grid cells. For the grid cells, an image signature may be generated. A grid cell contiguous to the obtained initial portion of the plane is determined to include part of the plane. An iterative process may be performed for each neighboring grid cell from the grid cell contiguous to at least part of the obtained initial portion, determining whether the neighboring grid cell is to be included as part of the plane if the image signature of said neighboring grid cell is similar to the image signature of a grid cell already determined to be included as part of the plane.

Abstract: Disclosed is a method and apparatus for providing visual guidance to a user capturing images of a three-dimensional object. In one embodiment, the operations implemented may include: generating a virtual registered sphere comprising a plurality of contiguous patches, wherein each of the plurality of patches corresponds to a continuous range of image capture angles; rendering at least a portion of the virtual registered sphere in an image capture camera view; determining whether images of the three-dimensional object have been captured to a predetermined satisfactory degree from a particular range of image capture angles associated with a particular patch; and assigning a color to the particular patch based at least in part on the determination of whether images of the three-dimensional object have been captured to the predetermined satisfactory degree from the particular range of image capture angles associated with the particular patch.

Abstract: Techniques described herein provide a method for defining virtual content for real objects that are unknown or unidentified at the time of the development of the application for an augmented reality (AR) environment. For example, at the time of development of an AR application, the application developer may not know the context that the mobile device may operate in and consequently the types or classes of real object and the number of real objects that the AR application may encounter. In one embodiment, the mobile device may detect unknown objects from a physical scene. The mobile device may then associate an object template with the unknown object based on the physical attributes, such as height, shape, size, etc., associated with the unknown object. The mobile device may render a display object at the pose of the unknown object using at least one display property of the object template.

Abstract: Techniques are presented for expanding a digital representation of a physical plane from a physical scene. In some aspects, a method may include determining an orientation and an initial portion of a physical plane in the scene, and subdividing a rectified image for the scene into a plurality of grid cells. For the grid cells, an image signature may be generated. A grid cell contiguous to the obtained initial portion of the plane is determined to include part of the plane. An iterative process may be performed for each neighboring grid cell from the grid cell contiguous to at least part of the obtained initial portion, determining whether the neighboring grid cell is to be included as part of the plane if the image signature of said neighboring grid cell is similar to the image signature of a grid cell already determined to be included as part of the plane.

Abstract: Systems, methods, and devices are described for constructing a digital representation of a physical scene by obtaining information about the physical scene. Based on the information, an initial portion of a planar surface within the physical scene may be identified. In one aspect of the disclosure, constructing a digital representation of a physical scene may include obtaining information about the physical scene, identifying a planar surface within the physical scene, selecting a physical object within the physical scene, placed above the planar surface, detecting properties associated with the physical object, generating a three-dimensional (3D) reconstructed object using the properties associated with the physical object, and representing the planar surface as an augmented reality (AR) plane in an augmented reality environment, wherein the AR plane in the AR environment is capable of supporting 3D reconstructed objects on top of it.