Abstract: A system and method can support image based determination of mobile device location through recognition of surface features for a previously scanned physical environment. The system and method can also support authoring and positioning of augmented reality features in an authoring interface using the same images and positions of surface features that are to be used for subsequent mobile device localization. As a result, mobile devices leveraging those same images and positions of surface features for localization will be more likely to obtain a localization that is consistent with the positioning displayed in the authoring interface. Augmented reality features authored using the same scan of the environment can be reliably displayed to an end user of an augmented reality application in a position consistent with their authoring in a common coordinate system, even though the authoring may have been performed remotely, away from the actual situs of the physical environment.

Abstract: In a template design application, a user creates a template for a machine-readable image target that supports encoded data and augmented reality homography. The design application enforces design constraints that ensure reliable detection of the target by a detection application while supporting creative freedom in designing the template. The design constraints can include specification of a detection contour outlining a transition between a perimeter of a border shape and an adjacent area of a contrasting color. Data to be encoded is applied to the template to create printable image instances of the target. The template is also loaded into a detection application, which scans and recognizes printed instances of the target and decodes the encoded data. The detection application uses the decoded data to create a synthesized image target matching the scanned target and which is used to execute further tracking of the target within a moving field of view.

Abstract: In a template design application, a user creates a template for a machine-readable image target that supports encoded data and augmented reality homography. The design application enforces design constraints that ensure reliable detection of the target by a detection application while supporting creative freedom in designing the template. The design constraints can include specification of a detection contour outlining a transition between a perimeter of a border shape and an adjacent area of a contrasting color. Data to be encoded is applied to the template to create printable image instances of the target. The template is also loaded into a detection application, which scans and recognizes printed instances of the target and decodes the encoded data. The detection application uses the decoded data to create a synthesized image target matching the scanned target and which is used to execute further tracking of the target within a moving field of view.

Abstract: Disclosed is a method and apparatus for providing visual guidance to a user capturing images of a three-dimensional object. In one embodiment, the operations implemented may include: generating a virtual registered sphere comprising a plurality of contiguous patches, wherein each of the plurality of patches corresponds to a continuous range of image capture angles; rendering at least a portion of the virtual registered sphere in an image capture camera view; determining whether images of the three-dimensional object have been captured to a predetermined satisfactory degree from a particular range of image capture angles associated with a particular patch; and assigning a color to the particular patch based at least in part on the determination of whether images of the three-dimensional object have been captured to the predetermined satisfactory degree from the particular range of image capture angles associated with the particular patch.

Abstract: Method, mobile device, computer program product and apparatus for performing a search are disclosed. The method of performing a search comprises receiving one or more images of an environment in view of a mobile device, generating a simultaneous localization and mapping of the environment using the one or more images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment, sending a set of the plurality of map points as a search query to a server, receiving a query response from the server, and identifying an object in the environment based at least in part on the query response.

Abstract: Disclosed is a method and apparatus for selecting a part of SLAM map information of a first device for transmission to a second device in a collaborative SLAM environment. In one embodiment, the functions implemented include: determining whether a 3D registration transformation between a map of the first device and a map of the second device is available; and transmitting a part of map information of the first device to the second device according to one of a first strategy or a second strategy based on whether or not a 3D registration transformation between the map of the first device and the map of the second device is available.

Abstract: Disclosed is a method and apparatus for providing visual guidance to a user capturing images of a three-dimensional object. In one embodiment, the operations implemented may include: generating a virtual registered sphere comprising a plurality of contiguous patches, wherein each of the plurality of patches corresponds to a continuous range of image capture angles; rendering at least a portion of the virtual registered sphere in an image capture camera view; determining whether images of the three-dimensional object have been captured to a predetermined satisfactory degree from a particular range of image capture angles associated with a particular patch; and assigning a color to the particular patch based at least in part on the determination of whether images of the three-dimensional object have been captured to the predetermined satisfactory degree from the particular range of image capture angles associated with the particular patch.

Abstract: Disclosed is a method and apparatus for selecting a part of SLAM map information of a first device for transmission to a second device in a collaborative SLAM environment. In one embodiment, the functions implemented include: determining whether a 3D registration transformation between a map of the first device and a map of the second device is available; and transmitting a part of map information of the first device to the second device according to one of a first strategy or a second strategy based on whether or not a 3D registration transformation between the map of the first device and the map of the second device is available.

Abstract: Disclosed is a method and apparatus for exemplars-based color classification. In one embodiment, the functions implemented include: processing an image captured by a camera to identify a first color profile that most closely matches colors of the image, wherein the first color profile is selected from a plurality of color profiles each color profile encoding data related to how two or more component colors appear under a different lighting condition.

Abstract: Method, mobile device, computer program product and apparatus for performing a search are disclosed. The method of performing a search comprises receiving one or more images of an environment in view of a mobile device, generating a simultaneous localization and mapping of the environment using the one or more images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment, sending a set of the plurality of map points as a search query to a server, receiving a query response from the server, and identifying an object in the environment based at least in part on the query response.