Abstract: An augmented reality (AR) display application generates mapped visualization content overlaid on a real world physical environment. The AR display application receives sensor feeds, location information, and orientation information from wearable devices within the environment. A tessellation surface is visually mapped to surfaces of the environment based on a depth-based point cloud. A texture is applied to the tessellation surface and the tessellation may be viewed overlaying the surfaces of the environment via a wearable device.

Abstract: A mobile platform detects and tracks a three-dimensional (3D) object using occlusions of a two-dimensional (2D) surface. To detect and track the 3D object, an image of the 2D surface with the 3D object is captured and displayed and the 2D surface is detected and tracked. Occlusion of a region assigned as an area of interest on the 2D surface is detected. The shape of the 3D object is determined based on a predefined shape or by using the shape of the area of the 2D surface that is occluded along with the position of the camera with respect to the 2D to calculate the shape. Any desired action with respect to the position of the 3D object on the 2D surface may be performed, such as rendering and displaying a graphical object on or near the displayed 3D object.

Abstract: An augmented reality (AR) display application generates mapped visualization content overlaid on a real world physical environment. The AR display application receives sensor feeds, location information, and orientation information from wearable devices within the environment. A tessellation surface is visually mapped to surfaces of the environment based on a depth-based point cloud. A texture is applied to the tessellation surface and the tessellation may be viewed overlaying the surfaces of the environment via a wearable device.

Abstract: Techniques for managing applications associated with a mobile device are provided. The techniques disclosed herein include techniques for obtaining an image of an object in the view of a camera associated with a mobile device, identifying the object in the image based on attributes of the object extracted from the image, and determining whether one or more applications are associated with the object. If there are one or more applications associated with the real-world object, an application associated with the object can be automatically launched on the mobile device. The association between a real-world object and an application may be identified by a visual indicator, such as an icon, symbol, or other markings on the object that indicates that the object is associated with one or more applications.

Abstract: Techniques described herein provide a method for defining virtual content for real objects that are unknown or unidentified at the time of the development of the application for an augmented reality (AR) environment. For example, at the time of development of an AR application, the application developer may not know the context that the mobile device may operate in and consequently the types or classes of real object and the number of real objects that the AR application may encounter. In one embodiment, the mobile device may detect unknown objects from a physical scene. The mobile device may then associate an object template with the unknown object based on the physical attributes, such as height, shape, size, etc., associated with the unknown object. The mobile device may render a display object at the pose of the unknown object using at least one display property of the object template.

Abstract: Techniques are presented for expanding a digital representation of a physical plane from a physical scene. In some aspects, a method may include determining an orientation and an initial portion of a physical plane in the scene, and subdividing a rectified image for the scene into a plurality of grid cells. For the grid cells, an image signature may be generated. A grid cell contiguous to the obtained initial portion of the plane is determined to include part of the plane. An iterative process may be performed for each neighboring grid cell from the grid cell contiguous to at least part of the obtained initial portion, determining whether the neighboring grid cell is to be included as part of the plane if the image signature of said neighboring grid cell is similar to the image signature of a grid cell already determined to be included as part of the plane.

Abstract: Techniques described herein provide a method for defining virtual content for real objects that are unknown or unidentified at the time of the development of the application for an augmented reality (AR) environment. For example, at the time of development of an AR application, the application developer may not know the context that the mobile device may operate in and consequently the types or classes of real object and the number of real objects that the AR application may encounter. In one embodiment, the mobile device may detect unknown objects from a physical scene. The mobile device may then associate an object template with the unknown object based on the physical attributes, such as height, shape, size, etc., associated with the unknown object. The mobile device may render a display object at the pose of the unknown object using at least one display property of the object template.

Abstract: Techniques are presented for expanding a digital representation of a physical plane from a physical scene. In some aspects, a method may include determining an orientation and an initial portion of a physical plane in the scene, and subdividing a rectified image for the scene into a plurality of grid cells. For the grid cells, an image signature may be generated. A grid cell contiguous to the obtained initial portion of the plane is determined to include part of the plane. An iterative process may be performed for each neighboring grid cell from the grid cell contiguous to at least part of the obtained initial portion, determining whether the neighboring grid cell is to be included as part of the plane if the image signature of said neighboring grid cell is similar to the image signature of a grid cell already determined to be included as part of the plane.

Abstract: Techniques for managing applications associated with a mobile device are provided. The techniques disclosed herein include techniques for obtaining an image of an object in the view of a camera associated with a mobile device, identifying the object in the image based on attributes of the object extracted from the image, and determining whether one or more applications are associated with the object. If there are one or more applications associated with the real-world object, an application associated with the object can be automatically launched on the mobile device. The association between a real-world object and an application may be identified by a visual indicator, such as an icon, symbol, or other markings on the object that indicates that the object is associated with one or more applications.

Abstract: Embodiments disclosed pertain to mobile device based text detection and tracking. In some embodiments, a first reference frame is obtained by performing Optical Character Recognition (OCR) on an image frame captured by a camera to locate and recognize a first text block. A subsequent image frame may be selected from a set of subsequent image frames based on parameters associated with the selected subsequent image and a second reference frame may be obtained by performing OCR on the selected subsequent image frame to recognize a second text block. A geometric relationship between the first and second text blocks is determined based on a position of the first text block in the second reference frame and a pose associated with the second reference frame.

Abstract: A mobile platform renders different augmented reality objects based on the spatial relationship, such as the proximity and/or relative positions between real-world objects. The mobile platform detects and tracks a first object and a second object in one or more captured images. The mobile platform determines the spatial relationship of the objects, e.g., the proximity or distance between objects and/or the relative positions between objects. The proximity may be based on whether the objects appear in the same image or the distance between the objects. Based on the spatial relationship of the objects, the augmentation object to be rendered is determined, e.g., by searching a database. The selected augmentation object is rendered and displayed.

Abstract: A mobile platform captures a scene that includes a real world object, wherein the real world object has a non-uniform pattern in a predetermined region. The mobile platform determines an area in an image of the real world object in the scene corresponding to the predetermined region. The mobile platform compares intensity differences between pairs of pixels in the area, with known intensity differences between pairs of pixels in the non-uniform pattern, to identify any portion of the area that differs from a corresponding portion of the predetermined region. The mobile platform then stores in its memory, a value indicative of a location of the any portion relative to the area. The stored value may be used in any application running in the mobile platform.

Abstract: A mobile platform renders an augmented reality graphic to indicate selectable regions of interest on a captured image or scene. The region of interest is an area that is defined on the image of a physical object, which when selected by the user can generate a specific action. The mobile platform captures and displays a scene that includes an object and detects the object in the scene. A coordinate system is defined within the scene and used to track the object. A selectable region of interest is associated with one or more areas on the object in the scene. An indicator graphic is rendered for the selectable region of interest, where the indicator graphic identifies the selectable region of interest.

Abstract: A mobile platform renders different augmented reality objects based on the spatial relationship, such as the proximity and/or relative positions between real-world objects. The mobile platform detects and tracks a first object and a second object in one or more captured images. The mobile platform determines the spatial relationship of the objects, e.g., the proximity or distance between objects and/or the relative positions between objects. The proximity may be based on whether the objects appear in the same image or the distance between the objects. Based on the spatial relationship of the objects, the augmentation object to be rendered is determined, e.g., by searching a database. The selected augmentation object is rendered and displayed.

Abstract: A mobile platform detects and tracks a three-dimensional (3D) object using occlusions of a two-dimensional (2D) surface. To detect and track the 3D object, an image of the 2D surface with the 3D object is captured and displayed and the 2D surface is detected and tracked. Occlusion of a region assigned as an area of interest on the 2D surface is detected. The shape of the 3D object is determined based on a predefined shape or by using the shape of the area of the 2D surface that is occluded along with the position of the camera with respect to the 2D to calculate the shape. Any desired action with respect to the position of the 3D object on the 2D surface may be performed, such as rendering and displaying a graphical object on or near the displayed 3D object.