Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object and includes a mesh with mesh elements. The mesh elements are assigned views first from a subset of views to texture large contiguous portions of the object from relatively few views. Portions that are not textured from the subset views are textured using the full set of views, such that all mesh elements are assigned views. The views first assigned from the subset of views and the views then assigned from the full plurality of views can be packaged into a texture atlas. These texture atlas views can be packaged with mapping data to map the texture atlas views to their corresponding mesh elements. The texture atlas and the object mesh structure can be sent to a client device to render a representation of the object.

Abstract: Various embodiments enable a computing device to perform tasks such as processing an image to recognize text or an object in an image to identify a particular product or related products associated with the text or object. In response to recognizing the text or the object as being associated with a product available for purchase from an electronic marketplace, one or more advertisements or product listings associated with the product can be displayed to the user. Accordingly, additional information for the associated product can be displayed, enabling the user to learn more about and purchase the product from the electronic marketplace through the portable computing device.

Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object and includes a mesh with mesh elements. The mesh elements are assigned views first from a subset of views to texture large contiguous portions of the object from relatively few views. Portions that are not textured from the subset views are textured using the full set of views, such that all mesh elements are assigned views. The views first assigned from the subset of views and the views then assigned from the full plurality of views can be packaged into a texture atlas. These texture atlas views can be packaged with mapping data to map the texture atlas views to their corresponding mesh elements. The texture atlas and the object mesh structure can be sent to a client device to render a representation of the object.

Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object and includes a mesh with mesh elements. The mesh elements are assigned views first from a subset of views to texture large contiguous portions of the object from relatively few views. Portions that are not textured from the subset views are textured using the full set of views, such that all mesh elements are assigned views. The views first assigned from the subset of views and the views then assigned from the full plurality of views can be packaged into a texture atlas. These texture atlas views can be packaged with mapping data to map the texture atlas views to their corresponding mesh elements. The texture atlas and the object mesh structure can be sent to a client device to render a representation of the object.

Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

Abstract: A computing device can obtain data describing at least one document, the at least one document referencing at least one media object, wherein a portion of the at least one media object includes one or more characters. The computing device can obtain data describing the one or more characters in the at least one media object in the at least one document. The computing device can generate an updated copy of the at least one document that includes the data describing the one or more characters in the at least one media object. The computing device can present, on a display screen of the computing device and through an interface, the updated copy of the at least one document, wherein the one or more characters in the at least one media object are able to be selected or searched.

Abstract: Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.

Abstract: A computing device can obtain data describing at least one document, the at least one document referencing at least one media object, wherein a portion of the at least one media object includes one or more characters. The computing device can obtain data describing the one or more characters in the at least one media object in the at least one document. The computing device can generate an updated copy of the at least one document that includes the data describing the one or more characters in the at least one media object. The computing device can present, on a display screen of the computing device and through an interface, the updated copy of the at least one document, wherein the one or more characters in the at least one media object are able to be selected or searched.

Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

Abstract: Objects can be rendered in three dimensions and viewed and manipulated in an augmented reality environment. A number of object images, a number of segmentation masks, and an object mesh structure are used by a client device to render the object in three dimensions. The object images and segmentation masks can be sequenced into frames. The object images and segmentation masks can be partitioned into patches and sequenced, or ordered, within each patch, and a keyframe can be assigned in each patch. Then, the object images and segmentation masks can be encoded into video files and sent to a client device. The client device can quickly retrieve a requested object image and segmentation mask based at least in part on identifying the keyframe in the same patch as the object image and segmentation mask.

Abstract: Various embodiments enable an image recognition system reduce the number image match candidates before running a full-fledged pair-wise match on all image match candidates. In order to accomplish this, each inventory image can be assigned to a group. For example, a title for a book sold by an electronic marketplace could be available in multiple languages, in multiple bindings, and the book could be available in print, audio book, or electronic book. Each one of these variations could be associated with its own similarly looking inventory image, each of which could be returned as a valid match to a query image for the book. Accordingly, the inventory images for these variations could be assigned to a group for the book and, instead of geometrically processing an image for each variation, the image match system can process a single image representing all of the variations.

Abstract: Various embodiments provide methods and systems for users and business owners to share content and/or links to visual elements of a place at a physical location, and, in response to a user device pointing at a tagged place, causing the content and/or links to the visual elements of the place to be presented on the user device. In some embodiments, content and links are tied to specific objects at a place based at least in part upon one of Global Positioning System (GPS) locations, Inertial Measurement Unit (IMU) orientations, compass data, or one or more visual matching algorithms. Once the content and links are attached to the specific objects of the place, they can be discovered by a user with a portable device pointing at the specific objects in the real world.

Abstract: Approaches herein provide for multi-camera calibration and subsequent application in augmented reality applications. The approach obtains image data of a three-dimensional (3D) calibration object from different directions using the at least one camera. A determination is made for extrinsic parameters associated with a relative position of the 3D calibration object to the at least one camera. A further determination is made for intrinsic parameters associated with the at least one camera relative to the 3D calibration object facing in the different positions. Revised intrinsic parameters are generated from the intrinsic parameters. The revised intrinsic parameters provide a calibration output that may be applied to generate views of an item in an augmented reality application.

Abstract: Various embodiments provide methods and systems for users and business owners to share content and/or links to visual elements of a place at a physical location, and, in response to a user device pointing at a tagged place, causing the content and/or links to the visual elements of the place to be presented on the user device. In some embodiments, content and links are tied to specific objects at a place based at least in part upon one of Global Positioning System (GPS) locations, Inertial Measurement Unit (IMU) orientations, compass data, or one or more visual matching algorithms. Once the content and links are attached to the specific objects of the place, they can be discovered by a user with a portable device pointing at the specific objects in the real world.

Abstract: Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.

Abstract: Systems and methods for displaying 3D containers in a computer generated environment are described. A computing device may provide a user with a catalog of objects which may be purchased. In order to view what an object may look like prior to purchasing the object, a computing device may show a 3D container that has the same dimensions as the object. As discussed herein, the 3D container may be located and oriented based on a two-dimensional marker. Moreover, some 3D containers may contain a representation of an object, which may be a 2D image of the object.

Abstract: Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.

Abstract: Images can be used to determine the size of an article of clothing matching the physical characteristics of a user. An image can include an article of clothing known to fit well or a representation of a body part, which can comprise the body part itself. Images can also include a reference item. Various techniques are used to determine one or more perspective distortions in the image based on analysis of the reference item and information known about the reference item. The one or more perspective distortions can be accounted for to determine physical characteristics of the article of clothing or the body part associated with the article of clothing. The physical characteristics can be used to determine the size of an article of clothing matching, or corresponding to, the physical characteristics.

Abstract: Objects can be rendered in three dimensions and viewed and manipulated in an augmented reality environment. A number of object images, a number of segmentation masks, and an object mesh structure are used by a client device to render the object in three dimensions. The object images and segmentation masks can be sequenced into frames. The object images and segmentation masks can be partitioned into patches and sequenced, or ordered, within each patch, and a keyframe can be assigned in each patch. Then, the object images and segmentation masks can be encoded into video files and sent to a client device. The client device can quickly retrieve a requested object image and segmentation mask based at least in part on identifying the keyframe in the same patch as the object image and segmentation mask.

Abstract: Objects can be rendered in three-dimensions and viewed and manipulated in an augmented reality environment. Background images are subtracted from object images from multiple viewpoints to provide baseline representations of the object. Morphological operations can be used to remove errors caused by misalignment of an object image and background image. Using two different contrast thresholds, pixels can be identified that can be said at two different confidence levels to be object pixels. An edge detection algorithm can be used to determine object contours. Low confidence pixels can be associated with the object if they can be connected to high confidence pixels without crossing an object contour. Segmentation masks can be created from high confidence pixels and properly associated low confidence pixels. Segmentation masks can be used to create a three-dimensional representation of the object.