Abstract: The arrangement and selection of digital content to present to a user can be based at least in part upon probabilities of the user selecting to view more information and/or entering into a transaction with respect to instances of the content. For example, user behavior with respect to various items provided through a content provider can be determined in order to calculate a probability that a user was searching for a particular type of item for a given search. The user behavior can include historical action data, such as information that indicates items that were selected in response to a particular search and/or items that were purchased in response to a particular search. The historical action data can be analyzed to generate an index that indicates a likelihood that the search was intended for a particular type of product. Additionally, the historical data can be used to train language models that can be used to determine a probability of interest for a particular type of product for a given search.

Abstract: A machine learning system receives a reference image and generates a series of projected view images of a physical object represented in the images. Parallel neural networks may receive the reference image and series of projected view images for analysis to determine one or more features of the physical object. By pooling the results from the parallel network, a single output may be provided to a set of decodes that are trained to identify a material property of the one or more items. As a result, a three-dimensional model may be generated that includes a graphical representation of the object as a function of its material properties to enable improved rendering.

Abstract: A color selection image matching system can receive, from a computing device, image data captured by a camera in the user device, where the image data includes one or more colors. The computing device can extrapolate a subset of the colors and receive an indication of a target color to initiate a product search based on the target color. The subset of colors may be determined based on other image data, and selectable color elements may be generated for the subset of colors. In some embodiments, the system may generate a palette of colors visually similar to the target color. The target color and/or palette of colors can be cross-referenced with products colors, based on standardized or quantitative color descriptors, to determine relevant product search results matching the target color, which may be displayed on the user device.

Abstract: Systems and methods are disclosed for a system to provide an interface that is dynamic and that provides selectable links in response to a query for products in an electronic marketplace, where the selectable links are titled with the query and portions of reviews for products associated with the query. The system is configured to select feedback for items purchased from an electronic marketplace. Descriptors from the feedback are generated. In response to a query for the one or more of the items in the electronic marketplace, a determination is made that portions of the descriptors provide detail responsive to the query. An interface is displayed including selectable links titled with the query in combination with the portions of the descriptors. In response to selection of one of the selectable links, a portion of the items are displayed.

Abstract: Disclosed are various embodiments of systems and methods for dynamically generating and providing personalized recommendations of newer products or services potentially of interest to a particular user who has previously purchased a similar product or service. Historical purchase data or other information indicating the user's preferences is analyzed to determine personal preference data. Candidate content is identified based on attributes found in the preference data. Similarity strategies and criteria can be used to test features and qualities in candidate content. Recommended product or service content comes in the form of candidate content which reaches a similarity threshold or otherwise achieves a sufficient confidence score based at least in part on a similarity metric is determined.

Abstract: Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.

Abstract: A method for enhanced mesh networking, including performing network analysis, configuring router link parameters, and managing routing paths, is described. A metric for routing path assessment, including a throughput metric and a channel utilization metric, is described. A Segment Table Announced Mesh Protocol, including determining network segments and designating forwarding devices for communication between the network segments, is described.

Abstract: In various embodiments, when a search query for certain products in an electronic catalog is received, a group of related products that are responsive to the search query may be identified. The product variants may be defined by one or more attributes. Each attribute may have one or more attribute values. The product variants may be first classified according to an attribute. One or more representative classes may be selected from the classes, for example, based on sales data (or other metric) and/or meaningful differentiation between the classes. Then a representative product variant from each class may be selected and returned as search results in response to the search query. In some embodiments, selection of the representative product variant from each class may be based on one or more factors, such as sales data, the particular customer's purchase or browsing history, cost, the search query, availability, among others.

Abstract: Approaches described and suggested herein relate to generating three-dimensional representations of objects to be used to render virtual reality and augmented reality effects on personal devices such as smartphones and personal computers, for example. An initial surface mesh of an object is obtained. A plurality of silhouette masks of the object taken from a plurality of viewpoints is also obtained. A plurality of depth maps are generated from the initial surface mesh. Specifically, the plurality of depth maps are taken from the same plurality of viewpoints from which the silhouette images are taken. A volume including the object is discretized into a plurality of voxels. Each voxel is then determined to be either inside the object or outside of the object based on the silhouette masks and the depth data. A final mesh is then generated from the voxels that are determined to be inside the object.

Abstract: A computing device can obtain data describing at least one document, the at least one document referencing at least one media object, wherein a portion of the at least one media object includes one or more characters. The computing device can obtain data describing the one or more characters in the at least one media object in the at least one document. The computing device can generate an updated copy of the at least one document that includes the data describing the one or more characters in the at least one media object. The computing device can present, on a display screen of the computing device and through an interface, the updated copy of the at least one document, wherein the one or more characters in the at least one media object are able to be selected or searched.

Abstract: Various embodiments provide techniques for generating a style profile in which items are recognized in image data, analyzed for their attributes, and categorized based on those attributes. In various embodiments, computer vision techniques can be used to analyze the image data and subsequent image data to update the generated style profiles. The style profiles may be associated with a person, event, or the like and provide users with items having similar characteristics or attributes, which may be available for purchase in an electronic marketplace. The style profiles may be updated by analyzing user interaction with the provided items and by receiving additional image data. Additionally, recommendations may be provided based on search queries that identify certain events or style profiles.

Abstract: An image creation and editing tool can use the data produced from training a neural network to add stylized representations of an object to an image. An object classification will correspond to an object representation, and pixel values for the object representation can be added to, or blended with, the pixel values of an image in order to add a visualization of a type of object to the image. Such an approach can be used to add stylized representations of objects to existing images or create new images based on those representations. The visualizations can be used to create patterns and textures as well, as may be used to paint or fill various regions of an image. Such patterns can enable regions to be filled where image data has been deleted, such as to remove an undesired object, in a way that appears natural for the contents of the image.

Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

Abstract: Users can view images or renderings of items placed (virtually) within a physical space. For example, a rendering of an item can be placed within a live camera view of the physical space. A snapshot of the physical space can be captured and the snapshot can be customized, shared, etc. The renderings can be represented as two-dimensional images, e.g., virtual stickers or three-dimensional models of the items. Users can have the ability to view different renderings, move those items around, and develop views of the physical space that may be desirable. The renderings can link to products offered through an electronic marketplace and those products can be consumed. Further, collaborative design is enabled through modeling the physical space and enabling users to view and move around the renderings in a virtual view of the physical space.

Abstract: Objects can be rendered in three dimensions and viewed and manipulated in an augmented reality environment. A number of object images, a number of segmentation masks, and an object mesh structure are used by a client device to render the object in three dimensions. The object images and segmentation masks can be sequenced into frames. The object images and segmentation masks can be partitioned into patches and sequenced, or ordered, within each patch, and a keyframe can be assigned in each patch. Then, the object images and segmentation masks can be encoded into video files and sent to a client device. The client device can quickly retrieve a requested object image and segmentation mask based at least in part on identifying the keyframe in the same patch as the object image and segmentation mask.

Abstract: Various embodiments of systems and methods allow the presentation of a content item with a marketplace section. A system can receive a content item and analyze the content item to identify at least one featured object in the content item. The system can then match the at least one featured object with a marketplace item. If the marketplace item passes various filtering criteria, then the author of the content item can approve the marketplace item being presented with the content item. A system can then receive data for the content item from an application server and data for the marketplace item from a marketplace server and generate a unified presentation of the content item and the marketplace item. A user can then interact with a marketplace section to buy the marketplace item.

Abstract: Visual effects for element of interest can be displayed within a live camera view in real time or substantially using a processing pipeline that does not immediately display an acquired image until it has been updated with the effects. In various embodiments, software-based approaches, such as fast convolution algorithms, and/or hardware-based approaches, such as using a graphics processing unit (GPU), can be used reduce the time between acquiring an image and displaying the image with various visual effects. These visual effects can include automatically highlighting elements, augmenting the color, style, and/or size of elements, casting a shadow on elements, erasing elements, substituting elements, or shaking and jumbling elements, among other effects.

Abstract: Systems and methods are disclosed for a system configured to access first content to determine that textual features common to queries received in a website are available in text within the first content. An identifier within the first content is determined where the identifier references second content that comprises details associated with the textual features. In response to a content query including the textual features received in the website, display content is generated. The display content includes a first area to display matching content indexed from prior user searches and also includes a second area to be modified. A portion of the details and the identifier is provided in the second area.

Abstract: Systems and methods are provided for previewing content that is located behind the links of a search results webpage without having to click on the links and thereby cause webpage changes. Embodiments provide a webpage that presents a first set of search results in response to a search query submitted by a user. This webpage is displayed in a graphical user interface and the first set of search results comprises one or more links to other search results webpages, which are defined dynamically and cannot be pre-computed. In the event a user mouses over one of the links, embodiments execute the search associated with the moused-over link and then render selected portions of the search results in a preview window that is positioned over a portion the webpage that displays the first set of search results.

Abstract: Approaches are described for an interface element that displays progressively more information about a search result in a listing of search results. In an embodiment, a user interacts with a search result, for example by utilizing a gesture on a touch-sensitive display, and a supplemental content item is generated and displayed using, in one example, a subset of available supplemental information associated with the search result. The display of the supplemental content item is accompanied by an animation is some embodiments whereby the supplemental content item visually “slides” over to replace the search result.