Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for analyzing image search result relevance. In one aspect, a method includes receiving result data specifying a search query and responsive image search results that reference images that are responsive to the search query. A determination is made that the search query matches an indexed query. An image relevance model is identified for the indexed query. The image relevance model can output a relevance score adjustment factor for an image search result based on image feature values of the image that is referenced by the search result. A relevance score adjustment factor is determined for each image search result using the identified image relevance model. A relevance score for each image search result is adjusted using the image's image relevance score adjustment factor. The images are ranked based on the adjusted relevance scores.

Abstract: Methods, systems, and apparatus, including computer program products, for identifying images relevant to a query are disclosed. An image search subsystem selects images to reference in image search results that are responsive to a query based on an image relevance model that is trained for the query. An independent image relevance model is trained for each unique query that is identified by the image search subsystem. The image relevance models can be applied to images to order image search results obtained for the query. Each relevance model is trained based on content feature values of images that are identified as being relevant to the query (e.g., frequently selected from the image search results) and images that are identified as being relevant to another unique query. The trained model is applied to the content feature values of all known images to generate an image relevance score that can be used to order search results for the query.

Abstract: An image classification system trains an image classification model to classify images relative to text appearing with the images. Training images are iteratively selected and classified by the image classification model according to feature vectors of the training images. An independent model is trained for unique n-grams of text. The image classification system obtains text appearing with an image and parses the text into candidate labels for the image. The image classification system determines whether an image classification model has been trained for the candidate labels. When an image classification model corresponding to a candidate label has been trained, the image classification subsystem classifies the image relative to the candidate label. The image is labeled based on candidate labels for which the image is classified as a positive image.

Abstract: Methods, systems and apparatus for identifying result images for a query image. One or more labels that are associated with the query image are obtained. Candidate images matching the query labels are identified. Visual similarity scores are generated for the candidate images. Each visual similarity score represents the visual similarity of a respective candidate image to the query image. Relevance scores are generated for each of the candidate images based on the visual similarity scores. Each relevance score represents a measure of relevance of the respective candidate images to the query image. The candidate images are ranked based on the relevance scores, a highest ranking subset of the candidate images being identified as result images and referenced by image search results. The result images can be candidate images that satisfy a similarity condition relative to the query image and other result images.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating image search results. One of the methods includes receiving first image search results responsive to a text query, each first image search result associated with a respective first score indicating a relevance of an image represented by the first image search result to the text query. Second image search results responsive to a query image are received, each second image search result associated with a respective second score indicating a measure of similarity between an image represented by the second image search result and the query image. A set of final image search results is selected including combining first scores and second scores of the selected first image search results. The final image search results are ordered by similarity to the query image.

Abstract: Implementations generally relate to generating image compositions. In some implementations, a method includes receiving a plurality of photos from a user and determining one or more composition types from the photos. The method further includes generating one or more compositions from the received photos based on the one or more determined composition types, where each composition is based on modified foregrounds of the photos. The method further includes providing the one or more generated compositions to the user.

Abstract: Systems, methods and computer readable media for providing labels for photos are described herein. In some implementations, a method can include receiving a plurality of photos. The method can also include associating one or more labels with the plurality of photos based on one or more predetermined criteria. The method can also include determining one or more suggested labels from the one or more labels to be used as search terms, and providing for the suggested labels for display in a user interface.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating image search results. One of the methods includes receiving first image search results responsive to a text query, each first image search result associated with a respective first score indicating a relevance of an image represented by the first image search result to the text query. Second image search results responsive to a query image are received, each second image search result associated with a respective second score indicating a measure of similarity between an image represented by the second image search result and the query image. A set of final image search results is selected including combining first scores and second scores of the selected first image search results. The final image search results are ordered by similarity to the query image.

Abstract: Implementations generally relate to generating photo animations. In some implementations, a method includes receives a plurality of photos from a user. The method also includes selecting photos from the plurality of photos that meet one or more predetermined similarity criteria. The method also includes generating an animation using the selected photos.

Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.

Abstract: Embodiments generally relate to summarizing a photo album in a social network system. In one embodiment, a method includes grouping photos into a plurality of groups of photos, and selecting a plurality of representative photos, where each representative photo represents a respective group from the plurality of groups, where the selecting is based on a quality score of each of the photos, and where each quality score is based on different types of attributes. The method also includes enabling the plurality of representative photos to be shared.

Abstract: Embodiments generally relate to summarizing a photo album in a social network system. In one embodiment, a method includes grouping photos into a plurality of groups of photos, and selecting a plurality of representative photos, where each representative photo represents a respective group from the plurality of groups, where the selecting is based on a quality score of each of the photos, and where each quality score is based on different types of attributes. The method also includes enabling the plurality of representative photos to be shared.

Abstract: Embodiments generally relate to summarizing a photo album. In one embodiment, a method includes grouping photos into a plurality of groups of photos, and selecting a plurality of representative photos, where each representative photo represents a respective group from the plurality of groups, where the selecting is based on a quality score of each of the photos, and where each quality score is based on different types of attributes. The method also includes providing the plurality of representative photos to a user.

Abstract: An image classification system trains an image classification model to classify images relative to text appearing with the images. Training images are iteratively selected and classified by the image classification model according to feature vectors of the training images. An independent model is trained for unique n-grams of text. The image classification system obtains text appearing with an image and parses the text into candidate labels for the image. The image classification system determines whether an image classification model has been trained for the candidate labels. When an image classification model corresponding to a candidate label has been trained, the image classification subsystem classifies the image relative to the candidate label. The image is labeled based on candidate labels for which the image is classified as a positive image.

Abstract: The disclosed subject matter relates to computer implemented methods for automatic curation of digital images. In one aspect, the method includes selecting one of every two or more duplicate digital images of a plurality of digital images. The method further includes calculating an image quality score for each of the selected digital images. The method further includes associating a ranking with each of the selected digital images based on its respective calculated image quality score.

Abstract: Methods, systems, and apparatus, including computer program products, for identifying images relevant to a query are disclosed. An image search subsystem selects images to reference in image search results that are responsive to a query based on an image relevance model that is trained for the query. An independent image relevance model is trained for each unique query that is identified by the image search subsystem. The image relevance models can be applied to images to order image search results obtained for the query. Each relevance model is trained based on content feature values of images that are identified as being relevant to the query (e.g., frequently selected from the image search results) and images that are identified as being relevant to another unique query. The trained model is applied to the content feature values of all known images to generate an image relevance score that can be used to order search results for the query.

Abstract: An image classification system trains an image classification model to classify images relative to text appearing with the images. Training images are iteratively selected and classified by the image classification model according to feature vectors of the training images. An independent model is trained for unique n-grams of text. The image classification system obtains text appearing with an image and parses the text into candidate labels for the image. The image classification system determines whether an image classification model has been trained for the candidate labels. When an image classification model corresponding to a candidate label has been trained, the image classification subsystem classifies the image relative to the candidate label. The image is labeled based on candidate labels for which the image is classified as a positive image.

Abstract: Methods, systems and apparatus for identifying result images for a query image. One or more labels that are associated with the query image are obtained. Candidate images matching the query labels are identified. Visual similarity scores are generated for the candidate images. Each visual similarity score represents the visual similarity of a respective candidate image to the query image. Relevance scores are generated for each of the candidate images based on the visual similarity scores. Each relevance score represents a measure of relevance of the respective candidate images to the query image. The candidate images are ranked based on the relevance scores, a highest ranking subset of the candidate images being identified as result images and referenced by image search results. The result images can be candidate images that satisfy a similarity condition relative to the query image and other result images.