Abstract: A video demographics analysis system selects a training set of videos to use to correlate viewer demographics and video content data. The video demographics analysis system extracts demographic data from viewer profiles related to videos in the training set and creates a set of demographic distributions, and also extracts video data from videos in the training set. The video demographics analysis system correlates the viewer demographics with the video data of videos viewed by that viewer. Using the prediction model produced by the machine learning process, a new video about which there is no a priori knowledge can be associated with a predicted demographic distribution specifying probabilities of the video appealing to different types of people within a given demographic category, such as people of different ages within an age demographic category.

Abstract: A video demographics analysis system selects a training set of videos to use to correlate viewer demographics and video content data. The video demographics analysis system extracts demographic data from viewer profiles related to videos in the training set and creates a set of demographic distributions, and also extracts video data from videos in the training set. The video demographics analysis system correlates the viewer demographics with the video data of videos viewed by that viewer. Using the prediction model produced by the machine learning process, a new video about which there is no a priori knowledge can be associated with a predicted demographic distribution specifying probabilities of the video appealing to different types of people within a given demographic category, such as people of different ages within an age demographic category.

Abstract: An object recognition system performs a number of rounds of dimensionality reduction and consistency learning on visual content items such as videos and still images, resulting in a set of feature vectors that accurately predict the presence of a visual object represented by a given object name within an visual content item. The feature vectors are stored in association with the object name which they represent and with an indication of the number of rounds of dimensionality reduction and consistency learning that produced them. The feature vectors and the indication can be used for various purposes, such as quickly determining a visual content item containing a visual representation of a given object name.

Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes inferring labels for videos, users, advertisements, groups of users, and other entities included in a social network system. The inferred labels can be used to generate recommendations such as videos or advertisements in which a user may be interested. Inferred labels can be generated based on social or other relationships derived from, for example, profiles or activities of social network users. Inferred labels can be advantageous when explicit information about these entities is not available. For example, a particular user may not have clicked on any online advertisements, so the user is not explicitly linked to any advertisements.

Abstract: A system and method detects matches between portions of video content. A matching module receives an input video fingerprint representing an input video and a set of reference fingerprints representing reference videos in a reference database. The matching module compares the reference fingerprints and input fingerprints to generate a list of candidate segments from the reference video set. Each candidate segment comprises a time-localized portion of a reference video that potentially matches the input video. A classifier is applied to each of the candidate segments to classify the segment as a matching segment or a non-matching segment. A result is then outputted identifying a matching portion of a reference video from the reference video set based on the segments classified as matches.

Abstract: Methods and systems for automated annotation of persons in video content are disclosed. In one embodiment, a method of identifying faces in a video includes the stages of: generating face tracks from input video streams; selecting key face images for each face track; clustering the face tracks to generate face clusters; creating face models from the face clusters; and correlating face models with a face model database. In another embodiment, a system for identifying faces in a video includes a face model database having face entries with face models and corresponding names, and a video face identifier module. In yet another embodiment, the system for identifying faces in a video can also have a face model generator.

Abstract: A method, a system and a computer program product generate a statistical classification model used by a computer system to determine a class associated with an unlabeled time series event.

Abstract: A feature vector is encoded into a sparse binary vector. The feature vector is retrieved, for example from storage or a feature vector generator. The feature vector represents a media object or other data object. One or more permutations are generated, the dimensionality of the generated permutations equivalent to the dimensionality of the feature vector. The permutations may be generated randomly or formulaically. The feature vector is permuted with the one or more permutations, creating one or more permuted feature vectors. The permuted feature vectors are truncated according to a selected window size. The indexes representing the maximum values of the permuted feature vectors are identified and encoded using one-hot encoding, producing one or more sparse binary vectors. The sparse binary vectors may be concatenated into a single sparse binary vector and stored. The sparse binary vector may be used in the similarity search, indexing or categorization of media objects.

Abstract: A video hosting service automatically identifies, in a video database, a set of videos associated with an advertiser, and presents the identified videos to the advertiser for consideration. The videos may be selected based on analysis of their video content for images of logos associated with the advertisers. The video hosting service may then receive from the advertisers a listing of which of the presented videos should be given an award.

Abstract: A feature vector is encoded into a sparse binary vector. The feature vector is retrieved, for example from storage or a feature vector generator. The feature vector represents a media object or other data object. One or more permutations are generated, the dimensionality of the generated permutations equivalent to the dimensionality of the feature vector. The permutations may be generated randomly or formulaically. The feature vector is permuted with the one or more permutations, creating one or more permuted feature vectors. The permuted feature vectors are truncated according to a selected window size. The indexes representing the maximum values of the permuted feature vectors are identified and encoded using one-hot encoding, producing one or more sparse binary vectors. The sparse binary vectors may be concatenated into a single sparse binary vector and stored. The sparse binary vector may be used in the similarity search, indexing or categorization of media objects.

Abstract: A method includes identifying a named entity, retrieving images associated with the named entity, and using a face detection algorithm to perform face detection on the retrieved images to detect faces in the retrieved images. At least one representative face image from the retrieved images is identified, and the representative face image is used to identify one or more additional images representing the at least one named entity.

Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes inferring labels for videos, users, advertisements, groups of users, and other entities included in a social network system. The inferred labels can be used to generate recommendations such as videos or advertisements in which a user may be interested. Inferred labels can be generated based on social or other relationships derived from, for example, profiles or activities of social network users. Inferred labels can be advantageous when explicit information about these entities is not available. For example, a particular user may not have clicked on any online advertisements, so the user is not explicitly linked to any advertisements.

Abstract: Disclosed herein is a method, a system and a computer program product for generating a statistical classification model used by a computer system to determine a class associated with an unlabeled time series event. Initially, a set of labeled time series events is received. A set of time series features is identified for a selected set of the labeled time series events. A plurality of scale space decompositions is generated based on the set of time series features. A plurality of multi-scale features is generated based on the plurality of scale space decompositions. A first subset of the plurality of multi-scale features that correspond at least in part to a subset of space or time points within a time series event that contain feature data that distinguish the time series event as belonging to a class of time series events that corresponds to the class label are identified.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training scoring models. One method includes storing data identifying a plurality of positive and a plurality of negative training images for a query. The method further includes selecting a first image from either the positive group of images or the negative group of images, and applying a scoring model to the first image. The method further includes selecting a plurality of candidate images from the other group of images, applying the scoring model to each of the candidate images, and then selecting a second image from the candidate images according to scores for the images. The method further includes determining that the scores for the first image and the second image fail to satisfy a criterion, updating the scoring model, and storing the updated scoring model.

Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes determining, for a portion of users of a social network, label values each comprising an inferred interest level of a user in a subject indicated by a label, associating a first user with one or more second users based on one or more relationships specified by the first user, and outputting a first label value for the first user based on one or more second label values of the one or more second users.

Abstract: A method and system generates and compares fingerprints for videos in a video library. The video fingerprints provide a compact representation of the spatial and sequential characteristics of the video that can be used to quickly and efficiently identify video content. Because the fingerprints are based on spatial and sequential characteristics rather than exact bit sequences, visual content of videos can be effectively compared even when there are small differences between the videos in compression factors, source resolutions, start and stop times, frame rates, and so on. Comparison of video fingerprints can be used, for example, to search for and remove copyright protected videos from a video library. Further, duplicate videos can be detected and discarded in order to preserve storage space.

Abstract: A method includes identifying a named entity, retrieving images associated with the named entity, and using a face detection algorithm to perform face detection on the retrieved images to detect faces in the retrieved images. At least one representative face image from the retrieved images is identified, and the representative face image is used to identify one or more additional images representing the at least one named entity.

Abstract: A method, a system and a computer program product generate a statistical classification model used by a computer system to determine a class associated with an unlabeled time series event.

Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes determining, for a portion of users of a social network, label values each comprising an inferred interest level of a user in a subject indicated by a label, associating a first user with one or more second users based on one or more relationships specified by the first user, and outputting a first label value for the first user based on one or more second label values of the one or more second users.

Abstract: A method, a system and a computer program product generate a statistical classification model used by a computer system to determine a class associated with an unlabeled time series event.