Abstract: Generating granular clusters for real-time processing is provided. The systems can identify tokens based on aggregating input from computing devices over a time interval. The systems can identify, based on metrics, a subset of tokens for cluster generation. The systems can generate, via a clustering technique, token clusters from the subset of the tokens, each of the token clusters comprising two or more tokens from the subset of the tokens. The systems can apply a de-duplication technique to each of the token clusters. The systems can apply a filtering technique to the token clusters to remove tokens erroneously grouped in a token cluster. The systems can assign, based on a selection process, a label for each of the token clusters. The systems can activate, based on a number of remaining tokens in each of the token clusters, a subset of the token clusters for real-time content selection.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for distributing content are disclosed. In one aspect, a method includes storing, in a data structure, data specifying a future live event. An opportunity to provide the specified content to a user at a user device is identified. It is determined that (i) a time of the opportunity is between a start time and an end time for the live event, (ii) that a user device is located in a same geographic region as the live event based on geographical data provided by the user device, and (iii) the user is interested in the live event based on attributes of the user matching attributes of other users that were identified as interested in the live event (e.g., based on evaluation of online search data). The content is provided for display at the user device.

Abstract: Generating granular clusters for real-time processing is provided. The systems can identify tokens based on aggregating input from computing devices over a time interval. The systems can identify, based on metrics, a subset of tokens for cluster generation. The systems can generate, via a clustering technique, token clusters from the subset of the tokens, each of the token clusters comprising two or more tokens from the subset of the tokens. The systems can apply a de-duplication technique to each of the token clusters. The systems can apply a filtering technique to the token clusters to remove tokens erroneously grouped in a token cluster. The systems can assign, based on a selection process, a label for each of the token clusters. The systems can activate, based on a number of remaining tokens in each of the token clusters, a subset of the token clusters for real-time content selection.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for selecting a neural network to perform a particular machine learning task while satisfying a set of constraints.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for distributing content are disclosed. In one aspect, a method includes storing, in a data structure, data specifying a future live event. An opportunity to provide the specified content to a user at a user device is identified. It is determined that (i) a time of the opportunity is between a start time and an end time for the live event, (ii) that a user device is located in a same geographic region as the live event based on geographical data provided by the user device, and (iii) the user is interested in the live event based on attributes of the user matching attributes of other users that were identified as interested in the live event (e.g., based on evaluation of online search data). The content is provided for display at the user device.

Abstract: Systems and methods of the present disclosure are directed to a computer-implemented method. The method can include obtaining a machine-learned model comprising a plurality of model units, wherein each model unit comprises a plurality of parameters that are tied to a shared plurality of parameters. The method can include performing a first plurality of training iterations with the machine-learned model to adjust parameters of the shared plurality of parameters. The method can include detecting, based on the first plurality of training iterations, an occurrence of an untying condition. The method can include untying the parameters of one or more model units from the shared plurality of parameters. The method can include performing a second plurality of training iterations with the machine-learned model to adjust parameters of the one or more model units independent of the shared plurality of parameters.

Abstract: A computer-implemented method of generating scale-permuted models can generate models having improved accuracy and reduced evaluation computational requirements. The method can include defining, by a computing system including one or more computing devices, a search space including a plurality of candidate permutations of a plurality of candidate feature blocks, each of the plurality of candidate feature blocks having a respective scale. The method can include performing, by the computing system, a plurality of search iterations by a search algorithm to select a scale-permuted model from the search space, the scale-permuted model based at least in part on a candidate permutation of the plurality of candidate permutations.

Abstract: Systems and methods of providing information via a computer network are provided. A data processing system can identify a cluster that includes a plurality of online content items having a semantic or user similarity. The data processing system determines a plurality of cluster placement criteria of the cluster, and receives content configured for display with a web page. The content can be associated with the cluster based on the semantic or user similarity. A cluster placement criterion of the plurality of cluster placement criteria can be selected based on a quality metric of the selected cluster placement criterion, and the selected cluster placement criterion can be provided as a supplemental criterion used to select the content for display with the web page.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for distributing content are disclosed. In one aspect, a method includes storing, in a data structure, data specifying a future live event. An opportunity to provide the specified content to a user at a user device is identified. It is determined that (i) a time of the opportunity is between a start time and an end time for the live event, (ii) that a user device is located in a same geographic region as the live event based on geographical data provided by the user device, and (iii) the user is interested in the live event based on attributes of the user matching attributes of other users that were identified as interested in the live event (e.g., based on evaluation of online search data). The content is provided for display at the user device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for distributing content are disclosed. In one aspect, a method includes storing, in a data structure, data specifying a future live event. An opportunity to provide the specified content to a user at a user device is identified. It is determined that (i) a time of the opportunity is between a start time and an end time for the live event, (ii) that a user device is located in a same geographic region as the live event based on geographical data provided by the user device, and (iii) the user is interested in the live event based on attributes of the user matching attributes of other users that were identified as interested in the live event (e.g., based on evaluation of online search data). The content is provided for display at the user device.

Abstract: Generating granular clusters for real-time processing is provided. The systems can identify tokens based on aggregating input from computing devices over a time interval. The systems can identify, based on metrics, a subset of tokens for cluster generation. The systems can generate, via a clustering technique, token clusters from the subset of the tokens, each of the token clusters comprising two or more tokens from the subset of the tokens. The systems can apply a de-duplication technique to each of the token clusters. The systems can apply a filtering technique to the token clusters to remove tokens erroneously grouped in a token cluster. The systems can assign, based on a selection process, a label for each of the token clusters. The systems can activate, based on a number of remaining tokens in each of the token clusters, a subset of the token clusters for real-time content selection.

Abstract: Systems and methods of providing information via a computer network are provided. A data processing system can identify a cluster that includes a plurality of online content items having a semantic or user similarity. The data processing system determines a plurality of cluster placement criteria of the cluster, and receives content configured for display with a web page. The content can be associated with the cluster based on the semantic or user similarity. A cluster placement criterion of the plurality of cluster placement criteria can be selected based on a quality metric of the selected cluster placement criterion, and the selected cluster placement criterion can be provided as a supplemental criterion used to select the content for display with the web page.

Abstract: Systems and methods of providing information via a computer network are provided. A data processing system can identify a cluster that includes a plurality of online content items having a semantic or user similarity. The data processing system determines a plurality of cluster placement criteria of the cluster, and receives content configured for display with a web page. The content can be associated with the cluster based on the semantic or user similarity. A cluster placement criterion of the plurality of cluster placement criteria can be selected based on a quality metric of the selected cluster placement criterion, and the selected cluster placement criterion can be provided as a supplemental criterion used to select the content for display with the web page.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for distributing content are disclosed. In one aspect, a method includes storing, in a data structure, data specifying a future live event. An opportunity to provide the specified content to a user at a user device is identified. It is determined that (i) a time of the opportunity is between a start time and an end time for the live event, (ii) that a user device is located in a same geographic region as the live event based on geographical data provided by the user device, and (iii) the user is interested in the live event based on attributes of the user matching attributes of other users that were identified as interested in the live event (e.g., based on evaluation of online search data). The content is provided for display at the user device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for distributing content are disclosed. In one aspect, a method includes storing, in a data structure, data specifying a future live event. An opportunity to provide the specified content to a user at a user device is identified. It is determined that (i) a time of the opportunity is between a start time and an end time for the live event, (ii) that a user device is located in a same geographic region as the live event based on geographical data provided by the user device, and (iii) the user is interested in the live event based on attributes of the user matching attributes of other users that were identified as interested in the live event (e.g., based on evaluation of online search data). The content is provided for display at the user device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for distributing content are disclosed. In one aspect, a method includes storing, in a data structure, data specifying a future live event. An opportunity to provide the specified content to a user at a user device is identified. It is determined that (i) a time of the opportunity is between a start time and an end time for the live event, (ii) that a user device is located in a same geographic region as the live event based on geographical data provided by the user device, and (iii) the user is interested in the live event based on attributes of the user matching attributes of other users that were identified as interested in the live event (e.g., based on evaluation of online search data). The content is provided for display at the user device.

Abstract: Systems and methods of providing information via a computer network are provided. A data processing system can identify a cluster that includes a plurality of online content items having a semantic or user similarity. The data processing system determines a plurality of cluster placement criteria of the cluster, and receives content configured for display with a web page. The content can be associated with the cluster based on the semantic or user similarity. A cluster placement criterion of the plurality of cluster placement criteria can be selected based on a quality metric of the selected cluster placement criterion, and the selected cluster placement criterion can be provided as a supplemental criterion used to select the content for display with the web page.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for scoring concept terms using a deep network. One of the methods includes receiving an input comprising a plurality of features of a resource, wherein each feature is a value of a respective attribute of the resource; processing each of the features using a respective embedding function to generate one or more numeric values; processing the numeric values to generate an alternative representation of the features of the resource, wherein processing the floating point values comprises applying one or more non-linear transformations to the floating point values; and processing the alternative representation of the input to generate a respective relevance score for each concept term in a pre-determined set of concept terms, wherein each of the respective relevance scores measures a predicted relevance of the corresponding concept term to the resource.

Abstract: Systems and methods of providing information via a computer network are provided. A data processing system can identify a cluster that includes a plurality of online content items having a semantic or user similarity. The data processing system determines a plurality of cluster placement criteria of the cluster, and receives content configured for display with a web page. The content can be associated with the cluster based on the semantic or user similarity. A cluster placement criterion of the plurality of cluster placement criteria can be selected based on a quality metric of the selected cluster placement criterion, and the selected cluster placement criterion can be provided as a supplemental criterion used to select the content for display with the web page.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for scoring concept terms using a deep network. One of the methods includes receiving an input comprising a plurality of features of a resource, wherein each feature is a value of a respective attribute of the resource; processing each of the features using a respective embedding function to generate one or more numeric values; processing the numeric values to generate an alternative representation of the features of the resource, wherein processing the floating point values comprises applying one or more non-linear transformations to the floating point values; and processing the alternative representation of the input to generate a respective relevance score for each concept term in a pre-determined set of concept terms, wherein each of the respective relevance scores measures a predicted relevance of the corresponding concept term to the resource.