Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: A method and system for controlling access to an Internet resource is disclosed herein. When a request for an Internet resource, such as a Web site, is transmitted by an end-user of a LAN, a security appliance for the LAN analyzes a reputation index for the Internet resource before transmitting the request over the Internet. The reputation index is based on a plurality of factors for the Internet resource. A client application's access to the Internet resource can be allowed or denied based on the reputation index of the Internet resource.

Abstract: A method and system for controlling access to an Internet resource is disclosed herein. When a request for an Internet resource, such as a Web site, is transmitted by an end-user of a LAN, a security appliance for the LAN analyzes a reputation index for the Internet resource before transmitting the request over the Internet. The reputation index is based on a reputation vector which includes a plurality of factors for the Internet resource such as country of domain registration, country of service hosting, country of an internet protocol address block, age of a domain registration, popularity rank, internet protocol address, number of hosts, to-level domain, a plurality of run-time behaviors, JavaScript block count, picture count, immediate redirect and response latency. If the reputation index for the Internet resource is at or above a threshold value established for the LAN, then access to the Internet resource is permitted.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for off-policy evaluation of a control policy. One of the methods includes obtaining policy data specifying a control policy for controlling a source agent interacting with a source environment to perform a particular task; obtaining a validation data set generated from interactions of a target agent in a target environment; determining a performance estimate that represents an estimate of a performance of the control policy in controlling the target agent to perform the particular task in the target environment; and determining, based on the performance estimate, whether to deploy the control policy for controlling the target agent to perform the particular task in the target environment.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing content. Data specifying a post-install activity is received from a provider of an application. An opportunity is identified to provide third-party content to a user. A likelihood is determined that the user will perform the specified post-install activity based on one or more attributes of the user and attributes of users that have previously performed the specified post-install activity in the application. A selection value is adjusted for third-party content that identifies the application based on the determined likelihood, wherein the selection value increases as the likelihood increases. The third-party content identifying the application is selected based on the adjusted selection value. The third-party content identifying the application is distributed to a client device of the user.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing content. Data specifying a post-install activity is received from a provider of an application. An opportunity is identified to provide third-party content to a user. A likelihood is determined that the user will perform the specified post-install activity based on one or more attributes of the user and attributes of users that have previously performed the specified post-install activity in the application. A selection value is adjusted for third-party content that identifies the application based on the determined likelihood, wherein the selection value increases as the likelihood increases. The third-party content identifying the application is selected based on the adjusted selection value. The third-party content identifying the application is distributed to a client device of the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for optimizing digital components. In one aspect, the system includes a digital component server that identifies a digital component to be presented in an electronic document. The system also includes a digital component distribution server that interacts with the digital component server to determine that the electronic document includes a particular item that identifies a same entity as the digital component that was identified to be presented in the electronic document. The system combines at least a portion of the digital component with content from the particular item to form an optimized digital component. The optimized digital component is integrated into the electronic document rather than presenting either of the particular item or the digital component individually.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing content. Data specifying a post-install activity is received from a provider of an application. An opportunity is identified to provide third-party content to a user. A likelihood is determined that the user will perform the specified post-install activity based on one or more attributes of the user and attributes of users that have previously performed the specified post-install activity in the application. A selection value is adjusted for third-party content that identifies the application based on the determined likelihood, wherein the selection value increases as the likelihood increases. The third-party content identifying the application is selected based on the adjusted selection value. The third-party content identifying the application is distributed to a client device of the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for off-policy evaluation of a control policy. One of the methods includes obtaining policy data specifying a control policy for controlling a source agent interacting with a source environment to perform a particular task; obtaining a validation data set generated from interactions of a target agent in a target environment; determining a performance estimate that represents an estimate of a performance of the control policy in controlling the target agent to perform the particular task in the target environment; and determining, based on the performance estimate, whether to deploy the control policy for controlling the target agent to perform the particular task in the target environment.

Abstract: Methods, systems, apparatus, including computer programs encoded on a computer storage medium, for determining whether to execute a query based on a predicted computerized rendering period The method may include actions of receiving a query, determining a set of one or more features based on the query, generating a query vector, providing the query vector to a machine learning model, receiving first data, based on the output of the machine learning model, that is indicative of whether the computerized rendering period associated with the query is likely to satisfy the predetermined threshold, determining based on the first data that the computerized rendering period available for displaying a set of one or more candidate content items that are responsive to the query is not likely to satisfy the predetermined threshold, and determining to not use a search engine to execute the received query.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing content. Data specifying a post-install activity is received from a provider of an application. An opportunity is identified to provide third-party content to a user. A likelihood is determined that the user will perform the specified post-install activity based on one or more attributes of the user and attributes of users that have previously performed the specified post-install activity in the application. A selection value is adjusted for third-party content that identifies the application based on the determined likelihood, wherein the selection value increases as the likelihood increases. The third-party content identifying the application is selected based on the adjusted selection value. The third-party content identifying the application is distributed to a client device of the user.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing content. Data specifying a post-install activity is received from a provider of an application. An opportunity is identified to provide third-party content to a user. A likelihood is determined that the user will perform the specified post-install activity based on one or more attributes of the user and attributes of users that have previously performed the specified post-install activity in the application. A selection value is adjusted for third-party content that identifies the application based on the determined likelihood, wherein the selection value increases as the likelihood increases. The third-party content identifying the application is selected based on the adjusted selection value. The third-party content identifying the application is distributed to a client device of the user.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a system that controls content distribution using a feedback loop. Content is distributed over multiple different online channels using a same initial selection value for distribution over each different online channel. An observed user actions required for distribution of the content over the multiple different online channels is received through a feedback loop and for multiple different distributions of the content. Based on the observed user actions received through the feedback loop, a predicted user action rate is determined for the multiple different distributions across the multiple different online channels. The selection value is adjusted based on a difference between the predicted user action rate and a reference distribution amount specified by a provider of the content. The content is distributed over the multiple different online channels using the adjusted selection value.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for optimizing digital components. In one aspect, the system includes a digital component server that identifies a digital component to be presented in an electronic document. The system also includes a digital component distribution server that interacts with the digital component server to determine that the electronic document includes a particular item that identifies a same entity as the digital component that was identified to be presented in the electronic document. The system combines at least a portion of the digital component with content from the particular item to form an optimized digital component. The optimized digital component is integrated into the electronic document rather than presenting either of the particular item or the digital component individually.