Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a high-level controller neural network for controlling an agent. In particular, the high-level controller neural network generates natural language commands that can be provided as input to a low-level controller neural network, which generates control outputs that can be used to control the agent.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a memory-based prediction system configured to receive an input observation characterizing a state of an environment interacted with by an agent and to process the input observation and data read from a memory to update data stored in the memory and to generate a latent representation of the state of the environment. The method comprises: for each of a plurality of time steps: processing an observation for the time step and data read from the memory to: (i) update the data stored in the memory, and (ii) generate a latent representation of the current state of the environment as of the time step; and generating a predicted return that will be received by the agent as a result of interactions with the environment after the observation for the time step is received.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a memory-based prediction system configured to receive an input observation characterizing a state of an environment interacted with by an agent and to process the input observation and data read from a memory to update data stored in the memory and to generate a latent representation of the state of the environment. The method comprises: for each of a plurality of time steps: processing an observation for the time step and data read from the memory to: (i) update the data stored in the memory, and (ii) generate a latent representation of the current state of the environment as of the time step; and generating a predicted return that will be received by the agent as a result of interactions with the environment after the observation for the time step is received.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for controlling agents using reporter neural networks.

Abstract: Systems, methods, and media for detecting suspicious activity in connection with advertisement impressions are provided.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Systems, methods, and media for detecting suspicious activity in connection with advertisement impressions are provided.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for controlling agents. In particular, an interactive agent can be controlled based on multi-modal inputs that include both an observation image and a natural language text sequence.

Abstract: Systems, methods, and media for detecting suspicious activity in connection with advertisement impressions are provided.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Systems, methods, and media for detecting suspicious activity in connection with advertisement impressions are provided.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a memory-based prediction system configured to receive an input observation characterizing a state of an environment interacted with by an agent and to process the input observation and data read from a memory to update data stored in the memory and to generate a latent representation of the state of the environment. The method comprises: for each of a plurality of time steps: processing an observation for the time step and data read from the memory to: (i) update the data stored in the memory, and (ii) generate a latent representation of the current state of the environment as of the time step; and generating a predicted return that will be received by the agent as a result of interactions with the environment after the observation for the time step is received.

Abstract: Systems, methods, and media for detecting suspicious activity in connection with advertisement impressions are provided.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided.

Abstract: Systems, methods, and media for detecting suspicious activity in connection with advertisement impressions are provided.

Abstract: The present invention relates to a method for conducting transactions, such as standard banking transactions, using a wireless device, such as a cellular telephone, personal digital assistant, and other web-enabled wireless devices utilizing software downloaded to the wireless device. The software provides a user with interface screens on the display of the wireless device for facilitating information requests to a service provider having access to at least one account of the user.