Abstract: A computer-implemented video generation neural network system, configured to determine a value for each of a set of object latent variables by sampling from a respective prior object latent distribution for the object latent variable. The system comprises a trained image frame decoder neural network configured to, for each pixel of each generated image frame and for each generated image frame time step process determined values of the object latent variables to determine parameters of a pixel distribution for each of the object latent variables, combine the pixel distributions for each of the object latent variables to determine a combined pixel distribution, and sample from the combined pixel distribution to determine a value for the pixel and for the time step.

Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for predicting scene transitions. A computer system receives an input sequence of images of a scene with each image corresponding to a different time point in an observation time sequence. For each time point, the system processes the corresponding image using a decomposition neural network to generate one or more feature representations. The system processes the feature representations for the time points using an alignment neural network to generate a set of aligned sequences of feature representations. The system further processes the set of aligned sequences of feature representations using a transition neural network to predict, for each of the aligned sequences of feature representations, one or more feature representations that represent predicted features of the object represented by the aligned sequence at one or more successive time points.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a response to a query input using a selection-inference neural network.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for aligning entities across time.