Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a graph model representing an environment being interacted with by an agent. In one aspect, one of the methods include: obtaining experience data; using the experience data to update a visitation count for each of one or more state-action pairs represented by the graph model; and at each of multiple environment exploration steps: computing a utility measure for each of the one or more state-action pairs represented by the graph model; determining, based on the utility measures, a sequence of one or more planned actions that have an information gain that satisfies a threshold; and controlling the agent to perform the sequence of one or more planned actions to cause the environment to transition from a state characterized by a last observation received after a last action in the experience data into a different state.

Abstract: A system for event prediction using schema networks includes a first antecedent entity state that represents a first entity at a first time; a first consequent entity state that represents the first entity at a second time; a second antecedent entity state that represents a second entity at the first time; and a first schema factor that couples the first and second antecedent entity states to the first consequent entity state; wherein the first schema factor is configured to predict the first consequent entity state from the first and second antecedent entity states.

Abstract: A system and method for machine understanding, using program induction, includes a visual cognitive computer including a set of components designed to execute predetermined primitive functions. The method includes determining programs using a program induction engine that interfaces with the visual cognitive computer to discover programs using the predetermined primitive functions and/or executes the discovered programs based on an input.

Abstract: A method for generating data explanations in a recursive cortical network includes receiving a set of evidence data at child feature nodes of a first layer of the recursive cortical network, setting a transformation configuration that directs messaging of evidence data and transformed data between layers of the network, performing a series of transformations on the evidence data according to the transformation configuration, the series including at least one forward transformation and at least one reverse transformation, and outputting the transformed evidence data.

Abstract: A method for inferring patterns in multi-dimensional image data comprises providing a recursive network of sub-networks with a parent feature node and at least two child feature nodes; wherein each sub-network is associated with a distinct subset of the space; configuring nodes of the sub-networks with posterior distribution component; receiving image data feature input at the final child feature nodes; propagating node activation through the network layer hierarchy in a manner consistent with node connections of sub-networks of the network and the posterior prediction of child nodes; and outputting parent feature node selection to an inferred output.

Abstract: A method for inferring patterns in multi-dimensional image data comprises providing a recursive network of sub-networks with a parent feature node and at least two child feature nodes; wherein each sub-network is associated with a distinct subset of the space; configuring nodes of the sub-networks with posterior distribution component; receiving image data feature input at the final child feature nodes; propagating node activation through the network layer hierarchy in a manner consistent with node connections of sub-networks of the network and the posterior prediction of child nodes; and outputting parent feature node selection to an inferred output.

Abstract: A system for teaching compositionality to convolutional neural networks includes an unmasked convolutional neural network comprising a first set of convolutional neural network layers; a first masked convolutional neural network comprising a second set of convolutional neural network layers; the unmasked convolutional neural network and the first masked convolutional network sharing convolutional neural network weights; the system training the unmasked and first masked convolutional neural networks simultaneously based on an objective function that seeks to reduce both discriminative loss and compositional loss.

Abstract: A method for robot control using visual feedback including determining a generative model S100, training the generative model S200, and controlling the robot using the trained generative model S300.

Abstract: The method for query training can include: determining a graphical representation, determining an inference network based on the graphical representation, determining a query distribution, sampling one or more train queries from the query distribution, and optionally determining a trained inference network by training the untrained inference network using the train query. The method can optionally include determining an inference query and determining an inference query result for the inference query using the trained inference network.

Abstract: A system for teaching compositionality to convolutional neural networks includes an unmasked convolutional neural network comprising a first set of convolutional neural network layers; a first masked convolutional neural network comprising a second set of convolutional neural network layers; the unmasked convolutional neural network and the first masked convolutional network sharing convolutional neural network weights; the system training the unmasked and first masked convolutional neural networks simultaneously based on an objective function that seeks to reduce both discriminative loss and compositional loss.

Abstract: A system includes: a recursively architected network of sub-networks organized into a hierarchical layers; the sub-networks including at least a parent feature node, a pool node, a parent-specific child feature (PSCF) node, and a child feature node; the parent feature node of at least one sub-network configured with a selection function actionable on at least two pool nodes connected to the parent feature node of the at least one sub-network; the pool node of the at least one sub-network configured with a selection function actionable on at least two PSCF nodes connected to the pool node of the at least one sub-network; the PSCF node of the at least one sub-network configured to activate a connected child feature node; the child feature node connectable to at least a parent feature node of a sub-network at a lower hierarchical layer.

Abstract: A method for robot control using visual feedback including determining a generative model S100, training the generative model S200, and controlling the robot using the trained generative model S300.

Abstract: The method for query training can include: determining a graphical representation, determining an inference network based on the graphical representation, determining a query distribution, sampling one or more train queries from the query distribution, and optionally determining a trained inference network by training the untrained inference network using the train query. The method can optionally include determining an inference query and determining an inference query result for the inference query using the trained inference network.

Abstract: A method for robot control using visual feedback including determining a generative model S100, training the generative model S200, and controlling the robot using the trained generative model S300.

Abstract: The method for query training can include: determining a graphical representation, determining an inference network based on the graphical representation, determining a query distribution, sampling one or more train queries from the query distribution, and optionally determining a trained inference network by training the untrained inference network using the train query. The method can optionally include determining an inference query and determining an inference query result for the inference query using the trained inference network.

Abstract: The system and method for determining and using a cloned hidden Markov model (CHMM) preferably including: determining an initial CHMM, learning a final CHMM, and using the final CHMM, wherein the CHMM includes a transition probability data structure and an observation probability data structure.

Abstract: A system for event prediction using schema networks includes a first antecedent entity state that represents a first entity at a first time; a first consequent entity state that represents the first entity at a second time; a second antecedent entity state that represents a second entity at the first time; and a first schema factor that couples the first and second antecedent entity states to the first consequent entity state; wherein the first schema factor is configured to predict the first consequent entity state from the first and second antecedent entity states.

Abstract: A system and method for machine understanding, using program induction, includes a visual cognitive computer including a set of components designed to execute predetermined primitive functions. The method includes determining programs using a program induction engine that interfaces with the visual cognitive computer to discover programs using the predetermined primitive functions and/or executes the discovered programs based on an input.

Abstract: A system for event prediction using schema networks includes a first antecedent entity state that represents a first entity at a first time; a first consequent entity state that represents the first entity at a second time; a second antecedent entity state that represents a second entity at the first time; and a first schema factor that couples the first and second antecedent entity states to the first consequent entity state; wherein the first schema factor is configured to predict the first consequent entity state from the first and second antecedent entity states.

Abstract: A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.