Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for profiling and configuring work on a cluster of computer nodes.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for identifying a plurality of software components deployed on a cluster of computing nodes, each component operating on one or more respective nodes within the cluster to process a workload, each component utilizing at least the following resources of the one or more respective nodes: storage, processing power, memory, and disk and network input and output operations; determining, for each identified component, current and historical usages of the resources of the one or more respective nodes by the component when processing the workload; receiving data specifying a future workload; and calculating, from the current and historical usages of each component, an estimated capacity required for the cluster to process the future workload, where the estimated capacity specifies, at least, how many nodes should be in the cluster to process the future workload.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for identifying a plurality of software components within a cluster of computing nodes, each component operating on one or more respective nodes within the cluster to process a workload; determining, for each identified component, a respective resource usage trend for the component having a respective range of predicted values; comparing, for each identified component, the respective range of predicted values to a respective range of suitable values; and generating, for each component with the respective range of predicted values that is outside of the respective range of suitable values, a respective recommendation for configuring the component to cause the component to generate an updated respective resource usage trend having an updated respective range of predicted values that are inside of the respective range of suitable values.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for identifying inconsistent security policies. One of the methods includes identifying running software components on a cluster of computers, a first subset of the components managing datasets, a second subset of the components managing other components; identifying entity pairs, each being either: (1) (i) a component paired with (ii) a dataset, or (2) two components paired with each other; determining, for each entity pair, a directed relationship from a first to a second entity, where the first entity is a component, and where the directed relationship represents the first entity executing a type of interaction with the second entity; identifying security policies affecting each entity that each limit user access to a type of interaction; and analyzing, for each entity, entity pairs including the entity and one or more security policies affecting the entity to identify inconsistent security policies.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for identifying inconsistent security policies. One of the methods includes identifying running software components on a cluster of computers, a first subset of the components managing datasets, a second subset of the components managing other components; identifying entity pairs, each being either: (1) (i) a component paired with (ii) a dataset, or (2) two components paired with each other; determining, for each entity pair, a directed relationship from a first to a second entity, where the first entity is a component, and where the directed relationship represents the first entity executing a type of interaction with the second entity; identifying security policies affecting each entity that each limit user access to a type of interaction; and analyzing, for each entity, entity pairs including the entity and one or more security policies affecting the entity to identify inconsistent security policies.