Abstract: Techniques are disclosed for aggregating received data from a data stream. Data is received from a particular stream partition to which a device is subscribed, and subsets of the data, from the particular stream partition, are aggregated based on respective keys associated with the subsets of the data. The device determines whether one or more subsets of data, associated with a particular key, meet at least one processing criteria, such as a threshold amount of data, and refraining from processing the aggregated data when the processing criteria is not met. Once additional subset(s) of data associated with the particular key are received, they are aggregated with the one or more subsets of data. When the processing criteria is satisfied, the device processes the aggregated subsets of data associated with the particular key.

Abstract: Techniques are disclosed for partitioning received data for use in a data stream. Data is received during a period of time at a device, such as a data partitioner. The device a) determines that a first subset of the data is for a first system component, b) a second subset of the data is for a second system component, and c) a third subset of the data is for the first system component. Also, determines that a first stream partition is mapped to the first system component and a second stream partition is mapped to the second system component. Based on these determinations, the device assigns the first and third subsets of the data to the first stream partition and the second subset of the data to the second stream partition. Thereafter, the device transmits a stream that includes the first stream partition and the second stream partition.

Abstract: The present disclosure relates to systems and methods that enhance log data processing by asynchronously processing log data for detecting log messages that include errors and enriching the log messages with annotations that identify the errors. More particularly, log data that includes log records can be received. The log data can be asynchronously processed to validate a configuration of each log record and to validate data included in each log record. An attribute of a particular log record can be determined to correspond to an error. A category of the error can be determined. An enriched log record can be generated by augmenting the particular log record with error information indicating the category. The enriched log record can be transmitted via a user interface to facilitate correction of the error.

Abstract: Techniques for recommending plans to remediate a network topologies are disclosed. The techniques include predicting characteristics of the network using network topology information identifying relationships between entities in the network. The techniques further include determining a subset of the topology based on the predicted characteristics violating anomaly detection criteria. Additionally, the techniques include determining a remediation plan for modifying the subset and presenting the plan to a user.

Abstract: Techniques for recommending plans to remediate a network topologies are disclosed. The techniques include logging network topology information identifying relationships between entities in a network topology over a number of time periods. The techniques also include, using the logged network topology information, predicting characteristics of the network at a future time period. The techniques further include computing a signature based on the predicted characteristics and, using the signature, determining whether the predicted characteristics meet remediation criteria. Additionally, the techniques include, in response to determining the predicted characteristics meet the remediation criteria, determining a remediation plan for the current network topology and presenting the plan to a user.

Abstract: Systems that determine relationships between network components of a cluster using packet filters are disclosed. A system can identify objects that implement services of a cluster and network connections associated with respective pairs of the objects. The system can also filter out network connections from the identified network connections. The filtering can remove connections between source objects and destination objects based on the destination objects lacking any components that implement a service in cluster. The filtering can also retain network connections between source objects and destination objects based on the source objects including components that implement at least one service, and based on the second destination object including components that implement at least one service. Additionally, the system can generate relationship maps and network topologies using the determined relationships.

Abstract: Log data that includes a plurality of log records is asynchronously processed to validate a configuration of each log record and data included in each log record. It is determined that one or more attributes of a particular subset of log records of the plurality of log records corresponds to one or more errors. Using the particular subset, one or more enriched log records are generated by augmenting each log record of the particular subset of log records with error information that indicates one or more categories corresponding to the one or more errors. A user interface is generated to facilitate correction of the one or more errors, the user interface comprising a plurality of interactive elements corresponding to a plurality of error metrics of different categories of errors, wherein the one or more categories of the one or more errors are included in the different categories of errors.

Abstract: Systems that determine relationships between network components of a cluster using packet filters are disclosed. A system can identify objects that implement services of a cluster and network connections associated with respective pairs of the objects. The system can also filter out network connections from the identified network connections. The filtering can remove connections between source objects and destination objects based on the destination objects lacking any components that implement a service in cluster. The filtering can also retain network connections between source objects and destination objects based on the source objects including components that each implement at least one service, and based on the second destination object including components that each implement at least one service. Additionally, the system can generate relationship maps and network topologies using the determined relationships.

Abstract: Log data that includes a plurality of log records is asynchronously processed to validate a configuration of each log record and data included in each log record. It is determined that one or more attributes of a particular subset of log records of the plurality of log records corresponds to one or more errors. Using the particular subset, one or more enriched log records are generated by augmenting each log record of the particular subset of log records with error information that indicates one or more categories corresponding to the one or more errors. A user interface is generated to facilitate correction of the one or more errors, the user interface comprising a plurality of interactive elements corresponding to a plurality of error metrics of different categories of errors, wherein the one or more categories of the one or more errors are included in the different categories of errors.

Abstract: The present disclosure relates to systems and methods that enhance log data processing by asynchronously processing log data for detecting log messages that include errors and enriching the log messages with annotations that identify the errors. More particularly, log data that includes log records can be received. The log data can be asynchronously processed to validate a configuration of each log record and to validate data included in each log record. An attribute of a particular log record can be determined to correspond to an error. A category of the error can be determined. An enriched log record can be generated by augmenting the particular log record with error information indicating the category. The enriched log record can be transmitted via a user interface to facilitate correction of the error.

Abstract: Techniques are disclosed for partitioning received data for use in a data stream. Data is received during a period of time at a device, such as a data partitioner. The device a) determines that a first subset of the data is for a first system component, b) a second subset of the data is for a second system component, and c) a third subset of the data is for the first system component. Also, determines that a first stream partition is mapped to the first system component and a second stream partition is mapped to the second system component. Based on these determinations, the device assigns the first and third subsets of the data to the first stream partition and the second subset of the data to the second stream partition. Thereafter, the device transmits a stream that includes the first stream partition and the second stream partition.

Abstract: Techniques are disclosed for aggregating received data from a data stream. Data is received from a particular stream partition to which a device is subscribed, and subsets of the data, from the particular stream partition, are aggregated based on respective keys associated with the subsets of the data. The device determines whether one or more subsets of data, associated with a particular key, meet at least one processing criteria, such as a threshold amount of data, and refraining from processing the aggregated data when the processing criteria is not met. Once additional subset(s) of data associated with the particular key are received, they are aggregated with the one or more subsets of data. When the processing criteria is satisfied, the device processes the aggregated subsets of data associated with the particular key.