Abstract: A dynamically-managed microservices platform. The microservices platform is configured to selectively accept admission of microservices and to selectively throttle microservices based on a continually-trained machine learning model. The system is configured to implement multiple microservice lifecycle strategies, where individual ones of the multiple microservice lifecycle strategies use a prediction model having long-term and short term demand predictions. One or another of the multiple microservice lifecycle strategies are invoked at different times under different conditions. Under a first set of conditions, a prediction model is used to select a first strategy to admit or throttle a microservice based upon long-term or short-term demand predictions. Under a second set of conditions, the prediction model is used to select a different strategy to admit or throttle a microservice.

Abstract: A dynamically-managed microservices platform. The microservices platform is configured to selectively accept admission of microservices and to selectively throttle microservices based on a continually-trained machine learning model. The system is configured to implement multiple microservice lifecycle strategies, where individual ones of the multiple microservice lifecycle strategies use a prediction model having long-term and short term demand predictions. One or another of the multiple microservice lifecycle strategies are invoked at different times under different conditions. Under a first set of conditions, a prediction model is used to select a first strategy to admit or throttle a microservice based upon long-term or short-term demand predictions. Under a second set of conditions, the prediction model is used to select a different strategy to admit or throttle a microservice.

Abstract: Datasource processors may communicate with an artificial intelligence (AI) engine in order to generate, in parallel, object summaries from datasource objects received from datasources. Each object summary may include an object identifier, one or more local entities, and a mapping from each of the one or more local entities to one or more attributes. A global entity resolver may augment the object summaries by mapping each of the local entities to a global entity. Policy engines may evaluate, in parallel, the object summaries with respect to a security and/or privacy policy. If a security and/or privacy violation is recognized, a remediation measure may be applied in connection with the datasource object for which the security and/or privacy violation exists.

Abstract: A dynamically-managed microservices platform. The microservices platform is configured to selectively accept admission of microservices and to selectively throttle microservices based on a continually-trained machine learning model. The system is configured to implement multiple microservice lifecycle strategies, where individual ones of the multiple microservice lifecycle strategies use a prediction model having long-term and short term demand predictions. One or another of the multiple microservice lifecycle strategies are invoked at different times under different conditions. Under a first set of conditions, a prediction model is used to select a first strategy to admit or throttle a microservice based upon long-term or short-term demand predictions. Under a second set of conditions, the prediction model is used to select a different strategy to admit or throttle a microservice.

Abstract: In accordance with some aspects of the present disclosure, an apparatus is disclosed. The apparatus includes a processor and a memory, wherein the memory includes programmed instructions that when executed by the processor, cause the apparatus to receive a request to join a plurality of entity data structures using a first join order, determine a first performance cost of the first join order, determine a second performance cost of a second join order, determine whether the second performance cost is lower than the first performance cost, in response to determining that the second performance cost is lower than or exceeds the first performance cost, select the second join order or the first join order, respectively, join the plurality of entity data structures using the selected join order, and send the joined plurality of entity data structures.

Abstract: A method for time series analysis of time-oriented usage data pertaining to computing resources of a computing system. A method embodiment commences upon collecting time series datasets, individual ones of the time series datasets comprising time-oriented usage data of a respective individual computing resource. A plurality of prediction models are trained using portions of time-oriented data. The trained models are evaluated to determine quantitative measures pertaining to predictive accuracy. One of the trained models is selected and then applied over another time series dataset of the individual resource to generate a plurality of individual resource usage predictions. The individual resource usage predictions are used to calculate seasonally-adjusted resource usage demand amounts over a future time period. The resource usage demand amounts are compared to availability of the resource to form a runway that refers to a future time period when the resource is predicted to be demanded to its capacity.

Abstract: Systems and methods for scheduling storage management tasks over predicted user tasks in a distributed storage system. A method commences upon receiving a set of historical stimulus records that characterize management tasks that are run in the storage system. A corresponding set of historical response records comprising system metrics associated with execution of the system tasks is also received. A learning model is formed from the stimulus records and the response records and formatted to be used as a predictor. A set of forecasted user tasks is input as new stimulus records to the predictor to determine a set of forecasted system metrics that would result from running the forecasted user tasks. Management tasks are selected so as not to impact the forecasted user tasks. Management tasks can be selected based on non-contentions resource usage between historical management task resource usage and predictions of resource usage by the user tasks.

Abstract: Systems and methods for scheduling storage management tasks over predicted user tasks in a distributed storage system. A method commences upon receiving a set of historical stimulus records that characterize management tasks that are run in the storage system. A corresponding set of historical response records comprising system metrics associated with execution of the system tasks is also received. A learning model is formed from the stimulus records and the response records and formatted to be used as a predictor. A set of forecasted user tasks is input as new stimulus records to the predictor to determine a set of forecasted system metrics that would result from running the forecasted user tasks. Management tasks are selected so as not to impact the forecasted user tasks. Management tasks can be selected based on non-contentions resource usage between historical management task resource usage and predictions of resource usage by the user tasks.

Abstract: Systems for cluster computing. A method for detection and remediation of degraded nodes in a cluster commences upon measuring operational aspects of the nodes in the cluster, then determining, based on the measurements and other factors, a suspect set of nodes comprising one or more suspect nodes from the nodes in the cluster that have measurements that are determined to be outliers with respect to remaining nodes that are determined not to be the outliers. A density-based spatial clustering analysis is performed over the suspect set and remediation actions are initiated when results of the density-based spatial clustering analysis identifies a suspect node as being a degraded node.

Abstract: In accordance with some aspects of the present disclosure, an apparatus is disclosed. The apparatus includes a processor and a memory, wherein the memory includes programmed instructions that when executed by the processor, cause the apparatus to receive a request to join a plurality of entity data structures using a first join order, determine a first performance cost of the first join order, determine a second performance cost of a second join order, determine whether the second performance cost is lower than the first performance cost, in response to determining that the second performance cost is lower than or exceeds the first performance cost, select the second join order or the first join order, respectively, join the plurality of entity data structures using the selected join order, and send the joined plurality of entity data structures.

Abstract: This disclosure relates to resource allocation for workloads across computing environments and computing architectures. Computing resource usage of a workload is monitored, where the workload is executing on one or more processors of a first computing environment. One or more comparable workloads are identified based on the computing resource usage of the workload in the first environment. A suggested resource allocation for the workload in a second computing environment is generated based on characteristics of the one or more comparable workloads.

Abstract: A system and method for dynamically adjusting the amount of memory allocated to a virtual machine includes generating, by a memory resizing system, a current memory usage profile for the virtual machine. The memory resizing system and the virtual machine are part of a virtual computing system and the current memory usage profile is generated by mapping, as a function of time, memory usage information from the virtual machine. The system and method also include computing an upper baseline based upon a peak memory usage in the current memory profile, updating an initial memory allocation of the virtual machine based upon the upper baseline and a predetermined threshold for obtaining an initial revised memory allocation, determining a moving average of memory usage from a historical memory usage profile, and updating the initial revised memory allocation based upon the moving average of memory usage for obtaining a final revised memory allocation.

Abstract: Systems for distributed data storage. A method embodiment commences upon capturing a history of storage I/O activity over a recent time period. A predictive model is derived from the captured storage I/O activity, and the predictive model is then used for predicting future storage I/O activity. A set of snapshot planning parameters comprising objectives (e.g., to minimize costs or to maximize likelihood completing a snapshot activity by a prescribed time) and/or constraints (e.g., don't wait more than one day to start a snapshot) are applied to the predicted storage I/O characteristics to generate a set of feasible snapshot plans. One of the feasible snapshot plans is selected for scheduling so as to begin the planned snapshot activity at a prescribed time. The snapshot planning parameters are normalized based on the predicted storage I/O characteristics.

Abstract: Systems for alerting in computing systems. A method commences by defining a plurality of analysis zones bounded by respective ranges of system metric values, which ranges in turn correspond a plurality of system behavior classifications. System observations are taken while the computing system is running. A system observation comprising a measured metric value is classified into one or more of the behavior classifications. Based on the classification, one or more alert analysis processes are invoked to analyze the system observation and make a remediation recommendation. An alert or remediation is raised or suppressed based on one or more zone-based analysis outcomes. An alert is raised when anomalous behavior is detected. The system makes ongoing observations to learn how and when to classify a measured metric value into normal or anomalous behaviors. As changes occur in the system configuration, the analysis zones are adjusted to reflect changing bounds of the zones.

Abstract: Systems for distributed resource system management. A first computing system operates in a first computing environment. A predictive model is trained in the first computing environment to form a trained resource performance predictive model that comprises a set of trained model parameters to capture at least computing and storage IO parameters that are responsive to execution of one or more workloads that consume computing and storage resources in the first computing environment. When the trained resource performance predictive model is deployed to a second computing environment, various computing system configuration differences, and/or workload differences and/or other differences between the first computing environment and the second computing environment are detected and measured.

Abstract: A system and method for dynamically adjusting the amount of memory allocated to a virtual machine includes generating, by a memory resizing system, a current memory usage profile for the virtual machine. The memory resizing system and the virtual machine are part of a virtual computing system and the current memory usage profile is generated by mapping, as a function of time, memory usage information from the virtual machine. The system and method also include computing an upper baseline based upon a peak memory usage in the current memory profile, updating an initial memory allocation of the virtual machine based upon the upper baseline and a predetermined threshold for obtaining an initial revised memory allocation, determining a moving average of memory usage from a historical memory usage profile, and updating the initial revised memory allocation based upon the moving average of memory usage for obtaining a final revised memory allocation.

Abstract: Systems for cluster computing. A method for detection and remediation of degraded nodes in a cluster commences upon measuring operational aspects of the nodes in the cluster, then determining, based on the measurements and other factors, a suspect set of nodes comprising one or more suspect nodes from the nodes in the cluster that have measurements that are determined to be outliers with respect to remaining nodes that are determined not to be the outliers. A density-based spatial clustering analysis is performed over the suspect set and remediation actions are initiated when results of the density-based spatial clustering analysis identifies a suspect node as being a degraded node.

Abstract: Systems for distributed data storage. A method embodiment commences upon capturing a history of storage I/O activity over a recent time period. A predictive model is derived from the captured storage I/O activity, and the predictive model is then used for predicting future storage I/O activity. A set of snapshot planning parameters comprising objectives (e.g., to minimize costs or to maximize likelihood completing a snapshot activity by a prescribed time) and/or constraints (e.g., don't wait more than one day to start a snapshot) are applied to the predicted storage I/O characteristics to generate a set of feasible snapshot plans. One of the feasible snapshot plans is selected for scheduling so as to begin the planned snapshot activity at a prescribed time. The snapshot planning parameters are normalized based on the predicted storage I/O characteristics.

Abstract: Systems for distributed resource system management. A first computing system operates in a first computing environment. A predictive model is trained in the first computing environment to form a trained resource performance predictive model that comprises a set of trained model parameters to capture at least computing and storage IO parameters that are responsive to execution of one or more workloads that consume computing and storage resources in the first computing environment. When the trained resource performance predictive model is deployed to a second computing environment, various computing system configuration differences, and/or workload differences and/or other differences between the first computing environment and the second computing environment are detected and measured.

Abstract: A system for implementing seasonal time series analysis and forecasting using a distributed tournament selection process. Time series analysis is initiated by a prediction or runway event trigger. Prediction events include a determination of the availability of one or more resources at a given point in time or over a given time period. A runway event may include a determination of when a resource is below a minimum threshold level of availability. Training of the prediction models is based data taken from different time periods, accounting for any combination of time periods and/or for differing sampling frequencies or ranges. Processes for prosecuting a tournament to identify winning models are parallelized to achieve low latency tournament results. Ranking of each model and/or some combination of models is based on how precisely and/or conclusively the models match a determined set of training data.