Abstract: Aspects of the present disclosure provide systems, methods, and computer-readable storage media that support automated optimization of product management systems. In embodiments, automated optimization of component tools of the product management system is provided by automated evaluation and optimization of associated rules and metadata. In embodiments, metadata and rules may be associated to each other by an assessment engine. A recommendation engine may then identify non-compliant metadata, may determine a condition of the rule, and/or may generate recommendations for the rules based on the non-compliant metadata. Automated optimization of the product management system may include automated creation and mapping of decomposition relationships between commercial products and technical products. In embodiments, input data may be parsed into a set of object with unique attribute fields, which may then be validated.

Abstract: Systems and methods for facilitating validation of datasets are disclosed. A system may include a processor. The system may include a data validator implemented via the processor to receive an input dataset including a component metadata. The data validator may perform, using an validation model and through a rules engine, validation of information in the component metadata to obtain a validation dataset. The validation may enable to predict at least one invalid feature in the component dataset. The system may include an insight generator implemented via the processor to generate, based on the validation datasets, automated insights pertaining to mitigation of the at least one invalid feature. In an embodiment, the automated insights may be stored in a distributed ledger to facilitate an authenticated storage of the automated insights. The authenticated storage may be facilitated by a network comprising a plurality of nodes.

Abstract: A system, computer program product, and method are presented for performing multi-objective automated machine learning, and, more specifically, to identifying a plurality of machine learning pipelines as Pareto-optimal solutions to optimize a plurality of objectives. The method includes receiving input data directed toward one or more subjects of interest and determining a plurality of objectives to be optimized. The method also includes ingesting at least a portion of the input data through one or more machine learning (ML) models. The method further includes aggregating the plurality of objectives into one or more aggregated single objectives. The method also includes determining a plurality of Pareto-optimal solutions, thereby defining a plurality of ML pipelines that optimize the one or more aggregated single objectives. The method further includes selecting one ML pipeline from the plurality of ML pipelines.

Abstract: Aspects of the present disclosure provide systems, methods, and computer-readable storage media that support automated optimization of product management systems. In embodiments, automated optimization of component tools of the product management system is provided by automated evaluation and optimization of associated rules and metadata. In embodiments, metadata and rules may be associated to each other by an assessment engine. A recommendation engine may then identify non-compliant metadata, may determine a condition of the rule, and/or may generate recommendations for the rules based on the non-compliant metadata. Automated optimization of the product management system may include automated creation and mapping of decomposition relationships between commercial products and technical products. In embodiments, input data may be parsed into a set of object with unique attribute fields, which may then be validated.

Abstract: A system, program product, and method for performing multi-objective automated machine learning. The method includes selecting two or more objectives from a plurality of objectives to be optimized and injecting data and the objectives into a first machine learning (ML) pipeline. The first ML pipeline includes one or more data transformation stages in communication with a modeling stage. The method also includes executing, subject to the injecting, optimization of the two or objectives. Such executing includes selecting a respective algorithm for each of the data transformation stages and the modeling stage. Each respective algorithm is associated with a first set of respective hyperparameters. The executing also includes generating a plurality of second ML pipelines.

Abstract: Techniques for utilizing model and hyperparameter optimization for multi-objective machine learning are disclosed. In one example, a method comprises the following steps. One of a plurality of hyperparameter optimization operations and a plurality of model parameter optimization operations are performed to generate a first solution set. The other of the plurality of hyperparameter optimization operations and the plurality of model parameter optimization operations are performed to generate a second solution set. At least a portion of the first solution set and at least a portion of the second solution set are combined to generate a third solution set.

Abstract: One embodiment provides a method, including: receiving at least one deep learning job for scheduling and running on a distributed system comprising a plurality of nodes; receiving a batch size range indicating a minimum batch size and a maximum batch size that can be utilized for running the at least one deep learning job; determining a plurality of runtime estimations for running the at least one deep learning job; creating a list of optimal combinations of (i) batch sizes and (ii) numbers of the plurality of nodes for running both (a) the at least one deep learning job and (b) current deep learning jobs; and scheduling the at least one deep-learning job at the distributed system, responsive to identifying, by utilizing the list, that the distributed system has necessary processing resources for running both (iii) the at least one deep learning job and (iv) the current deep learning jobs.

Abstract: A system, computer program product, and method are presented for performing multi-objective automated machine learning, and, more specifically, to identifying a plurality of machine learning pipelines as Pareto-optimal solutions to optimize a plurality of objectives. The method includes receiving input data directed toward one or more subjects of interest and determining a plurality of objectives to be optimized. The method also includes ingesting at least a portion of the input data through one or more machine learning (ML) models. The method further includes aggregating the plurality of objectives into one or more aggregated single objectives. The method also includes determining a plurality of Pareto-optimal solutions, thereby defining a plurality of ML pipelines that optimize the one or more aggregated single objectives. The method further includes selecting one ML pipeline from the plurality of ML pipelines.

Abstract: The exemplary embodiments disclose a method, a computer program product, and a computer system for determining that one or more model pipelines satisfy one or more constraints. The exemplary embodiments may include detecting a user uploading data, one or more constraints, and one or more model pipelines, collecting the data, the one or more constraints, and the one or more model pipelines, and determining that one or more of the model pipelines satisfies all of the one or more constraints based on applying one or more algorithms to the collected data, constraints, and model pipelines.

Abstract: Methods, systems, and computer program products for determining optimal compute resources for distributed batch based optimization applications are provided herein. A method includes obtaining a size of an input dataset, a size of a model, and a set of batch sizes corresponding to a job to be processed using a distributed computing system; computing, based at least in part on the set of batch sizes, one or more node counts corresponding to a number of nodes that can be used for processing said job; estimating, for each given one of the node counts, an execution time to process the job based on an average computation time for a batch of said input dataset and an average communication time for said batch of said input dataset; and selecting, based at least in part on said estimating, at least one of said node counts for processing the job.

Abstract: One embodiment provides a method, including: receiving at least one deep learning job for scheduling and running on a distributed system comprising a plurality of nodes; receiving a batch size range indicating a minimum batch size and a maximum batch size that can be utilized for running the at least one deep learning job; determining a plurality of runtime estimations for running the at least one deep learning job; creating a list of optimal combinations of (i) batch sizes and (ii) numbers of the plurality of nodes for running both (a) the at least one deep learning job and (b) current deep learning jobs; and scheduling the at least one deep-learning job at the distributed system, responsive to identifying, by utilizing the list, that the distributed system has necessary processing resources for running both (iii) the at least one deep learning job and (iv) the current deep learning jobs.

Abstract: Methods, systems, and computer program products for determining optimal compute resources for distributed batch based optimization applications are provided herein. A method includes obtaining a size of an input dataset, a size of a model, and a set of batch sizes corresponding to a job to be processed using a distributed computing system; computing, based at least in part on the set of batch sizes, one or more node counts corresponding to a number of nodes that can be used for processing said job; estimating, for each given one of the node counts, an execution time to process the job based on an average computation time for a batch of said input dataset and an average communication time for said batch of said input dataset; and selecting, based at least in part on said estimating, at least one of said node counts for processing the job.

Abstract: One embodiment provides a method for determining at least one recommended vehicular travel route, the method including collecting a plurality of travel route inputs from a plurality of sources, relative to a travel route comprising a starting point and an ending point; determining at least one travel route recommendation by (i) assessing the collected plurality of travel route inputs and (ii) taking in to consideration vehicle emission impact parameters; and tracking vehicle adherence. Other variants and embodiments are broadly contemplated herein.

Abstract: Methods and arrangements for automating weather model configurations. Characteristics of a target geographical area are received, as are a plurality of existing weather model configurations which are implemented for undertaking weather modeling in other geographical areas. A subset of the existing weather model configurations is selected, the subset comprising configurations corresponding to geographical areas having characteristics similar to the characteristics of the target area. A weather model is run with respect to each configuration in the subset of existing weather model configurations. Based on the running of a weather model with respect to each configuration, an output set of weather model configurations is selected for undertaking weather modeling in the target area.

Abstract: One embodiment provides a method for determining at least one recommended vehicular travel route, the method including collecting a plurality of travel route inputs from a plurality of sources, relative to a travel route comprising a starting point and an ending point; determining at least one travel route recommendation by (i) assessing the collected plurality of travel route inputs and (ii) taking in to consideration vehicle emission impact parameters; and tracking vehicle adherence. Other variants and embodiments are broadly contemplated herein.

Abstract: Techniques for transferring a matrix for performing one or more operations are provided. The techniques include applying a permutation on at least one of one or more columns and one or more rows of a matrix to group each of at least one of one or more columns and one or more rows of the matrix with a same alignment, blocking at least one of the grouped columns and grouped rows, and performing one or more operations on each matrix block.

Abstract: A computer-implemented method of load balancing including calculating an expected cost set associated with an application-specific task of an application executing on a processing resource in a cloud computing environment, and communicating the expected cost set from the processing resource to a cloud management system. Resource mapping of applications currently executing in the cloud computing environment are retrieved, the application-specific task is assigned to a specific computational resource in the cloud computing environment based on the expected cost set and the resource mapping of applications currently executing in the cloud computing environment. A task to VM (virtual machine) assignment is determined based on the assignment of the application-specific task to the specific computational resource. The task to VM assignment is transferred from the cloud management system to the application executing on the processing resource in the cloud computing environment.

Abstract: A non-transitory computer-implemented method of load balancing includes calculating an expected cost set associated with an application-specific task of an application executing on a processing resource in a cloud computing environment, and communicating the expected cost set from the processing resource to a cloud management system. Resource mapping of applications currently executing in the cloud computing environment are retrieved, and the application-specific task is assigned to a specific computational resource in the cloud computing environment based on the expected cost set and the resource mapping of applications currently executing in the cloud computing environment. A task to VM (virtual machine) assignment is determined based on the assignment of the application-specific task to the specific computational resource. The task to VM assignment is transferred from the cloud management system to the application executing on the processing resource in the cloud computing environment.

Abstract: Methods and arrangements for automating weather model configurations. Characteristics of a target geographical area are received, as are a plurality of existing weather model configurations which are implemented for undertaking weather modeling in other geographical areas. A subset of the existing weather model configurations is selected, the subset comprising configurations corresponding to geographical areas having characteristics similar to the characteristics of the target area. A weather model is run with respect to each configuration in the subset of existing weather model configurations. Based on the running of a weather model with respect to each configuration, an output set of weather model configurations is selected for undertaking weather modeling in the target area.

Abstract: A non-transitory computer-implemented method of load balancing includes calculating an expected cost set associated with an application-specific task of an application executing on a processing resource in a cloud computing environment, and communicating the expected cost set from the processing resource to a cloud management system. Resource mapping of applications currently executing in the cloud computing environment are retrieved, and the application-specific task is assigned to a specific computational resource in the cloud computing environment based on the expected cost set and the resource mapping of applications currently executing in the cloud computing environment. A task to VM (virtual machine) assignment is determined based on the assignment of the application-specific task to the specific computational resource. The task to VM assignment is transferred from the cloud management system to the application executing on the processing resource in the cloud computing environment.