Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for secure communications in a digital engineering ecosystem. In some implementations, a digital platform receives a request from a user device to interact with a digital model. The digital platform determines whether a user operating the user device is authorized. In response to determining the user is authorized to access the digital platform, the digital platform generates a token that provides the user with access to the digital platform. The digital platform determines whether the request includes malicious activity. In response to determining that the request is absent of the malicious activity, the digital platform executes a digital thread that executes one or more operations using digital tools and the digital model. The digital platform provides data indicative of the one or more operations executing the digital thread to the user device.

Abstract: A machine learning service implements programmatic interfaces for a variety of operations on several entity types, such as data sources, statistics, feature processing recipes, models, and aliases. A first request to perform an operation on an instance of a particular entity type is received, and a first job corresponding to the requested operation is inserted in a job queue. Prior to the completion of the first job, a second request to perform another operation is received, where the second operation depends on a result of the operation represented by the first job. A second job, indicating a dependency on the first job, is stored in the job queue. The second job is initiated when the first job completes.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for securely certifying products in an ecosystem. In some implementations, a digital platform receives a user request to access digital models. The digital platform determines whether the user is authorized to access the digital models. In response, the digital platform generates a transaction request to send to a location of the digital models, wherein the transaction request comprises data identifying operations to perform using the digital models. The digital platform transmits, to the location of the digital models, the generated transaction request that causes execution of the operations. The digital platform receives data representative of a result of the operations performed. The digital platform provides, to a user interface of the user device, the data representative of the result. The digital platform audits the data related to the transaction request and the data representative of the result.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: Computer-implemented systems and methods are disclosed, including for integration and management of computer-based models in a model management. A computer-implemented method may include, for example, receiving one or more inputs including requesting to add a first model to a defined modeling objective, specifying a first model location, and/or providing a first model adapter configuration. In response to the one or more user inputs, the method may further include storing or providing access to information associated with the first model, associating the first model with a defined modeling objective, and/or implementing the first model adapter configuration to provide communication with the first model.

Abstract: Systems and methods for automatic resource allocation and optimization. The method receives at least one first data component associated with a user and at least one second data component associated with the user. The system determines at least one first value for a first metric of the user based on the received at least one first data component and determines at least one second value for a second metric of the user based on the received at least one second data component. The system determines at least one third value for a third metric of the user based on the at least one first value of the first metric and the at least one second value of the second metric and utilizes the at least one third value for the third metric in a forecasting mechanism.

Abstract: Disclosed herein is a method of providing feedback to a machine learning model. The method includes allowing a user to observe an output of a trained machine learning model; allowing the user to input feedback to the machine learning model based on the output, wherein the feedback is on at least one of a model level or on a training dataset level; and incorporating the feedback into the machine learning model to improve the machine learning model, wherein the method is performed using one or more processors. Disclosed herein are one or more computer-readable storage media including computer executable instructions which when executed by the one or more processors cause the one or more processors to perform the method. Disclosed herein is a computer system which includes one or more processors and one or more computer-readable storage media which include computer executable instructions which when executed by the one or more processors cause the one or more processors to perform the method.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for securely certifying products in an ecosystem. In some implementations, a digital platform receives a user request to access digital models. The digital platform determines whether the user is authorized to access the digital models. In response, the digital platform generates a transaction request to send to a location of the digital models, wherein the transaction request comprises data identifying operations to perform using the digital models. The digital platform transmits, to the location of the digital models, the generated transaction request that causes execution of the operations. The digital platform receives data representative of a result of the operations performed. The digital platform provides, to a user interface of the user device, the data representative of the result. The digital platform audits the data related to the transaction request and the data representative of the result.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for securely certifying products in an ecosystem. In some implementations, a digital platform receives a user request to access digital models. The digital platform determines whether the user is authorized to access the digital models. In response, the digital platform generates a transaction request to send to a location of the digital models, wherein the transaction request comprises data identifying operations to perform using the digital models. The digital platform transmits, to the location of the digital models, the generated transaction request that causes execution of the operations. The digital platform receives data representative of a result of the operations performed. The digital platform provides, to a user interface of the user device, the data representative of the result. The digital platform audits the data related to the transaction request and the data representative of the result.

Abstract: A machine learning service implements programmatic interfaces for a variety of operations on several entity types, such as data sources, statistics, feature processing recipes, models, and aliases. A first request to perform an operation on an instance of a particular entity type is received, and a first job corresponding to the requested operation is inserted in a job queue. Prior to the completion of the first job, a second request to perform another operation is received, where the second operation depends on a result of the operation represented by the first job. A second job, indicating a dependency on the first job, is stored in the job queue. The second job is initiated when the first job completes.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: A method in a server includes: storing, in a memory of the server, an energy consumption definition corresponding to a client device, the energy consumption definition including: (i) a plurality of operational states of the client device, and (ii) an estimation mechanism for each operational state; receiving, from the client device, operational data including an active one of the operational states at the client device, and a time period associated with the active operational state; generating, based on the operational data and the estimation mechanism corresponding to the active operational state, an estimated energy consumption for the client device; in response to generating the estimated energy consumption, obtaining an updated configuration setting for the client device; and transmitting the updated configuration setting to the client device to alter energy consumption at the client device.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.

Abstract: A computer-implemented method includes receiving design and/or engineering data (D/E data) corresponding to a prototype representation of a product and transmitting one or more inputs derived from the D/E data to one or more digital engineering tools for processing. The method also includes receiving engineering-related data outputs from the one or more digital engineering tools and receiving data corresponding to one or more common validation and verification (V&V products). The method further includes identifying one or more requirements for the product based on the data corresponding to the one or more common V&V products; determining whether or not the one or more requirements have been satisfied; and presenting information corresponding to the engineering-related data outputs and/or the data corresponding to the one or more common V&V products. The method also includes receiving instructions from the user device, and performing one or more manipulations of the D/E data.