Abstract: A method and system for training a target neural network using a foundation model having a source neural network that has been pre-trained to operate on a source modality. Inputting source data to the foundation model. The source neural network of the foundation model having at least one source encoder having a source weights which has been pre-trained to compute source features which are computable within the source data of the source modality. Inputting target data to a target neural network operating on a target modality. The target neural network including at least one target encoder having target weights for computing target features within the target data of the target modality. Training the target weight by pairing the target data with the source data and freezing the source weights of the source neural network for a pre-determined epoch.

Abstract: A computer-implemented system and method include performing neural style transfer augmentations using at least a content image, a first style image, and a second style image. A first augmented image is generated based at least on content of the content image and a first style of the first style image. A second augmented image is generated based at least on the content of the content image and a second style of the second style image. The machine learning system is trained with training data that includes at least the content image, the first augmented image, and the second augmented image. A loss output is computed for the machine learning system. The loss output includes at least a consistency loss that accounts for a predicted label provided by the machine learning system with respect to each of the content image, the first augmented image, and the second augmented image.

Abstract: Methods and systems are disclosed that allows users to define, train, and deploy deep equilibrium models. Decoupled and structured interfaces allow users to easily customize deep equilibrium models. Disclosed systems support a number of different forward and backward solvers, normalization, and regularization approaches.

Abstract: A computer-implemented system and method includes establishing a station sequence that a given part traverses. Each station includes a machine that performs at least one operation with respect to the given part. Measurement data, which relates to attributes of a plurality of parts that traversed the plurality of machines, is received. The measurement data is obtained by sensors and corresponds to a current process period. A first machine learning model is pretrained to generate (i) latent representations based on the measurement data and (ii) machine states based on the latent representations. Machine observation data, which relates to the current process period, is received. Aggregated data is generated based on the measurement data and the machine observation data. A second machine learning model generates a maintenance prediction based on the aggregated data. The maintenance prediction corresponds to a next process period.

Abstract: A computer-implemented system and method include establishing a station sequence that a given part traverses. A history embedding sequence is generated and comprises (a) history measurement embeddings based on history measurement data, the history measurement data relating to attributes of at least one other part that traversed the plurality of stations before the given part, (b) history part identifier embeddings based at least one history part identifiers of at least one other part, and (c) history station identifier embeddings based on the at least one history station identifier corresponding to the history measurement data.

Abstract: A computer-implemented system and method includes establishing a station sequence that a given part traverses. A first neural network generates a set of parameter data based on observed measurement data of the given part at each station of a station subsequence. The set of parameter data is associated with a latent variable subsequence corresponding to the station subsequence. A second neural network generates next parameter data based on history measurement data and the set of parameter data. The history measurement data relates to another part processed before the given part and is associated with each station of the station sequence. The next parameter data is associated with a next latent variable that follows the latent variable subsequence. The next latent variable corresponds to a next station that follows the station subsequence in the station sequence.

Abstract: A computer-implemented system and method provide improved training to a machine learning system, such as a vision transformer. The system and method include performing neural style transfer augmentations using at least a content image, a first style image, and a second style image. A first augmented image is generated based at least on content of the content image and a first style of the first style image. A second augmented image is generated based at least on the content of the content image and a second style of the second style image. The machine learning system is trained with training data that includes at least the content image, the first augmented image, and the second augmented image. A loss output is computed for the machine learning system. The loss output includes at least a consistency loss that accounts for a predicted label provided by the machine learning system with respect to each of the content image, the first augmented image, and the second augmented image.