Abstract: Methods and systems of using a trained machine-learning model to perform root cause analysis on a manufacturing process. A pre-trained machine learning model is provided that is trained to predict measurements of non-faulty parts. The pre-trained model is trained on training measurement data regarding physical characteristics of manufactured parts as measured by a plurality of sensors at a plurality of manufacturing stations. With the trained model, then measurement data from the sensors is received regarding the manufactured part and the stations. This new set of measurement data is back propagated through the pre-trained model to determine a magnitude of absolute gradients of the new measurement data. The root cause is then identified based on this magnitude of absolute gradients. In other embodiments the root cause is identified based on losses determined between a set of predicted measurement data of a part using the model, and actual measurement data.

Abstract: A computer-implemented system and method relate to certified defense against adversarial patch attacks. A set of one-mask images is generated using a first mask at a set of predetermined regions of a source image. The source image is obtained from a sensor. A set of one-mask predictions is generated, via a machine learning system, based on the set of one-mask images. A first one-mask image is extracted from the set of one-mask images. The first one-mask image is associated with a first one-mask prediction that is identified as a minority amongst the set of one-mask predictions. A set of two-mask images is generated by masking the first one-mask image using a set of second masks. The set of second masks include at least a first submask and a second submask in which a dimension of the first submask is less than a dimension of the first mask. A set of two-mask predictions is generated based on the set of two-mask images.

Abstract: A system and method include dividing a source image into a plurality of source regions, which are portions of the source image that correspond to a plurality of grid regions. A mask is used to create a first masked region that masks a first source region and a first unmasked region that comprises a second source region. A first inpainted region is generated by inpainting the first masked region based on the second source region. Similarity data is generated based on a similarity assessment. A protected image is generated that includes at least (i) the first masked region at a first grid region when the similarity data indicates that the first source region is not similar to the first inpainted region and (ii) the first inpainted region at the first grid region when the similarity data indicates that the first source region is similar to the first inpainted region.

Abstract: A computer-program product storing instructions which, when executed by a computer, cause the computer to receive an input data from a sensor, generate a training data set utilizing the input data, wherein the training data set is created by creating one or more copies of the input data and adding noise to the one or more copies, send the training data set to a diffusion model, wherein the diffusion model is configured to reconstruct and purify the training data set by removing noise associated with the input data and reconstructing the one or more copies of the training data set to create a modified input data set, send the modified input data set to a fixed classifier, and output a classification associated with the input data in response to a majority vote of the classification obtained by the fixed classifier of the modified input data set.

Abstract: Semiconductor devices and methods of manufacturing are presented in which inner spacers for nanostructures are manufactured. In embodiments a dielectric material is deposited for the inner spacer and then treated. The treatment may add material and cause an expansion in volume in order to close any seams that can interfere with subsequent processes.

Abstract: A multimodal perception system for an autonomous vehicle includes a first sensor that is one of a video, RADAR, LIDAR, or ultrasound sensor, and a controller. The controller may be configured to, receive a first signal from a first sensor, a second signal from a second sensor, and a third signal from a third sensor, extract a first feature vector from the first signal, extract a second feature vector from the second signal, extract a third feature vector from the third signal, determine an odd-one-out vector from the first, second, and third feature vectors via an odd-one-out network of a machine learning network, based on inconsistent modality prediction, fuse the first, second, and third feature vectors and odd-one-out vector into a fused feature vector, output the fused feature vector, and control the autonomous vehicle based on the fused feature vector.

Abstract: A computer-implemented system and method relate to test-time adaptation of a machine learning system from a source domain to a target domain. Sensor data is obtained from a target domain. The machine learning system generates prediction data based on the sensor data. Pseudo-reference data is generated based on a gradient of a predetermined function evaluated with the prediction data. Loss data is generated based on the pseudo-reference data and the prediction data. One or more parameters of the machine learning system is updated based on the loss data. The machine learning system is configured to perform a task in the target domain after the one or more parameters has been updated.

Abstract: A method of identifying an attack comprising receiving an input of one or more images, wherein the one or more images includes a patch size and size, divide the image into a first sub-image and a second sub-image, classify the first sub-image and the second sub-image, wherein classifying is accomplished via introducing a variable in a pixel location associated with the first and second sub-image, and in response to classifying the first and second sub-image and identifying an adversarial patch, output a notification indicating that the input is not certified.

Abstract: Methods and systems for training a machine learning model with measurement data captured during a manufacturing process. Measurement data regarding a physical characteristic of a plurality of manufactured parts is received as measured by a plurality of sensors at various manufacturing stations. A time-series dynamics machine learning model encodes the measurement data into a latent space having a plurality of nodes. Each node is associated with the measurement data of one of the manufactured parts and at one of the manufacturing stations. A batch of the measurement data can be built, the batch include a first node and a first plurality of nodes immediately connected to the first node via first edges, and measured in time earlier than the first node. A prediction machine learning model can predict measurements of a first of the manufactured parts based on the latent space of the batch of nodes.

Abstract: Methods and systems of estimating an accuracy of a neural network on out-of-distribution data. In-distribution accuracies of a plurality of machine learning models trained with in-distribution data are determined. The plurality of machine learning models includes a first model, and a remainder of models. In-distribution agreement is determined between (i) an output of the first machine learning model executed with an in-distribution dataset and (ii) outputs of a remainder of the plurality of machine learning models executed with the in-distribution dataset. The machine learning models are also executed with an unlabeled out-of-distribution dataset, and an out-of-distribution agreement is determined. The in-distribution agreement is compared with the out-of-distribution agreement.

Abstract: A system includes a machine-learning network. The network includes an input interface configured to receive input data from a sensor. The processor is programmed to receive the input data, generate a perturbed input data set utilize the input data, wherein the perturbed input data set includes perturbations of the input data, denoise the perturbed input data set utilizing a denoiser, wherein the denoiser is configured to generate a denoised data set, send the denoised data set to both a pre-trained classifier and a rejector, wherein the pre-trained classifier is configured to classify the denoised data set and the rejector is configured to reject a classification of the denoised data set, train, utilizing the denoised input data set, the a rejector to achieve a trained rejector, and in response to obtaining the trained rejector, output an abstain classification associated with the input data, wherein the abstain classification is ignored for classification.

Abstract: Performing semantic segmentation in an absence of labels for one or more semantic classes is provided. One or more weak predictors are utilized to obtain label proposals of novel classes for an original dataset for which at least a subset of sematic classes are unlabeled classes. The label proposals are merged with ground truth of the original dataset to generate a merged dataset, the ground truth defining labeled classes of portions of the original dataset. A machine learning model is trained using the merged dataset. The machine learning model is utilized for performing semantic segmentation on image data.

Abstract: A system for training a machine learning model using a batch based active learning approach. The system includes an information source and an electronic processor. The electronic processor is configured to receive a machine learning model to train, an unlabeled training data set, a labeled training data set, and an identifier of the information source. The electronic processor is also configured to select a batch of training examples from the unlabeled training data set and send, to the information source, a request for, for each training example included in the batch, a label for the training example. The electronic processor is further configured to, for each training example included in the batch, receive a label, associate the training example with the label, and add the training example to the labeled training data set. The electronic processor is also configured to train the machine learning model using the labeled training data.

Abstract: A computer-implemented system and method provide improved training to a machine learning system, such as a vision transformer. The system and method include performing neural style transfer augmentations using at least a content image, a first style image, and a second style image. A first augmented image is generated based at least on content of the content image and a first style of the first style image. A second augmented image is generated based at least on the content of the content image and a second style of the second style image. The machine learning system is trained with training data that includes at least the content image, the first augmented image, and the second augmented image. A loss output is computed for the machine learning system. The loss output includes at least a consistency loss that accounts for a predicted label provided by the machine learning system with respect to each of the content image, the first augmented image, and the second augmented image.

Abstract: A method of image segmentation includes receiving one or more images, determining a loss component, for each pixel one image of the one or more images, identifying a majority class and identify a cross-entropy loss between a network output and a target, randomly selecting pixels associated with the one image and select a second set of pixels to compute a super pixel loss for each pair of pixels, summing corresponding loss associated with each pair of pixels, for each corresponding frame of the plurality of frames of the image, computing a flow loss, a negative flow loss, a contrastive optical flow loss, and a equivariant optical flow loss, computing a final loss including a weighted average of the flow loss, the cross entropy loss, the super pixel loss, and foreground loss, updating a network parameter and outputting a trained neural network.

Abstract: A computer-program product storing instructions which, when executed by a computer, cause the computer to, for one or more iterations, update parameters associated with a machine-learning network utilizing perturbations for input data, wherein the perturbations are sampled utilizing Markov chain Monte Carlo, identify a loss value associated with each perturbation in each iteration, and evaluate the machine learning network by identifying an average loss value across each iteration and outputting the average loss value.

Abstract: A method of road sign classification utilizing a knowledge graph, including detecting and selecting a representation of a sign across a plurality of frames, outputting a prompt initiating a request for a classification associated with the representation of the sign, classifying one or more images including the sign, querying the knowledge graph to obtain a plurality of road sign classes with at least one same attribute as the sign, and classifying the sign across the plurality of frames in response to a confidence level exceeding a threshold.

Abstract: A system and method relate to providing machine learning predictions with defenses against patch attacks. The system and method include obtaining a digital image and generating a set of location data via a random process. The set of location data include randomly selected locations on the digital image that provide feasible bases for creating regions for cropping. A set of random crops is generated based on the set of location data. Each crop includes a different region of the digital image as defined in relation to its corresponding location data. The machine learning system is configured to provide a prediction for each crop of the set of random crops and output a set of predictions. The set of predictions is evaluated collectively to determine a majority prediction from among the set of predictions. An output label is generated for the digital image based on the majority prediction. The output label includes the majority prediction as an identifier for the digital image.

Abstract: A multimodal perception system for an autonomous vehicle includes a first sensor that is one of a video, RADAR, LIDAR, or ultrasound sensor, and a controller. The controller may be configured to, receive a first signal from a first sensor, a second signal from a second sensor, and a third signal from a third sensor, extract a first feature vector from the first signal, extract a second feature vector from the second signal, extract a third feature vector from the third signal, determine an odd-one-out vector from the first, second, and third feature vectors via an odd-one-out network of a machine learning network, based on inconsistent modality prediction, fuse the first, second, and third feature vectors and odd-one-out vector into a fused feature vector, output the fused feature vector, and control the autonomous vehicle based on the fused feature vector.

Abstract: A computer-implemented method for training a machine-learning network. The method includes receiving an input data from a sensor, wherein the input data is indicative of image, radar, sonar, or sound information, generating an input data set utilizing the input data, wherein the input data set includes perturbed data, sending the input data set to a robustifier, wherein the robustifier is configured to clean the input data set by removing perturbations associated with the input data set to create a modified input data set, sending the modified input data set to a pretrained machine learning task, training the robustifier to obtain a trained robustifier utilizing the modified input data set, and in response to convergence of the trained robustifier to a first threshold, output the trained robustifier.