Abstract: The disclosed technology can acquire a first set of data from a first group of data sources including a plurality of network components within an energy delivery network. A first metric indicating a likelihood that a particular network component, from the plurality of network components, is affected by cyber vulnerabilities can be generated based on the first set of data. A second set of data can be acquired from a second group of data sources including a collection of services associated with the energy delivery network. A second metric indicating a calculated impact on at least a portion of the energy delivery network when the cyber vulnerabilities affect the particular network component can be generated based on the second set of data. A third metric indicating an overall level of cybersecurity risk associated with the particular network component can be generated based on the first metric and the second metric.

Abstract: Methods and systems are disclosed for generating training data for a machine learning model for better performance of the model. A source image is selected from an image database, along with a target image. An image segmenter is utilized with the source image to generate a source image segmentation mask having a foreground region and a background region. The same is performed with the target image to generate a target image segmentation mask having a foreground region and a background region. Foregrounds and backgrounds of the source image and target image are determined based on the masks. The target image foreground is removed from the target image, and the source image foreground is inserted into the target image to create an augmented image having the source image foreground and the target image background. The training data for the machine learning model is updated to include this augmented image.

Abstract: Various embodiments of the present disclosure can include systems, methods, and non-transitory computer readable media configured to identify a set of features associated with at least one of a collection of residences or an energy billing period. Measured energy consumption information and a plurality of feature values can be acquired for each residence in the collection of residences. Each feature value in the plurality of feature values can correspond to a respective feature in the set of features. A regression model can be trained based on the measured energy consumption information and the plurality of features values for each residence in the collection of residences. At least one expected consumption value and at least one efficient consumption value can be determined based on the regression model.

Abstract: A method of identifying an attack comprising receiving an input of one or more images, wherein the one or more images includes a patch size and size, divide the image into a first sub-image and a second sub-image, classify the first sub-image and the second sub-image, wherein classifying is accomplished via introducing a variable in a pixel location associated with the first and second sub-image, and in response to classifying the first and second sub-image and identifying an adversarial patch, output a notification indicating that the input is not certified.

Abstract: The disclosed technology can acquire a first set of data from a first group of data sources including a plurality of network components within an energy delivery network. A first metric indicating a likelihood that a particular network component, from the plurality of network components, is affected by cyber vulnerabilities can be generated based on the first set of data. A second set of data can be acquired from a second group of data sources including a collection of services associated with the energy delivery network. A second metric indicating a calculated impact on at least a portion of the energy delivery network when the cyber vulnerabilities affect the particular network component can be generated based on the second set of data. A third metric indicating an overall level of cybersecurity risk associated with the particular network component can be generated based on the first metric and the second metric.

Abstract: A computer-implemented method for training a machine-learning network includes receiving an input data from a sensor, wherein the input data includes a perturbation, wherein the input data is indicative of image, radar, sonar, or sound information, obtain a worst-case bound on a classification error and loss for perturbed versions of the input data, utilizing at least bounding of one or more hidden layer values, in response to the input data, train a classifier, wherein the classifier includes a plurality of classes, including an additional abstain class, wherein the abstain class is determined in response to at least bounding the input data, outputting a classification in response to the input data, and output a trained classifier configured to detect the additional abstain class in response to the input data classifier with a plurality of classes, including an additional abstain class.

Abstract: A computer-implemented method for training a machine learning network includes receiving an input data from one or more sensors, selecting one or more batch samples from the input data, wherein the batch samples include one or more perturbed samples from a source class configured to be misclassified into a target class, identifying the one or more perturbed samples from the one or more batch samples, determining a trigger event in response to identification of a trigger pattern of the one or more batch samples, wherein the trigger pattern induces a pre-determined response on a classifier, outputting a classification in response to identification of the trigger pattern via the classifier, and outputting a set of trigger patterns extracted from the machine-learning network.

Abstract: A system includes a machine-learning network. The network includes an input interface configured to receive input data from a sensor. The processor is programmed to receive the input data, generate a perturbed input data set utilize the input data, wherein the perturbed input data set includes perturbations of the input data, denoise the perturbed input data set utilizing a denoiser, wherein the denoiser is configured to generate a denoised data set, send the denoised data set to both a pre-trained classifier and a rejector, wherein the pre-trained classifier is configured to classify the denoised data set and the rejector is configured to reject a classification of the denoised data set, train, utilizing the denoised input data set, the a rejector to achieve a trained rejector, and in response to obtaining the trained rejector, output an abstain classification associated with the input data, wherein the abstain classification is ignored for classification.

Abstract: A system including a machine learning network that includes a controller configured to, utilizing numerical values assigned at an image-text similarity matrix, output at the machine learning network including a text encoder and an image encoder, update parameters of a untrained layer of the machine learning network utilizing sparse logistic regression to generate a sparse logistic regression layer, wherein the image-text similarity matrix is associated with a plurality of input images received at the controller, freeze one or more entries of the sparse logistic regression layer that include zero values, run a plurality of input images at both (1) the image encoder and (2) one or more unfrozen entries at the sparse logistic regression layer, and update, in response to the running of the plurality of input images, parameters of the image encoder and parameters associated with one or more unfrozen entries, and output a tuned machine learning model until a threshold is met.

Abstract: A computer-implemented method that includes receiving a plurality of input images, generating a visual matrix utilizing the plurality of images and an image encoder, wherein the visual matrix includes a list of encoded images, receiving a plurality of text prompts, selecting a text prompt from the plurality of text prompts, send the first one of the text prompts to a language model to generate a candidate list of tokens, selecting tokens, converting the text prompts into updated text prompts via appending the tokens, generating a text matrix utilizing the text prompt and text encoder, and utilizing numerical values assigned at an image-text similarity matrix, determining a score associated with the image-text similarity matrix; and evaluating a criteria and outputting a final token to the updated text prompt in response to identifying a highest score associated with the final token after evaluating each of the plurality of text prompts.

Abstract: Methods and systems are disclosed that allows users to define, train, and deploy deep equilibrium models. Decoupled and structured interfaces allow users to easily customize deep equilibrium models. Disclosed systems support a number of different forward and backward solvers, normalization, and regularization approaches.

Abstract: Methods and systems of estimating an accuracy of a neural network on out-of-distribution data. In-distribution accuracies of a plurality of machine learning models trained with in-distribution data are determined. The plurality of machine learning models includes a first model, and a remainder of models. In-distribution agreement is determined between (i) an output of the first machine learning model executed with an in-distribution dataset and (ii) outputs of a remainder of the plurality of machine learning models executed with the in-distribution dataset. The machine learning models are also executed with an unlabeled out-of-distribution dataset, and an out-of-distribution agreement is determined. The in-distribution agreement is compared with the out-of-distribution agreement.

Abstract: A method discloses receiving, at a cross-attention layer of a model, first text data describing a first object and second text data describing a first scene, wherein the first text data includes a description of a location of the first object, utilizing the model with cross-attention layers, concatenating the first text data and the second text data to generate a prompt; generating, a broadcasted location mask constructed from at least the location; generating, a broadcasted all-one matrix associated with the second text data described the first scene; computing a key matrix and a value matrix utilizing separate linear projections of the prompt; computing a query matrix utilizing linear projections; generating a broadcasted location matrix in response to concatenating the broadcasted location mask and the broadcasted all-one matrix; generating a cross-attention map utilizing the query matrix, the key matrix, and the broadcasted location matrix; and outputting a final image.

Abstract: A computer-implemented method includes converting tabular data to a text representation, generating metadata associated with the text representation of the tabular data, outputting one or more natural language data descriptions indicative of the tabular data in response to utilizing a large language model (LLM) and zero-shot prompting of the metadata and text representation of the tabular data, outputting one or more summaries utilizing the LLM and appending a prompt on the one or more natural language data descriptions, selecting a single summary of the one or more summaries in response to the single summary having a smallest validation rate, receiving a query associated with the tabular data, outputting one or more predictions associated with the query, and in response to meeting a convergence threshold with the one or more predictions generated from the one or more iterations, output a final prediction associated with the query.

Abstract: Generative equilibrium transformers are disclosed. Disclosed embodiments provide a simple and effective technique that can distill a multi-step diffusion process into a single-step generative model using solely noise/image pairs.

Abstract: Various embodiments of the present disclosure can include systems, methods, and non-transitory computer readable media configured to identify a set of features associated with at least one of a collection of residences or an energy billing period. Measured energy consumption information and a plurality of feature values can be acquired for each residence in the collection of residences. Each feature value in the plurality of feature values can correspond to a respective feature in the set of features. A regression model can be trained based on the measured energy consumption information and the plurality of features values for each residence in the collection of residences. At least one expected consumption value and at least one efficient consumption value can be determined based on the regression model.

Abstract: A linguistic system includes a controller. The controller may be configured to receive a query and document, tokenize the query into a sequence of query tokens and tokenize the document into a sequence of document tokens, generate a matrix of token pairs for each of the query and the document tokens, retrieve for each entry in the matrix of token pairs, a precomputed similarity score produced by a neural conditional translation probability network, wherein the neural network has been trained in a ranking task using a corpus of paired queries and respective relevant documents, produce a ranking score for each document with respect to each query via a product-of-sum aggregation of each of the similarity scores for the respective query; and output the document and associated ranking score of the document.

Abstract: A computer-implemented method for training a machine-learning network, wherein the network includes receiving an input data from a sensor, wherein the input data includes data indicative of an image, wherein the sensor includes a video, radar, LiDAR, sound, sonar, ultrasonic, motion, or thermal imaging sensor, generating an adversarial version of the input data utilizing an optimizer, wherein the adversarial version of the input data utilizes a subset of the input data, parameters associated with the optimizer, and one or more perturbation tiles, determining loss function value in response to the adversarial version of the input data and a classification of the adversarial version of the input data, determining a perturbation tile in response the loss function value associated with one or more subsets of the adversarial version of the input data, and output a perturbation that includes at least the perturbation tile.

Abstract: A computational method for training a meta-learned, evolution strategy black box optimization classifier. The method includes receiving one or more training functions and one or more initial meta-learning parameters of the optimization classifier. The method further includes sampling a sampled objective function from the one or more training functions and an initial mean of the sampled function. The method also includes computing a set of T number of means by running the meta learned, evolution strategy classifier on the sampled objective function using the initial mean for T number of steps in t=1, . . . , T. The method also includes computing a loss function from the set of T number of means. The method further includes updating the one or more initial meta-learning parameters of the optimization classifier in response to a characteristic of the loss function.

Abstract: A convolutional neural network system includes a sensor and a controller, wherein the controller is configured to receive an image from the sensor, divide the image into patches, each patch of size p, extract, via a first convolutional layer, a feature map having a number of channels based on a feature detector of size p, wherein the feature detector has a stride equal to size p, refine the feature map by alternatingly applying depth-wise convolutional layers and point-wise convolutional layers to obtain a refined feature map, wherein the number of channels in the feature map and the size of the feature map remains constant throughout all operations in the refinement; and output the refined feature map.