Abstract: A method includes receiving, by a processor, an input data set. The input data set includes a plurality of features. The method includes determining, by the processor, one or more characteristics of the input data set. The method includes, based on the one or more characteristics, adjusting, by the processor, one or more architectural parameters of an automated model generation process. The automated model generation process is configured to generate a plurality of models using a weighted randomization process. The one or more architectural parameters weight the weighted randomization process to adjust a probability of generation of models having particular architectural features. The method further includes executing, by the processor, the automated model generation process to output a mode, the model including data representative of a neural network.

Abstract: A method includes obtaining sensor data associated with operation of one or more devices and providing input data based on the sensor data to a dimensional-reduction model having an encoder portion and a decoder portion and configured such that the encoder portion is not mirrored by the decoder portion. The method also includes obtaining output data from the dimensional-reduction model responsive to the input data and determining a reconstruction error indicating a difference between the input data and the output data. The method also includes performing a comparison of the reconstruction error to an anomaly detection criterion and generating an anomaly detection output for the one or more devices based on a result of the comparison.

Abstract: A method includes determining, by a processor of a computing device, a subset of models included in a plurality of models generated based on a genetic algorithm and corresponds to a first epoch of the genetic algorithm. Each of the plurality of models includes data representative of a neural network. The method includes aggregating the subset of models to generate an ensembler. The ensembler, when executed on an input, provides at least a portion of the input to each model of the subset of models to generate a plurality of intermediate outputs. An ensembler output of the ensembler is based on the plurality of intermediate outputs. The method further includes executing the ensembler on input data to determine the ensembler output.

Abstract: A device includes one or more processors configured to process first input time-series data associated with a first time range using an embedding generator to generate an input embedding. The input embedding includes a positional embedding and a temporal embedding. The positional embedding indicates a position of an input value within the first input time-series data. The temporal embedding indicates that a first time associated with the input value is included in a particular day, a particular week, a particular month, a particular year, a particular holiday, or a combination thereof. The processors are configured to process the input embedding using a predictor to generate second predicted time-series data associated with a second time range. The second time range is subsequent to at least a portion of the first time range. The processors are configured to provide, to a second device, an output based on the second predicted time-series data.

Abstract: A method includes obtaining sensor data associated with operation of one or more devices and providing input data based on the sensor data to a dimensional-reduction model that includes a first layer having a first count of nodes, a second layer having a second count of nodes, and a third layer having a third count of nodes. The second layer is disposed between the first layer and the third layer, and the second count of nodes is greater than the first count of nodes and the third count of nodes. The method also includes determining a reconstruction error indicating a difference between the input data and the output data of the dimensional-reduction model. The method also includes performing a comparison of the reconstruction error to an anomaly detection criterion and generating an anomaly detection output for the one or more devices based on a result of the comparison.

Abstract: A method includes obtaining sensor data associated with operation of one or more devices and providing input data based on the sensor data to a dimensional-reduction model having an encoder portion and a decoder portion and configured such that the encoder portion is not mirrored by the decoder portion. The method also includes obtaining output data from the dimensional-reduction model responsive to the input data and determining a reconstruction error indicating a difference between the input data and the output data. The method also includes performing a comparison of the reconstruction error to an anomaly detection criterion and generating an anomaly detection output for the one or more devices based on a result of the comparison.

Abstract: A method includes obtaining sensor data associated with operation of one or more devices and providing input data based on the sensor data to a dimensional-reduction model that includes a first layer having a first count of nodes, a second layer having a second count of nodes, and a third layer having a third count of nodes. The second layer is disposed between the first layer and the third layer, and the second count of nodes is greater than the first count of nodes and the third count of nodes. The method also includes determining a reconstruction error indicating a difference between the input data and the output data of the dimensional-reduction model. The method also includes performing a comparison of the reconstruction error to an anomaly detection criterion and generating an anomaly detection output for the one or more devices based on a result of the comparison.

Abstract: A method includes, during an epoch of a genetic algorithm, determining a fitness value for each of a plurality of autoencoders. The fitness value for an autoencoder indicates reconstruction error responsive to data representing a first operational state of one or more devices. The method includes selecting, based on the fitness values, a subset of autoencoders. The method also includes performing a genetic operation with respect to at least one autoencoder to generate a trainable autoencoder. The method includes training the trainable autoencoder to reduce a loss function value to generate a trained autoencoder. The loss function value is based on reconstruction error of the trainable autoencoder responsive to data representative of a second operational state of the device(s). The method includes adding the trained autoencoder to a population to be provided as input to a subsequent epoch of the genetic algorithm.

Abstract: A method includes determining a plurality of rows and a plurality of columns of a matrix. A count of rows of the plurality of rows is determined based on an architecture of a neural network, and a count of columns of the plurality of columns is determined based on a grammar. The method also includes assigning a value to each row/column pair. The value assigned to a particular row/column pair indicates a hyperparameter descriptive of the neural network. The method further includes storing the matrix as a representation of the neural network.

Abstract: A method of generating a neural network includes iteratively performing operations including generating, for each neural network of a population, a matrix representation. The matrix representation of a particular neural network includes rows of values, where each row corresponds to a set of layers of the particular neural network and each value specifies a hyperparameter of the set of layers. The operations also include providing the matrix representations as input to a relative fitness estimator that is trained to generate estimated fitness data for neural networks of the population. The estimated fitness data are based on expected fitness of neural networks predicted by the relative fitness estimator. The operations further include generating, based on the estimated fitness data, a subsequent population of neural networks. The method also includes, when a termination condition is satisfied, outputting data identifying a neural network as a candidate neural network.

Abstract: A method includes, during an epoch of a genetic algorithm, determining a fitness value for each of a plurality of autoencoders. The fitness value for an autoencoder indicates reconstruction error responsive to data representing a first operational state of one or more devices. The method includes selecting, based on the fitness values, a subset of autoencoders. The method also includes performing a genetic operation with respect to at least one autoencoder to generate a trainable autoencoder. The method includes training the trainable autoencoder to reduce a loss function value to generate a trained autoencoder. The loss function value is based on reconstruction error of the trainable autoencoder responsive to data representative of a second operational state of the device(s). The method includes adding the trained autoencoder to a population to be provided as input to a subsequent epoch of the genetic algorithm.

Abstract: A method includes receiving, by a processor, an input data set. The input data set includes a plurality of features. The method includes determining, by the processor, one or more characteristics of the input data set. The method includes, based on the one or more characteristics, adjusting, by the processor, one or more architectural parameters of an automated model generation process. The automated model generation process is configured to generate a plurality of models using a weighted randomization process. The one or more architectural parameters weight the weighted randomization process to adjust a probability of generation of models having particular architectural features. The method further includes executing, by the processor, the automated model generation process to output a mode, the model including data representative of a neural network.

Abstract: A method includes determining, by a processor of a computing device, a subset of models included in a plurality of models generated based on a genetic algorithm and corresponds to a first epoch of the genetic algorithm. Each of the plurality of models includes data representative of a neural network. The method includes aggregating the subset of models to generate an ensembler. The ensembler, when executed on an input, provides at least a portion of the input to each model of the subset of models to generate a plurality of intermediate outputs. An ensembler output of the ensembler is based on the plurality of intermediate outputs. The method further includes executing the ensembler on input data to determine the ensembler output.

Abstract: A method of generating a neural network includes iteratively performing operations including generating, for each neural network of a population, a matrix representation. The matrix representation of a particular neural network includes rows of values, where each row corresponds to a set of layers of the particular neural network and each value specifies a hyperparameter of the set of layers. The operations also include providing the matrix representations as input to a relative fitness estimator that is trained to generate estimated fitness data for neural networks of the population. The estimated fitness data are based on expected fitness of neural networks predicted by the relative fitness estimator. The operations further include generating, based on the estimated fitness data, a subsequent population of neural networks. The method also includes, when a termination condition is satisfied, outputting data identifying a neural network as a candidate neural network.

Abstract: A method includes receiving, by a processor, an input data set. The input data set includes a plurality of features. The method includes determining, by the processor, one or more characteristics of the input data set. The method includes, based on the one or more characteristics, adjusting, by the processor, one or more architectural parameters of an automated model generation process. The automated model generation process is configured to generate a plurality of models using a weighted randomization process. The one or more architectural parameters weight the weighted randomization process to adjust a probability of generation of models having particular architectural features. The method further includes executing, by the processor, the automated model generation process to output a mode, the model including data representative of a neural network.

Abstract: A method includes receiving, by a processor, an input data set. The input data set includes a plurality of features. The method includes determining, by the processor, one or more characteristics of the input data set. The method includes, based on the one or more characteristics, adjusting, by the processor, one or more architectural parameters of an automated model generation process. The automated model generation process is configured to generate a plurality of models using a weighted randomization process. The one or more architectural parameters weight the weighted randomization process to adjust a probability of generation of models having particular architectural features. The method further includes executing, by the processor, the automated model generation process to output a mode, the model including data representative of a neural network.

Abstract: A method includes determining, by a processor of a computing device, a subset of models included in a plurality of models generated based on a genetic algorithm and corresponds to a first epoch of the genetic algorithm. Each of the plurality of models includes data representative of a neural network. The method includes aggregating the subset of models to generate an ensembler. The ensembler, when executed on an input, provides at least a portion of the input to each model of the subset of models to generate a plurality of intermediate outputs. An ensembler output of the ensembler is based on the plurality of intermediate outputs. The method further includes executing the ensembler on input data to determine the ensembler output.

Abstract: A method includes determining, by a processor of a computing device, a subset of models included in a plurality of models generated based on a genetic algorithm and corresponds to a first epoch of the genetic algorithm. Each of the plurality of models includes data representative of a neural network. The method includes aggregating the subset of models to generate an ensembler. The ensembler, when executed on an input, provides at least a portion of the input to each model of the subset of models to generate a plurality of intermediate outputs. An ensembler output of the ensembler is based on the plurality of intermediate outputs. The method further includes executing the ensembler on input data to determine the ensembler output.