Abstract: Simulating uncertainty in an artificial neural network is provided. Aleatoric uncertainty is simulated to measure what the artificial neural network does not understand from sensor data received from an object operating in a real-world environment by adding random values to edge weights between nodes in the artificial neural network during backpropagation of output data of the artificial neural network and measuring impact on the output data by the added random values to the edge weights between the nodes. Epistemic uncertainty is simulated to measure what the artificial neural network does not know by dropping out a selected node from each respective layer of the artificial neural network during forward propagation of the sensor data and measuring impact of dropped out nodes on the output data of the artificial neural network. An action corresponding to the object is performed based on the impact of simulating the aleatoric and epistemic uncertainty.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training an actor neural network used to select actions to be performed by an agent interacting with an environment. One of the methods includes obtaining a minibatch of experience tuples; and updating current values of the parameters of the actor neural network, comprising: for each experience tuple in the minibatch: processing the training observation and the training action in the experience tuple using a critic neural network to determine a neural network output for the experience tuple, and determining a target neural network output for the experience tuple; updating current values of the parameters of the critic neural network using errors between the target neural network outputs and the neural network outputs; and updating the current values of the parameters of the actor neural network using the critic neural network.

Abstract: A method of operating a neural network system includes parsing, by a processor, at least one item of information related to a neural network operation from an input neural network model; determining, by the processor, information of at least one dedicated hardware device; and generating, by the processor, a reshaped neural network model by changing information of the input neural network model according to a result of determining the information of the at least one dedicated hardware device such that the reshaped neural network model is tailored for execution by the dedicated hardware device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving training data for multiple datasets that include information about a computing process. The training data is received at a computing system that includes a data manager, a data classifier, and a machine learning (ML) system. The data classifier annotates the training data as being associated with a particular dataset and as being descriptive of computing processes executed to perform transactions. The ML system receives the annotated training data and data about a transaction operation of the system, trains a predictive model to generate prediction data that indicates a runtime condition of the system, and provides the prediction data to a process automation module of the system. The module executes process automation scripts to remediate the computing process, where the computing process is executed by the system to perform the real-time transaction operation.

Abstract: The subject technology determines input parameters and an output format of algorithms for a particular functionality provided by an electronic device. The subject technology determines an order of the algorithms for performing the particular functionality based on temporal dependencies of the algorithms, and the input parameters and the output format of the algorithms. The subject technology generates a graph based on the order of the algorithms, the graph comprising a set of nodes corresponding to the algorithms, each node indicating a particular processor of the electronic device for executing an algorithm. Further, the subject technology executes the particular functionality based on performing a traversal of the graph, the traversal comprising a topological traversal of the set of nodes and the traversal being based on a score indicating whether selection of a particular node for execution over another node enables a greater number of processors to be utilized at a time.

Abstract: This invention provides an autonomic method for controlling an algorithm on a multi-terminal computing system, wherein the algorithm is configured to analyse diagnostic data for each terminal and an outcome of the analysis is a first action or a second action, and a device for implementing the method, the method comprising the steps of: receiving a first set of data for the multi-terminal computing system; applying the algorithm to the first set of data to classify each terminal in the multi-terminal computing system as being associated with either a first action or second action; re-classifying a first subset of terminals classified as being associated with the first action as being associated with the second action; and applying the first actions, second actions, and reclassified second actions respectively to each terminal in the multi-terminal computing system.

Abstract: A method for method for classification of virtual reality (VR) content for use in head mounted displays (HMDs). The method includes accessing a model that identifies a plurality of learned patterns associated with the generation of corresponding baseline VR content that is likely to cause discomfort. The method includes executing a first application to generate first VR content. The method includes extracting data associated with simulated user interactions with the first VR content, the extracted data generated during execution of the first application. The method includes comparing the extracted data to the model to identify one or more patterns in the extracted data matching at least one of the learned patterns from the model such that the one or more patterns are likely to cause discomfort.

Abstract: A method and an apparatus to build a machine learning based network model are described. For example, processing circuitry of an information processing apparatus obtains a data processing procedure of a first network model and a reference dataset that is generated by the first network model in the data processing procedure. The data processing procedure includes a first data processing step. Further, the processing circuitry builds a first sub-network in a second network model of a neural network type. The second network model is the machine learning based network model to be built. The first sub-network performs the first data processing step. Then, the processing circuitry performs optimization training on the first sub-network by using the reference dataset.

Abstract: A computer-implemented method, computer program product, and computer processing system are provided for Hierarchical Reinforcement Learning (HRL) with a target task. The method includes obtaining, by a processor device, a sequence of tasks based on hierarchical relations between the tasks, the tasks constituting the target task. The method further includes learning, by a processor device, a sequence of constraints corresponding to the sequence of tasks by repeating, for each of the tasks in the sequence, reinforcement learning and supervised learning with a set of good samples and a set of bad samples and by applying an obtained constraint for a current task to a next task.

Abstract: An example method for facilitating the generation of a control field for a quantum system is provided. The example method may include receiving quantum system experiment input parameters and generating a set of coefficients defining a plurality of controls. The plurality of controls may be provided as a weighted sum of basis functions that include discrete prolate spheroidal sequences. The example method may further include applying a gradient based optimization, synthesizing the plurality of controls, and configuring a waveform generator with the plurality of controls to enable the waveform generator to generate the control field.

Abstract: Methods, systems, and computer program products for multi-modal construction of deep learning networks are provided herein. A computer-implemented method includes extracting, from user-provided multi-modal inputs, one or more items related to generating a deep learning network; generating a deep learning network model, wherein the generating includes inferring multiple details attributed to the deep learning network model based on the one or more extracted items; creating an intermediate representation based on the deep learning network model, wherein the intermediate representation includes (i) one or more items of data pertaining to the deep learning network model and (ii) one or more design details attributed to the deep learning network model; automatically converting the intermediate representation into source code; and outputting the source code to at least one user.

Abstract: A computer-implemented method is provided for machine prediction. The method includes forming, by a hardware processor, a Convolutional Dynamic Boltzmann Machine (C-DyBM) by extending a non-convolutional DyBM with a convolutional operation. The method further includes generating, by the hardware processor using the convolution operation of the C-DyBM, a prediction of a future event at time t from a past patch of time-series of observations. The method also includes performing, by the hardware processor, a physical action responsive to the prediction of the future event at time t.

Abstract: In one embodiment, a service receives machine learning-based generative models from a plurality of distributed sites. Each generative model is trained locally at a site using unlabeled data observed at that site to generate synthetic unlabeled data that mimics the unlabeled data used to train the generative model. The service receives, from each of the distributed sites, a subset of labeled data observed at that site. The service uses the generative models to generate synthetic unlabeled data. The service trains a global machine learning-based model using the received subsets of labeled data received from the distributed sites and the synthetic unlabeled data generated by the generative models.

Abstract: In various examples there is a computer-implemented method performed by a digital twin at a computing device in a communications network. The method comprises: receiving at least one stream of event data observed from the environment. Computing at least one schema from the stream of event data, the schema being a concise representation of the stream of event data. Participating in a distributed inference process by sending information about the schema or the received event stream to at least one other digital twin in the communications network and receiving information about schemas or received event streams from the other digital twin. Computing comparisons of the sent and received information. Aggregating the digital twin and the other digital twin, or defining a relationship between the digital twin and the other digital twin on the basis of the comparison.

Abstract: A computer-implemented method for outputting a data element to a user for an operation by the user to give a label to plural data elements, includes: selecting the data element by either one of a first strategy and a second strategy, the first strategy being a strategy for selecting a data element which has been predicted with a low confidence level, the second strategy being a strategy for selecting a data element which has been predicted with a high confidence level; outputting the selected data element so as for a user to give a label to the selected data element; and switching between the first strategy and the second strategy depending on a progress degree of labeling by the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.

Abstract: Systems and methods are provided for operating to an initial optimized baseline solution to a multi-objective problem. As the initial optimized baseline solution is determined, some regions, such as local or global maxima, minima, and/or saddle points in the objective space may be mapped. The mapping may be performed by storing mesh chromosomes corresponding to some of the features (e.g., extrema, saddle points, etc.) in the objective space along with the location of those chromosomes within the objective space (e.g., objective values corresponding to each of the objectives). The mesh chromosome may be used in subsequent re-optimization problems, such as with reformulation. Although in a re-optimization the objectives, decision variables, and or objective/constraint models may change, the mesh chromosomes may still provide information and direction for more quickly and/or with reduced resources converge on a re-optimized solution.

Abstract: In an embodiment, a method for optimizing computer machine learning includes receiving an optimization goal. The optimization goal is used to search a database of base option candidates (BOC) to identify matching BOCs that at least in part matches the goal. A selection of a selected base option among the matching BOCs is received. Machine learning prediction model(s) are selected based at least in part on the goal to determine prediction values associated with alternative features for the selected base option, where the model(s) were trained using training data to at least identify weight values associated with the alternative features for models. Based on the prediction values, at least a portion of the alternative features is sorted to generate an ordered list. The ordered list is provided for use in manufacturing an alternative version of the selected base option with the alternative feature(s) in the ordered list.

Abstract: Described is a system for controlling a mobile platform. A neural network that runs on the mobile platform is trained based on a current state of the mobile platform. A Satisfiability Modulo Theories (SMT) solver capable of reasoning over non-linear activation functions is periodically queried to obtain examples of states satisfying specified constraints of the mobile platform. The neural network is then trained on the examples of states. Following training on the examples of states, the neural network selects an action to be performed by the mobile platform in its environment. Finally, the system causes the mobile platform to perform the selected action in its environment.

Abstract: A system and method for training a system for monitoring administration of medication. The method includes the steps of a method for training a medication administration monitoring apparatus, comprising the steps of defining one or more predetermined medications and then acquiring information from one or more data sources of a user administering medication. A first network is trained to recognize a first step of a medication administration sequence, and then a second network is trained to recognize a second step of a medication administration sequence based upon the training of the first network.