Abstract: An apparatus to facilitate neural network (NN) training is disclosed. The apparatus includes training logic to receive one or more network constraints and train the NN by automatically determining a best network layout and parameters based on the network constraints.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for few-shot learning-based generator training based on raw data collected from a specific domain or class. In cases where the raw data is collected from multiple domains but is not easily divisible into classes, the invention describes training multiple generators based on a pivot-sample-based training process. Pivot samples are randomly selected from the raw data for clustering, and each cluster of raw data may be used to train a generator using the few-shot learning-based training process.

Abstract: A sequential data analysis apparatus extracts a pattern of two or more sets of items based on an appearance frequency of each of different sets of items in first sequential data, selects a pattern of two or more sets of items based on an appearance frequency of a sub-pattern formed of a portion of the extracted pattern, creates a related pattern including the same last set of items as and the other sets of items different from the selected characteristic pattern, calculates an evaluation value of the related pattern, creates a prediction model by organizing data of the characteristic pattern and the related pattern, and applies second sequential data to the prediction model to determine a result which the second sequential data is likely to lead to.

Abstract: A method for using machine learning techniques to analyze past decisions made by administrators concerning account opening requests and to recommend whether an account opening request should be allowed or denied. Further, the machine learning techniques determine various other products that the customer may be interested in and prioritizes the choices of options that the machine learning algorithm determines appropriate for the customer.

Abstract: A physical environment is equipped with a plurality of sensors (e.g., motion sensors). As individuals perform various activities within the physical environment, sensor readings are received from one or more of the sensors. Based on the sensor readings, activities being performed by the individuals are recognized and the sensor data is labeled based on the recognized activities. Future activity occurrences are predicted based on the labeled sensor data. Activity prompts may be generated and/or facility automation may be performed for one or more future activity occurrences.

Abstract: A fact validation method including the following steps: a statement to be validated is inputted and a searching is made for the statement to obtain an evidence set of the statement; a hierarchical heterogeneous graph consisting of an entity node, a sentence node and a context node is constructed based on the evidence set; the statement and the evidence set are spliced and a node is initialized to obtain feature representation of the node; the feature representation of the node is updated based on inference according to a propagation direction of a neural network of the node in the hierarchical heterogeneous graph; and an inference path for the updated feature representation of the node is built and a prediction result of the statement is output according to the inference path.

Abstract: Systems and methods analyze training of a first machine learning system with a second machine learning system. The first machine learning system comprises a neural network with a first inner layer node. The method includes connecting the first machine learning system to an input of the second machine learning system. The second machine learning system comprises a second objective function for analyzing an internal characteristic of the first machine learning system and which is different from a first objective function for the first machine learning system.

Abstract: A non-transitory computer-readable storage medium storing therein a learning program that causes a computer to execute a process includes: determining whether or not there is a discontinuity point at which a variation in a learning time relative to a variation in a learning parameter is discontinuous; specifying, when the discontinuity point is present, ranges of the learning parameter in which the variation in the learning time relative to the variation in the learning parameter is continuous, based on the discontinuity point; calculating, for each of the specified ranges, an estimated value of performance of trials using a trial parameter learned by machine learning per a learning time of machine learning using a learning parameter included in the range; and specifying a learning parameter which enables any of the estimated values selected in accordance with a magnitude of the estimated value among the calculated estimated values.

Abstract: Technologies are described for analyzing interactions with data objects stored by a network-based storage service. The analysis of the interactions can identify patterns of the data object interactions and outcomes that can result from the patterns. Models can be developed that include the patterns and the outcomes corresponding to the patterns. As requests related to data object interactions are subsequently obtained by the system, the requests can be analyzed with respect to the models to identify an outcome that may be associated with the requests.

Abstract: An algorithm data store may contain information about a pool of available algorithms (e.g., to improve operation of an industrial asset). A deployment platform may be implemented in an edge portion at an industrial site associated with a live environment executing a current algorithm. A lifecycle manager of the deployment platform may manage execution of the current algorithm in the live environment creating source data. A performance manager may receive an indication of a selected at least one potential replacement algorithm from the pool of available algorithms and manage execution of the at least one potential replacement algorithm in a shadow environment using the source data. The performance manager may then report performance information associated with the at least one potential replacement algorithm. When appropriate, the potential replacement algorithm may replace the current algorithm.

Abstract: An embodiment of the present invention provides a quantization method for weights of a plurality of batch normalization layers, including: receiving a plurality of previously learned first weights of the plurality of batch normalization layers; obtaining first distribution information of the plurality of first weights; performing a first quantization on the plurality of first weights using the first distribution information to obtain a plurality of second weights; obtaining second distribution information of the plurality of second weights; and performing a second quantization on the plurality of second weights using the second distribution information to obtain a plurality of final weights, and thereby reducing an error that may occur when quantizing the weight of the batch normalization layer.

Abstract: Methods, systems, and apparatuses, including computer programs encoded on computer storage media, for federal learning are disclosed. One exemplary method may include receiving, by a client device from a server device, model parameters of a global machine learning model being collaboratively trained by the client device and the server device; constructing, by the client device, a local machine learning model based on the model parameters of the global machine learning model, wherein the local machine learning model comprises two branches corresponding to two loss functions; training, by the client device, the local machine learning model based on local training data, wherein the training comprises updating the model parameters to minimize a first loss function of the two loss functions and maximize a second loss function of the two loss functions; and sending, by the client device, the updated model parameters back to the server device.

Abstract: A system and method design and optimize neural networks. The system and method include a data store that stores a plurality of gene vectors that represent diverse and distinct neural networks and an evaluation queue stored with the plurality of gene vectors. Secondary nodes construct, train, and evaluate the neural network and automatically render a plurality of fitness values asynchronously. A primary node executes a gene amplification on a select plurality of gene vectors, a crossing-over of the amplified gene vectors, and a mutation of the crossing-over gene vectors automatically and asynchronously, which are then transmitted to the evaluation queue. The process continuously repeats itself by processing the gene vectors inserted into the evaluation queue until a fitness level is reached, a network's accuracy level plateaus, a processing time period expires, or when some stopping condition or performance metric is met or exceeded.

Abstract: Automatically generating and/or automatically transmitting a status of a user. The status is transmitted for presentation to one or more additional users via corresponding computing device(s) of the additional user(s). Some implementations are directed to determining both: a status of a user, and a predicted duration of that status; and generating a status notification that includes the status and that indicates the predicted duration. Some implementations are additionally or alternatively directed to utilizing at least one trust criterion in determining whether to provide a status notification of a user to an additional user and/or in determining what status notification to provide to the additional user. Some implementations are additionally or alternatively directed to training and/or use of machine learning model(s) in determining a status of a user and/or a predicted duration of that status.

Abstract: A method for finding a solution to a problem is provided. The method includes storing candidate individuals in a candidate pool and evolving the candidate individuals by performing steps including (i) testing each of the candidate individuals to obtain test results, (ii) assigning a performance measure to the tested candidate individuals, (iii) discarding candidate individuals from the candidate pool in dependence upon their assigned performance measure, and (iv) adding, to the candidate pool, a new candidate individual procreated from candidate individuals remaining in the candidate pool.

Abstract: An artificial intelligence testing apparatus may include processing circuitry configured to execute instructions that, when executed, cause the apparatus to create initial sample points based on a simulation received at the apparatus, and employ cyclic evaluation of the simulation until a stopping criteria is met. Employing the cyclic evaluation includes running the simulation at design points for a set of queries associated with a current iteration of the cyclic evaluation, training a set of meta-models of parameter space associated with the simulation for the current iteration, computing a set of metrics for the current iteration, and employing a selected sampling approach to select a new set of design points for a next iteration of the cyclic evaluation.

Abstract: Methods and systems for determining an optimized setting for one or more process parameters of a machine learning training process are described. One of the methods includes processing a current network input using a recurrent neural network in accordance with first values of the network parameters to obtain a current network output, obtaining a measure of the performance of the machine learning training process with an updated setting defined by the current network output, and generating a new network input that includes (i) the updated setting defined by the current network output and (ii) the measure of the performance of the training process with the updated setting defined by the current network output.

Abstract: A weld production knowledge system for processing welding data collected from one of a plurality of welding systems, the weld production knowledge system comprising a communication interface communicatively coupled with a plurality of welding systems situated at one or more physical locations. The communication interface may be configured to receive, from one of said plurality of welding systems, welding data associated with a weld. The weld production knowledge system may comprise an analytics computing platform operatively coupled with the communication interface and a weld data store. The weld data store employs a dataset comprising (1) welding process data associated with said one or more physical locations, and/or (2) weld quality data associated with said one or more physical locations. The analytics computing platform may employ a weld production knowledge machine learning algorithm to analyze the welding data vis-à-vis the weld data store to identify a defect in said weld.

Abstract: Methods, systems, and apparatus, including computer-readable media, for machine learning in a multi-tenant data sharing platform. In some implementations, a server system provides a multi-tenant data sharing platform configured to selectively use stored data collected for different tenant organizations according to policy data for the respective tenant organizations. A request from one organization is received to perform a machine learning task involving a data set of a different tenant organization. The server system uses stored policy data to determine an applicable data policy, and based on the determination, the server system performs the machine learning task and provides the results of the machine learning task.

Abstract: Techniques are shown for generating image frames from a media presentation. In one embodiment a computer implemented method is provided. The method includes identifying, by a processing device, image frames from a media presentation comprising a plurality of image frames. Candidate thumbnails are selected from the identified image frames. A probability is determined that a selected candidate thumbnail with a success ranking higher than other selected thumbnails is an optimum candidate thumbnail for representing the media presentation in view of a relationship between the success ranking of the selected candidate thumbnail and the success rankings of the other selected candidate thumbnails. Thereupon, data for displaying the selected candidate thumbnail to a user as a representative of the media presentation is provided by the processing device.