Abstract: Systems and methods for mitigating defects in a crossbar-based computing environment are disclosed. In some implementations, an apparatus comprises: a plurality of row wires; a plurality of column wires connecting between the plurality of row wires; a plurality of non-linear devices formed in each of a plurality of column wires configured to receive an input signal, wherein at least one of the non-linear device has a characteristic of activation function and at least one of the non-linear device has a characteristic of neuronal function.

Abstract: A device, system, and method for approximating a neural network comprising N synapses or filters. The neural network may be partially-activated by iteratively executing a plurality of M partial pathways of the neural network to generate M partial outputs, wherein the M partial pathways respectively comprise M different continuous sequences of synapses or filters linking an input layer to an output layer. The M partial pathways may cumulatively span only a subset of the N synapses or filters such that a significant number of the remaining the N synapses or filters are not computed. The M partial outputs of the M partial pathways may be aggregated to generate an aggregated output approximating an output generated by fully-activating the neural network by executing a single instance of all N synapses or filters of the neural network. Training or prediction of the neural network may be performed based on the aggregated output.

Abstract: In one aspect, a method of a neuron circuit includes the step of providing a plurality of 2N?1 single-level-cell (SLC) flash cells for each synapse (Yi) connected to a bit line forming a neuron. The method includes the step of providing an input vector (Xi) for each synapse Yi wherein each input vector is translated into an equivalent electrical signal ESi (current IDACi, pulse, TPULSEi, etc). The method includes the step of providing an input current to each synapse sub-circuit varying from 20*ESi to (2N?1)*ESi. The method includes the step of providing a set of weight vectors or synapse (Yi), wherein each weight vector is translated into an equivalent threshold voltage level or resistance level to be stored in one of many non-volatile memory cells assigned to each synapse (Yi).

Abstract: Systems for predicting communication settlement times across disparate networks store a first tier of a machine learning architecture comprising multiple machine learning models and an aggregation layer; store a second tier comprising rule sets for predicting settlement times; receive multiple data feeds corresponding to multiple communication data types; generate feature inputs based on the data feeds; input the feature inputs into the respective models to generate respective outputs; generate, using the aggregation layer, a third feature input based on the outputs; determine, based on the third feature input, a first rule set for predicting settlement times; receive a communication; predict a settlement time based on the first rule set; determine an aggregated communication load at a first time based on the settlement time; determine a performance availability requirement based on the load; determine a recommendation based on the performance availability requirement; and generate the recommendation based on

Abstract: A property vector representing extractable measurable properties, such as musical properties, of a file is mapped to semantic properties for the file. This is achieved by using artificial neural networks “ANNs” in which weights and biases are trained to align a distance dissimilarity measure in property space for pairwise comparative files back towards a corresponding semantic distance dissimilarity measure in semantic space for those same files. The result is that, once optimised, the ANNs can process any file, parsed with those properties, to identify other files sharing common traits reflective of emotional-perception, thereby rendering a more liable and true-to-life result of similarity/dissimilarity. This contrasts with simply training a neural network to consider extractable measurable properties that, in isolation, do not provide a reliable contextual relationship into the real-world.

Abstract: Systems and methods for projecting one or more trends in electronic data and generating enhanced data. A system includes a data forecasting system is in electronic communication with one or more electronic data sources via an electronic network. The data forecasting system is configured to: monitor the electronic data source(s) for data that meet one or more predetermined criteria; obtain at least a portion of the monitored data from electronic data source(s) based on the predetermined criteria; create a data set from the obtained data; derive one or more data values associated with the data set over a predetermined period according to a forward-looking term methodology; and utilize the data set and the derived value(s) over the predetermined period to derive at least one data forecast metric associated with the data set.

Abstract: The present disclosure relates to a neuron for an artificial neural network, the neuron comprising: a first dot product engine and a second dot product engine. The first dot product engine is operative to: receive a first set of weights; receive a set of inputs; and calculate the dot product of the set of inputs and the first set of weights to generate a first dot product engine output. The second dot product engine is operative to: receive a second set of weights; receive the set of inputs; and calculate the dot product of the set of inputs and the second set of weights to generate a second dot product engine output. The neuron further comprises a combiner operative to combine the first dot product engine output and the second dot product engine output to generate a combined output, and an activation function module arranged to apply an activation function to the combined output to generate a neuron output.

Abstract: Modifying digital content based on predicted future user behavior is provided. Trends in propagation values corresponding to a layer of nodes in an artificial neural network are identified based on measuring the propagation values at each run of the artificial neural network. The trends in the propagation values are forecasted to generate predicted propagation values at a specified future point in time. The predicted propagation values are applied to the layer of nodes in the artificial neural network. Predicted website analytics values corresponding to a set of website variables of interest for the specified future point in time are generated based on running the artificial neural network with the predicted propagation values. A website corresponding to the set of website variables of interest is modified based on the predicted website analytics values corresponding to the set of website variables of interest for the specified future point in time.

Abstract: The present invention discloses an online neuron spike sorting method based on neuromorphic computing, which converts neuron spike signals collected from the cerebral cortex into spike signals through field coding, classifies different waveforms and corresponding time stamps by means of spiking neural networks, and realizes online neuron spike sorting; at the same time, the online update method of spiking neural network is used to adapt to the online changes of neuronal spike waveform and improve the accuracy of long-term online neuronal spike sorting. This method has fast computational speed, which can improve the speed of spike sorting process, maintain high consistency in classification on different datasets, and facilitate the deployment of implanted chips.

Abstract: The present disclosure discloses a neural network processing module, in which a mapping unit is configured to receive an input neuron and a weight, and then process the input neuron and/or the weight to obtain a processed input neuron and a processed weight; and an operation unit is configured to perform an artificial neural network operation on the processed input neuron and the processed weight. Examples of the present disclosure may reduce additional overhead of the device, reduce the amount of access, and improve efficiency of the neural network operation.

Abstract: The present disclosure discloses a neural network processing module, in which a mapping unit is configured to receive an input neuron and a weight, and then process the input neuron and/or the weight to obtain a processed input neuron and a processed weight; and an operation unit is configured to perform an artificial neural network operation on the processed input neuron and the processed weight. Examples of the present disclosure may reduce additional overhead of the device, reduce the amount of access, and improve efficiency of the neural network operation.

Abstract: A computer-implemented method for detecting an anomalous operating status of a technical system. A training phase obtains a first set of time-series values generated by a digital twin simulation of the technical system for a regular operating status and a second set of time-series values measured by sensors in an anomalous operating status, and adjusts parameters of a machine learning model for detecting the regular operating status and for discriminating data samples of the regular operating status from data samples of the anomalous operating status to generate a trained machine learning model. A monitoring phase obtains a set of multivariate time-series values measured by the sensors, calculates an anomaly score value for determining whether the technical system is in an anomalous operating status based on the obtained set of multi-variate time-series values and the trained machine learning model, and outputs a signal including information on the determined anomalous operating status.

Abstract: Embodiments herein describe techniques for expressing the layers of a neural network in a software model. In one embodiment, the software model includes a class that describes the various functional blocks (e.g., convolution units, max-pooling units, rectified linear units (ReLU), and scaling functions) used to execute the neural network layers. In turn, other classes in the software model can describe the operation of each of the functional blocks. In addition, the software model can include conditional logic for expressing how the data flows between the functional blocks since different layers in the neural network can process the data differently. A compiler can convert the high-level code in the software model (e.g., C++) into a hardware description language (e.g., register transfer level (RTL)) which is used to configure a hardware system to implement a neural network accelerator.

Abstract: A computer-implemented method of generating scale-permuted models can generate models having improved accuracy and reduced evaluation computational requirements. The method can include defining, by a computing system including one or more computing devices, a search space including a plurality of candidate permutations of a plurality of candidate feature blocks, each of the plurality of candidate feature blocks having a respective scale. The method can include performing, by the computing system, a plurality of search iterations by a search algorithm to select a scale-permuted model from the search space, the scale-permuted model based at least in part on a candidate permutation of the plurality of candidate permutations.

Abstract: Defect resistant designs for location-sensitive neural network processor arrays are provided. In various embodiments, plurality of neural network processor cores are arrayed in a grid. The grid has a plurality of rows and a plurality of columns. A network interconnects at least those of the plurality of neural network processor cores that are adjacent within the grid. The network is adapted to bypass a defective core of the plurality of neural network processor cores by providing a connection between two non-adjacent rows or columns of the grid, and transparently routing messages between the two non-adjacent rows or columns, past the defective core.

Abstract: The present teaching relates to obtaining a model for identifying content matching a query. Training data are received which include queries, advertisements, and hyperlinks. A plurality of subwords are identified from each of the queries and a plurality of vectors for the plurality of subwords of each of the queries are obtained. Via a neural network, a vector for each of the queries is derived based on a plurality of vectors for the plurality of subwords of the query. A query/ads model is obtained via optimization with respect to an objective function, based on vectors associated with the plurality of subwords of each of the queries and vectors for the queries obtained from the neural network.

Abstract: A method of performing, by an electronic device, a convolution operation at a certain layer in a neural network includes: obtaining N pieces of input channel data; performing a first convolution operation by applying a first input channel data group including K pieces of first input channel data from among the N pieces of input channel data to a first kernel filter group including K first kernel filters; performing a second convolution operation by applying a second input channel data group including K pieces of second input channel data from among the N pieces of input channel data to a second kernel filter group including K second kernel filters; and obtaining output channel data based on the first convolution operation and the second convolution operation, wherein K is a natural number that is less than N.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing a machine learning task on a network input to generate a network output. One of the systems comprises an attention neural network configured to perform the machine learning task, the attention neural network comprising a plurality of attention layers, each attention layer comprising an attention sub-layer that is arranged in parallel with a feed-forward sub-layer.

Abstract: A method for generating an alimentary instruction set identifying a nutrition plan, comprising receiving information related to a biological extraction and physiological state of a user and generating a diagnostic output based upon the information related to the biological extraction and physiological state of the user. The generating comprises identifying a condition of the user as a function of the information related to the biological extraction and physiological state of the user and a first training set. Further, the generating includes identifying nutrition related to the identified condition of the user as a function of the identified condition of the user and a second training set. Further, the method includes generating, by an alimentary instruction set generator operating on a computing device, a nutrition plan as a function of the diagnostic output, said nutrition plan including the nutrition related to the identified condition of the user.

Abstract: A library of machine learning primitives is provided to optimize a machine learning model to improve the efficiency of inference operations. In one embodiment a trained convolutional neural network (CNN) model is processed into a trained CNN model via pruning, convolution window optimization, and quantization.