Abstract: Provided are systems, methods, and apparatuses of data processing for machine learning. In one or more examples, the systems, devices, and methods include determining priority values for elements of a weight matrix based on a gradient of a loss function of an AI model and the weight matrix; determining an index value based on a number of elements in the weight importance matrix and a sparsity ratio; determining a threshold based on sorting the elements of the weight importance matrix in sequential order and determining a value of an element of the sorted weight importance matrix based on using the index value as an index of the sorted weight importance matrix; determining a pruned weights matrix based on the threshold; and processing a query using an updated AI model, the updated AI model being based on the pruned weights matrix being implemented in the AI model.

Abstract: Provided are systems, methods, and apparatuses for artificial intelligence query processing by processing-near-memory storage. In one or more examples, the systems, devices, and methods include receiving, at a first processing-near-memory (PNM) storage device, data and processing, at the first PNM storage device, first values from the data with transposed query values from the data. In one or more examples, the systems, devices, and methods include determining, at the first PNM storage device, a probability distribution of a result of the processing and generating, at the first PNM storage device, an activation value based on the probability distribution, the activation value indicating a correlation between units of text in a query associated with the data.

Abstract: A system and a method for loop exit are disclosed. A unit scheduler includes a command queue, a report queue, an interface, and a unit controller. The command queue is configured to store commands for execution in an iterative procedure for an application using a transformer model with a multi-head attention (MHA) mechanism and a decoder. The report queue is configured to store status reports on the execution of the commands. The interface is configured to communicate with a host processor to receive the commands and to transmit the status reports. The unit controller is configured to determine a change of the iterative procedure based on a loop exit condition being met. The unit controller reports the loop exit condition in the report queue.

Abstract: A processor is disclosed. A first processing layer of the processor may process a first vector into a second vector. A second processing layer may process the second vector into a third vector. A comparator to determine a similarity of the third vector and a fourth vector. A refine module may refine the third vector into a fifth vector based at least in part on the similarity of the third vector and the fourth vector.

Abstract: A system and method for in-storage machine learning operations. In some embodiments, a system includes a first persistent memory, and a control and inference circuit. The first persistent memory may be connected to the control and inference circuit by a wideband data connection, and the control and inference circuit may be configured to perform arithmetic operations.

Abstract: A method for hand pose identification in an automated system includes providing map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for hand pose identification in an automated system includes providing map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for training a hierarchy of trained neural networks for hand pose detection includes training a first neural network to generate a first plurality of activation features that classify an input depth map data corresponding to a hand based on a wrist angle of the hand, the training using a plurality of depth maps of a hand with predetermined wrist angles as inputs to the first neural network during the training, and storing the first neural network in a memory after the training for use in classifying an additional depth map corresponding to a hand based on an angle of a wrist of the hand in the additional depth map.

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.