Patents Issued in July 9, 2024
  • Patent number: 12033049
    Abstract: The subject technology receives assessment values determined by a first machine learning model deployed on a client electronic device, the assessment values being indicative of classifications of input data and the assessment values being associated with constraint data that comprises a probability distribution of the assessment values with respect to the classifications of the input data. The subject technology applies the assessment values determined by the first machine learning model to a second machine learning model to determine the classifications of the input data. The subject technology determines whether accuracies of the classifications determined by the second machine learning model conform with the probability distribution for corresponding assessment values determined by the first machine learning model.
    Type: Grant
    Filed: July 31, 2023
    Date of Patent: July 9, 2024
    Assignee: Apple Inc.
    Inventors: Edouard Godfrey, Gianpaolo Fasoli, Kuangyu Wang
  • Patent number: 12033050
    Abstract: This disclosure describes embodiments of systems, methods, and non-transitory computer readable storage media that can utilize language neural networks to automatically generate draft electronic communications for a user account. For example, the disclosed systems leverage composition parameters of a user account (determined from historical electronic communications of the user account, digital content items corresponding to the user account, and/or other application data) with a neural network to automatically generate draft electronic communications that reflect a composition style of a user account and accurately addresses a context of a communication thread. In addition, the disclosed systems can generate electronic communications using the communication generation neural network and save the electronic communication as a draft (e.g., for review by a user of the user account) and/or automatically transmit the electronic message to a recipient user account.
    Type: Grant
    Filed: June 22, 2023
    Date of Patent: July 9, 2024
    Assignee: Dropbox, Inc.
    Inventor: Devin Mancuso
  • Patent number: 12033051
    Abstract: A computer-based system and process are disclosed for reconstructing the internal electrical behavior of a patient's heart based partly or wholly on the patient's electrocardiogram (ECG). The output of the process may include, for example, a cardiac activation map, and/or a representation of transmembrane potentials over time. The process advantageously does not require any medical imaging of the patient, and does not require any special medical equipment. For example, the patient's activation map and transmembrane potentials may be reconstructed based solely on a preexisting or newly-obtained 12-lead cardiac ECG of the patient. The process makes use of a machine learning model, such as a neural network based model, trained with actual and/or simulated ECGs and intracardiac electrical data (typically transmembrane potentials) of many thousands of patients.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: July 9, 2024
    Assignee: Lawrence Livermore National Security, LLC
    Inventors: Robert C. Blake, Thomas J. O'Hara, Mikel L. Landajuela, Rushil Anirudh
  • Patent number: 12033052
    Abstract: Provided are a latency prediction method and a computing device for the same. The latency prediction method includes receiving a deep learning model and predicting on-device latency of the received deep learning model using a latency predictor which is trained on the basis of a latency lookup table. The latency lookup table includes information on single neural network layers and latency information of the single neural network layers on an edge device.
    Type: Grant
    Filed: August 11, 2022
    Date of Patent: July 9, 2024
    Assignee: NOTA, INC.
    Inventors: Jeong Ho Kim, Min Su Kim, Tae Ho Kim
  • Patent number: 12033053
    Abstract: Embodiments of the invention may execute a NN by executing sub-tensor columns, each sub-tensor column including computations from portions of a layers of the NN, and each sub-tensor column performing computations entirely within a first layer of cache (e.g. L2 in one embodiment) and saving its output entirely within a second layer of cache (e.g. L3 in one embodiment). Embodiments may include partitioning the execution of a NN by partitioning the execution of the NN into sub-tensor columns, each sub-tensor column including computations from portions of layers of the NN, each sub-tensor column performing computations entirely within a first layer of cache and saving its output entirely within a second layer of cache.
    Type: Grant
    Filed: November 23, 2022
    Date of Patent: July 9, 2024
    Assignee: NEURALMAGIC, INC.
    Inventors: Alexander Matveev, Nir Shavit, Govind Ramnarayan
  • Patent number: 12033054
    Abstract: Data-dependent node-to-node knowledge sharing to increase the interpretability of the activation pattern of one or more nodes in a neural network, is implemented by a set of knowledge sharing links. Each link may comprise a knowledge providing node or other source P and a knowledge receiving node R. A knowledge sharing link can impose a node-specific regularization on the knowledge receiving node R to help guide the knowledge receiving node R to have an activation pattern that is more easily interpreted. The specification and training of the knowledge sharing links may be controlled by a cooperative human-AI learning supervisor system in which a human and an artificial intelligence system work cooperatively to improve the interpretability and performance of the client system.
    Type: Grant
    Filed: July 17, 2023
    Date of Patent: July 9, 2024
    Assignee: D5AI LLC
    Inventors: James K. Baker, Bradley J. Baker
  • Patent number: 12033055
    Abstract: A system including an attention neural network that is configured to receive an input sequence and to process the input sequence to generate an output is described. The attention neural network includes: an attention block configured to receive a query input, a key input, and a value input that are derived from an attention block input. The attention block includes an attention neural network layer configured to: receive an attention layer input derived from the query input, the key input, and the value input, and apply an attention mechanism to the query input, the key input, and the value input to generate an attention layer output for the attention neural network layer; and a gating neural network layer configured to apply a gating mechanism to the attention block input and the attention layer output of the attention neural network layer to generate a gated attention output.
    Type: Grant
    Filed: September 7, 2020
    Date of Patent: July 9, 2024
    Assignee: DeepMind Technologies Limited
    Inventors: Emilio Parisotto, Hasuk Song, Jack William Rae, Siddhant Madhu Jayakumar, Maxwell Elliot Jaderberg, Razvan Pascanu, Caglar Gulcehre
  • Patent number: 12033056
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, relating to multi-task recurrent neural networks. One of the methods includes maintaining data specifying, for a recurrent neural network, a separate internal state for each of a plurality of memory regions; receiving a current input; identifying a particular memory region of the memory access address defined by the current input; selecting, from the internal states specified in the maintained data, the internal state for the particular memory region; processing, in accordance with the selected internal state for the particular memory region, the current input in the sequence of inputs using the recurrent neural network to: generate an output, the output defining a probability distribution of a predicted memory access address, and update the selected internal state of the particular memory region; and associating the updated selected internal state with the particular memory region in the maintained data.
    Type: Grant
    Filed: August 15, 2022
    Date of Patent: July 9, 2024
    Assignee: Google LLC
    Inventors: Milad Olia Hashemi, Jamie Alexander Smith, Kevin Jordan Swersky
  • Patent number: 12033057
    Abstract: A system for classifying the usage of a handheld consumer device having a sensor and an analyzer. The sensor determines usage data at successive time instants and provides a temporally successive sequence of usage data during a usage session. The analyzer classifies the usage of the device with respect to at least one set usage classes and assembles a temporally successive sequence of input tuples of usage data relating to a predetermined time period of the usage session, each of the input tuples having at least one element representing the usage data at the respective time instant and for inputting the sequence of input tuples into at least one artificial neural network arranged to output at least one output tuple comprising a number of elements in accordance with the number of usage classes, each element of the output tuple representing a prediction value that the usage of the consumer device at the given time instant relates to a respective usage class.
    Type: Grant
    Filed: June 28, 2023
    Date of Patent: July 9, 2024
    Assignee: Braun GmbH
    Inventors: Faiz Feisal Sherman, Xiaole Mao
  • Patent number: 12033058
    Abstract: In some implementations initially training a first neural network includes inputting the training inputs and corresponding training labels into the first neural network to produce output labels, comparing the output labels to the corresponding training labels using a second neural network that learns and applies a comparison metric, and adjusting parameters of the first neural network based on the comparing. The device then inputs additional inputs into the first neural network to produce additional output labels and corresponding confidence values from the second neural network. The device selects, based on the confidence values, an automatically-labeled training set of data including a subset of the additional inputs and a corresponding subset of the additional output labels. During a second training stage, the device trains the first neural network and the second neural network using the automatically-labeled training set of data.
    Type: Grant
    Filed: May 24, 2019
    Date of Patent: July 9, 2024
    Assignee: Apple Inc.
    Inventors: Peter Meier, Tanmay Batra
  • Patent number: 12033059
    Abstract: The present invention discloses a method for predicting bearing life based on a hidden Markov model (HMM) and transfer learning, including the following steps: (1) acquiring an original signal of full life of a rolling bearing; and extracting a feature set including a time domain feature, a time-frequency domain feature, and a trigonometric function feature; (2) inputting the feature set into an HMM to predict a hidden state, to obtain a failure occurrence time (FOT); (3) constructing a multilayer perceptron (MLP) model, obtaining a domain invariant feature and an optimal model parameter, and obtaining a neural network life prediction model; and (4) inputting the remaining target domain feature sets into the neural network life prediction model, and predicting the remaining life of the bearing. In the present invention, MLP-based transfer learning is used to resolve distribution differences in a source domain and a target domain caused by different operating conditions.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: July 9, 2024
    Assignee: SOOCHOW UNIVERSITY
    Inventors: Jun Zhu, Changqing Shen, Nan Chen, Dongmiao Song, Jianqin Zhou, Jun Wang, Juanjuan Shi, Weiguo Huang, Zhongkui Zhu
  • Patent number: 12033060
    Abstract: Neural networks, in many cases, include convolution layers that are configured to perform many convolution operations that require multiplication and addition operations. Compared with performing multiplication on integer, fixed-point, or floating-point format values, performing multiplication on logarithmic format values is straightforward and energy efficient as the exponents are simply added. However, performing addition on logarithmic format values is more complex. Conventionally, addition is performed by converting the logarithmic format values to integers, computing the sum, and then converting the sum back into the logarithmic format. Instead, logarithmic format values may be added by decomposing the exponents into separate quotient and remainder components, sorting the quotient components based on the remainder components, summing the sorted quotient components using an asynchronous accumulator to produce partial sums, and multiplying the partial sums by the remainder components to produce a sum.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: July 9, 2024
    Assignee: NVIDIA Corporation
    Inventors: William James Dally, Rangharajan Venkatesan, Brucek Kurdo Khailany, Stephen G. Tell
  • Patent number: 12033061
    Abstract: A neural network device comprises a first plurality of synapse network capacitors, wherein the synapse network capacitors of the first plurality of synapse network capacitors share a first output terminal. The neural network device further comprises a second plurality of synapse network capacitors, wherein the synapse network capacitors of the second plurality of synapse network capacitors share a second output terminal. Still further, the neural network device comprises a metal shielding disposed between the first output terminal and the second output terminal. The neural network device may be used as part of an artificial intelligence system.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: July 9, 2024
    Assignee: International Business Machines Corporation
    Inventors: Chen Zhang, Jie Yang, Dexin Kong, Tenko Yamashita
  • Patent number: 12033062
    Abstract: A reservoir element includes a plurality of magnetoresistive effect elements each having a first ferromagnetic layer, a non-magnetic layer and a second ferromagnetic layer laminated in a first direction, and separated from each other, a spin orbit torque wiring that faces a part of at least one of the plurality of magnetoresistive effect elements, and a spin-conductive layer that connects at least the magnetoresistive effect elements closest to each other of the plurality of magnetoresistive effect elements, and conducts spins, wherein, the magnetoresistive effect elements are seen from the first direction, the second ferromagnetic layer overlaps part of the first ferromagnetic layer, the spin orbit torque wiring faces a first portion that does not overlap the second ferromagnetic layer in the first ferromagnetic layer when seen from the first direction, and the spin-conductive layer faces at least the first ferromagnetic layer each of the closest magnetoresistive effect elements.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: July 9, 2024
    Assignee: TDK CORPORATION
    Inventors: Tomoyuki Sasaki, Tatsuo Shibata
  • Patent number: 12033063
    Abstract: In an example, an apparatus comprises a plurality of execution units comprising and logic, at least partially including hardware logic, to traverse a solution space, score a plurality of solutions to a scheduling deep learning network execution, and select a preferred solution from the plurality of solutions to implement the deep learning network. Other embodiments are also disclosed and claimed.
    Type: Grant
    Filed: February 24, 2023
    Date of Patent: July 9, 2024
    Assignee: Intel Corporation
    Inventors: Eran Ben-Avi, Neta Zmora, Guy Jacob, Lev Faivishevsky, Jeremie Dreyfuss, Tomer Bar-On, Jacob Subag, Yaniv Fais, Shira Hirsch, Orly Weisel, Zigi Walter, Yarden Oren
  • Patent number: 12033064
    Abstract: The present disclosure provides a neural network weight matrix adjusting method, a writing control method and a related apparatus, The method comprises: judging whether a weight distribution of a neural network weight matrix is lower than a first preset threshold; if yes, multiplying all weight values in the neural network weight matrix by a first constant; if no, judging whether the weight distribution of the neural network weight matrix is higher than a second preset threshold, wherein the second preset threshold is greater than the first preset threshold; and dividing all weight values in the neural network weight matrix by a second constant, if the weight distribution of the neural network weight matrix is higher than the second preset threshold; wherein the first constant and the second constant are both greater than 1, thereby improving the operation precision.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: July 9, 2024
    Assignee: HANGZHOU ZHICUN INTELLIGENT TECHNOLOGY CO., LTD.
    Inventor: Shaodi Wang
  • Patent number: 12033065
    Abstract: Aspects of the present application relate to techniques for computing convolutions and cross-correlations of input matrices. A first technique is based on the transformation of convolution operations into a matrix-vector product. A second technique is based on two-dimensional matrix multiplication. A third technique is based on the convolution theorem, which states that convolutions correspond to multiplications in a transform space. Embodiments include methods for computing convolutions of a filter matrix and an input data matrix; apparatuses for computing convolutions of a filter matrix and an input data matrix; and a non-transitory computer readable medium programmed with instructions that, when executed by a processor perform a method for computing convolutions of a filter matrix and an input data matrix.
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: July 9, 2024
    Assignee: Lightmatter, Inc.
    Inventors: Tyler Kenney, Martin Forsythe, Tomo Lazovich, Darius Bunandar
  • Patent number: 12033066
    Abstract: An optical processing system comprises at least one spatial light modulator, SLM, configured to simultaneously display a first input data pattern (a) and at least one data focusing pattern which is a Fourier domain representation (B) of a second input data pattern (b), the optical processing system further comprising a detector for detecting light that has been successively optically processed by said input data patterns and focusing data patterns, thereby producing an optical convolution of the first and second input data patterns, the optical convolution for use in a neural network.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: July 9, 2024
    Assignee: Optalysys Limited
    Inventor: Alexander Joseph Macfaden
  • Patent number: 12033067
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a neural network that has one or more batch normalized neural network layers for use by a quantized inference system. One of the methods includes receiving a first batch of training data; determining batch normalization statistics for the first batch of training data; determining a correction factor from the batch normalization statistics for the first batch of training data and the long-term moving averages of the batch normalization statistics; generating batch normalized weights from the floating point weights for the batch normalized first neural network layer, comprising applying the correction factor to the floating point weights of the batch normalized first neural network layer; quantizing the batch normalized weights; determining a gradient of an objective function; and updating the floating point weights using the gradient.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: July 9, 2024
    Assignee: Google LLC
    Inventors: Suharsh Vikram Sivakumar, Raghuraman Krishnamoorthi
  • Patent number: 12033068
    Abstract: Embodiments of the application provide a method and device for training a cash-return recognition model and a method and device for cash-return recognition, the training method comprises: acquiring first transaction information of a first transaction and a first cash-return label value of the first transaction; calculating a first cash-return predictive value for the first transaction, and a Q-value's label value corresponding to the first transaction information and the first cash-return predictive value; and training a Deep Q-Network (DQN) by adjusting parameters of the DQN such that an absolute value of a difference between a first Q-value's predictive value output by the trained DQN and the Q-value's label value is smaller than that between the first Q-value's predictive value output by the untrained DQN and the Q-value's label value, the first Q-value's predictive value obtained by inputting the first transaction information and the first cash-return predictive value to the DQN.
    Type: Grant
    Filed: June 19, 2019
    Date of Patent: July 9, 2024
    Assignee: ADVANCED NEW TECHNOLOGIES CO., LTD.
    Inventor: Qi Zhao
  • Patent number: 12033069
    Abstract: A machine accesses a stored dataset comprising, for each of multiple optical fiber preforms, a plurality of images of each optical fiber preform coupled with an indication of a number of fiber kilometers lost due to diameter upset of a cable built using optical fiber drawn from the optical fiber preform. Each image represents a portion of the optical fiber preform. The machine preprocesses the stored dataset to generate a training dataset. The machine trains, using the training dataset, a convolutional neural network (CNN) to predict diameter upset performance of an optical fiber preform based on visual information representing the optical fiber preform. The CNN comprises an input layer, a plurality of hidden layers, and an output layer. Each of the input layer and the plurality of hidden layers comprises a plurality of artificial neurons. The machine provides an output representing the trained CNN.
    Type: Grant
    Filed: May 11, 2020
    Date of Patent: July 9, 2024
    Assignee: Corning Incorporated
    Inventors: Siam B Aumi, Abhishek Jain, Jeffrey Byron Rosbrugh
  • Patent number: 12033070
    Abstract: A computational block configured to perform an inference task by applying a plurality of low resource computing operations to a binary input feature tensor to generate an integer feature tensor that is equivalent to an output of multiplication and accumulation operations performed in respect of a ternary weight tensor and the binary input feature tensor; and performing a comparison operation between the generated integer feature tensor and a comparison threshold to generate a binary output feature tensor.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: July 9, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Xinlin Li, Vahid Partovi Nia
  • Patent number: 12033071
    Abstract: Certain embodiments may generally relate to various techniques for machine learning. Feed-forward, fully-connected Artificial Neural Networks (ANNs), or the so-called Multi-Layer Perceptrons (MLPs) are well-known universal approximators. However, their learning performance may vary significantly depending on the function or the solution space that they attempt to approximate for learning. This is because they are based on a loose and crude model of the biological neurons promising only a linear transformation followed by a nonlinear activation function. Therefore, while they learn very well those problems with a monotonous, relatively simple and linearly separable solution space, they may entirely fail to do so when the solution space is highly nonlinear and complex. In order to address this drawback and also to accomplish a more generalized model of biological neurons and learning systems, Generalized Operational Perceptrons (GOPs) may be formed and they may encapsulate many linear and nonlinear operators.
    Type: Grant
    Filed: February 7, 2017
    Date of Patent: July 9, 2024
    Assignee: QATAR UNIVERSITY
    Inventors: Serkan Kiranyaz, Turker Ince, Moncef Gabbouj, Alexandros Iosifidis
  • Patent number: 12033072
    Abstract: A computer implemented method includes building a Positive Knowledge Base with directive words, designated verbs and designated objects. A Negative Knowledge Base with designated phrases and designated legal terms is built. Tasks and phrases from the Positive Knowledge Base and the Negative Knowledge Base are built. Regulations are received. Phrases from the regulations are weighted against the Positive Knowledge Base and the Negative Knowledge Base to isolate positive Maintenance Compliances. The positive Maintenance Compliances are matched to tasks to derive ranked Maintenance Compliances. The ranked Maintenance Compliances are supplied.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: July 9, 2024
    Inventors: Daniel Cunningham, Baron R. K. Von Wolfshield
  • Patent number: 12033073
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural network layer.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: July 9, 2024
    Assignee: Google LLC
    Inventors: Sergey Ioffe, Corinna Cortes
  • Patent number: 12033074
    Abstract: For a plurality of client computing devices of a federated learning system, obtain initial compressed embeddings, compressed by clustering, and including output of initial local models for a current minibatch, and initial cluster labels corresponding to the initial embeddings. Recreate an initial overall embedding based on the initial embeddings and the initial labels. At a server of the federated learning system, send a current version of a server model to each of the client computing devices; and obtain, from the client computing devices: updated compressed embeddings, compressed by clustering, and updated cluster labels corresponding to the updated embeddings. Based on local training by the plurality of clients with the overall embedding and the current server model, at the server, recreate an updated overall embedding based on the updated embeddings and the corresponding updated labels, and locally train the server model based on the updated overall embedding.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: July 9, 2024
    Assignee: International Business Machines Corporation
    Inventors: Anirban Das, Timothy John Castiglia, Stacy Elizabeth Patterson, Shiqiang Wang
  • Patent number: 12033075
    Abstract: This application relates to use of transformer neural networks to generate dynamic parameters for use in convolutional neural networks. In various embodiments, received image data is encoded and the encoded signal is sent to both a decoder and a transformer neural network. The decoder outputs a decoded data for input into a convolutional neural network. The transformer outputs a set of dynamic parameter values for input into the convolutional neural network. The convolutional neural network may use the decoded data and the set of dynamic parameter values to output instance image data show identifying a number of objects in an image. In various embodiments, the decoded data is also used to generate semantic data. The semantic data may be combined with the instance data to form panoptic image data.
    Type: Grant
    Filed: July 9, 2021
    Date of Patent: July 9, 2024
    Assignee: Apple Inc.
    Inventor: Atila Orhon
  • Patent number: 12033076
    Abstract: The disclosure relates to a system for evaluating movement of a body of a user. The system may include a video display, one or more digital cameras, and a processor. The processor may control the one or more cameras to generate images of at least the part of the body over a period of time. The processor may estimate a position of a plurality of joints of the body. The processor may receive a selection of a tracked pose, and determine, from the plurality of joints, a set of joints associated with the tracked pose. The processor may generate at least one joint vector connecting joints in the set of joints, and assign, based on changes in the joint vector over the period of time, a form score to a performance of the tracked pose. The processor may then generate a user interface that depicts the form score.
    Type: Grant
    Filed: April 24, 2023
    Date of Patent: July 9, 2024
    Assignee: MirrorAR LLC
    Inventors: Hemant Virkar, Leah R. Kaplan, Stephen Furlani, Jacob Borgman, Anil Bhave, Mihir Thakkar, Sunkist Mehta
  • Patent number: 12033077
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving, by a neural network (NN), a dataset for generating features from the dataset. A first set of features is computed from the dataset using at least a feature layer of the NN. The first set of features i) is characterized by a measure of informativeness; and ii) is computed such that a size of the first set of features is compressible into a second set of features that is smaller in size than the first set of features and that has a same measure of informativeness as the measure of informativeness of the first set of features. The second set of features if generated from the first set of features using a compression method that compresses the first set of features to generate the second set of features.
    Type: Grant
    Filed: February 27, 2023
    Date of Patent: July 9, 2024
    Assignee: Google LLC
    Inventors: Abhinav Shrivastava, Saurabh Singh, Johannes Ballé, Sami Ahmad Abu-El-Haija, Nicholas Milo Johnston, George Dan Toderici
  • Patent number: 12033078
    Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.
    Type: Grant
    Filed: August 4, 2023
    Date of Patent: July 9, 2024
    Assignee: SNAP INC.
    Inventors: Yuncheng Li, Zhou Ren, Ning Xu, Enxu Yan, Tan Yu
  • Patent number: 12033079
    Abstract: A multi-task (MTL) process is adapted to the single-task learning (STL) case, i.e., when only a single task is available for training. The process is formalized as pseudo-task augmentation (PTA), in which a single task has multiple distinct decoders projecting the output of the shared structure to task predictions. By training the shared structure to solve the same problem in multiple ways, PTA simulates the effect of training towards distinct but closely-related tasks drawn from the same universe. Training dynamics with multiple pseudo-tasks strictly subsumes training with just one, and a class of algorithms is introduced for controlling pseudo-tasks in practice.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: July 9, 2024
    Assignee: Cognizant Technology Solutions U.S. Corporation
    Inventors: Elliot Meyerson, Risto Miikkulainen
  • Patent number: 12033080
    Abstract: A sparse dataset is encoded using a data-driven learned sensing matrix. For example, an example method includes receiving a dataset of sparse vectors with dimension d from a requesting process, initializing an encoding matrix of dimension k×d, selecting a subset of sparse vectors from the dataset, and updating the encoding matrix via machine learning. Updating the encoding matrix includes using a linear encoder to generate an encoded vector of dimension k for each vector in the subset, the linear encoder using the encoding matrix, using a non-linear decoder to decode each of the encoded vectors, the non-linear decoder using a transpose of the encoding matrix in a projected subgradient, and adjusting the encoding matrix using back propagation. The method also includes returning an embedding of each sparse vector in the dataset of sparse vectors, the embedding being generated with the updated encoding matrix.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: July 9, 2024
    Assignee: GOOGLE LLC
    Inventors: Xinnan Yu, Shanshan Wu, Daniel Holtmann-Rice, Dmitry Storcheus, Sanjiv Kumar, Afshin Rostamizadeh
  • Patent number: 12033081
    Abstract: The description relates the feature matching. Our approach establishes pointwise correspondences between challenging image pairs. It takes off-the-shelf local features as input and uses an attentional graph neural network to solve an assignment optimization problem. The deep middle-end matcher acts as a middle-end and handles partial point visibility and occlusion elegantly, producing a partial assignment matrix.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: July 9, 2024
    Inventors: Paul-Edouard Sarlin, Daniel DeTone, Tomasz Jan Malisiewicz, Andrew Rabinovich
  • Patent number: 12033082
    Abstract: Techniques are provided for processing one or more frames. For example, a region of interest can be determined in a first frame of a sequence of frames. The region of interest in the first frame includes an object having a size in the first frame. A portion of a second frame of the sequence of frames (occurring after the first frame in the sequence of frames) can be cropped and scaled to cause the object in the second frame to have a same size (and in some cases a same location) as the object in the first frame.
    Type: Grant
    Filed: September 27, 2023
    Date of Patent: July 9, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Songan Mao, Youngmin Huh, Ehsan Shahrian Varnousfaderani, Ajit Chourasia, Donald Gosnell, Muhua Li, Denis Mamedov
  • Patent number: 12033083
    Abstract: Variational Autoencoders (VAEs) have been shown to be effective in modeling complex data distributions. Conventional VAEs operate with fully-observed data during training. However, learning a VAE model from partially-observed data is still a problem. A modified VAE framework is proposed that can learn from partially-observed data conditioned on the fully-observed mask. A model described in various embodiments is capable of learning a proper proposal distribution based on the missing data. The framework is evaluated for both high-dimensional multimodal data and low dimensional tabular data.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: July 9, 2024
    Assignee: ROYAL BANK OF CANADA
    Inventors: Yu Gong, Jiawei He, Thibaut Durand, Megha Nawhal, Yanshuai Cao, Gregory Mori, Seyed Hossein Hajimirsadeghi
  • Patent number: 12033084
    Abstract: There is a region of interest of a synthetic image depicting an object from a class of objects. A trained neural image generator, having been trained to map embeddings from a latent space to photorealistic images of objects in the class, is accessed. A first embedding is computed from the latent space, the first embedding corresponding to an image which is similar to the region of interest while maintaining photorealistic appearance. A second embedding is computed from the latent space, the second embedding corresponding to an image which matches the synthetic image. Blending of the first embedding and the second embedding is done to form a blended embedding. At least one output image is generated from the blended embedding, the output image being more photorealistic than the synthetic image.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: July 9, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Stephan Joachim Garbin, Marek Adam Kowalski, Matthew Alastair Johnson, Tadas Baltrusaitis, Martin De La Gorce, Virginia Estellers Casas, Sebastian Karol Dziadzio, Jamie Daniel Joseph Shotton
  • Patent number: 12033085
    Abstract: A system for processing and verifying real-time calculations in a cloud computing environment is disclosed. In embodiments, the system performs implements methods to receive, at a first data center, a request from a point of sale (POS) system to perform a real-time calculation, where the real-time calculation is used to make automated decisions about a transaction. The system can transmit the request to a decision handler. The decision handler can determine which of a plurality of decision engine queues to further transmit the request to. The decision handler can transmit the request to a decision engine queue from the plurality of decision engine queues. The decision engine queue can scatter the request to at least two decision engines. The decision engine queue can receive a result of the real-time calculation and transmit the results through other components to the POS system.
    Type: Grant
    Filed: December 1, 2021
    Date of Patent: July 9, 2024
    Assignee: Capital One Services, LLC
    Inventors: Vijayasuriya Ravi, Christina Garcia, Raja Kavuru, Sathiyamurthy Thiruvengadathan, Lakshmi Ph Kommaraju, Mallikarjuna Rao Sambaraju, Nathan Robert Oster, Philip Austin Kedy
  • Patent number: 12033086
    Abstract: Systems and methods for providing an Artificial Intelligence (AI) character model with modifiable behavioral characteristics are provided. An example method includes determining that an event has occurred in a virtual environment associated with the AI character model; modifying, in response to the determination that the event has occurred and based on information associated with the event, parameters of the AI character model to obtain further parameters associated with behavioral characteristics of the AI character model; and causing the AI character model to interact with the user according to the further parameters. The virtual environment and the AI character model may be provided to a user via a client-side computing device.
    Type: Grant
    Filed: April 28, 2023
    Date of Patent: July 9, 2024
    Assignee: Theai, Inc.
    Inventors: Ilya Gelfenbeyn, Mikhail Ermolenko, Kylan Gibbs
  • Patent number: 12033087
    Abstract: There is a need for more effective and efficient predictive data analysis based at least in part on categorical input data. This need can be addressed by, for example, solutions for performing predictive data analysis that utilize at least one of categorical level merging, mutual-information-based feature filtering, feature-correlation-based feature filtering to generate training data feature value arrangements, as well as training and using categorical input machine learning models trained using the training data feature value arrangements.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: July 9, 2024
    Assignee: Optum Services (Ireland) Limited
    Inventors: Lorcan B. MacManus, Peter Cogan, Conor Breen
  • Patent number: 12033088
    Abstract: In an embodiment, the systems and methods discussed herein are related to generating, via a processor, a Markov Distribution Problem (MDP), the MDP including a state space, an action space, a transition function, a reward function, and a discount factor. A reinforcement learning (RL) model is applied, via the processor, to the MDP to generate a RL agent. An input data associated with a first user is received at the RL agent. At least one counterfactual explanation (CFE) is generated via the processor and by the RL agent and based on the input data. A representation of the at least one CFE and at least one recommended remedial action is caused to transmit, via the processor, to at least one of a compute device of the first user or a compute device of a second user different from and associated with the first user.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: July 9, 2024
    Assignee: Arthur AI, Inc.
    Inventors: Sahil Verma, John Dickerson, Keegan Hines
  • Patent number: 12033089
    Abstract: Systems, methods, and computer-readable media are disclosed for generating and training a deep convolutional generative model for multivariate time series modeling and utilizing the model to assess time series data indicative of a machine or machine component's operational state over a period of time to detect and localize potential operational anomalies.
    Type: Grant
    Filed: September 14, 2017
    Date of Patent: July 9, 2024
    Assignee: Siemens Aktiengesellschaft
    Inventors: Yuan Chao, Amit Chakraborty
  • Patent number: 12033090
    Abstract: According to one embodiment, an information processing device includes a first storage and a first processing circuit. The first storage is configured to store constraint data which includes a constraint of a combinatorial optimization problem expressed in a formal language. The first processing circuit is configured to generate logical expression data from the constraint data and generate a penalty term data including a penalty term having a binary variable parameter by converting the logical expression data.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: July 9, 2024
    Assignees: Kabushiki Kaisha Toshiba, Toshiba Digital Solutions Corporation
    Inventors: Yoshisato Sakai, Kotaro Endo
  • Patent number: 12033091
    Abstract: A system may receive information indicating a driver requesting a shared vehicle, estimate, based on web browsing information associated with the driver, one or more characteristics of the driver, determine, based on the characteristics of the driver, a driver safety score indicating an estimated risk of an accident involving the driver, select, from a plurality of available vehicles, a subset of the plurality of available vehicles based on the driver safety score, and cause the display of a user interface offering the subset of the plurality of available vehicles to the driver.
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: July 9, 2024
    Assignee: ALLSTATE INSURANCE COMPANY
    Inventors: Rachel Edelshteyn Allen, Benjamin Labaschin
  • Patent number: 12033092
    Abstract: Systems and methods related to resource acquisition on a resource market are disclosed. A system may include a machine having a resource requirement for a task. A system controller may include a resource requirement circuit to determine an amount of a resource for the machine to service the task requirement, a resource market circuit to access a resource market, and a market testing circuit to execute a first transaction of the resource on the resource market. The controller may further include an arbitrage execution circuit to execute a second transaction of the resource on the resource market in response to an outcome of the first transaction, wherein the second transaction comprises a larger transaction than the first transaction.
    Type: Grant
    Filed: November 22, 2019
    Date of Patent: July 9, 2024
    Assignee: Strong Force TX Portfolio 2018, LLC
    Inventor: Charles Howard Cella
  • Patent number: 12033093
    Abstract: A business process related computer software that displays a tabular view of a business process. Also, assigning types and/or attributes to worksteps of a business process and filtering the view of the business process based on the workstep types and/or workstep attributes.
    Type: Grant
    Filed: July 5, 2022
    Date of Patent: July 9, 2024
    Assignee: Aurea Software, Inc.
    Inventors: Kamyar J Sadeghi, Mohammad A. Ketabchi, Ajay Khanna, Steve Wilber
  • Patent number: 12033094
    Abstract: Provided are a computer program product, system, and method for generation of tasks and retraining machine learning modules to generate tasks based on feedback for the generated tasks. A machine learning module processes an input text message sent in the communication channel to output task information including an intended action and a set of associated users. A task message is generated including the output task information of a task to perform. The task message is sent to a user interface panel in a user computer. Feedback is received from the user computer on the output task information in the task message. The machine learning module is retrained to output task information from the input text message based on the feedback to reinforce likelihood correct task information is outputted and reinforce lower likelihood incorrect task information is outputted.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: July 9, 2024
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Jonathan F. Brunn, Rachael Marie Huston Dickens, Rui Zhang, Ami Herrman Dewar, Heiko H. Ludwig
  • Patent number: 12033095
    Abstract: A terminal includes a display unit, a map information storage unit that stores map information including a traveling route of a work vehicle in association with absolute position information, a display control unit that displays the map, an indication reception unit that receives first indication information indicating, on the map, an acquisition start position where acquisition of operation information of the work vehicle starts and second indication information indicating, on the map, an acquisition end position where the acquisition of the operation information ends, a first setting unit that sets the acquisition start position to cross the traveling route based on the map information and the first indication information, a second setting unit that sets the acquisition end position to cross the traveling route based on the map information and the second indication information, and an output unit that outputs information regarding the set acquisition start position and acquisition end position.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: July 9, 2024
    Assignee: Komatsu Ltd.
    Inventors: Kousuke Kurinami, Keisuke Kaneso, Takaya Oshikawa
  • Patent number: 12033096
    Abstract: In some implementations, a method includes receiving user input indicating a request to create a task and presenting a visual representation of the task. The method can also include receiving user input indicating an assignment of the task to an assignee, sending, to a second application, a first notification indicating the task and the assignment of the task to the assignee. It can further include receiving, from the second application, a second notification indicative of a change to a status of the task, and modifying the visual representation of the task to graphically illustrate the change in the status of the task in the user interface of the first application.
    Type: Grant
    Filed: September 29, 2021
    Date of Patent: July 9, 2024
    Assignee: Google LLC
    Inventors: Thomas Fahrni, Remi Wesley Ogundokun, Michael Kaeser, Lars Krüger, Ali Abdelhadi, Lara Scheidegger, Konstantin Yakovlev, Behnoosh Hariri, Beixi Li, Timothy Chen, Barak Ben Noon, William Joshua Billingham, Stephan Burkhardt
  • Patent number: 12033097
    Abstract: A new product development system may provide, to one or more client devices and server devices, one or more tools to enable development of a new product. The new product development system may receive current project data identifying a current project for developing the new product, historical project data identifying historical projects for developing historical products, and industry data associated with the new product. The new product development system may process the current project data, the historical project data, and the industry data, with a machine learning model, to identify one or more variables for a predictive model and may process the one or more variables, with the predictive model, to predict a predicted success rate of the current project. The new product development system may perform one or more actions based on the predicted success rate of the current project.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: July 9, 2024
    Assignee: Accenture Global Solutions Limited
    Inventors: Amit Kumar, Piyush Manocha, Anshul Gupta, Nishant Mehta, Anshul Anand
  • Patent number: 12033098
    Abstract: A method for managing a budget includes determining, by a budget management system, funds of a project management account that are to be routed to a task manager for a project. The determining comprises: determining a current progress of a task managed by the task manager, the task included in a budget for the project that identifies the task manager and that includes payment information for the task manager that specifies a financial account, determining an amount owed to the task manager, and setting the amount owed to the task manager as the amount of the funds to be routed to the task manager. The method further comprises transmitting, by the budget management system to a financial computing system, a request to transfer the determined funds to the financial account specified by the payment information.
    Type: Grant
    Filed: July 16, 2021
    Date of Patent: July 9, 2024
    Assignee: Wells Fargo Bank, N.A.
    Inventors: Abraham Drucker, Khushbu Katariya, Timothy R. Knowlton, Shelby K. Morita-Fowler, Brian M. Pearce, Dana Roytenberg, John T. Wright