Patents Issued in July 9, 2024
-
Patent number: 12033049Abstract: The subject technology receives assessment values determined by a first machine learning model deployed on a client electronic device, the assessment values being indicative of classifications of input data and the assessment values being associated with constraint data that comprises a probability distribution of the assessment values with respect to the classifications of the input data. The subject technology applies the assessment values determined by the first machine learning model to a second machine learning model to determine the classifications of the input data. The subject technology determines whether accuracies of the classifications determined by the second machine learning model conform with the probability distribution for corresponding assessment values determined by the first machine learning model.Type: GrantFiled: July 31, 2023Date of Patent: July 9, 2024Assignee: Apple Inc.Inventors: Edouard Godfrey, Gianpaolo Fasoli, Kuangyu Wang
-
Patent number: 12033050Abstract: This disclosure describes embodiments of systems, methods, and non-transitory computer readable storage media that can utilize language neural networks to automatically generate draft electronic communications for a user account. For example, the disclosed systems leverage composition parameters of a user account (determined from historical electronic communications of the user account, digital content items corresponding to the user account, and/or other application data) with a neural network to automatically generate draft electronic communications that reflect a composition style of a user account and accurately addresses a context of a communication thread. In addition, the disclosed systems can generate electronic communications using the communication generation neural network and save the electronic communication as a draft (e.g., for review by a user of the user account) and/or automatically transmit the electronic message to a recipient user account.Type: GrantFiled: June 22, 2023Date of Patent: July 9, 2024Assignee: Dropbox, Inc.Inventor: Devin Mancuso
-
Patent number: 12033051Abstract: A computer-based system and process are disclosed for reconstructing the internal electrical behavior of a patient's heart based partly or wholly on the patient's electrocardiogram (ECG). The output of the process may include, for example, a cardiac activation map, and/or a representation of transmembrane potentials over time. The process advantageously does not require any medical imaging of the patient, and does not require any special medical equipment. For example, the patient's activation map and transmembrane potentials may be reconstructed based solely on a preexisting or newly-obtained 12-lead cardiac ECG of the patient. The process makes use of a machine learning model, such as a neural network based model, trained with actual and/or simulated ECGs and intracardiac electrical data (typically transmembrane potentials) of many thousands of patients.Type: GrantFiled: November 24, 2020Date of Patent: July 9, 2024Assignee: Lawrence Livermore National Security, LLCInventors: Robert C. Blake, Thomas J. O'Hara, Mikel L. Landajuela, Rushil Anirudh
-
Patent number: 12033052Abstract: Provided are a latency prediction method and a computing device for the same. The latency prediction method includes receiving a deep learning model and predicting on-device latency of the received deep learning model using a latency predictor which is trained on the basis of a latency lookup table. The latency lookup table includes information on single neural network layers and latency information of the single neural network layers on an edge device.Type: GrantFiled: August 11, 2022Date of Patent: July 9, 2024Assignee: NOTA, INC.Inventors: Jeong Ho Kim, Min Su Kim, Tae Ho Kim
-
Patent number: 12033053Abstract: Embodiments of the invention may execute a NN by executing sub-tensor columns, each sub-tensor column including computations from portions of a layers of the NN, and each sub-tensor column performing computations entirely within a first layer of cache (e.g. L2 in one embodiment) and saving its output entirely within a second layer of cache (e.g. L3 in one embodiment). Embodiments may include partitioning the execution of a NN by partitioning the execution of the NN into sub-tensor columns, each sub-tensor column including computations from portions of layers of the NN, each sub-tensor column performing computations entirely within a first layer of cache and saving its output entirely within a second layer of cache.Type: GrantFiled: November 23, 2022Date of Patent: July 9, 2024Assignee: NEURALMAGIC, INC.Inventors: Alexander Matveev, Nir Shavit, Govind Ramnarayan
-
Patent number: 12033054Abstract: Data-dependent node-to-node knowledge sharing to increase the interpretability of the activation pattern of one or more nodes in a neural network, is implemented by a set of knowledge sharing links. Each link may comprise a knowledge providing node or other source P and a knowledge receiving node R. A knowledge sharing link can impose a node-specific regularization on the knowledge receiving node R to help guide the knowledge receiving node R to have an activation pattern that is more easily interpreted. The specification and training of the knowledge sharing links may be controlled by a cooperative human-AI learning supervisor system in which a human and an artificial intelligence system work cooperatively to improve the interpretability and performance of the client system.Type: GrantFiled: July 17, 2023Date of Patent: July 9, 2024Assignee: D5AI LLCInventors: James K. Baker, Bradley J. Baker
-
Patent number: 12033055Abstract: A system including an attention neural network that is configured to receive an input sequence and to process the input sequence to generate an output is described. The attention neural network includes: an attention block configured to receive a query input, a key input, and a value input that are derived from an attention block input. The attention block includes an attention neural network layer configured to: receive an attention layer input derived from the query input, the key input, and the value input, and apply an attention mechanism to the query input, the key input, and the value input to generate an attention layer output for the attention neural network layer; and a gating neural network layer configured to apply a gating mechanism to the attention block input and the attention layer output of the attention neural network layer to generate a gated attention output.Type: GrantFiled: September 7, 2020Date of Patent: July 9, 2024Assignee: DeepMind Technologies LimitedInventors: Emilio Parisotto, Hasuk Song, Jack William Rae, Siddhant Madhu Jayakumar, Maxwell Elliot Jaderberg, Razvan Pascanu, Caglar Gulcehre
-
Patent number: 12033056Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, relating to multi-task recurrent neural networks. One of the methods includes maintaining data specifying, for a recurrent neural network, a separate internal state for each of a plurality of memory regions; receiving a current input; identifying a particular memory region of the memory access address defined by the current input; selecting, from the internal states specified in the maintained data, the internal state for the particular memory region; processing, in accordance with the selected internal state for the particular memory region, the current input in the sequence of inputs using the recurrent neural network to: generate an output, the output defining a probability distribution of a predicted memory access address, and update the selected internal state of the particular memory region; and associating the updated selected internal state with the particular memory region in the maintained data.Type: GrantFiled: August 15, 2022Date of Patent: July 9, 2024Assignee: Google LLCInventors: Milad Olia Hashemi, Jamie Alexander Smith, Kevin Jordan Swersky
-
Patent number: 12033057Abstract: A system for classifying the usage of a handheld consumer device having a sensor and an analyzer. The sensor determines usage data at successive time instants and provides a temporally successive sequence of usage data during a usage session. The analyzer classifies the usage of the device with respect to at least one set usage classes and assembles a temporally successive sequence of input tuples of usage data relating to a predetermined time period of the usage session, each of the input tuples having at least one element representing the usage data at the respective time instant and for inputting the sequence of input tuples into at least one artificial neural network arranged to output at least one output tuple comprising a number of elements in accordance with the number of usage classes, each element of the output tuple representing a prediction value that the usage of the consumer device at the given time instant relates to a respective usage class.Type: GrantFiled: June 28, 2023Date of Patent: July 9, 2024Assignee: Braun GmbHInventors: Faiz Feisal Sherman, Xiaole Mao
-
Patent number: 12033058Abstract: In some implementations initially training a first neural network includes inputting the training inputs and corresponding training labels into the first neural network to produce output labels, comparing the output labels to the corresponding training labels using a second neural network that learns and applies a comparison metric, and adjusting parameters of the first neural network based on the comparing. The device then inputs additional inputs into the first neural network to produce additional output labels and corresponding confidence values from the second neural network. The device selects, based on the confidence values, an automatically-labeled training set of data including a subset of the additional inputs and a corresponding subset of the additional output labels. During a second training stage, the device trains the first neural network and the second neural network using the automatically-labeled training set of data.Type: GrantFiled: May 24, 2019Date of Patent: July 9, 2024Assignee: Apple Inc.Inventors: Peter Meier, Tanmay Batra
-
Patent number: 12033059Abstract: The present invention discloses a method for predicting bearing life based on a hidden Markov model (HMM) and transfer learning, including the following steps: (1) acquiring an original signal of full life of a rolling bearing; and extracting a feature set including a time domain feature, a time-frequency domain feature, and a trigonometric function feature; (2) inputting the feature set into an HMM to predict a hidden state, to obtain a failure occurrence time (FOT); (3) constructing a multilayer perceptron (MLP) model, obtaining a domain invariant feature and an optimal model parameter, and obtaining a neural network life prediction model; and (4) inputting the remaining target domain feature sets into the neural network life prediction model, and predicting the remaining life of the bearing. In the present invention, MLP-based transfer learning is used to resolve distribution differences in a source domain and a target domain caused by different operating conditions.Type: GrantFiled: August 7, 2020Date of Patent: July 9, 2024Assignee: SOOCHOW UNIVERSITYInventors: Jun Zhu, Changqing Shen, Nan Chen, Dongmiao Song, Jianqin Zhou, Jun Wang, Juanjuan Shi, Weiguo Huang, Zhongkui Zhu
-
Patent number: 12033060Abstract: Neural networks, in many cases, include convolution layers that are configured to perform many convolution operations that require multiplication and addition operations. Compared with performing multiplication on integer, fixed-point, or floating-point format values, performing multiplication on logarithmic format values is straightforward and energy efficient as the exponents are simply added. However, performing addition on logarithmic format values is more complex. Conventionally, addition is performed by converting the logarithmic format values to integers, computing the sum, and then converting the sum back into the logarithmic format. Instead, logarithmic format values may be added by decomposing the exponents into separate quotient and remainder components, sorting the quotient components based on the remainder components, summing the sorted quotient components using an asynchronous accumulator to produce partial sums, and multiplying the partial sums by the remainder components to produce a sum.Type: GrantFiled: January 23, 2020Date of Patent: July 9, 2024Assignee: NVIDIA CorporationInventors: William James Dally, Rangharajan Venkatesan, Brucek Kurdo Khailany, Stephen G. Tell
-
Patent number: 12033061Abstract: A neural network device comprises a first plurality of synapse network capacitors, wherein the synapse network capacitors of the first plurality of synapse network capacitors share a first output terminal. The neural network device further comprises a second plurality of synapse network capacitors, wherein the synapse network capacitors of the second plurality of synapse network capacitors share a second output terminal. Still further, the neural network device comprises a metal shielding disposed between the first output terminal and the second output terminal. The neural network device may be used as part of an artificial intelligence system.Type: GrantFiled: December 14, 2020Date of Patent: July 9, 2024Assignee: International Business Machines CorporationInventors: Chen Zhang, Jie Yang, Dexin Kong, Tenko Yamashita
-
Patent number: 12033062Abstract: A reservoir element includes a plurality of magnetoresistive effect elements each having a first ferromagnetic layer, a non-magnetic layer and a second ferromagnetic layer laminated in a first direction, and separated from each other, a spin orbit torque wiring that faces a part of at least one of the plurality of magnetoresistive effect elements, and a spin-conductive layer that connects at least the magnetoresistive effect elements closest to each other of the plurality of magnetoresistive effect elements, and conducts spins, wherein, the magnetoresistive effect elements are seen from the first direction, the second ferromagnetic layer overlaps part of the first ferromagnetic layer, the spin orbit torque wiring faces a first portion that does not overlap the second ferromagnetic layer in the first ferromagnetic layer when seen from the first direction, and the spin-conductive layer faces at least the first ferromagnetic layer each of the closest magnetoresistive effect elements.Type: GrantFiled: November 21, 2018Date of Patent: July 9, 2024Assignee: TDK CORPORATIONInventors: Tomoyuki Sasaki, Tatsuo Shibata
-
Patent number: 12033063Abstract: In an example, an apparatus comprises a plurality of execution units comprising and logic, at least partially including hardware logic, to traverse a solution space, score a plurality of solutions to a scheduling deep learning network execution, and select a preferred solution from the plurality of solutions to implement the deep learning network. Other embodiments are also disclosed and claimed.Type: GrantFiled: February 24, 2023Date of Patent: July 9, 2024Assignee: Intel CorporationInventors: Eran Ben-Avi, Neta Zmora, Guy Jacob, Lev Faivishevsky, Jeremie Dreyfuss, Tomer Bar-On, Jacob Subag, Yaniv Fais, Shira Hirsch, Orly Weisel, Zigi Walter, Yarden Oren
-
Patent number: 12033064Abstract: The present disclosure provides a neural network weight matrix adjusting method, a writing control method and a related apparatus, The method comprises: judging whether a weight distribution of a neural network weight matrix is lower than a first preset threshold; if yes, multiplying all weight values in the neural network weight matrix by a first constant; if no, judging whether the weight distribution of the neural network weight matrix is higher than a second preset threshold, wherein the second preset threshold is greater than the first preset threshold; and dividing all weight values in the neural network weight matrix by a second constant, if the weight distribution of the neural network weight matrix is higher than the second preset threshold; wherein the first constant and the second constant are both greater than 1, thereby improving the operation precision.Type: GrantFiled: July 6, 2020Date of Patent: July 9, 2024Assignee: HANGZHOU ZHICUN INTELLIGENT TECHNOLOGY CO., LTD.Inventor: Shaodi Wang
-
Patent number: 12033065Abstract: Aspects of the present application relate to techniques for computing convolutions and cross-correlations of input matrices. A first technique is based on the transformation of convolution operations into a matrix-vector product. A second technique is based on two-dimensional matrix multiplication. A third technique is based on the convolution theorem, which states that convolutions correspond to multiplications in a transform space. Embodiments include methods for computing convolutions of a filter matrix and an input data matrix; apparatuses for computing convolutions of a filter matrix and an input data matrix; and a non-transitory computer readable medium programmed with instructions that, when executed by a processor perform a method for computing convolutions of a filter matrix and an input data matrix.Type: GrantFiled: May 14, 2019Date of Patent: July 9, 2024Assignee: Lightmatter, Inc.Inventors: Tyler Kenney, Martin Forsythe, Tomo Lazovich, Darius Bunandar
-
Patent number: 12033066Abstract: An optical processing system comprises at least one spatial light modulator, SLM, configured to simultaneously display a first input data pattern (a) and at least one data focusing pattern which is a Fourier domain representation (B) of a second input data pattern (b), the optical processing system further comprising a detector for detecting light that has been successively optically processed by said input data patterns and focusing data patterns, thereby producing an optical convolution of the first and second input data patterns, the optical convolution for use in a neural network.Type: GrantFiled: April 26, 2019Date of Patent: July 9, 2024Assignee: Optalysys LimitedInventor: Alexander Joseph Macfaden
-
Patent number: 12033067Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a neural network that has one or more batch normalized neural network layers for use by a quantized inference system. One of the methods includes receiving a first batch of training data; determining batch normalization statistics for the first batch of training data; determining a correction factor from the batch normalization statistics for the first batch of training data and the long-term moving averages of the batch normalization statistics; generating batch normalized weights from the floating point weights for the batch normalized first neural network layer, comprising applying the correction factor to the floating point weights of the batch normalized first neural network layer; quantizing the batch normalized weights; determining a gradient of an objective function; and updating the floating point weights using the gradient.Type: GrantFiled: January 30, 2019Date of Patent: July 9, 2024Assignee: Google LLCInventors: Suharsh Vikram Sivakumar, Raghuraman Krishnamoorthi
-
Patent number: 12033068Abstract: Embodiments of the application provide a method and device for training a cash-return recognition model and a method and device for cash-return recognition, the training method comprises: acquiring first transaction information of a first transaction and a first cash-return label value of the first transaction; calculating a first cash-return predictive value for the first transaction, and a Q-value's label value corresponding to the first transaction information and the first cash-return predictive value; and training a Deep Q-Network (DQN) by adjusting parameters of the DQN such that an absolute value of a difference between a first Q-value's predictive value output by the trained DQN and the Q-value's label value is smaller than that between the first Q-value's predictive value output by the untrained DQN and the Q-value's label value, the first Q-value's predictive value obtained by inputting the first transaction information and the first cash-return predictive value to the DQN.Type: GrantFiled: June 19, 2019Date of Patent: July 9, 2024Assignee: ADVANCED NEW TECHNOLOGIES CO., LTD.Inventor: Qi Zhao
-
Patent number: 12033069Abstract: A machine accesses a stored dataset comprising, for each of multiple optical fiber preforms, a plurality of images of each optical fiber preform coupled with an indication of a number of fiber kilometers lost due to diameter upset of a cable built using optical fiber drawn from the optical fiber preform. Each image represents a portion of the optical fiber preform. The machine preprocesses the stored dataset to generate a training dataset. The machine trains, using the training dataset, a convolutional neural network (CNN) to predict diameter upset performance of an optical fiber preform based on visual information representing the optical fiber preform. The CNN comprises an input layer, a plurality of hidden layers, and an output layer. Each of the input layer and the plurality of hidden layers comprises a plurality of artificial neurons. The machine provides an output representing the trained CNN.Type: GrantFiled: May 11, 2020Date of Patent: July 9, 2024Assignee: Corning IncorporatedInventors: Siam B Aumi, Abhishek Jain, Jeffrey Byron Rosbrugh
-
Patent number: 12033070Abstract: A computational block configured to perform an inference task by applying a plurality of low resource computing operations to a binary input feature tensor to generate an integer feature tensor that is equivalent to an output of multiplication and accumulation operations performed in respect of a ternary weight tensor and the binary input feature tensor; and performing a comparison operation between the generated integer feature tensor and a comparison threshold to generate a binary output feature tensor.Type: GrantFiled: June 12, 2020Date of Patent: July 9, 2024Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Xinlin Li, Vahid Partovi Nia
-
Patent number: 12033071Abstract: Certain embodiments may generally relate to various techniques for machine learning. Feed-forward, fully-connected Artificial Neural Networks (ANNs), or the so-called Multi-Layer Perceptrons (MLPs) are well-known universal approximators. However, their learning performance may vary significantly depending on the function or the solution space that they attempt to approximate for learning. This is because they are based on a loose and crude model of the biological neurons promising only a linear transformation followed by a nonlinear activation function. Therefore, while they learn very well those problems with a monotonous, relatively simple and linearly separable solution space, they may entirely fail to do so when the solution space is highly nonlinear and complex. In order to address this drawback and also to accomplish a more generalized model of biological neurons and learning systems, Generalized Operational Perceptrons (GOPs) may be formed and they may encapsulate many linear and nonlinear operators.Type: GrantFiled: February 7, 2017Date of Patent: July 9, 2024Assignee: QATAR UNIVERSITYInventors: Serkan Kiranyaz, Turker Ince, Moncef Gabbouj, Alexandros Iosifidis
-
Patent number: 12033072Abstract: A computer implemented method includes building a Positive Knowledge Base with directive words, designated verbs and designated objects. A Negative Knowledge Base with designated phrases and designated legal terms is built. Tasks and phrases from the Positive Knowledge Base and the Negative Knowledge Base are built. Regulations are received. Phrases from the regulations are weighted against the Positive Knowledge Base and the Negative Knowledge Base to isolate positive Maintenance Compliances. The positive Maintenance Compliances are matched to tasks to derive ranked Maintenance Compliances. The ranked Maintenance Compliances are supplied.Type: GrantFiled: December 14, 2020Date of Patent: July 9, 2024Inventors: Daniel Cunningham, Baron R. K. Von Wolfshield
-
Patent number: 12033073Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural network layer.Type: GrantFiled: January 22, 2021Date of Patent: July 9, 2024Assignee: Google LLCInventors: Sergey Ioffe, Corinna Cortes
-
Patent number: 12033074Abstract: For a plurality of client computing devices of a federated learning system, obtain initial compressed embeddings, compressed by clustering, and including output of initial local models for a current minibatch, and initial cluster labels corresponding to the initial embeddings. Recreate an initial overall embedding based on the initial embeddings and the initial labels. At a server of the federated learning system, send a current version of a server model to each of the client computing devices; and obtain, from the client computing devices: updated compressed embeddings, compressed by clustering, and updated cluster labels corresponding to the updated embeddings. Based on local training by the plurality of clients with the overall embedding and the current server model, at the server, recreate an updated overall embedding based on the updated embeddings and the corresponding updated labels, and locally train the server model based on the updated overall embedding.Type: GrantFiled: May 25, 2021Date of Patent: July 9, 2024Assignee: International Business Machines CorporationInventors: Anirban Das, Timothy John Castiglia, Stacy Elizabeth Patterson, Shiqiang Wang
-
Patent number: 12033075Abstract: This application relates to use of transformer neural networks to generate dynamic parameters for use in convolutional neural networks. In various embodiments, received image data is encoded and the encoded signal is sent to both a decoder and a transformer neural network. The decoder outputs a decoded data for input into a convolutional neural network. The transformer outputs a set of dynamic parameter values for input into the convolutional neural network. The convolutional neural network may use the decoded data and the set of dynamic parameter values to output instance image data show identifying a number of objects in an image. In various embodiments, the decoded data is also used to generate semantic data. The semantic data may be combined with the instance data to form panoptic image data.Type: GrantFiled: July 9, 2021Date of Patent: July 9, 2024Assignee: Apple Inc.Inventor: Atila Orhon
-
Patent number: 12033076Abstract: The disclosure relates to a system for evaluating movement of a body of a user. The system may include a video display, one or more digital cameras, and a processor. The processor may control the one or more cameras to generate images of at least the part of the body over a period of time. The processor may estimate a position of a plurality of joints of the body. The processor may receive a selection of a tracked pose, and determine, from the plurality of joints, a set of joints associated with the tracked pose. The processor may generate at least one joint vector connecting joints in the set of joints, and assign, based on changes in the joint vector over the period of time, a form score to a performance of the tracked pose. The processor may then generate a user interface that depicts the form score.Type: GrantFiled: April 24, 2023Date of Patent: July 9, 2024Assignee: MirrorAR LLCInventors: Hemant Virkar, Leah R. Kaplan, Stephen Furlani, Jacob Borgman, Anil Bhave, Mihir Thakkar, Sunkist Mehta
-
Patent number: 12033077Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving, by a neural network (NN), a dataset for generating features from the dataset. A first set of features is computed from the dataset using at least a feature layer of the NN. The first set of features i) is characterized by a measure of informativeness; and ii) is computed such that a size of the first set of features is compressible into a second set of features that is smaller in size than the first set of features and that has a same measure of informativeness as the measure of informativeness of the first set of features. The second set of features if generated from the first set of features using a compression method that compresses the first set of features to generate the second set of features.Type: GrantFiled: February 27, 2023Date of Patent: July 9, 2024Assignee: Google LLCInventors: Abhinav Shrivastava, Saurabh Singh, Johannes Ballé, Sami Ahmad Abu-El-Haija, Nicholas Milo Johnston, George Dan Toderici
-
Patent number: 12033078Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.Type: GrantFiled: August 4, 2023Date of Patent: July 9, 2024Assignee: SNAP INC.Inventors: Yuncheng Li, Zhou Ren, Ning Xu, Enxu Yan, Tan Yu
-
Patent number: 12033079Abstract: A multi-task (MTL) process is adapted to the single-task learning (STL) case, i.e., when only a single task is available for training. The process is formalized as pseudo-task augmentation (PTA), in which a single task has multiple distinct decoders projecting the output of the shared structure to task predictions. By training the shared structure to solve the same problem in multiple ways, PTA simulates the effect of training towards distinct but closely-related tasks drawn from the same universe. Training dynamics with multiple pseudo-tasks strictly subsumes training with just one, and a class of algorithms is introduced for controlling pseudo-tasks in practice.Type: GrantFiled: February 8, 2019Date of Patent: July 9, 2024Assignee: Cognizant Technology Solutions U.S. CorporationInventors: Elliot Meyerson, Risto Miikkulainen
-
Patent number: 12033080Abstract: A sparse dataset is encoded using a data-driven learned sensing matrix. For example, an example method includes receiving a dataset of sparse vectors with dimension d from a requesting process, initializing an encoding matrix of dimension k×d, selecting a subset of sparse vectors from the dataset, and updating the encoding matrix via machine learning. Updating the encoding matrix includes using a linear encoder to generate an encoded vector of dimension k for each vector in the subset, the linear encoder using the encoding matrix, using a non-linear decoder to decode each of the encoded vectors, the non-linear decoder using a transpose of the encoding matrix in a projected subgradient, and adjusting the encoding matrix using back propagation. The method also includes returning an embedding of each sparse vector in the dataset of sparse vectors, the embedding being generated with the updated encoding matrix.Type: GrantFiled: June 14, 2019Date of Patent: July 9, 2024Assignee: GOOGLE LLCInventors: Xinnan Yu, Shanshan Wu, Daniel Holtmann-Rice, Dmitry Storcheus, Sanjiv Kumar, Afshin Rostamizadeh
-
Patent number: 12033081Abstract: The description relates the feature matching. Our approach establishes pointwise correspondences between challenging image pairs. It takes off-the-shelf local features as input and uses an attentional graph neural network to solve an assignment optimization problem. The deep middle-end matcher acts as a middle-end and handles partial point visibility and occlusion elegantly, producing a partial assignment matrix.Type: GrantFiled: November 13, 2020Date of Patent: July 9, 2024Inventors: Paul-Edouard Sarlin, Daniel DeTone, Tomasz Jan Malisiewicz, Andrew Rabinovich
-
Patent number: 12033082Abstract: Techniques are provided for processing one or more frames. For example, a region of interest can be determined in a first frame of a sequence of frames. The region of interest in the first frame includes an object having a size in the first frame. A portion of a second frame of the sequence of frames (occurring after the first frame in the sequence of frames) can be cropped and scaled to cause the object in the second frame to have a same size (and in some cases a same location) as the object in the first frame.Type: GrantFiled: September 27, 2023Date of Patent: July 9, 2024Assignee: QUALCOMM IncorporatedInventors: Songan Mao, Youngmin Huh, Ehsan Shahrian Varnousfaderani, Ajit Chourasia, Donald Gosnell, Muhua Li, Denis Mamedov
-
Patent number: 12033083Abstract: Variational Autoencoders (VAEs) have been shown to be effective in modeling complex data distributions. Conventional VAEs operate with fully-observed data during training. However, learning a VAE model from partially-observed data is still a problem. A modified VAE framework is proposed that can learn from partially-observed data conditioned on the fully-observed mask. A model described in various embodiments is capable of learning a proper proposal distribution based on the missing data. The framework is evaluated for both high-dimensional multimodal data and low dimensional tabular data.Type: GrantFiled: May 22, 2020Date of Patent: July 9, 2024Assignee: ROYAL BANK OF CANADAInventors: Yu Gong, Jiawei He, Thibaut Durand, Megha Nawhal, Yanshuai Cao, Gregory Mori, Seyed Hossein Hajimirsadeghi
-
Patent number: 12033084Abstract: There is a region of interest of a synthetic image depicting an object from a class of objects. A trained neural image generator, having been trained to map embeddings from a latent space to photorealistic images of objects in the class, is accessed. A first embedding is computed from the latent space, the first embedding corresponding to an image which is similar to the region of interest while maintaining photorealistic appearance. A second embedding is computed from the latent space, the second embedding corresponding to an image which matches the synthetic image. Blending of the first embedding and the second embedding is done to form a blended embedding. At least one output image is generated from the blended embedding, the output image being more photorealistic than the synthetic image.Type: GrantFiled: May 23, 2022Date of Patent: July 9, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Stephan Joachim Garbin, Marek Adam Kowalski, Matthew Alastair Johnson, Tadas Baltrusaitis, Martin De La Gorce, Virginia Estellers Casas, Sebastian Karol Dziadzio, Jamie Daniel Joseph Shotton
-
Patent number: 12033085Abstract: A system for processing and verifying real-time calculations in a cloud computing environment is disclosed. In embodiments, the system performs implements methods to receive, at a first data center, a request from a point of sale (POS) system to perform a real-time calculation, where the real-time calculation is used to make automated decisions about a transaction. The system can transmit the request to a decision handler. The decision handler can determine which of a plurality of decision engine queues to further transmit the request to. The decision handler can transmit the request to a decision engine queue from the plurality of decision engine queues. The decision engine queue can scatter the request to at least two decision engines. The decision engine queue can receive a result of the real-time calculation and transmit the results through other components to the POS system.Type: GrantFiled: December 1, 2021Date of Patent: July 9, 2024Assignee: Capital One Services, LLCInventors: Vijayasuriya Ravi, Christina Garcia, Raja Kavuru, Sathiyamurthy Thiruvengadathan, Lakshmi Ph Kommaraju, Mallikarjuna Rao Sambaraju, Nathan Robert Oster, Philip Austin Kedy
-
Patent number: 12033086Abstract: Systems and methods for providing an Artificial Intelligence (AI) character model with modifiable behavioral characteristics are provided. An example method includes determining that an event has occurred in a virtual environment associated with the AI character model; modifying, in response to the determination that the event has occurred and based on information associated with the event, parameters of the AI character model to obtain further parameters associated with behavioral characteristics of the AI character model; and causing the AI character model to interact with the user according to the further parameters. The virtual environment and the AI character model may be provided to a user via a client-side computing device.Type: GrantFiled: April 28, 2023Date of Patent: July 9, 2024Assignee: Theai, Inc.Inventors: Ilya Gelfenbeyn, Mikhail Ermolenko, Kylan Gibbs
-
Patent number: 12033087Abstract: There is a need for more effective and efficient predictive data analysis based at least in part on categorical input data. This need can be addressed by, for example, solutions for performing predictive data analysis that utilize at least one of categorical level merging, mutual-information-based feature filtering, feature-correlation-based feature filtering to generate training data feature value arrangements, as well as training and using categorical input machine learning models trained using the training data feature value arrangements.Type: GrantFiled: July 24, 2020Date of Patent: July 9, 2024Assignee: Optum Services (Ireland) LimitedInventors: Lorcan B. MacManus, Peter Cogan, Conor Breen
-
Patent number: 12033088Abstract: In an embodiment, the systems and methods discussed herein are related to generating, via a processor, a Markov Distribution Problem (MDP), the MDP including a state space, an action space, a transition function, a reward function, and a discount factor. A reinforcement learning (RL) model is applied, via the processor, to the MDP to generate a RL agent. An input data associated with a first user is received at the RL agent. At least one counterfactual explanation (CFE) is generated via the processor and by the RL agent and based on the input data. A representation of the at least one CFE and at least one recommended remedial action is caused to transmit, via the processor, to at least one of a compute device of the first user or a compute device of a second user different from and associated with the first user.Type: GrantFiled: June 30, 2022Date of Patent: July 9, 2024Assignee: Arthur AI, Inc.Inventors: Sahil Verma, John Dickerson, Keegan Hines
-
Patent number: 12033089Abstract: Systems, methods, and computer-readable media are disclosed for generating and training a deep convolutional generative model for multivariate time series modeling and utilizing the model to assess time series data indicative of a machine or machine component's operational state over a period of time to detect and localize potential operational anomalies.Type: GrantFiled: September 14, 2017Date of Patent: July 9, 2024Assignee: Siemens AktiengesellschaftInventors: Yuan Chao, Amit Chakraborty
-
Patent number: 12033090Abstract: According to one embodiment, an information processing device includes a first storage and a first processing circuit. The first storage is configured to store constraint data which includes a constraint of a combinatorial optimization problem expressed in a formal language. The first processing circuit is configured to generate logical expression data from the constraint data and generate a penalty term data including a penalty term having a binary variable parameter by converting the logical expression data.Type: GrantFiled: February 26, 2021Date of Patent: July 9, 2024Assignees: Kabushiki Kaisha Toshiba, Toshiba Digital Solutions CorporationInventors: Yoshisato Sakai, Kotaro Endo
-
Patent number: 12033091Abstract: A system may receive information indicating a driver requesting a shared vehicle, estimate, based on web browsing information associated with the driver, one or more characteristics of the driver, determine, based on the characteristics of the driver, a driver safety score indicating an estimated risk of an accident involving the driver, select, from a plurality of available vehicles, a subset of the plurality of available vehicles based on the driver safety score, and cause the display of a user interface offering the subset of the plurality of available vehicles to the driver.Type: GrantFiled: May 14, 2019Date of Patent: July 9, 2024Assignee: ALLSTATE INSURANCE COMPANYInventors: Rachel Edelshteyn Allen, Benjamin Labaschin
-
Patent number: 12033092Abstract: Systems and methods related to resource acquisition on a resource market are disclosed. A system may include a machine having a resource requirement for a task. A system controller may include a resource requirement circuit to determine an amount of a resource for the machine to service the task requirement, a resource market circuit to access a resource market, and a market testing circuit to execute a first transaction of the resource on the resource market. The controller may further include an arbitrage execution circuit to execute a second transaction of the resource on the resource market in response to an outcome of the first transaction, wherein the second transaction comprises a larger transaction than the first transaction.Type: GrantFiled: November 22, 2019Date of Patent: July 9, 2024Assignee: Strong Force TX Portfolio 2018, LLCInventor: Charles Howard Cella
-
Patent number: 12033093Abstract: A business process related computer software that displays a tabular view of a business process. Also, assigning types and/or attributes to worksteps of a business process and filtering the view of the business process based on the workstep types and/or workstep attributes.Type: GrantFiled: July 5, 2022Date of Patent: July 9, 2024Assignee: Aurea Software, Inc.Inventors: Kamyar J Sadeghi, Mohammad A. Ketabchi, Ajay Khanna, Steve Wilber
-
Patent number: 12033094Abstract: Provided are a computer program product, system, and method for generation of tasks and retraining machine learning modules to generate tasks based on feedback for the generated tasks. A machine learning module processes an input text message sent in the communication channel to output task information including an intended action and a set of associated users. A task message is generated including the output task information of a task to perform. The task message is sent to a user interface panel in a user computer. Feedback is received from the user computer on the output task information in the task message. The machine learning module is retrained to output task information from the input text message based on the feedback to reinforce likelihood correct task information is outputted and reinforce lower likelihood incorrect task information is outputted.Type: GrantFiled: September 17, 2019Date of Patent: July 9, 2024Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Jonathan F. Brunn, Rachael Marie Huston Dickens, Rui Zhang, Ami Herrman Dewar, Heiko H. Ludwig
-
Patent number: 12033095Abstract: A terminal includes a display unit, a map information storage unit that stores map information including a traveling route of a work vehicle in association with absolute position information, a display control unit that displays the map, an indication reception unit that receives first indication information indicating, on the map, an acquisition start position where acquisition of operation information of the work vehicle starts and second indication information indicating, on the map, an acquisition end position where the acquisition of the operation information ends, a first setting unit that sets the acquisition start position to cross the traveling route based on the map information and the first indication information, a second setting unit that sets the acquisition end position to cross the traveling route based on the map information and the second indication information, and an output unit that outputs information regarding the set acquisition start position and acquisition end position.Type: GrantFiled: July 12, 2019Date of Patent: July 9, 2024Assignee: Komatsu Ltd.Inventors: Kousuke Kurinami, Keisuke Kaneso, Takaya Oshikawa
-
Patent number: 12033096Abstract: In some implementations, a method includes receiving user input indicating a request to create a task and presenting a visual representation of the task. The method can also include receiving user input indicating an assignment of the task to an assignee, sending, to a second application, a first notification indicating the task and the assignment of the task to the assignee. It can further include receiving, from the second application, a second notification indicative of a change to a status of the task, and modifying the visual representation of the task to graphically illustrate the change in the status of the task in the user interface of the first application.Type: GrantFiled: September 29, 2021Date of Patent: July 9, 2024Assignee: Google LLCInventors: Thomas Fahrni, Remi Wesley Ogundokun, Michael Kaeser, Lars Krüger, Ali Abdelhadi, Lara Scheidegger, Konstantin Yakovlev, Behnoosh Hariri, Beixi Li, Timothy Chen, Barak Ben Noon, William Joshua Billingham, Stephan Burkhardt
-
Patent number: 12033097Abstract: A new product development system may provide, to one or more client devices and server devices, one or more tools to enable development of a new product. The new product development system may receive current project data identifying a current project for developing the new product, historical project data identifying historical projects for developing historical products, and industry data associated with the new product. The new product development system may process the current project data, the historical project data, and the industry data, with a machine learning model, to identify one or more variables for a predictive model and may process the one or more variables, with the predictive model, to predict a predicted success rate of the current project. The new product development system may perform one or more actions based on the predicted success rate of the current project.Type: GrantFiled: August 6, 2020Date of Patent: July 9, 2024Assignee: Accenture Global Solutions LimitedInventors: Amit Kumar, Piyush Manocha, Anshul Gupta, Nishant Mehta, Anshul Anand
-
Patent number: 12033098Abstract: A method for managing a budget includes determining, by a budget management system, funds of a project management account that are to be routed to a task manager for a project. The determining comprises: determining a current progress of a task managed by the task manager, the task included in a budget for the project that identifies the task manager and that includes payment information for the task manager that specifies a financial account, determining an amount owed to the task manager, and setting the amount owed to the task manager as the amount of the funds to be routed to the task manager. The method further comprises transmitting, by the budget management system to a financial computing system, a request to transfer the determined funds to the financial account specified by the payment information.Type: GrantFiled: July 16, 2021Date of Patent: July 9, 2024Assignee: Wells Fargo Bank, N.A.Inventors: Abraham Drucker, Khushbu Katariya, Timothy R. Knowlton, Shelby K. Morita-Fowler, Brian M. Pearce, Dana Roytenberg, John T. Wright