Patents Examined by Michael H Hoang
-
Patent number: 11922283Abstract: An indication of a selection of an entry associated with a machine learning model is received. One or more interpretation views associated with one or more machine learning models are dynamically updated based on the selected entry.Type: GrantFiled: April 20, 2018Date of Patent: March 5, 2024Assignee: H2O.ai Inc.Inventors: Mark Chan, Navdeep Gill, Patrick Hall
-
Patent number: 11900222Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a machine learning model that is trained to perform a machine learning task. In one aspect, a method comprises receiving a request to train a machine learning model on a set of training examples; determining a set of one or more meta-data values characterizing the set of training examples; using a mapping function to map the set of meta-data values characterizing the set of training examples to data identifying a particular machine learning model architecture; selecting, using the particular machine learning model architecture, a final machine learning model architecture for performing the machine learning task; and training a machine learning model having the final machine learning model architecture on the set of training examples.Type: GrantFiled: March 15, 2019Date of Patent: February 13, 2024Assignee: Google LLCInventors: Jyrki A. Alakuijala, Quentin Lascombes de Laroussilhe, Andrey Khorlin, Jeremiah Joseph Harmsen, Andrea Gesmundo
-
Patent number: 11893480Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for reinforcement learning with scheduled auxiliary tasks. In one aspect, a method includes maintaining data specifying parameter values for a primary policy neural network and one or more auxiliary neural networks; at each of a plurality of selection time steps during a training episode comprising a plurality of time steps: receiving an observation, selecting a current task for the selection time step using a task scheduling policy, processing an input comprising the observation using the policy neural network corresponding to the selected current task to select an action to be performed by the agent in response to the observation, and causing the agent to perform the selected action.Type: GrantFiled: February 28, 2019Date of Patent: February 6, 2024Assignee: DeepMind Technologies LimitedInventors: Martin Riedmiller, Roland Hafner
-
Patent number: 11790274Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a machine learning model to generate embeddings of inputs to the machine learning model, the machine learning model having an encoder that generates the embeddings from the inputs and a decoder that generates outputs from the generated embeddings, wherein the embedding is partitioned into a sequence of embedding partitions that each includes one or more dimensions of the embedding, the operations comprising: for a first embedding partition in the sequence of embedding partitions: performing initial training to train the encoder and a decoder replica corresponding to the first embedding partition; for each particular embedding partition that is after the first embedding partition in the sequence of embedding partitions: performing incremental training to train the encoder and a decoder replica corresponding to the particular partition.Type: GrantFiled: October 26, 2022Date of Patent: October 17, 2023Assignee: Google LLCInventors: Robert Andrew James Clark, Chun-an Chan, Vincent Ping Leung Wan
-
Patent number: 11775811Abstract: The subject technology determines input parameters and an output format of algorithms for a particular functionality provided by an electronic device. The subject technology determines an order of the algorithms for performing the particular functionality based on temporal dependencies of the algorithms, and the input parameters and the output format of the algorithms. The subject technology generates a graph based on the order of the algorithms, the graph comprising a set of nodes corresponding to the algorithms, each node indicating a particular processor of the electronic device for executing an algorithm. Further, the subject technology executes the particular functionality based on performing a traversal of the graph, the traversal comprising a topological traversal of the set of nodes and the traversal being based on a score indicating whether selection of a particular node for execution over another node enables a greater number of processors to be utilized at a time.Type: GrantFiled: January 8, 2019Date of Patent: October 3, 2023Assignee: Apple Inc.Inventors: Benjamin P. Englert, Elliott B. Harris, Neil G. Crane, Brandon J. Corey
-
Patent number: 11704554Abstract: In one embodiment, a method of training dynamic models for autonomous driving vehicles includes the operations of receiving a first set of training data from a training data source, the first set of training data representing driving statistics for a first set of features; training a dynamic model based on the first set of training data for the first set of features; determining a second set of features as a subset of the first set of features based on evaluating the dynamic model, each of the second set of features representing a feature whose performance score is below a predetermined threshold. The method further includes the following operations for each of the second set of features: retrieving a second set of training data associated with the corresponding feature of the second set of features, and retraining the dynamic model using the second set of training data.Type: GrantFiled: May 6, 2019Date of Patent: July 18, 2023Assignee: BAIDU USA LLCInventors: Jiaxuan Xu, Qi Luo, Runxin He, Jinyun Zhou, Jinghao Miao, Jiangtao Hu, Yu Wang, Shu Jiang
-
Patent number: 11699080Abstract: In one embodiment, a service receives machine learning-based generative models from a plurality of distributed sites. Each generative model is trained locally at a site using unlabeled data observed at that site to generate synthetic unlabeled data that mimics the unlabeled data used to train the generative model. The service receives, from each of the distributed sites, a subset of labeled data observed at that site. The service uses the generative models to generate synthetic unlabeled data. The service trains a global machine learning-based model using the received subsets of labeled data received from the distributed sites and the synthetic unlabeled data generated by the generative models.Type: GrantFiled: September 14, 2018Date of Patent: July 11, 2023Assignee: Cisco Technology, Inc.Inventors: Xiaoqing Zhu, Yaqi Wang, Dan Tan, Rob Liston, Mehdi Nikkhah
-
Patent number: 11694094Abstract: In various examples there is a computer-implemented method performed by a digital twin at a computing device in a communications network. The method comprises: receiving at least one stream of event data observed from the environment. Computing at least one schema from the stream of event data, the schema being a concise representation of the stream of event data. Participating in a distributed inference process by sending information about the schema or the received event stream to at least one other digital twin in the communications network and receiving information about schemas or received event streams from the other digital twin. Computing comparisons of the sent and received information. Aggregating the digital twin and the other digital twin, or defining a relationship between the digital twin and the other digital twin on the basis of the comparison.Type: GrantFiled: March 21, 2018Date of Patent: July 4, 2023Assignee: SWIM.IT INCInventor: Christopher David Sachs
-
Patent number: 11645546Abstract: A system and method for predicting multi-agent locations is disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a predictive model using a conditional variational autoencoder. The conditional variational autoencoder learns one or more paths a subset of agents of the plurality of agents are likely to take. The computing system receives tracking data from a tracking system positioned remotely in a venue hosting a candidate sporting event. The computing system identifies one or more candidate agents for which to predict locations. The computing system infers, via the predictive model, one or more locations of the one or more candidate agents. The computing system generates a graphical representation of the one or more locations of the one or more candidate agents.Type: GrantFiled: January 22, 2019Date of Patent: May 9, 2023Assignee: STATS LLCInventors: Panna Felsen, Sujoy Ganguly, Patrick Lucey
-
Patent number: 11586882Abstract: A synapse memory and a method for reading a weight value stored in a synapse memory are provided. The synapse memory includes a memory device configured to store a weight value. The memory device includes a read terminal, a write terminal, and a common terminal, the read terminal being configured to receive a read signal, the write terminal being configured to receive a write signal, and the common terminal being configured to output an output signal from the memory device. The synapse memory also includes a write transistor provided between the write terminal of the memory device and a write signal line configured to send the write signal. The synapse memory further includes a common transistor provided between the common terminal of the memory device and one of the dendrite lines.Type: GrantFiled: January 24, 2018Date of Patent: February 21, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Takeo Yasuda, Kohji Hosokawa
-
Patent number: 11580407Abstract: A learning data processing unit accepts, as input, a plurality of pieces of learning data for a respective plurality of tasks, and calculates, for each of the tasks, a batch size which meets a condition that a value obtained by dividing a data size of corresponding one of the pieces of learning data by the corresponding batch size is the same between the tasks. A batch sampling unit samples, for each of the tasks, samples from corresponding one of the pieces of learning data with the corresponding batch size calculated by the learning data processing unit. A learning unit updates a weight of a discriminator for each of the tasks, using the samples sampled by the batch sampling unit.Type: GrantFiled: September 6, 2016Date of Patent: February 14, 2023Assignee: Mitsubishi Electric CorporationInventors: Takayuki Semitsu, Wataru Matsumoto, Xiongxin Zhao
-
Patent number: 11580378Abstract: A computer-implemented method comprises instantiating a policy function approximator. The policy function approximator is configured to calculate a plurality of estimated action probabilities in dependence on a given state of the environment. Each of the plurality of estimated action probabilities corresponds to a respective one of a plurality of discrete actions performable by the reinforcement learning agent within the environment. An initial plurality of estimated action probabilities in dependence on a first state of the environment are calculated. Two or more of the plurality of discrete actions are concurrently performed within the environment when the environment is in the first state. In response to the concurrent performance, a reward value is received. In response to the received reward value being greater than a baseline reward value, the policy function approximator is updated, such that it is configured to calculate an updated plurality of estimated action probabilities.Type: GrantFiled: November 12, 2018Date of Patent: February 14, 2023Assignee: ELECTRONIC ARTS INC.Inventors: Jack Harmer, Linus Gisslén, Magnus Nordin, Jorge del Val Santos
-
Patent number: 11562287Abstract: The disclosed technology reveals a hierarchical policy network, for use by a software agent, to accomplish an objective that requires execution of multiple tasks. A terminal policy learned by training the agent on a terminal task set, serves as a base task set of the intermediate task set. An intermediate policy learned by training the agent on an intermediate task set serves as a base policy of the top policy. A top policy learned by training the agent on a top task set serves as a base task set of the top task set. The agent is configurable to accomplish the objective by traversal of the hierarchical policy network. A current task in a current task set is executed by executing a previously-learned task selected from a corresponding base task set governed by a corresponding base policy, or performing a primitive action selected from a library of primitive actions.Type: GrantFiled: January 31, 2018Date of Patent: January 24, 2023Assignee: salesforce.com, inc.Inventors: Caiming Xiong, Tianmin Shu, Richard Socher
-
Patent number: 11556773Abstract: Aspects of the present disclosure relate to machine learning techniques for identifying the incremental impact of different past events on the likelihood that a target outcome will occur. The technology can use a recurrent neural network to analyze two different representations of an event sequence—one in which some particular event occurs, and another in which that particular event does not occur. The incremental impact of that particular event can be determined based on the calculated difference between the probabilities of the target outcome occurring after these two sequences.Type: GrantFiled: June 29, 2018Date of Patent: January 17, 2023Assignee: Amazon Technologies, Inc.Inventors: Shikha Aggarwal, Nikolaos Chatzipanagiotis, Shivani Matta, Pragyana K. Mishra, Anil Padia, Nikhil Raina
-
Patent number: 11544620Abstract: According to an embodiment of the present disclosure, a method of training a machine learning model is provided. Input data is received from at least one remote device. A classifier is evaluated by determining a classification accuracy of the input data. A training data matrix of the input data is applied to a selected context autoencoder of a knowledge bank of autoencoders including at least one context autoencoder and the training data matrix is determined to be out of context for the selected autoencoder. The training data matrix is applied to each other context autoencoder of the at least one autoencoder and the training data matrix is determined to be out of context for each other context autoencoder. A new context autoencoder is constructed.Type: GrantFiled: January 22, 2019Date of Patent: January 3, 2023Assignee: Raytheon Technologies CorporationInventors: Kin Gwn Lore, Kishore K. Reddy
-
Patent number: 11521109Abstract: An information processing apparatus comprises a storage unit configured to store correct answer data used to detect at least one portion of a detection object from an image and detection data detected as the at least one portion of the detection object from the image; a target determination unit configured to extract mismatching data between the correct answer data and the detection data, which exists within a predetermined range from a region in which the correct answer data and the detection data match, and determine the mismatching data as evaluation target data; an investigation unit configured to investigate property information of the evaluation target data; and an error determination unit configured to determine, based on the property information, whether the evaluation target data is error candidate data of the correct answer data.Type: GrantFiled: August 23, 2018Date of Patent: December 6, 2022Assignee: CANON KABUSHIKI KAISHAInventors: Kei Takayama, Masakazu Matsugu, Atsushi Nogami
-
Patent number: 11494695Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a machine learning model to generate embeddings of inputs to the machine learning model, the machine learning model having an encoder that generates the embeddings from the inputs and a decoder that generates outputs from the generated embeddings, wherein the embedding is partitioned into a sequence of embedding partitions that each includes one or more dimensions of the embedding, the operations comprising: for a first embedding partition in the sequence of embedding partitions: performing initial training to train the encoder and a decoder replica corresponding to the first embedding partition; for each particular embedding partition that is after the first embedding partition in the sequence of embedding partitions: performing incremental training to train the encoder and a decoder replica corresponding to the particular partition.Type: GrantFiled: September 27, 2019Date of Patent: November 8, 2022Assignee: Google LLCInventors: Robert Andrew James Clark, Chun-an Chan, Vincent Ping Leung Wan
-
Patent number: 11481616Abstract: To obtain one or more recommendations for the migration of a database to a cloud computing system, information about performance of the database operating under a workload may be obtained. A first machine learning model (e.g., a neural network-based autoencoder) may be used to generate a compressed representation of characteristics of the database operating under the workload. The compressed representation may then be provided as input to a second machine learning model (e.g., a neural network-based classifier), which outputs a recommendation regarding a characteristic (e.g., size, configuration, level of service) of the cloud database to which the database should be migrated. This type of recommendation may be made prior to migration, thereby making it easier to properly estimate the cost of running the cloud database and plan the migration accordingly.Type: GrantFiled: November 21, 2018Date of Patent: October 25, 2022Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Mitchell Gregory Spryn, Intaik Park, Felipe Vieira Frujeri, Vijay Govind Panjeti, Ashok Sai Madala, Ajay Kumar Karanam
-
Patent number: 11468291Abstract: A method is provided for protecting a machine learning ensemble. In the method, a plurality of machine learning models is combined to form a machine learning ensemble. A plurality of data elements for training the machine learning ensemble is provided. The machine learning ensemble is trained using the plurality of data elements to produce a trained machine learning ensemble. During an inference operating phase, an input is received by the machine learning ensemble. A piecewise function is used to pseudo-randomly choose one of the plurality of machine learning models to provide an output in response to the input. The use of a piecewise function hides which machine learning model provided the output, making the machine learning ensemble more difficult to copy.Type: GrantFiled: September 28, 2018Date of Patent: October 11, 2022Assignee: NXP B.V.Inventors: Wilhelmus Petrus Adrianus Johannus Michiels, Gerardus Antonius Franciscus Derks
-
Patent number: 11443228Abstract: Embodiments for efficient machine and deep learning hyperparameter tuning in a distributed computing system. Runtime metrics of each training iteration are collected to identify candidate jobs to merge during an execution phase. The candidate jobs are grouped into job groups, and the job groups containing the candidate jobs are merged together subsequent to each iteration boundary for execution during the execution phase.Type: GrantFiled: June 21, 2018Date of Patent: September 13, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Junfeng Liu, Kuan Feng, Zhichao Su, Yi Zhao