Patents Examined by Michael H Hoang
  • Patent number: 11922283
    Abstract: An indication of a selection of an entry associated with a machine learning model is received. One or more interpretation views associated with one or more machine learning models are dynamically updated based on the selected entry.
    Type: Grant
    Filed: April 20, 2018
    Date of Patent: March 5, 2024
    Assignee: H2O.ai Inc.
    Inventors: Mark Chan, Navdeep Gill, Patrick Hall
  • Patent number: 11900222
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a machine learning model that is trained to perform a machine learning task. In one aspect, a method comprises receiving a request to train a machine learning model on a set of training examples; determining a set of one or more meta-data values characterizing the set of training examples; using a mapping function to map the set of meta-data values characterizing the set of training examples to data identifying a particular machine learning model architecture; selecting, using the particular machine learning model architecture, a final machine learning model architecture for performing the machine learning task; and training a machine learning model having the final machine learning model architecture on the set of training examples.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: February 13, 2024
    Assignee: Google LLC
    Inventors: Jyrki A. Alakuijala, Quentin Lascombes de Laroussilhe, Andrey Khorlin, Jeremiah Joseph Harmsen, Andrea Gesmundo
  • Patent number: 11893480
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for reinforcement learning with scheduled auxiliary tasks. In one aspect, a method includes maintaining data specifying parameter values for a primary policy neural network and one or more auxiliary neural networks; at each of a plurality of selection time steps during a training episode comprising a plurality of time steps: receiving an observation, selecting a current task for the selection time step using a task scheduling policy, processing an input comprising the observation using the policy neural network corresponding to the selected current task to select an action to be performed by the agent in response to the observation, and causing the agent to perform the selected action.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: February 6, 2024
    Assignee: DeepMind Technologies Limited
    Inventors: Martin Riedmiller, Roland Hafner
  • Patent number: 11790274
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a machine learning model to generate embeddings of inputs to the machine learning model, the machine learning model having an encoder that generates the embeddings from the inputs and a decoder that generates outputs from the generated embeddings, wherein the embedding is partitioned into a sequence of embedding partitions that each includes one or more dimensions of the embedding, the operations comprising: for a first embedding partition in the sequence of embedding partitions: performing initial training to train the encoder and a decoder replica corresponding to the first embedding partition; for each particular embedding partition that is after the first embedding partition in the sequence of embedding partitions: performing incremental training to train the encoder and a decoder replica corresponding to the particular partition.
    Type: Grant
    Filed: October 26, 2022
    Date of Patent: October 17, 2023
    Assignee: Google LLC
    Inventors: Robert Andrew James Clark, Chun-an Chan, Vincent Ping Leung Wan
  • Patent number: 11775811
    Abstract: The subject technology determines input parameters and an output format of algorithms for a particular functionality provided by an electronic device. The subject technology determines an order of the algorithms for performing the particular functionality based on temporal dependencies of the algorithms, and the input parameters and the output format of the algorithms. The subject technology generates a graph based on the order of the algorithms, the graph comprising a set of nodes corresponding to the algorithms, each node indicating a particular processor of the electronic device for executing an algorithm. Further, the subject technology executes the particular functionality based on performing a traversal of the graph, the traversal comprising a topological traversal of the set of nodes and the traversal being based on a score indicating whether selection of a particular node for execution over another node enables a greater number of processors to be utilized at a time.
    Type: Grant
    Filed: January 8, 2019
    Date of Patent: October 3, 2023
    Assignee: Apple Inc.
    Inventors: Benjamin P. Englert, Elliott B. Harris, Neil G. Crane, Brandon J. Corey
  • Patent number: 11704554
    Abstract: In one embodiment, a method of training dynamic models for autonomous driving vehicles includes the operations of receiving a first set of training data from a training data source, the first set of training data representing driving statistics for a first set of features; training a dynamic model based on the first set of training data for the first set of features; determining a second set of features as a subset of the first set of features based on evaluating the dynamic model, each of the second set of features representing a feature whose performance score is below a predetermined threshold. The method further includes the following operations for each of the second set of features: retrieving a second set of training data associated with the corresponding feature of the second set of features, and retraining the dynamic model using the second set of training data.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: July 18, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaxuan Xu, Qi Luo, Runxin He, Jinyun Zhou, Jinghao Miao, Jiangtao Hu, Yu Wang, Shu Jiang
  • Patent number: 11699080
    Abstract: In one embodiment, a service receives machine learning-based generative models from a plurality of distributed sites. Each generative model is trained locally at a site using unlabeled data observed at that site to generate synthetic unlabeled data that mimics the unlabeled data used to train the generative model. The service receives, from each of the distributed sites, a subset of labeled data observed at that site. The service uses the generative models to generate synthetic unlabeled data. The service trains a global machine learning-based model using the received subsets of labeled data received from the distributed sites and the synthetic unlabeled data generated by the generative models.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: July 11, 2023
    Assignee: Cisco Technology, Inc.
    Inventors: Xiaoqing Zhu, Yaqi Wang, Dan Tan, Rob Liston, Mehdi Nikkhah
  • Patent number: 11694094
    Abstract: In various examples there is a computer-implemented method performed by a digital twin at a computing device in a communications network. The method comprises: receiving at least one stream of event data observed from the environment. Computing at least one schema from the stream of event data, the schema being a concise representation of the stream of event data. Participating in a distributed inference process by sending information about the schema or the received event stream to at least one other digital twin in the communications network and receiving information about schemas or received event streams from the other digital twin. Computing comparisons of the sent and received information. Aggregating the digital twin and the other digital twin, or defining a relationship between the digital twin and the other digital twin on the basis of the comparison.
    Type: Grant
    Filed: March 21, 2018
    Date of Patent: July 4, 2023
    Assignee: SWIM.IT INC
    Inventor: Christopher David Sachs
  • Patent number: 11645546
    Abstract: A system and method for predicting multi-agent locations is disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a predictive model using a conditional variational autoencoder. The conditional variational autoencoder learns one or more paths a subset of agents of the plurality of agents are likely to take. The computing system receives tracking data from a tracking system positioned remotely in a venue hosting a candidate sporting event. The computing system identifies one or more candidate agents for which to predict locations. The computing system infers, via the predictive model, one or more locations of the one or more candidate agents. The computing system generates a graphical representation of the one or more locations of the one or more candidate agents.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: May 9, 2023
    Assignee: STATS LLC
    Inventors: Panna Felsen, Sujoy Ganguly, Patrick Lucey
  • Patent number: 11586882
    Abstract: A synapse memory and a method for reading a weight value stored in a synapse memory are provided. The synapse memory includes a memory device configured to store a weight value. The memory device includes a read terminal, a write terminal, and a common terminal, the read terminal being configured to receive a read signal, the write terminal being configured to receive a write signal, and the common terminal being configured to output an output signal from the memory device. The synapse memory also includes a write transistor provided between the write terminal of the memory device and a write signal line configured to send the write signal. The synapse memory further includes a common transistor provided between the common terminal of the memory device and one of the dendrite lines.
    Type: Grant
    Filed: January 24, 2018
    Date of Patent: February 21, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Takeo Yasuda, Kohji Hosokawa
  • Patent number: 11580407
    Abstract: A learning data processing unit accepts, as input, a plurality of pieces of learning data for a respective plurality of tasks, and calculates, for each of the tasks, a batch size which meets a condition that a value obtained by dividing a data size of corresponding one of the pieces of learning data by the corresponding batch size is the same between the tasks. A batch sampling unit samples, for each of the tasks, samples from corresponding one of the pieces of learning data with the corresponding batch size calculated by the learning data processing unit. A learning unit updates a weight of a discriminator for each of the tasks, using the samples sampled by the batch sampling unit.
    Type: Grant
    Filed: September 6, 2016
    Date of Patent: February 14, 2023
    Assignee: Mitsubishi Electric Corporation
    Inventors: Takayuki Semitsu, Wataru Matsumoto, Xiongxin Zhao
  • Patent number: 11580378
    Abstract: A computer-implemented method comprises instantiating a policy function approximator. The policy function approximator is configured to calculate a plurality of estimated action probabilities in dependence on a given state of the environment. Each of the plurality of estimated action probabilities corresponds to a respective one of a plurality of discrete actions performable by the reinforcement learning agent within the environment. An initial plurality of estimated action probabilities in dependence on a first state of the environment are calculated. Two or more of the plurality of discrete actions are concurrently performed within the environment when the environment is in the first state. In response to the concurrent performance, a reward value is received. In response to the received reward value being greater than a baseline reward value, the policy function approximator is updated, such that it is configured to calculate an updated plurality of estimated action probabilities.
    Type: Grant
    Filed: November 12, 2018
    Date of Patent: February 14, 2023
    Assignee: ELECTRONIC ARTS INC.
    Inventors: Jack Harmer, Linus Gisslén, Magnus Nordin, Jorge del Val Santos
  • Patent number: 11562287
    Abstract: The disclosed technology reveals a hierarchical policy network, for use by a software agent, to accomplish an objective that requires execution of multiple tasks. A terminal policy learned by training the agent on a terminal task set, serves as a base task set of the intermediate task set. An intermediate policy learned by training the agent on an intermediate task set serves as a base policy of the top policy. A top policy learned by training the agent on a top task set serves as a base task set of the top task set. The agent is configurable to accomplish the objective by traversal of the hierarchical policy network. A current task in a current task set is executed by executing a previously-learned task selected from a corresponding base task set governed by a corresponding base policy, or performing a primitive action selected from a library of primitive actions.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: January 24, 2023
    Assignee: salesforce.com, inc.
    Inventors: Caiming Xiong, Tianmin Shu, Richard Socher
  • Patent number: 11556773
    Abstract: Aspects of the present disclosure relate to machine learning techniques for identifying the incremental impact of different past events on the likelihood that a target outcome will occur. The technology can use a recurrent neural network to analyze two different representations of an event sequence—one in which some particular event occurs, and another in which that particular event does not occur. The incremental impact of that particular event can be determined based on the calculated difference between the probabilities of the target outcome occurring after these two sequences.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: January 17, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Shikha Aggarwal, Nikolaos Chatzipanagiotis, Shivani Matta, Pragyana K. Mishra, Anil Padia, Nikhil Raina
  • Patent number: 11544620
    Abstract: According to an embodiment of the present disclosure, a method of training a machine learning model is provided. Input data is received from at least one remote device. A classifier is evaluated by determining a classification accuracy of the input data. A training data matrix of the input data is applied to a selected context autoencoder of a knowledge bank of autoencoders including at least one context autoencoder and the training data matrix is determined to be out of context for the selected autoencoder. The training data matrix is applied to each other context autoencoder of the at least one autoencoder and the training data matrix is determined to be out of context for each other context autoencoder. A new context autoencoder is constructed.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: January 3, 2023
    Assignee: Raytheon Technologies Corporation
    Inventors: Kin Gwn Lore, Kishore K. Reddy
  • Patent number: 11521109
    Abstract: An information processing apparatus comprises a storage unit configured to store correct answer data used to detect at least one portion of a detection object from an image and detection data detected as the at least one portion of the detection object from the image; a target determination unit configured to extract mismatching data between the correct answer data and the detection data, which exists within a predetermined range from a region in which the correct answer data and the detection data match, and determine the mismatching data as evaluation target data; an investigation unit configured to investigate property information of the evaluation target data; and an error determination unit configured to determine, based on the property information, whether the evaluation target data is error candidate data of the correct answer data.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: December 6, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Kei Takayama, Masakazu Matsugu, Atsushi Nogami
  • Patent number: 11494695
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a machine learning model to generate embeddings of inputs to the machine learning model, the machine learning model having an encoder that generates the embeddings from the inputs and a decoder that generates outputs from the generated embeddings, wherein the embedding is partitioned into a sequence of embedding partitions that each includes one or more dimensions of the embedding, the operations comprising: for a first embedding partition in the sequence of embedding partitions: performing initial training to train the encoder and a decoder replica corresponding to the first embedding partition; for each particular embedding partition that is after the first embedding partition in the sequence of embedding partitions: performing incremental training to train the encoder and a decoder replica corresponding to the particular partition.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: November 8, 2022
    Assignee: Google LLC
    Inventors: Robert Andrew James Clark, Chun-an Chan, Vincent Ping Leung Wan
  • Patent number: 11481616
    Abstract: To obtain one or more recommendations for the migration of a database to a cloud computing system, information about performance of the database operating under a workload may be obtained. A first machine learning model (e.g., a neural network-based autoencoder) may be used to generate a compressed representation of characteristics of the database operating under the workload. The compressed representation may then be provided as input to a second machine learning model (e.g., a neural network-based classifier), which outputs a recommendation regarding a characteristic (e.g., size, configuration, level of service) of the cloud database to which the database should be migrated. This type of recommendation may be made prior to migration, thereby making it easier to properly estimate the cost of running the cloud database and plan the migration accordingly.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: October 25, 2022
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Mitchell Gregory Spryn, Intaik Park, Felipe Vieira Frujeri, Vijay Govind Panjeti, Ashok Sai Madala, Ajay Kumar Karanam
  • Patent number: 11468291
    Abstract: A method is provided for protecting a machine learning ensemble. In the method, a plurality of machine learning models is combined to form a machine learning ensemble. A plurality of data elements for training the machine learning ensemble is provided. The machine learning ensemble is trained using the plurality of data elements to produce a trained machine learning ensemble. During an inference operating phase, an input is received by the machine learning ensemble. A piecewise function is used to pseudo-randomly choose one of the plurality of machine learning models to provide an output in response to the input. The use of a piecewise function hides which machine learning model provided the output, making the machine learning ensemble more difficult to copy.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: October 11, 2022
    Assignee: NXP B.V.
    Inventors: Wilhelmus Petrus Adrianus Johannus Michiels, Gerardus Antonius Franciscus Derks
  • Patent number: 11443228
    Abstract: Embodiments for efficient machine and deep learning hyperparameter tuning in a distributed computing system. Runtime metrics of each training iteration are collected to identify candidate jobs to merge during an execution phase. The candidate jobs are grouped into job groups, and the job groups containing the candidate jobs are merged together subsequent to each iteration boundary for execution during the execution phase.
    Type: Grant
    Filed: June 21, 2018
    Date of Patent: September 13, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Junfeng Liu, Kuan Feng, Zhichao Su, Yi Zhao