Patents Examined by Lut Wong
  • Patent number: 12210953
    Abstract: A data processing system receives a graph that includes a sequence of layers and executes graph cuts between a preceding layer in the graph and a succeeding layer in the graph that succeeds the preceding layer. The preceding layer generates a set of tiles on a tile-by-tile basis and the succeeding layer processes a tensor that includes multiple tiles in the set of tiles. Thus the graph is partitioned into a sequence of subgraphs, and a subgraph in the sequence of subgraphs including a sub-sequence of layers in the sequence of layers. One or more configuration files is generated to configure runtime logic to execute the sequence of subgraphs and the one or more configuration files are stored on a computer-readable media.
    Type: Grant
    Filed: March 4, 2022
    Date of Patent: January 28, 2025
    Assignee: SambaNova Systems, Inc.
    Inventors: Tejas Nagendra Babu Nama, Ruddhi Chaphekar, Ram Sivaramakrishnan, Raghu Prabhakar, Sumti Jairath, Junjue Wang, Kaizhao Liang, Adi Fuchs, Matheen Musaddiq, Arvind Krishna Sujeeth
  • Patent number: 12198029
    Abstract: The present disclosure provides a joint training method and apparatus for models, a device and a storage medium. The method may include: training a first-party model to be trained using a first sample quantity of first-party training samples to obtain first-party feature gradient information; acquiring second-party feature gradient information and second sample quantity information from a second party, where the second-party feature gradient information is obtained by training, by the second party, a second-party model to be trained using a second sample quantity of second-party training samples; and determining model joint gradient information according to the first-party feature gradient information, the second-party feature gradient information, first sample quantity information and the second sample quantity information, and updating the first-party model and the second-party model according to the model joint gradient information.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: January 14, 2025
    Assignee: Beijing Baidu Netcom Science and Technology Co., Ltd.
    Inventors: Chuanyuan Song, Zhi Feng, Liangliang Lyu
  • Patent number: 12198065
    Abstract: A system and method for designing a physical system using a genetic algorithm includes building a plurality of data structures necessary to build, heal, and verify a plurality of dependency chains; ensuring that multiple dependencies in a respective one of the plurality of dependency chains are represented correctly; removing any dependencies that will be trivially satisfied at random; in response to determining that one or more dependencies is consistent with another dependency, considering one or more combinations of dependencies; and building configurations that satisfy the dependencies and combinations of dependencies by associating the dependencies and combinations of dependencies with selected technology options and recursively specifying and/or revising additional technology options that are consistent with the dependencies or combinations of dependencies, until a configuration is fully specified.
    Type: Grant
    Filed: October 9, 2019
    Date of Patent: January 14, 2025
    Assignee: National Technology & Engineering Solutions of Sandia, LLC
    Inventors: John H. Gauthier, Matthew John Hoffman, Geoffry Scott Pankretz, Adam J. Pierson, Stephen Michael Henry, Darryl J. Melander, Lucas Waddell, John P. Eddy
  • Patent number: 12182698
    Abstract: Use a computerized trained graph neural network model to classify an input instance with a predicted label. With a computerized graph neural network interpretation module, compute a gradient-based saliency matrix based on the input instance and the predicted label, by taking a partial derivative of class prediction with respect to an adjacency matrix of the model. With a computerized user interface, obtain user input responsive to the gradient-based saliency matrix. Optionally, modify the trained graph neural network model based on the user input; and re-classify the input instance with a new predicted label based on the modified trained graph neural network model.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: December 31, 2024
    Assignees: International Business Machines Corporation, Massachusetts Institute of Technology
    Inventors: Dakuo Wang, Sijia Liu, Abel Valente, Chuang Gan, Bei Chen, Dongyu Liu, Yi Sun
  • Patent number: 12182671
    Abstract: A method optimizes machine learning systems. A computing device accesses a committee of classifiers that have been trained using an initial labeled instance of data from an annotator. The initial labeled instance of data includes annotator-ranked attributes of the data, initial values of the attributes, and an initial prediction label that describes an initial predicted state based on the values. The computing system compares the attributes ranking from the annotator to attributes rankings that are generated by and used by each of the machine learning systems when evaluating one or more instances of unlabeled data that include the attributes, and weights the machine learning systems according to how closely each of the attributes rankings generated by and used by each of the machine learning systems match the attributes ranking from the annotator. The machine learning systems are then optimized based on this matching.
    Type: Grant
    Filed: January 26, 2021
    Date of Patent: December 31, 2024
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Yunfeng Zhang, Qingzi Liao, Bhavya Ghai, Klaus Mueller
  • Patent number: 12182734
    Abstract: Provided are architectures, system, methods, and computer program products that provide a user with the ability to define an association of data and/or information from known reference sets perceived by the user as relevant to a subject matter domain, thereby imparting and formalizing some of the user's knowledge about the domain. An associative relevancy knowledge profiler may also allow a user to create a profile by modifying or restricting the known reference sets and windowing the results from the association as a user might refine any other analysis algorithms. An associative relevancy knowledge profiler may also be used to define a user profile used by the user and others. A user profile may be usable in various manners depending upon, for example, rights management permissions and restrictions for a user.
    Type: Grant
    Filed: January 20, 2022
    Date of Patent: December 31, 2024
    Assignee: ARAICOM RESEARCH LLC
    Inventor: Anthony Prestigiacomo
  • Patent number: 12175371
    Abstract: A method using the Sifr optimizer for training a neural network model having layers and parameters comprises providing an input corresponding to each of samples comprised in a batch from a training dataset to an input layer, obtaining outputs from the neural network model, calculating a loss function for each of the samples based on the outputs and corresponding desired values, and determining values of the parameters for minimizing a mismatch between the outputs and the corresponding desired values across the samples for the parameters based on the loss function. Further, the determining of the values for the parameters comprises executing at least one of forward passes and backward passes through the neural network model, obtaining a curvature data based on the executing, obtaining a Sifr update based on the data. The determining of the values for the parameters is based on the Sifr update.
    Type: Grant
    Filed: April 16, 2024
    Date of Patent: December 24, 2024
    Inventor: Fares Mehouachi
  • Patent number: 12175365
    Abstract: According to one embodiment, a learning apparatus includes a setting unit, a training unit, and a display. The setting unit sets one or more second training conditions based on a first training condition relating to a first trained model. The training unit trains one or more neural networks in accordance with the one or more second training conditions and generates one or more second trained models which execute a task identical to a task executed by the first trained model. The display displays a graph showing an inference performance and calculation cost of each of the one or more second trained models.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: December 24, 2024
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Atsushi Yaguchi, Shuhei Nitta, Yukinobu Sakata, Akiyuki Tanizawa
  • Patent number: 12169767
    Abstract: Techniques for responding to a healthcare inquiry from a user are disclosed. In one particular embodiment, the techniques may be realized as a method for responding to a healthcare inquiry from a user, according to a set of instructions stored on a memory of a computing device and executed by a processor of the computing device, the method comprising the steps of: classifying an intent of the user based on the healthcare inquiry; instantiating a conversational engine based on the intent; eliciting, by the conversational engine, information from the user; and presenting one or more medical recommendations to the user based at least in part on the information.
    Type: Grant
    Filed: March 20, 2024
    Date of Patent: December 17, 2024
    Assignee: CURAI, INC.
    Inventors: Anitha Kannan, Murali Ravuri, Vitor Rodrigues, Vignesh Venkataraman, Geoffrey Tso, Neal Khosla, Neil Hunt, Xavier Amatriain, Manish Chablani
  • Patent number: 12165031
    Abstract: A treatment model trained to compute an estimated treatment variable value for each observation vector of a plurality of observation vectors is executed. Each observation vector includes covariate variable values, a treatment variable value, and an outcome variable value. An outcome model trained to compute an estimated outcome value for each observation vector using the treatment variable value for each observation vector is executed. A standard error value associated with the outcome model is computed using a first variance value computed using the treatment variable value of the plurality of observation vectors, using a second variance value computed using the treatment variable value and the estimated treatment variable value of the plurality of observation vectors, and using a third variance value computed using the estimated outcome value of the plurality of observation vectors. The standard error value is output.
    Type: Grant
    Filed: December 5, 2023
    Date of Patent: December 10, 2024
    Assignee: SAS Institute Inc.
    Inventors: Sylvie Tchumtchoua Kabisa, Xilong Chen, Gunce Eryuruk Walton, David Bruce Elsheimer, Ming-Chun Chang
  • Patent number: 12165024
    Abstract: The present disclosure provides systems and methods for distributed training of machine learning models. In one example, a computer-implemented method is provided for training machine-learned models. The method includes obtaining, by one or more computing devices, a plurality of regions based at least in part on temporal availability of user devices; selecting a plurality of available user devices within a region; and providing a current version of a machine-learned model associated with the region to the plurality of selected user devices within the region. The method includes obtaining, from the plurality of selected user devices, updated machine-learned model data generated by the plurality of selected user devices through training of the current version of the machine-learned model associated with the region using data local to each of the plurality of selected user devices and generating an updated machine-learned model associated with the region based on the updated machine-learned model data.
    Type: Grant
    Filed: October 17, 2022
    Date of Patent: December 10, 2024
    Assignee: GOOGLE LLC
    Inventor: Keith Bonawitz
  • Patent number: 12165072
    Abstract: A method, apparatus, device, and storage medium for expanding data are disclosed. The method includes: acquiring a triplet from a knowledge graph; mining a relationship path equivalent to a relationship in the triplet from the knowledge graph, a subject in the triplet being used as a start point of the relationship path, and an object in the triplet being used as an end point of the relationship path; and expanding the triplet based on the relationship path to generate an expanded triplet. This implementation expands the triplet in the knowledge graph, and strengthens the association between the subject and the object in the triplet in a larger context, such that the association between the subject and the object in the triplet is more global.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: December 10, 2024
    Assignee: Beijing Baidu Netcom Science and Technology Co., Ltd.
    Inventors: Pingping Huang, Quan Wang, Wenbin Jiang, Pengcheng Yuan
  • Patent number: 12164408
    Abstract: Techniques are disclosed for controlling a device's operation based on an inferred state. More specifically, at each of a set of time points, execution of an application at an electronic device is detected. For each detected execution, an application-usage variable is determined. One or more aggregated metrics are generated based on aggregation of at least some of the application-usage variables. Based on the one or more aggregated metrics, a state identifier is identified that corresponds to an inferred state of a user of the electronic device. A device-operation identifier is retrieved that is associated with the state identifier. A device operation is performed associated with the device-operation identifier.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: December 10, 2024
    Assignee: Apple Inc.
    Inventors: Leon A. Gatys, Emily Fox, Jonas Rauber
  • Patent number: 12154039
    Abstract: There is a need for more accurate and more efficient predictive data analysis steps/operations. This need can be addressed by, for example, techniques for efficient predictive data analysis steps/operations. In one example, a method includes mapping a primary event having a primary event code to a related subset of a plurality of candidate secondary events by at least processing one or more lifecycle-related attributes for the primary event code using a lifecycle inference machine learning model to detect an inferred lifecycle for the primary event.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: November 26, 2024
    Assignee: Optum Technology, Inc.
    Inventors: Rama Krishna Singh, Priyank Jain, Ravi Pande
  • Patent number: 12147879
    Abstract: Mechanisms for performing intelligent federated machine learning (ML) model updates are provided. A plurality of ML model updates, and a plurality of dataset sketch commitment data structures (sketches), are received from a plurality of participant computing systems. Each sketch provides statistical characteristics of a corresponding local dataset used by a corresponding participant to train a local ML model. A potentially malicious participant identification operation is performed based on an analysis of the plurality of sketches to identify one or more potentially malicious participants based on differences in sketches. ML model updates received from participant computing systems identified as potentially malicious participants are discarded to thereby generate a modified set of updates. The federated ML computer model is updated based on the modified set of updates.
    Type: Grant
    Filed: February 22, 2021
    Date of Patent: November 19, 2024
    Assignee: International Business Machines Corporation
    Inventors: Lei Yu, Qi Zhang, Petr Novotny, Taesung Lee
  • Patent number: 12141667
    Abstract: A disclosed example includes implementing a first worker instance and a second worker instance to operate in parallel; running a first tuning operation via the first worker instance to tune first hyperparameters; running a second tuning operation via the second worker instance using a Bayesian-based optimization to determine a hyperparameter configuration to evaluate next; evaluating the hyperparameter configuration for an external model using a surrogate model; and selecting the hyperparameter configuration for the external model.
    Type: Grant
    Filed: December 23, 2021
    Date of Patent: November 12, 2024
    Assignee: Intel Corporation
    Inventors: Patrick Hayes, Michael McCourt, Alexandra Johnson, George Ke, Scott Clark
  • Patent number: 12124964
    Abstract: Disclosed is a method for updating a node model that resists discrimination propagation in federated learning. The method includes: obtaining a node model corresponding to a data node; calculating a mean value of the distribution of class features and a quantity ratio corresponding to training data of the data node, calculating a distribution weighted aggregation model based on the node model, the mean value of the distribution of class features and the quantity ratio; calculating a regularization term corresponding to the data node based on the node model and the distribution weighted aggregation model; calculating a variance of the distribution of the class features corresponding to the data node, calculating a class balanced complementary term by using a cross-domain feature generator; and updating the node model based on the distribution weighted aggregation model, the regularization term, and the class balanced complementary term.
    Type: Grant
    Filed: June 3, 2024
    Date of Patent: October 22, 2024
    Assignee: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
    Inventors: Zhenan Sun, Yunlong Wang, Zhengquan Luo, Kunbo Zhang, Qi Li, Yong He
  • Patent number: 12118063
    Abstract: The present disclosure provides a method, apparatus, electronic device and storage medium for training a semantic similarity model, which relates to the field of artificial intelligence. A specific implementation solution is as follows: obtaining a target field to be used by a semantic similarity model to be trained; calculating respective correlations between the target field and application fields corresponding to each of training datasets in known multiple training datasets; training the semantic similarity model with the training datasets in turn, according to the respective correlations between the target field and the application fields corresponding to each of the training datasets.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: October 15, 2024
    Assignee: Beijing Baidu Netcom Science and Technology Co., Ltd.
    Inventors: Zhen Li, Yukun Li, Yu Sun
  • Patent number: 12112250
    Abstract: A data processing system includes compile time logic to section a graph into a sequence of sections, including a first section followed by a second section. The compile time logic configured the first section to generate a first output in a first non-overlapping target configuration in response to processing an input in a first overlapping input configuration, and configures the second section to generate a second output in a second non-overlapping target configuration in response to processing the first output in a second overlapping input configuration. The compile time logic also creates a set of computer instructions to execute the first section and the second section on a target processing system.
    Type: Grant
    Filed: April 4, 2022
    Date of Patent: October 8, 2024
    Assignee: SambaNova Systems, Inc.
    Inventors: Tejas Nagendra Babu Nama, Ruddhi Chaphekar, Ram Sivaramakrishnan, Raghu Prabhakar, Sumti Jairath, Junjue Wang, Kaizhao Liang, Adi Fuchs, Matheen Musaddiq, Arvind Krishna Sujeeth
  • Patent number: 12106052
    Abstract: The disclosure discloses a method and an apparatus for generating a semantic representation model, and a storage medium. The detailed implementation includes: performing recognition and segmentation on the original text included in an original text set to obtain knowledge units and non-knowledge units in the original text; performing knowledge unit-level disorder processing on the knowledge units and the non-knowledge units in the original text to obtain a disorder text; generating a training text set based on the character attribute of each character in the disorder text; and training an initial semantic representation model by employing the training text set to generate the semantic representation model.
    Type: Grant
    Filed: March 18, 2021
    Date of Patent: October 1, 2024
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Shuohuan Wang, Siyu Ding, Yu Sun