Patents by Inventor Weiguang Ding

Weiguang Ding has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230342619
    Abstract: Systems are methods are provided for training an automated agent. The automated agent maintains a reinforcement learning neural network and generates, according to outputs of the reinforcement learning neural network, signals for communicating resource task requests. First and second task data are received. The task data are processed to compute a first performance metric reflective of performance of the automated agent relative to other entities in a first time interval, and a second performance metric reflective of performance of the automated agent relative to other entities in a second time interval. A reward for the reinforcement learning neural network that reflects a difference between the second performance metric and the first performance metric is computed and provided to the reinforcement learning neural network to train the automated agent.
    Type: Application
    Filed: June 13, 2023
    Publication date: October 26, 2023
    Inventors: Hasham BURHANI, Shary MUDASSIR, Xiao Qi SHI, Connor LAWLESS, Weiguang DING
  • Patent number: 11772266
    Abstract: Robotic systems, methods of operation of robotic systems, and storage media including processor-executable instructions are disclosed herein. The system may include a robot, at least one processor in communication with the robot, and an operator interface in communication with the robot and the at least one processor. The method may include executing a first set of autonomous robot control instructions which causes a robot to autonomously perform the at least one task in an autonomous mode, and generating a second set of autonomous robot control instructions from the first set of autonomous robot control instructions and a first set of environmental sensor data received from a senor. Execution of the second set of autonomous robot control instructions causes the robot to autonomously perform the at least one task. The method may include producing at least one signal that represents the second set of autonomous robot control instructions.
    Type: Grant
    Filed: February 23, 2022
    Date of Patent: October 3, 2023
    Assignee: Ocado Innovation Limited
    Inventors: Weiguang Ding, Jan Stanislaw Rudy, Olivia S. Norton, George Samuel Rose, James Sterling Bergstra, Oswin Rodrigues
  • Patent number: 11715017
    Abstract: Systems are methods are provided for training an automated agent. The automated agent maintains a reinforcement learning neural network and generates, according to outputs of the reinforcement learning neural network, signals for communicating resource task requests. First and second task data are received. The task data are processed to compute a first performance metric reflective of performance of the automated agent relative to other entities in a first time interval, and a second performance metric reflective of performance of the automated agent relative to other entities in a second time interval. A reward for the reinforcement learning neural network that reflects a difference between the second performance metric and the first performance metric is computed and provided to the reinforcement learning neural network to train the automated agent.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: August 1, 2023
    Assignee: ROYAL BANK OF CANADA
    Inventors: Hasham Burhani, Shary Mudassir, Xiao Qi Shi, Connor Lawless, Weiguang Ding
  • Patent number: 11568261
    Abstract: A system for generating an adversarial example in respect of a neural network, the adversarial example generated to improve a margin defined as a distance from a data example to a neural network decision boundary. The system includes a data receiver configured to receive one or more data sets including at least one data set representing a benign training example (x); an adversarial generator engine configured to: generate, using the neural network, a first adversarial example (Adv1) having a perturbation length epsilon1 against x; conduct a search in a direction (Adv1-x) using the neural network; and to generate, using the neural network, a second adversarial example (Adv2) having a perturbation length epsilon2 based at least on an output of a search in the direction (Adv1-x).
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: January 31, 2023
    Assignee: ROYAL BANK OF CANADA
    Inventors: Weiguang Ding, Yash Sharma, Yik Chau Lui, Ruitong Huang
  • Patent number: 11562244
    Abstract: Systems, methods, and computer readable media are described to train a compressed neural network with high robustness. The neural network is first adversarially pre-trained with both original data as well as data perturbed by adversarial attacks for some epochs, then “unimportant” weights or filters are pruned through criteria based on their magnitudes or other method (e.g., Taylor approximation of the loss function), and the pruned neural network is retrained with both clean and perturbed data for more epochs.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: January 24, 2023
    Assignee: ROYAL BANK OF CANADA
    Inventors: Luyu Wang, Weiguang Ding, Ruitong Huang, Yanshuai Cao, Yik Chau Lui
  • Patent number: 11551041
    Abstract: A method for acquiring measurements for a data structure corresponding to an array of variable includes: selecting a subset of elements from the data structure; measuring a sampled value for each of the selected subset of elements; storing each of the sampled values in a K-nearest neighbour (KNN) database and labelling the sampled value as certain; generating a predicted value data structure where each predicted element is generated as the value of its nearest neighbor based on the values stored in the KNN database; for each predicted element: retrieve the predicted element's X nearest neighbours for the sampled value in the KNN database, and when a value of the X nearest neighbours is the same as the predicted element, the predicted element is labelled as certain, otherwise the predicted element is labelled the values as uncertain; and repeating until all elements are labelled as certain.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: January 10, 2023
    Assignee: ROYAL BANK OF CANADA
    Inventors: Weiguang Ding, Ruitong Huang, Luyu Wang, Yanshuai Cao
  • Patent number: 11520899
    Abstract: A platform for training deep neural networks using push-to-corner preprocessing and adversarial training. A training engine adds a preprocessing layer before the input data is fed into a deep neural network at the input layer, for pushing the input data further to the corner of its domain.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: December 6, 2022
    Assignee: ROYAL BANK OF CANADA
    Inventors: Weiguang Ding, Luyu Wang, Ruitong Huang, Xiaomeng Jin, Kry Yik Chau Lui
  • Publication number: 20220382880
    Abstract: A system and method for adversarial vulnerability testing of machine learning models is proposed that receives as an input, a representation of a non-differentiable machine learning model, transforms the input model into a smoothed model and conducts an adversarial search against the smoothed model to generate an output data value representative of a potential vulnerability to adversarial examples. Variant embodiments are also proposed, directed to noise injection, hyperparameter control, and exhaustive/sampling-based searches in an effort to balance computational efficiency and accuracy in practical implementation. Flagged vulnerabilities can be used to have models re-validated, re-trained, or removed from use due to an increased cybersecurity risk profile.
    Type: Application
    Filed: May 20, 2022
    Publication date: December 1, 2022
    Inventors: Giuseppe Marcello Antonio CASTIGLIONE, Weiguang DING, Sayedmasoud HASHEMI AMROABADI, Ga WU, Christopher Côté SRINIVASA
  • Publication number: 20220281108
    Abstract: Robotic systems, methods of operation of robotic systems, and storage media including processor-executable instructions are disclosed herein. The system may include a robot, at least one processor in communication with the robot, and an operator interface in communication with the robot and the at least one processor. The method may include executing a first set of autonomous robot control instructions which causes a robot to autonomously perform the at least one task in an autonomous mode, and generating a second set of autonomous robot control instructions from the first set of autonomous robot control instructions and a first set of environmental sensor data received from a senor. Execution of the second set of autonomous robot control instructions causes the robot to autonomously perform the at least one task. The method may include producing at least one signal that represents the second set of autonomous robot control instructions.
    Type: Application
    Filed: February 23, 2022
    Publication date: September 8, 2022
    Inventors: Weiguang Ding, Jan Stanislaw Rudy, Olivia S. Norton, George Samuel Rose, James Sterling Bergstra, Oswin Rodrigues
  • Patent number: 11279030
    Abstract: Robotic systems, methods of operation of robotic systems, and storage media including processor-executable instructions are disclosed herein. The system may include a robot, at least one processor in communication with the robot, and an operator interface in communication with the robot and the at least one processor. The method may include executing a first set of autonomous robot control instructions which causes a robot to autonomously perform the at least one task in an autonomous mode, and generating a second set of autonomous robot control instructions from the first set of autonomous robot control instructions and a first set of environmental sensor data received from a sensor. Execution of the second set of autonomous robot control instructions causes the robot to autonomously perform the at least one task. The method may include producing at least one signal that represents the second set of autonomous robot control instructions.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: March 22, 2022
    Assignee: Kindred Systems Inc.
    Inventors: Weiguang Ding, Jan Stanislaw Rudy, Olivia S. Norton, George Samuel Rose, James Sterling Bergstra, Oswin Rodrigues
  • Publication number: 20220058531
    Abstract: The approaches described herein are adapted to provide a technical, computational mechanism to aid in improving explainability of machine learning architectures or for generating more explainable machine learning architectures. Specifically, the approaches describe a proposed implementation of cascading decision tree (CDT) based representation learning data models which can be structured in various approaches to learn features of varying complexity.
    Type: Application
    Filed: August 19, 2021
    Publication date: February 24, 2022
    Inventors: Zihan DING, Pablo Francisco HERNANDEZ-LEAL, Weiguang DING, Changjian LI, Ruitong HUANG
  • Patent number: 11157781
    Abstract: A system and method for determining a reliability score indicative of a level of fidelity between high dimensional (HD) data and corresponding dimension-reduced (LD) data are provided. The system comprises a processor, and a non-transitory computer-readable medium having stored thereon program instructions executable by the processor. The processor is configured to perform the method.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: October 26, 2021
    Assignee: ROYAL BANK OF CANADA
    Inventors: Weiguang Ding, Yik Chau Lui
  • Publication number: 20200380353
    Abstract: Systems are methods are provided for training an automated agent. The automated agent maintains a reinforcement learning neural network and generates, according to outputs of the reinforcement learning neural network, signals for communicating resource task requests. First and second task data are received. The task data are processed to compute a first performance metric reflective of performance of the automated agent relative to other entities in a first time interval, and a second performance metric reflective of performance of the automated agent relative to other entities in a second time interval. A reward for the reinforcement learning neural network that reflects a difference between the second performance metric and the first performance metric is computed and provided to the reinforcement learning neural network to train the automated agent.
    Type: Application
    Filed: May 30, 2019
    Publication date: December 3, 2020
    Inventor: Weiguang DING
  • Patent number: 10802822
    Abstract: Systems and methods for computationally generating a set of more “stable” configuration default values that are used for traceability and improving reproducibility of machine learning approaches. Hash values are generated based on a merged/modified configuration and both configuration content and hash are stored together in one or more data structures. These data structures can be used to link back to the actual values used in experiments.
    Type: Grant
    Filed: August 21, 2018
    Date of Patent: October 13, 2020
    Assignee: ROYAL BANK OF CANADA
    Inventors: Weiguang Ding, Yanshuai Cao
  • Publication number: 20200134468
    Abstract: A system for generating an adversarial example in respect of a neural network, the adversarial example generated to improve a margin defined as a distance from a data example to a neural network decision boundary. The system includes a data receiver configured to receive one or more data sets including at least one data set representing a benign training example (x); an adversarial generator engine configured to: generate, using the neural network, a first adversarial example (Adv1) having a perturbation length epsilon1 against x; conduct a search in a direction (Adv1-x) using the neural network; and to generate, using the neural network, a second adversarial example (Adv2) having a perturbation length epsilon2 based at least on an output of a search in the direction (Adv1-x).
    Type: Application
    Filed: October 25, 2019
    Publication date: April 30, 2020
    Inventors: Weiguang DING, Yash SHARMA, Yik Chau LUI, Ruitong HUANG
  • Publication number: 20190354688
    Abstract: A platform for training deep neural networks using push-to-corner preprocessing and adversarial training. A training engine adds a preprocessing layer before the input data is fed into a deep neural network at the input layer, for pushing the input data further to the corner of its domain.
    Type: Application
    Filed: May 17, 2019
    Publication date: November 21, 2019
    Inventors: Weiguang DING, Luyu WANG, Ruitong HUANG, Xiaomeng JIN, Kry Yik Chau LUI
  • Publication number: 20190270201
    Abstract: Robotic systems, methods of operation of robotic systems, and storage media including processor-executable instructions are disclosed herein. The system may include a robot, at least one processor in communication with the robot, and an operator interface in communication with the robot and the at least one processor. The method may include executing a first set of autonomous robot control instructions which causes a robot to autonomously perform the at least one task in an autonomous mode, and generating a second set of autonomous robot control instructions from the first set of autonomous robot control instructions and a first set of environmental sensor data received from a sensor. Execution of the second set of autonomous robot control instructions causes the robot to autonomously perform the at least one task. The method may include producing at least one signal that represents the second set of autonomous robot control instructions.
    Type: Application
    Filed: May 17, 2019
    Publication date: September 5, 2019
    Inventors: Weiguang Ding, Jan Stanislaw Rudy, Olivia S. Norton, George Samuel Rose, James Sterling Bergstra, Oswin Rodrigues
  • Publication number: 20190244103
    Abstract: Systems, methods, and computer readable media are described to train a compressed neural network with high robustness. The neural network is first adversarially pre-trained with both original data as well as data perturbed by adversarial attacks for some epochs, then “unimportant” weights or filters are pruned through criteria based on their magnitudes or other method (e.g., Taylor approximation of the loss function), and the pruned neural network is retrained with both clean and perturbed data for more epochs.
    Type: Application
    Filed: February 7, 2019
    Publication date: August 8, 2019
    Inventors: Luyu WANG, Weiguang DING, Ruitong HUANG, Yanshuai CAO, Yik Chau LUI
  • Patent number: 10322506
    Abstract: Robotic systems, methods of operation of robotic systems, and storage media including processor-executable instructions are disclosed herein. The system may include a robot, at least one processor in communication with the robot, and an operator interface in communication with the robot and the at least one processor. The method may include executing a first set of autonomous robot control instructions which causes a robot to autonomously perform the at least one task in an autonomous mode, and generating a second set of autonomous robot control instructions from the first set of autonomous robot control instructions and a first set of environmental sensor data received from a senor. The second set of autonomous robot control instructions when executed causes the robot to autonomously perform the at least one task. The method may include producing at least one signal that represents the second set of autonomous robot control instructions.
    Type: Grant
    Filed: May 8, 2017
    Date of Patent: June 18, 2019
    Assignee: Kindred Systems Inc.
    Inventors: Weiguang Ding, Jan Stanislaw Rudy, Olivia S. Norton, George Samuel Rose, James Sterling Bergstra, Oswin Rodrigues
  • Publication number: 20190130225
    Abstract: A method for acquiring measurements for a data structure corresponding to an array of variable includes: selecting a subset of elements from the data structure; measuring a sampled value for each of the selected subset of elements; storing each of the sampled values in a K-nearest neighbour (KNN) database and labelling the sampled value as certain; generating a predicted value data structure where each predicted element is generated as the value of its nearest neighbor based on the values stored in the KNN database; for each predicted element: retrieve the predicted element's X nearest neighbours for the sampled value in the KNN database, and when a value of the X nearest neighbours is the same as the predicted element, the predicted element is labelled as certain, otherwise the predicted element is labelled the values as uncertain; and repeating until all elements are labelled as certain.
    Type: Application
    Filed: October 31, 2018
    Publication date: May 2, 2019
    Inventors: Weiguang DING, Ruitong HUANG, Luyu WANG, Yanshuai CAO