Patents Examined by Shane D Woolwine
  • Patent number: 11568288
    Abstract: A knowledge-based system under uncertainties and/or incompleteness, referred to as augmented knowledge base (AKB) is provided, including constructing, reasoning, analyzing and applying AKBs by creating objects in the form E?A, where A is a rule in a knowledgebase and E is a set of evidences that supports the rule A. A reasoning scheme under uncertainties and/or incompleteness is provided as augmented reasoning (AR).
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: January 31, 2023
    Inventors: Eugene S. Santos, Eunice E. Santos, Evelyn W. Santos, Eugene Santos, Jr.
  • Patent number: 11552962
    Abstract: An ensemble of detection techniques are used to identify code that presents intermediate levels of threat. For example, an ensemble of machine learning techniques may be used to evaluate suspiciousness based on binaries, file paths, behaviors, reputations, and so forth, and code may be sorted into safe, unsafe, intermediate, or any similar categories. By filtering and prioritizing intermediate threats with these tools, human threat intervention can advantageously be directed toward code samples and associated contexts most appropriate for non-automated responses.
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: January 10, 2023
    Assignee: Sophos Limited
    Inventors: Joshua Daniel Saxe, Andrew J. Thomas, Russell Humphries, Simon Neil Reed, Kenneth D. Ray, Joseph H. Levy
  • Patent number: 11531879
    Abstract: Some embodiments provide a method for training a machine-trained (MT) network. The method uses a first set of training inputs to train parameters of the MT network. The method uses a set of validation inputs to measure error for the MT network as trained by the first set of training inputs. The method adds at least a subset of the validation inputs to the first set of training inputs to create a second set of training inputs. The method uses the second set of training inputs to train the parameters of the MT network. The error measurement is used to modify the training with the second set of training inputs.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: December 20, 2022
    Inventors: Steven L. Teig, Eric A. Sather
  • Patent number: 11531861
    Abstract: The present disclosure is directed to an automated neural architecture search approach for designing new neural network architectures such as, for example, resource-constrained mobile CNN models. In particular, the present disclosure provides systems and methods to perform neural architecture search using a novel factorized hierarchical search space that permits layer diversity throughout the network, thereby striking the right balance between flexibility and search space size. The resulting neural architectures are able to be run relatively faster and using relatively fewer computing resources (e.g., less processing power, less memory usage, less power consumption, etc.), all while remaining competitive with or even exceeding the performance (e.g., accuracy) of current state-of-the-art mobile-optimized models.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: December 20, 2022
    Assignee: GOOGLE LLC
    Inventors: Mingxing Tan, Quoc Le, Bo Chen, Vijay Vasudevan, Ruoming Pang
  • Patent number: 11531903
    Abstract: A computerized-method for real-time detection of real concept drift in predictive machine learning models, by processing high-speed streaming data. The computerized-method includes: receiving a real-time data stream having labeled and unlabeled instances. Obtaining a window of ā€˜nā€™ instances having a portion of the ā€˜nā€™ instances as reliable labels. Computing posterior distribution of the reliable labels; and operating a Drift-Detection (DD) module. The DD module is configured to: operate a kernel density estimation on the computed posterior distribution for sensitivity control of the DD module; operate an error rate function on the estimated kernel density to yield an error value; and train an incremental estimator module, according to the kernel density estimation. When the error value is not above a preconfigured drift threshold repeating operations (i) through (iii), else when the error value is above the preconfigured drift threshold, at least one concept drift related action takes place.
    Type: Grant
    Filed: August 2, 2020
    Date of Patent: December 20, 2022
    Assignee: ACTIMIZE LTD
    Inventors: Ganir Tamir, Danny Butvinik, Yoav Avneon
  • Patent number: 11501076
    Abstract: Approaches for multitask learning as question answering include a method for training that includes receiving a plurality of training samples including training samples from a plurality of task types, presenting the training samples to a neural model to generate an answer, determining an error between the generated answer and the natural language ground truth answer for each training sample presented, and adjusting parameters of the neural model based on the error. Each of the training samples includes a natural language context, question, and ground truth answer. An order in which the training samples are presented to the neural model includes initially selecting the training samples according to a first training strategy and switching to selecting the training samples according to a second training strategy. In some embodiments the first training strategy is a sequential training strategy and the second training strategy is a joint training strategy.
    Type: Grant
    Filed: May 8, 2018
    Date of Patent: November 15, 2022
    Assignee: SALESFORCE.COM, INC.
    Inventors: Nitish Shirish Keskar, Bryan McCann, Caiming Xiong, Richard Socher
  • Patent number: 11501154
    Abstract: A sensor transformation attention network (STAN) model including sensors, attention modules, a merge module and a task-specific module is provided. The attention modules calculate attention scores of feature vectors corresponding to the input signals collected by the sensors. The merge module calculates attention values of the attention scores, and generates a merged transformation vector based on the attention values and the feature vectors. The task-specific module classifies the merged transformation vector.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: November 15, 2022
    Inventors: Stefan Braun, Daniel Neil, Enea Ceolini, Jithendar Anumula, Shih-Chii Liu
  • Patent number: 11501178
    Abstract: The present disclosure relates to a data processing method, a medical term processing system, a medical diagnostic system, a medical intelligent triage apparatus and a computer readable storage medium. The method comprises: acquiring statement information inputted by a user; dividing the statement information into a plurality of information segments by means of a predetermined algorithm, the plurality of information segments comprising a first information segment; establishing a Gaussian distribution of each of the information segments; calculating the similarity between the first information segment and words in a database by means of a similarity model; and obtaining, from words in the database, at least one second information segment for describing the first information segment based on the calculated similarity. The present disclosure can provide professional terms, such as medical terms, corresponding to colloquial expressions, to facilitate users' diagnosis and treatment.
    Type: Grant
    Filed: April 13, 2018
    Date of Patent: November 15, 2022
    Inventor: Zhenzhong Zhang
  • Patent number: 11494702
    Abstract: An information processing apparatus includes a processor that acquires measurement information measured by a device put on a task performer; detects a predetermined operation in the measurement information; extracts feature vectors from an operation section in which the predetermined operation has been detected; divides the feature vectors into clusters by division methods; obtains ratios at which the feature vectors are classified into the respective clusters in a predetermined time; performs learning by using the ratios as an input and using, as an output label, information indicating whether the task performer performs a predetermined task in the predetermined time; generates a task estimation model by determining weighting for the clusters based on a result of the learning; and estimates, by using the task estimation model, whether the task performer is in a process of performing the predetermined task.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: November 8, 2022
    Inventors: Junya Fujimoto, Yuichi Murase
  • Patent number: 11461702
    Abstract: The present disclosure is directed to a novel system for generating expansion artificial intelligence (AI) based decision making engines to improve overall AI solution fairness, reduce bias and reduce discrimination in outcomes. Embodiments perform a restriction stage that includes generating an initial AI solution, perform an expansion stage by generating a plurality of artificial intelligence expansion engines by modifying the starting state to determine a new starting state for each; modifying the set of criteria to determine a new set of criteria, using the new starting state and the new set of criteria to generate an expansion AI solution; and joining the initial AI solution of the restriction engine with the plurality of expansion AI solutions to generate an ensemble AI solution. This solution may be refined by a restriction stage and the expansion and/or restriction stages may be reiterated as desired.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: October 4, 2022
    Inventor: Eren Kursun
  • Patent number: 11455523
    Abstract: A risk evaluation method is disclosed. A machine learning is conducted by using a neural network by inputting training data. A data distance corresponding to a permission level is calculated based on restoration data and the training data, the permission level being among a plurality of layers of the neural network, the restoration data being generated by using at least one weight of a plurality of permission level weights at the permission level, the plurality of permission level weights being among a plurality of weights of synapses at the plurality of layers, the plurality of weights being generated by the machine learning.
    Type: Grant
    Filed: May 23, 2018
    Date of Patent: September 27, 2022
    Inventor: Toshio Endoh
  • Patent number: 11455551
    Abstract: An identification of an item that was misclassified by a classification model constructed in accordance with a machine learning technique is received. One example of such a machine learning technique is a random forest. A subset of training data, previously used to construct the model, and that is associated with the misclassified item is identified. At least a portion of the identified subset is provided as output.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: September 27, 2022
    Assignee: Palo Alto Networks, Inc.
    Inventors: William Redington Hewlett, II, Seokkyung Chung, Lin Xu
  • Patent number: 11443243
    Abstract: In one embodiment, a computer-implemented method performed by a data processing (DP) accelerator, includes receiving, at the DP accelerator, first data representing a set of training data from a host processor; receiving, at the DP accelerator, a watermark kernel from the host processor; and executing the watermark kernel within the DP accelerator on an artificial intelligence (AI) model. The watermark kernel, when executed, is configured to: generate a watermark, train the AI model using the set of training data, and implant the watermark within the AI model during training of the AI model. The DP accelerator then transmits second data representing the trained AI model having the watermark implanted therein to the host processor. In an embodiment, the method further includes receiving a pre-trained AI model and the training is performed for the pre-trained AI model.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: September 13, 2022
    Inventors: Yueqiang Cheng, Yong Liu
  • Patent number: 11443179
    Abstract: The disclosure presents herein a method to train a classifier in a machine learning using more than one simultaneous sample to address class imbalance problem in any discriminative classifier. A modified representation of the training dataset is obtained by simultaneously considering features based representations of more than one sample. A modification to an architecture of a classifier is needed into handling the modified date representation of the more than one samples. The modification of the classifier directs same number of units in the input layer as to accept the plurality of simultaneous samples in the training dataset. The output layer will consist of units equal to twice the considered number of classes in the classification task, therefore, the output layer herein will have four units for two-class classification task. The disclosure herein can be implemented to resolve the problem of learning from low resourced data.
    Type: Grant
    Filed: May 18, 2018
    Date of Patent: September 13, 2022
    Inventors: Sri Harsha Dumpala, Rupayan Chakraborty, Sunil Kumar Kopparapu
  • Patent number: 11445378
    Abstract: Systems, methods, and apparatuses for providing dynamic, prioritized spectrum utilization management. The system includes at least one monitoring sensor, at least one data analysis engine, at least one application, a semantic engine, a programmable rules and policy editor, a tip and cue server, and/or a control panel. The tip and cue server is operable utilize the environmental awareness from the data processed by the at least one data analysis engine in combination with additional information to create actionable data.
    Type: Grant
    Filed: August 30, 2021
    Date of Patent: September 13, 2022
    Inventors: Armando Montalvo, Dwight Inman, Edward Hummel
  • Patent number: 11429902
    Abstract: Embodiments of the present disclosure relate to a method, device and computer program product for deploying a machine learning model. The method comprises: receiving an intermediate representation indicating processing of a machine learning model, learning parameters of the machine learning model, and a computing resource requirement for executing the machine learning model, the intermediate representation, the learning parameters, and the computing resource requirement being determined based on an original code of the machine learning model, the intermediate representation being irrelevant to a programming language of the original code; determining, at least based on the computing resource requirement, a computing node and a parameter storage node for executing the machine learning model; storing the learning parameters in the parameter storage node; and sending the intermediate representation to the computing node for executing the machine learning model with the stored learning parameters.
    Type: Grant
    Filed: May 20, 2019
    Date of Patent: August 30, 2022
    Assignee: EMC IP Holding Company LLC
    Inventors: Jinpeng Liu, Pengfei Wu, Junping Zhao, Kun Wang
  • Patent number: 11429836
    Abstract: Disclosed is an apparatus for performing a convolution operation in a convolutional neural network. The apparatus may comprise a selector for selecting one or more nonzero elements of a weight parameter, a selector for selecting a data item(s) corresponding to selected nonzero elements in input feature data, and a calculator unit for performing an operation. The apparatus may realize the convolution operation in a sparsified convolutional neural network efficiently through the hardware.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: August 30, 2022
    Inventors: Chang Huang, Liang Chen, Heng Luo, Kun Ling, Honghe Tan
  • Patent number: 11416712
    Abstract: A computing device generates synthetic tabular data.
    Type: Grant
    Filed: December 23, 2021
    Date of Patent: August 16, 2022
    Assignee: SAS Institute, Inc.
    Inventors: Amirhassan Fallah Dizche, Ye Liu, Xin Jiang Hunt, Jorge Manuel Gomes da Silva
  • Patent number: 11410014
    Abstract: In one embodiment, a computing device includes an input sensor providing an input data; a programmable logic device (PLD) implementing a convolutional neural network (CNN), wherein: each compute block of the PLD corresponds to one of a multiple of convolutional layers of the CNN, each compute block of the PLD is placed in proximity to at least two memory blocks, a first one of the memory blocks serves as a buffer for the corresponding layer of the CNN, and a second one of the memory blocks stores model-specific parameters for the corresponding layer of the CNN.
    Type: Grant
    Filed: February 11, 2019
    Date of Patent: August 9, 2022
    Assignee: Apple Inc.
    Inventors: Saman Naderiparizi, Mohammad Rastegari, Sayyed Karen Khatamifard
  • Patent number: 11410086
    Abstract: A method for controlling a physical process includes receiving an input dataset corresponding to the physical process. The method further includes determining a data model based on the input dataset. The data model includes a plurality of latent space variables of a machine learning model. The method also includes receiving a plurality of reference models corresponding to a plurality of classes. Each of the plurality of reference models includes a corresponding plurality of latent space variables. The method includes comparing the data model with each of the plurality of reference models to generate a plurality of distance metric values. The method further includes selecting a reference model among the plurality of reference models based on the plurality of distance metric values. The method also includes controlling the physical process based on the selected reference model.
    Type: Grant
    Filed: February 22, 2019
    Date of Patent: August 9, 2022
    Inventors: Arathi Sreekumari, Radhika Madhavan, Suresh Emmanuel Joel, Hariharan Ravishankar