Patents Examined by Daniel T Pellett
  • Patent number: 11170291
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for computing a layer output for a convolutional neural network layer, the method comprising: receiving a plurality of activation inputs; forming a plurality of vector inputs from the plurality of activation inputs, each vector input comprising values from a distinct region within the multi-dimensional matrix; sending the plurality of vector inputs to one or more cells along a first dimension of the systolic array; generating a plurality of rotated kernel structures from each of the plurality of kernel; sending each kernel structure and each rotated kernel structure to one or more cells along a second dimension of the systolic array; causing the systolic array to generate an accumulated output based on the plurality of value inputs and the plurality of kernels; and generating the layer output from the accumulated output.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: November 9, 2021
    Assignee: Google LLC
    Inventors: Jonathan Ross, Gregory Michael Thorson
  • Patent number: 11151471
    Abstract: An approach is provided for providing predictive classification of actionable network alerts. The approach includes receiving the plurality of alerts. Each alert of the plurality of alerts indicates an alarm condition occurring at a monitored network system, and is a data record comprising one or more data fields describing the alarm condition. The approach also includes classifying said each alert using a predictive machine learning model. The predictive machine learning model is trained to classify said each alert as actionable or non-actionable using the one or more data fields of said each alert as one or more respective classification features, and to calculate a respective probability that said each alert is actionable or non-actionable. The approach further includes presenting the plurality of alerts in a network monitoring user interface based on the respective probability of said each alert.
    Type: Grant
    Filed: November 30, 2016
    Date of Patent: October 19, 2021
    Assignee: HERE Global B.V.
    Inventors: Mauri Niininen, David Abrahams, James Thoennes, Anandbabu Chakrapani
  • Patent number: 11151467
    Abstract: A system, method, and computer program product are provided for generating intelligent automated adaptive decisions. In operation, a system receives a request to generate a prediction associated with a business problem for a customer. The system identifies a customer segment from a plurality of customer segments to which the new customer is most closely associated. Additionally, the system identifies a statistical model associated with the customer segment. Moreover, the system selects a best prediction from a competing set of machine learning models and the statistical model, utilizing a multi arm bandit arbitrator applying a multi arm bandit technique to solve the business problem.
    Type: Grant
    Filed: November 8, 2017
    Date of Patent: October 19, 2021
    Assignee: AMDOCS DEVELOPMENT LIMITED
    Inventors: Moshe Yechiel Shtein, Gilad Barkan, Pinchas Faran
  • Patent number: 11144836
    Abstract: The present disclosure relates to processing support data to increase a self-support knowledge base. In some embodiments, assisted support data is received comprising a record of an interaction between a user and a support professional. In certain embodiments, a support data set is extracted from the assisted support data. In some embodiments, feedback related to the support data set is received. The feedback may include an indication that the support data set is ready to be included in the self-support knowledge base. In some embodiments, upon determining, based on the feedback, that the support data set is ready to be used for self-support, the support data set is added to the self-support knowledge base. The self-support knowledge base may be accessible by a plurality of users.
    Type: Grant
    Filed: April 17, 2017
    Date of Patent: October 12, 2021
    Assignee: INTUIT INC.
    Inventors: Igor A. Podgorny, Benjamin Indyk, Matthew Cannon, Chris Gielow
  • Patent number: 11132601
    Abstract: In an example, an apparatus comprises a plurality of execution units comprising and logic, at least partially including hardware logic, to receive a plurality of data inputs for training a neural network, wherein the data inputs comprise training data and weights inputs; represent the data inputs in a first form; and represent the weight inputs in a second form. Other embodiments are also disclosed and claimed.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: September 28, 2021
    Assignee: INTEL CORPORATION
    Inventors: Lev Faivishevsky, Tomer Bar-On, Yaniv Fais, Jacob Subag, Jeremie Dreyfuss, Amit Bleiweiss, Tomer Schwartz
  • Patent number: 11126911
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for organizing trained and untrained neural networks. In one aspect, a neural network device includes a collection of node assemblies interconnected by between-assembly links, each node assembly itself comprising a network of nodes interconnected by a plurality of within-assembly links, wherein each of the between-assembly links and the within-assembly links have an associated weight, each weight embodying a strength of connection between the nodes joined by the associated link, the nodes within each assembly being more likely to be connected to other nodes within that assembly than to be connected to nodes within others of the node assemblies.
    Type: Grant
    Filed: August 1, 2019
    Date of Patent: September 21, 2021
    Assignee: Ecole Polytechnique Federale De Lausanne (EPFL)
    Inventors: Henry Markram, Rodrigo de Campos Perin, Thomas K. Berger
  • Patent number: 11120344
    Abstract: In various embodiments, a natural language (NL) application implements functionality that enables users to more effectively access various data storage systems based on NL requests. As described, the operations of the NL application are guided by, at least in part, on one or more templates and/or machine-learning models. Advantageously, the templates and/or machine-learning models provide a flexible framework that may be readily tailored to reduce the amount of time and user effort associated with processing NL requests and to increase the overall accuracy of NL application implementations.
    Type: Grant
    Filed: July 29, 2017
    Date of Patent: September 14, 2021
    Assignee: SPLUNK INC.
    Inventors: Dipock Das, Dayanand Pochugari, Neeraj Verma, Nikesh Padakanti, Aungon Nag Radon, Anand Srinivasabagavathar, Adam Oliner
  • Patent number: 11111425
    Abstract: Methods may include defining operational parameters for an initial composition design; generating an initial composition design from the defined operational parameters; predicting the performance of the initial composition design using a statistical model; comparing the performance of the initial composition design with the operational parameters; optimizing the initial composition design according to the defined operational parameters; and outputting a final composition design. Methods may also include defining operational parameters for an initial composition design for a wellbore fluid; generating an initial composition design from the defined operational parameters; predicting the performance of the initial composition design using a statistical model; comparing the performance of the initial composition design with the operational parameters; optimizing the initial composition design according to the defined operational parameters; and outputting a final composition design.
    Type: Grant
    Filed: June 20, 2016
    Date of Patent: September 7, 2021
    Assignee: Schlumberger Technology Corporation
    Inventors: Bhanu Kaushik, Samir Menasria
  • Patent number: 11106980
    Abstract: Embodiments herein implement quantum annealing with a driver Hamiltonian that uses oscillating fields to advantageously obtain a quantum speedup over classical computing techniques. For a many-body quantum system formed with qubits, the oscillating fields drive the qubits so as to independently modulate the magnitudes and/or directions of transverse terms of the driver Hamiltonian. In particular, embodiments provide a quantum speedup for two types of first-order phase transitions: the paramagnet-to-spin-glass transition, and transitions between distinct “bit string” states. The resulting speedup is robust against energy fluctuations (e.g., 1/f noise), in contrast to other strategies like variable-rate annealing. Each oscillating field may be an oscillating electric field or magnetic field. The oscillating fields can be implemented with superconducting flux qubits by coupling oscillating fluxes and/or voltages to the flux qubits.
    Type: Grant
    Filed: October 25, 2018
    Date of Patent: August 31, 2021
    Assignee: THE ADMINISTRATORS OF THE TULANE EDUCATIONAL FUND
    Inventor: Eliot Kapit
  • Patent number: 11100393
    Abstract: In an example, an apparatus comprises a plurality of execution units comprising and logic, at least partially including hardware logic, to receive a plurality of data inputs for training a neural network, wherein the data inputs comprise training data and weights inputs; represent the data inputs in a first form; and represent the weight inputs in a second form. Other embodiments are also disclosed and claimed.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: August 24, 2021
    Assignee: INTEL CORPORATION
    Inventors: Lev Faivishevsky, Tomer Bar-On, Yaniv Fais, Jacob Subag, Jeremie Dreyfuss, Amit Bleiweiss, Tomer Schwartz
  • Patent number: 11087209
    Abstract: Systems and methods for using collecting and analyzing device sensor data to determine whether an individual is an operator or a passenger of a vehicle are disclosed. According to certain aspects, an electronic device associated with the individual may collect or access sensor data that is indicative of or associated with an operation of the vehicle. The electronic device may transmit pertinent portion(s) of the sensor data to a backend server, which may input the portion(s) into a neural network for analysis. The neural network may output a probability metric(s) indicative of whether the individual is a passenger or an operator of the vehicle.
    Type: Grant
    Filed: July 21, 2017
    Date of Patent: August 10, 2021
    Assignee: BlueOwl, LLC
    Inventors: Vinay Kumar, Kenneth J. Sanchez
  • Patent number: 11087228
    Abstract: A generic online, probabilistic, approximate computational inference model for learning-based data processing is presented. The model includes detection, feature production and classification steps. It employs Bayesian Probabilistic Models (BPMs) to characterize complex real-world behaviors under uncertainty. The BPM learning is incremental. Online learning enables BPM adaptation to new data. The available data drives BPM complexity (e.g., number of states) accommodating spatial and temporal ambiguities, occlusions, environmental clutter, and large inter-domain data variability. Generic Sequential Bayesian Inference (GSBI) efficiently operates over BPMs to process streaming or forensic data. Deep Belief Networks (DBNs) learn feature representations from data. Examples include model applications for streaming imagery (e.g., video) and automatic target recognition (ATR).
    Type: Grant
    Filed: August 12, 2016
    Date of Patent: August 10, 2021
    Assignee: BAE Systems Information and Electronic Systems Integration Inc.
    Inventors: Denis Garagic, Bradley J Rhodes
  • Patent number: 11087227
    Abstract: Detecting patterns and sequences associated with an anomaly in predictions made a predictive system. The predictive system makes predictions by learning spatial patterns and temporal sequences in an input data that change over time. As the input data is received, the predictive system generates a series of predictions based on the input data. Each prediction is compared with corresponding actual value or state. If the prediction does not match or deviates significantly from the actual value or state, an anomaly is identified for further analysis. A corresponding state or a series of states of the predictive system before or at the time of prediction are associated with the anomaly and stored. The anomaly can be detected by monitoring whether the predictive system is placed in the state or states that is the same or similar to the stored state or states.
    Type: Grant
    Filed: July 14, 2016
    Date of Patent: August 10, 2021
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Rahul Agarwal
  • Patent number: 11086918
    Abstract: A method for performing multi-label classification includes extracting a feature vector from an input vector including input data by a feature extractor, determining, by a label predictor, a relevant vector including relevant labels having relevant scores based on the feature vector, updating a binary masking vector by masking pre-selected labels having been selected in previous label selections, applying the updated binary masking vector to the relevant vector such that the relevant label vector is updated to exclude the pre-selected labels from the relevant labels, and selecting a relevant label from the updated relevant label vector based on the relevant scores of the updated relevant label vector.
    Type: Grant
    Filed: December 7, 2016
    Date of Patent: August 10, 2021
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Takaaki Hori, Chiori Hori, Shinji Watanabe, John Hershey, Bret Harsham, Jonathan Le Roux
  • Patent number: 11080618
    Abstract: Systems and methods for augmenting incomplete training dataset for use in a machine learning system are described herein. In an embodiment, a server computer receives a plurality of input training datasets including one or more incomplete input training datasets and one or more complete datasets which contain one or more failure training datasets, the incomplete input training datasets comprising a plurality of parameters. Using the one or more failure training datasets, the server computer generates temporal failure data describing a likelihood of failure of an item as a function of time. Using the one or more complete training datasets, the server computer generates parameter specific likelihoods of failure of an item. The server computer augments the one or more incomplete input training datasets using the temporal failure data and/or the parameter specific likelihoods of failure to create one or more augmented training datasets.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: August 3, 2021
    Assignee: Upstart Network, Inc.
    Inventors: Brandon Ray Kam, Viraj Navkal, Grant Schneider, Paul Gu, Alec M. Zimmer
  • Patent number: 11068625
    Abstract: A system for generating digital models of nitrogen availability based on field data, weather forecast data, and models of water flow, temperature, and crop uptake of nitrogen and water is provided. In an embodiment, field data and forecast data are received by an agricultural intelligence computing system. Based on the received data, the agricultural intelligence computing system models changes in temperature of different soil layers, moisture content of different soil layers, and loss of nitrogen and water to the soil through crop uptake, leaching, denitrification, volatilization, and evapotranspiration. The agricultural intelligence computing system creates a digital model of nitrogen availability based on the temperature, moisture content, and loss models.
    Type: Grant
    Filed: November 14, 2016
    Date of Patent: July 20, 2021
    Assignee: THE CLIMATE CORPORATION
    Inventors: John Gates, Steven De Gryze
  • Patent number: 11062219
    Abstract: A computer solves a nonlinear optimization problem. An optimality check is performed for a current solution to an objective function that is a nonlinear equation with constraint functions on decision variables. When the performed optimality check indicates that the current solution is not an optimal solution, a barrier parameter value is updated, and a Lagrange multiplier value is updated for each constraint function based on a result of a complementarity slackness test. The current solution to the objective function is updated using a search direction vector determined by solving a primal-dual linear system that includes a dual variable for each constraint function and a step length value determined for each decision variable and for each dual variable. The operations are repeated until the optimality check indicates that the current solution is the optimal solution or a predefined number of iterations has been performed.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: July 13, 2021
    Assignee: SAS Institute Inc.
    Inventors: Joshua David Griffin, Riadh Omheni, Yan Xu
  • Patent number: 11049008
    Abstract: We describe a method of reinforcement learning for a subject system having multiple states and actions to move from one state to the next. Training data is generated by operating on the system with a succession of actions and used to train a second neural network. Target values for training the second neural network are derived from a first neural network which is generated by copying weights of the second neural network at intervals.
    Type: Grant
    Filed: June 9, 2017
    Date of Patent: June 29, 2021
    Assignee: DeepMind Technologies Limited
    Inventors: Volodymyr Mnih, Koray Kavukcuoglu
  • Patent number: 11042797
    Abstract: According to exemplary embodiments, a method, processor, and system for accelerating a recurrent neural network are presented. A method of accelerating a recurrent neural network may include distributing from a first master core to each of a plurality of processing cores a same relative one or more columns of weight matrix data for each of a plurality of gates in the neural network, broadcasting a current input vector from the first master core to each of the processing cores, and processing each column of weight matrix data in parallel, at each of the respective processing cores.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: June 22, 2021
    Assignee: SIMPLEMACHINES INC.
    Inventors: Karthikeyan Sankaralingam, Yunfeng Li, Vinay Gangadhar, Anthony Nowatzki
  • Patent number: 11033238
    Abstract: A system for guiding and evaluating physical positioning, orientation and motion of the human body, comprising: a cloud computing-based subsystem including an artificial neural network and spatial position analyzer said cloud computing-based subsystem adapted for data storage, management and analysis; at least one motion sensing device wearable on the human body, said at least one motion sensing device adapted to detect changes in at least one of spatial position, orientation, and rate of motion; a mobile subsystem running an application program (app) that controls said at least one motion sensing device, said mobile subsystem adapted to capture activity data quantifying said changes in at least one of spatial position, orientation, and rate of motion, said mobile subsystem further adapted to transfer said activity data to said cloud computing-based subsystem, wherein said cloud computing-based subsystem processes, stores, and analyzes said activity data.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: June 15, 2021
    Assignee: University of Central Oklahoma
    Inventors: Jicheng Fu, Maurice Haff