Patents Examined by Benjamin P. Geib
  • Patent number: 11270199
    Abstract: The present invention concerns a method of programming an analogue electronic neural network comprising a plurality of layers of somas. Any two consecutive layers of somas are connected by a matrix of synapses. The method comprises: applying test signals to inputs of the neural network; measuring at a plurality of measurement locations in the neural network responses of at least some somas and synapses to the test signals; extracting from the neural network, based on the responses, a first parameter set characterising the behaviour of the at least some somas; carrying out a training of the neural network by applying to a training algorithm the first parameter set and training data for obtaining a second parameter set; and programming the neural network by using the second parameter set. The invention also relates to the neural network and to a method of operating it.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: March 8, 2022
    Assignee: UNIVERSITÄT ZÜRICH
    Inventors: Jonathan Jakob Moses Binas, Daniel Lawrence Neil
  • Patent number: 11263522
    Abstract: Systems and methods are provided for reducing power in in-memory computing, matrix-vector computations, and neural networks. An apparatus for in-memory computing using charge-domain circuit operation includes transistors configured as memory bit cells, transistors configured to perform in-memory computing using the memory bit cells, capacitors configured to store a result of in-memory computing from the memory bit cells, and switches, wherein, based on a setting of each of the switches, the charges on at least a portion of the plurality of capacitors are shorted together. Shorting together the plurality of capacitors yields a computation result.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: March 1, 2022
    Assignee: Analog Devices, Inc.
    Inventors: Eric G. Nestler, Naveen Verma, Hossein Valavi
  • Patent number: 11263529
    Abstract: Methods, systems, and apparatus for updating machine learning models to improve locality are described. In one aspect, a method includes receiving data of a machine learning model. The data represents operations of the machine learning model and data dependencies between the operations. Data specifying characteristics of a memory hierarchy for a machine learning processor on which the machine learning model is going to be deployed is received. The memory hierarchy includes multiple memories at multiple memory levels for storing machine learning data used by the machine learning processor when performing machine learning computations using the machine learning model. An updated machine learning model is generated by modifying the operations and control dependencies of the machine learning model to account for the characteristics of the memory hierarchy. Machine learning computations are performed using the updated machine learning model.
    Type: Grant
    Filed: October 10, 2018
    Date of Patent: March 1, 2022
    Assignee: Google LLC
    Inventors: Doe Hyun Yoon, Nishant Patil, Norman Paul Jouppi
  • Patent number: 11257172
    Abstract: A method, computer program product, and system includes a processor(s) obtaining real time data related to an agricultural site by continuously monitoring remote data collection entities at the agricultural site, which include satellites, ground monitoring stations, and sensors. The processor(s) determine which data of the real time data can be utilized in subsequent decisions and accumulate a portion of the real time data in a data store, based on a timestamp of the portion indicating that the portion of the real time data is no longer current and is historical data. Based on obtaining a request for a recommendation, the processor(s) generate based on a cognitive analysis of the historical data, the real time data that can be utilized, and the agricultural data from the controlled environment, at least one agricultural model. The processor(s) determine the recommendation from the model and transmit the recommendation to the client.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: February 22, 2022
    Assignee: International Business Machines Corporation
    Inventors: Michael Bender, Gautam K. Bhat, Rhonda L. Childress, Nalini Muthurajan
  • Patent number: 11250309
    Abstract: An integrated artificial neuron device includes an input signal node, an output signal node and a reference supply node. An integrator circuit receives and integrates an input signal to produce an integrated signal. A generator circuit receives the integrated signal and, when the integrated signal exceeds a threshold, delivers the output signal. The integrator circuit includes a main capacitor coupled between the input signal node and the reference supply node. The generator circuit includes a main MOS transistor coupled between the input signal node and the output signal node. The main MOS transistor has a gate that is coupled to the output signal node, and a substrate that is mutually coupled to the gate.
    Type: Grant
    Filed: September 1, 2017
    Date of Patent: February 15, 2022
    Assignee: STMicroelectronics SA
    Inventors: Philippe Galy, Thomas Bedecarrats
  • Patent number: 11250319
    Abstract: Disclosed herein are techniques for classifying data with a data processing circuit. In one embodiment, the data processing circuit includes a probabilistic circuit configurable to generate a decision at a pre-determined probability, and an output generation circuit including an output node and configured to receive input data and a weight, and generate output data at the output node for approximating a product of the input data and the weight. The generation of the output data includes propagating the weight to the output node according a first decision of the probabilistic circuit. The probabilistic circuit is configured to generate the first decision at a probability determined based on the input data.
    Type: Grant
    Filed: September 25, 2017
    Date of Patent: February 15, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Randy Huang, Ron Diamant
  • Patent number: 11227211
    Abstract: A neuromorphic device is provided. The neuromorphic device may include a plurality of pre-synaptic neuron circuits, a plurality of post-synaptic neuron circuits, and a plurality of synapses. Each of the synapses may be electrically connected to the plurality of pre-synaptic neuron circuits and a corresponding one of the plurality of post-synaptic neuron circuits. Each of the plurality of synapses may include a plurality of synapse cells. Each of the synapse cells may be electrically connected to a corresponding one of the plurality of pre-synaptic neuron circuits through a corresponding one of a plurality of row lines, respectively. Each of the synapse cells may be electrically connected to the corresponding one of the plurality of post-synaptic neuron circuits through one common column line.
    Type: Grant
    Filed: September 26, 2017
    Date of Patent: January 18, 2022
    Assignee: SK hynix Inc.
    Inventor: Hyung-Dong Lee
  • Patent number: 11216723
    Abstract: Disclosed herein is a neuromorphic integrated circuit, including in many embodiments, a neural network disposed in a multiplier array in a memory sector of the integrated circuit, and a plurality of multipliers of the multiplier array, a multiplier thereof including at least one transistor-based cell configured to store a synaptic weight of the neural network, an input configured to accept digital input pulses for the multiplier, an output configured to provide digital output pulses of the multiplier, and a charge integrator, where the charge integrator is configured to integrate a current associated with an input pulse of the input pulses over an input pulse width thereof, and where the multiplier is configured to provide an output pulse of the output pulses with an output pulse width proportional to the input pulse width.
    Type: Grant
    Filed: August 10, 2018
    Date of Patent: January 4, 2022
    Assignee: SYNTIANT
    Inventors: Kurt F. Busch, Jeremiah H. Holleman, III, Pieter Vorenkamp, Stephen W. Bailey
  • Patent number: 11210613
    Abstract: Embodiments of the present invention are directed to a computer-implemented machine-learning method and system for automatically creating and updating tasks by reading signals from external data sources and understanding what users are doing. Embodiments of the present invention are directed to a computer-implemented machine-learning method and system for automatically completing tasks by reading signals from external sources and understanding when an existing task has been executed. Tasks created are representable and explainable in a human readable format that can be shown to users and used to automatically fill productivity applications including but not limited to task managers, to-do lists, project management, time trackers, and daily planners. Tasks created are representable in a way that can be interpreted by a machine such as a computer system or an artificial intelligence so that external systems can be delegated or connected to the system.
    Type: Grant
    Filed: August 25, 2017
    Date of Patent: December 28, 2021
    Assignee: DIALPAD UK LIMITED
    Inventors: Michele Sama, Arseni Anisimovich, Tim Porter, Theodosia Togia, James Hammerton
  • Patent number: 11205125
    Abstract: Mapping of logical neural cores to physical neural cores is provided. In various embodiments, a neural network description describing a plurality of logical cores is read. A plurality of precedence relationships is determined among the plurality of logical cores. Based on the plurality of precedence relationships, a directed acyclic graph among the plurality of logical cores is generated. By breadth first search of the directed acyclic graph, a schedule is generated. The schedule maps each of the plurality of logical cores to one of a plurality of physical cores at one of a plurality of time slices. Execution of the schedule is simulated.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: December 21, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Pallab Datta, Dharmendra S. Modha
  • Patent number: 11182676
    Abstract: Deep reinforcement learning of cooperative neural networks can be performed by obtaining an action and observation sequence including a plurality of time frames, each time frame including action values and observation values. At least some of the observation values of each time frame of the action and observation sequence can be input sequentially into a first neural network including a plurality of first parameters. The action values of each time frame of the action and observation sequence and output values from the first neural network corresponding to the at least some of the observation values of each time frame of the action and observation sequence can be input sequentially into a second neural network including a plurality of second parameters. An action-value function can be approximated using the second neural network, and the plurality of first parameters of the first neural network can be updated using backpropagation.
    Type: Grant
    Filed: August 4, 2017
    Date of Patent: November 23, 2021
    Assignee: International Business Machines Corporation
    Inventors: Sakyasingha Dasgupta, Takayuki Osogami
  • Patent number: 11176447
    Abstract: A deep neural network models semiconductor devices. Measurements of test transistors are gathered into training data including gate and drain voltages and transistor width and length, and target data such as the drain current measured under the input conditions. The training data is converted by an input pre-processor that can apply logarithms of the inputs or perform a Principal Component Analysis (PCA). Rather than use measured drain current as the target when training the deep neural network, a target transformer transforms the drain current into a transformed drain current, such as a derivative of the drain current with respect to gate or drain voltages, or a logarithm of the derivative. Weights in the deep neural network are adjusted during training by comparing the deep neural network's output to the transformed drain current and generating a loss function that is minimized over the training data.
    Type: Grant
    Filed: June 19, 2018
    Date of Patent: November 16, 2021
    Assignee: Hong Kong Applied Science and Technology Research Institute Company Limited
    Inventors: Yuan Lei, Xiao Huo
  • Patent number: 11170295
    Abstract: Systems and methods for training a personalized Machine Learning (ML) model used to detect fall events are described herein. The methods may be implemented by one or more computing devices and may include obtaining sensor data associated with one or more activities of a user. A processed or unprocessed version of at least a copy of the sensor data having been fed to a personalized ML model associated with the user and that has been determined not to be associated with a fall event; and using the obtained sensor data training the personalized ML model.
    Type: Grant
    Filed: September 19, 2017
    Date of Patent: November 9, 2021
    Assignee: Tidyware, LLC
    Inventors: Philip F Carmichael, Brian Hayward, Alvin G Solidum, Travis T Okahara, William L Richman, Raman Chandrasekar, Patrick Dean Kennedy, Ray Sun
  • Patent number: 11169799
    Abstract: One embodiment provides for a graphics processing unit to accelerate machine-learning operations, the graphics processing unit comprising a multiprocessor having a single instruction, multiple thread (SIMT) architecture, the multiprocessor to execute at least one single instruction; and a first compute unit included within the multiprocessor, the at least one single instruction to cause the first compute unit to perform a two-dimensional matrix multiply and accumulate operation, wherein to perform the two-dimensional matrix multiply and accumulate operation includes to compute a 32-bit intermediate product of 16-bit operands and to compute a 32-bit sum based on the 32-bit intermediate product.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: November 9, 2021
    Assignee: Intel Corporation
    Inventors: Himanshu Kaul, Mark A. Anders, Sanu K. Mathew, Anbang Yao, Joydeep Ray, Ping T. Tang, Michael S. Strickland, Xiaoming Chen, Tatiana Shpeisman, Abhishek R. Appu, Altug Koker, Kamal Sinha, Balaji Vembu, Nicolas C. Galoppo Von Borries, Eriko Nurvitadhi, Rajkishore Barik, Tsung-Han Lin, Vasanth Ranganathan, Sanjeev Jahagirdar
  • Patent number: 11170285
    Abstract: A system is described that determines, based on information associated with a user of a computing device, an event for initiating an interaction between the user and an assistant executing at the computing device. The system selects, based on the event and from a plurality of actions performed by the assistant, at least one action associated with the event. The system determines, based on the at least one action, whether to output a notification of the event which includes an indication of the event and a request to perform the at least one action associated with the event. Responsive to determining to output the notification of the event, the system sends, to the assistant, the notification of the event for output during the interaction between the user and the assistant.
    Type: Grant
    Filed: May 5, 2017
    Date of Patent: November 9, 2021
    Assignee: GOOGLE LLC
    Inventor: Vikram Aggarwal
  • Patent number: 11170288
    Abstract: Systems, methods, and non-transitory computer readable media can determine a representation of an advertisement based on a first machine learning model. The representation can be provided to a second machine learning model. One or more qualitative ratings associated with the advertisement can be determined based on the second machine learning model.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: November 9, 2021
    Assignee: Facebook, Inc.
    Inventors: Alexander Peysakhovich, Michael Randolph Corey, Neha Bhargava, Hannah Siow Pavalow
  • Patent number: 11164075
    Abstract: Aspects of the disclosure provide an information processing apparatus that includes interface circuitry and processing circuitry. The interface circuitry is configured to obtain a text authored by a person. The processing circuitry is configured to analyze the text to obtain measurements of language features of the person, input the measurements of the language features into an evaluation model that is trained to predict a score as a function of the language features, determine a specific score for the person based on the evaluation model and output the specific score of the person for predicting a behavior of the person.
    Type: Grant
    Filed: October 9, 2017
    Date of Patent: November 2, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Hongzhi Liu, Jie Jiang, Juhong Wang, Gang Guan, Zhonghai Wu, Xing Zhang
  • Patent number: 11163747
    Abstract: Time series data is generated and forecasted with a selected forecasting mechanism. Time series data to forecast including a plurality of data points is received. A count of the plurality of data points is determined to meet a threshold. Responsive to that determination, a plurality of test forecasts are generated with respective forecasting mechanisms of a plurality of forecasting mechanisms using a first subset of the plurality of data points. Errors are then determined for the respective forecasting mechanisms, such as based on comparisons of corresponding ones of the plurality of test forecasts and a second subset of the plurality of data points. One of the plurality of forecasting mechanisms is selected based on the errors. An output forecast is then generated with the selected forecasting mechanism using the first and second subsets of the plurality of data points.
    Type: Grant
    Filed: May 5, 2017
    Date of Patent: November 2, 2021
    Assignee: ServiceNow, Inc.
    Inventors: Shayan Shahand, Aida Rikovic Tabak, Robert Ninness, Abhijith Thette Nagarajan, Prabhakaran Subramani Thandayuthapani
  • Patent number: 11157804
    Abstract: A superconducting neuromorphic pipelined processor core can be used to build neural networks in hardware by providing the functionality of somas, axons, dendrites and synaptic connections. Each instance of the superconducting neuromorphic pipelined processor core can implement a programmable and scalable model of one or more biological neurons in superconducting hardware that is more efficient and biologically suggestive than existing designs. This core can be used to build a wide variety of large-scale neural networks in hardware. The biologically suggestive operation of the neuron core provides additional capabilities to the network that are difficult to implement in software-based neural networks and would be impractical using room-temperature semiconductor electronics. The superconductive electronics that make up the core enable it to perform more operations per second per watt than is possible in comparable state-of-the-art semiconductor-based designs.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: October 26, 2021
    Assignee: NORTHROP GRUMMAN SYSTEMS CORPORATION
    Inventor: Paul Kenton Tschirhart
  • Patent number: 11151457
    Abstract: A method of generating predictor rules using a genetic algorithm for predicting at least one target event associated with a given entity, the entity having a combination of an entity type and one or more attributes. The method comprises partitioning records data into a model generation set and a model testing set. A first generation of predictor rules is determined using the records in the model generation set, and subsequent generations are constructed by iteratively identifying a first subset of predictor rules based on a precision measure of each predictor rule and identifying a second subset of predictor rules based on a recall measure of each predictor rule and generating the subsequent generation by OR combining the predictor rules of the first subset and by AND combining the predictor rules of the second subset. Construction of the predictor rule population is terminated in response to a termination criteria being met.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: October 19, 2021
    Assignee: Castlight Health, Inc.
    Inventors: Soubhik Dawn, Ted Studley