Analog Neural Network Patents (Class 706/38)
  • Patent number: 11915747
    Abstract: Numerous examples for performing tuning of a page or a word of non-volatile memory cells in an analog neural memory are disclosed. In one example, an analog neural memory system comprises an array of non-volatile memory cells arranged into rows and columns, each non-volatile memory cell comprising a word line terminal, a bit line terminal, and an erase gate terminal; a plurality of word lines, each word line coupled to word line terminals of a row of non-volatile memory cells; a plurality of bit lines, each bit line coupled to bit line terminals of a column of non-volatile memory cells; and a plurality of erase gate enable transistors, each erase gate enable transistor coupled to erase gate terminals of a word of non-volatile memory cells.
    Type: Grant
    Filed: July 1, 2022
    Date of Patent: February 27, 2024
    Assignee: SILICON STORAGE TECHNOLOGY, INC.
    Inventors: Hieu Van Tran, Thuan Vu, Stephen Trinh, Stanley Hong, Anh Ly, Steven Lemke, Vipin Tiwari, Nhan Do
  • Patent number: 11803742
    Abstract: The present disclosure relates to a neuron for an artificial neural network. The neuron includes: a first dot product engine operative to: receive a first set of weights; receive a set of inputs; and calculate the dot product of the set of inputs and the first set of weights to generate a first dot product engine output. The neuron further includes a second dot product engine operative to: receive a second set of weights; receive an input based on the first dot product engine output; and generate a second dot product engine output based on the product of the first dot product engine output and a weight of the second set of weights. The neuron further includes an activation function module arranged to generate a neuron output based on the second dot product engine output. The first dot product engine and the second dot product engine are structurally or functionally different.
    Type: Grant
    Filed: November 18, 2022
    Date of Patent: October 31, 2023
    Assignee: Cirrus Logic Inc.
    Inventor: John Paul Lesso
  • Patent number: 11756565
    Abstract: An all-analog natural language processing system is provided. Analog audio input is processed directly by an all-analog signal pathway wherein the audio activity detection, voice activity detection, feature extraction and neural network processing are all performed in the analog domain. Audio/voice detection and feature extraction is performed by a bandpass filter bank having a plurality of individual bandpass filters. Each bandpass filter includes an array of individual capacitively coupled current conveyor second order sections having a charge-trap transistor as a programmable element for tuning the passband of the filter. Compared to typical digital systems for natural language processing, the present all-analog system can perform natural language processing with comparable accuracy but greatly reduced energy consumption of up to two orders of magnitude less.
    Type: Grant
    Filed: January 25, 2023
    Date of Patent: September 12, 2023
    Assignee: blumind Inc.
    Inventors: John Gosson, Roger Levinson, Niraj Mathur
  • Patent number: 11636321
    Abstract: There is provided with a data processing apparatus that carries out a computation corresponding to a neural network containing a plurality of layers. A processing unit includes a plurality of processors that, through pipeline processing, sequentially calculate data of each of blocks, each block corresponding to a part of a feature plane in one layer. A control unit determines a calculation order for the data of the blocks on the basis of structure information of the neural network, and sends a command that controls the calculation order to the plurality of processors.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: April 25, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masahiro Ariizumi
  • Patent number: 11604977
    Abstract: This application relates to computing circuitry (200), in particular for analogue computing circuitry suitable for neuromorphic computing. The circuitry (200) has a plurality of memory cells (201), each memory cell having an input electrode (201) for receiving a cell input signal and an output (203P, 203N) for outputting a cell output signal (IP, IN), with first and second paths connecting the input electrode to the output. The cell output signal thus depends on a differential current between the first and second paths due to the cell input signal. Each memory cell also comprises at least one programmable-resistance memory element (204) in each of the first and second paths and is controllable, by selective programming of the programmable-resistance memory elements, to store a data digit that can take any of at least three different values.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: March 14, 2023
    Assignee: Cirrus Logic, Inc.
    Inventors: John Paul Lesso, John Laurence Pennock
  • Patent number: 11574188
    Abstract: There is provided with a data processing apparatus. An acquisition unit acquires feature plane data of a layer included in a neural network. A control unit outputs a first control signal corresponding to the layer for controlling first compression processing and a second control signal corresponding to the layer for controlling second compression processing. A first compression unit performs the first compression processing corresponding to the first control signal on the feature plane data. A second compression unit performs the second compression processing corresponding to the second control signal on the feature plane data after the first compression processing. A type of processing of the second compression processing is different from the first compression processing.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: February 7, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Motoki Yoshinaga, Tsewei Chen, Masami Kato
  • Patent number: 11551075
    Abstract: The present disclosure relates to a neuron for an artificial neural network. The neuron includes: a first dot product engine operative to: receive a first set of weights; receive a set of inputs; and calculate the dot product of the set of inputs and the first set of weights to generate a first dot product engine output. The neuron further includes a second dot product engine operative to: receive a second set of weights; receive an input based on the first dot product engine output; and generate a second dot product engine output based on the product of the first dot product engine output and a weight of the second set of weights. The neuron further includes an activation function module arranged to generate a neuron output based on the second dot product engine output. The first dot product engine and the second dot product engine are structurally or functionally different.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: January 10, 2023
    Assignee: Cirrus Logic, Inc.
    Inventor: John Paul Lesso
  • Patent number: 11442695
    Abstract: A product-sum operation device includes a product operator, a sum operator, and a malfunction determiner. The product operator includes a plurality of product operation elements (10AA) to (10AC), and each of the plurality of product operation elements (10AA) to (10AC) is a resistance change element. The sum operator includes an output detector that detects the sum of outputs from the plurality of product operation elements (10AA) to (10AC). The malfunction determiner determines that a malfunction has occurred when the sum detected by the output detector exceeds a specified value. The specified value is a value equal to or greater than a maximum value of the sum that can be detected by the output detector when the plurality of product operation elements (10AA) to (10AC) all operate normally.
    Type: Grant
    Filed: December 12, 2018
    Date of Patent: September 13, 2022
    Assignee: TDK CORPORATION
    Inventor: Tatsuo Shibata
  • Patent number: 11308383
    Abstract: An artificial neural network device that utilizes one or more non-volatile memory arrays as the synapses. The synapses are configured to receive inputs and to generate therefrom outputs. Neurons are configured to receive the outputs. The synapses include a plurality of memory cells, wherein each of the memory cells includes spaced apart source and drain regions formed in a semiconductor substrate with a channel region extending there between, a floating gate disposed over and insulated from a first portion of the channel region and a non-floating gate disposed over and insulated from a second portion of the channel region. Each of the plurality of memory cells is configured to store a weight value corresponding to a number of electrons on the floating gate. The plurality of memory cells are configured to multiply the inputs by the stored weight values to generate the outputs.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: April 19, 2022
    Assignee: Silicon Storage Technology, Inc.
    Inventors: Farnood Merrikh Bayat, Xinjie Guo, Dmitri Strukov, Nhan Do, Hieu Van Tran, Vipin Tiwari, Mark Reiten
  • Patent number: 11270199
    Abstract: The present invention concerns a method of programming an analogue electronic neural network comprising a plurality of layers of somas. Any two consecutive layers of somas are connected by a matrix of synapses. The method comprises: applying test signals to inputs of the neural network; measuring at a plurality of measurement locations in the neural network responses of at least some somas and synapses to the test signals; extracting from the neural network, based on the responses, a first parameter set characterising the behaviour of the at least some somas; carrying out a training of the neural network by applying to a training algorithm the first parameter set and training data for obtaining a second parameter set; and programming the neural network by using the second parameter set. The invention also relates to the neural network and to a method of operating it.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: March 8, 2022
    Assignee: UNIVERSITÄT ZÜRICH
    Inventors: Jonathan Jakob Moses Binas, Daniel Lawrence Neil
  • Patent number: 11256330
    Abstract: A system and method for controlling a non-tactile device including a receiving device configured to receive signals corresponding to a user's brain waves or movements, the brain waves or movements corresponding to a series of directional intentions, the intentions defining at least one line pattern, a processor configured to process the at least one line pattern, each of said at least one line patterns associated with an action of the device, and output a control signal to the non-tactile device related to the action.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: February 22, 2022
    Assignee: NAQI LOGIX INC.
    Inventor: David Lee Segal
  • Patent number: 11140577
    Abstract: Facilitating energy-efficient wireless communications for advanced networks (e.g., 4G, 5G, and beyond) with low-resolution digital-to-analog converters is provided herein. Operations of a system can comprise determining first values. Respective values of the first values can be digital samples of transmission and reception chains determined based on symbols transformed from bits. The operations can also comprise facilitating a quantization of the first values resulting in second values. Facilitating the quantization can be based on a cost function associated with processing the first values. Further, the operations can comprise outputting the second values as a continuous time signal over antennas of a base station device. The second values can comprise fewer values than the first values.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: October 5, 2021
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Ralf Bendlin, Arunabha Ghosh, Aditya Chopra
  • Patent number: 10957309
    Abstract: A method and apparatus for training a recognition model and a recognition method and apparatus using the model are disclosed. The apparatus for training the model obtains an estimation hidden vector output from a hidden layer of the model in response to an estimation output vector output from the model at a previous time being input into the model at a current time, and trains the model such that the estimation hidden vector of the current time matches an answer hidden vector output from the hidden layer in response to an answer output vector, corresponding to the estimation output vector of the previous time, being input into the model at the current time.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: March 23, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Hwidong Na
  • Patent number: 10643125
    Abstract: Embodiments include methods and systems of neuron leaky integrate and fire circuit (NLIFC). Aspects include: receiving an input current having both AC component and DC component at an input terminal of the NLIFC, extracting AC component of input current, generating a number of swing voltages at a swing node using extracted AC component of the input current, transferring charge from a pull-up node to a neuron membrane potential (NP) node through an integration diode and a pull-up diode to raise a voltage at NP node over an integration capacitor gradually and the voltage at NP node shows integration value of AC component of input current, implementing leaky decay function of the neuron leaky integrate and fire circuit, detecting a timing of neuron fire using an analog comparator, resetting a neuron membrane potential level for a refractory period after neuron fire, and generating fire output signal of the NLIFC.
    Type: Grant
    Filed: March 3, 2016
    Date of Patent: May 5, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Mark B. Ritter, Takeo Yasuda
  • Patent number: 10592804
    Abstract: CNN based digital IC for AI contains a number of CNN processing units. Each CNN processing unit contains CNN logic circuits operatively coupling to a memory subsystem having first and second memories. The first memory includes an array of magnetic random access memory (RAM) cells for storing weights (e.g., filter coefficients) and the second memory contains SRAM for storing input signals (e.g., imagery data). The first memory may store one-time-programming weights. The memory subsystem may contain a third memory that contains magnetic RAM cells for storing one-time-programming data for security purpose. The magnetic RAM includes STT-RAM or OST-MRAM in SLC or MLC technology.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: March 17, 2020
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Chyu-Jiuh Torng, Lin Yang, Qi Dong
  • Patent number: 10552733
    Abstract: CNN (Cellular Neural Networks or Cellular Nonlinear Networks) based digital Integrated Circuit for artificial intelligence contains multiple CNN processing units. Each CNN processing unit contains CNN logic circuits operatively coupling to a memory subsystem having first and second memories. The first memory contains magnetic random access memory (MRAM) cells for storing weights (e.g., filter coefficients) while the second memory is for storing input signals (e.g., imagery data). The first memory may store one-time-programming weights. The memory subsystem may contain a third memory that contains MRAM cells for storing one-time-programming data for security purpose. The second memory contains MRAM cells or static random access memory cells. Each MRAM cell contains a Spin-Orbit-Torque (SOT) based magnetic tunnel junction (MTJ) element.
    Type: Grant
    Filed: October 10, 2017
    Date of Patent: February 4, 2020
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Chyu-Jiuh Torng, Daniel Liu
  • Patent number: 10545693
    Abstract: Embedded memory subsystems in a digital integrated circuit for artificial intelligence are disclosed. A semi-conductor substrate contains CNN processing units. Each CNN processing unit includes CNN logic circuits and an embedded memory subsystem. The memory subsystem includes first embedded memory and second embedded memory. The first embedded memory contains an array of MTJ STT-RAM cells with each cell has a circular planar area with a diameter in a range of 40-120 nm. The second embedded memory contains an array of MTJ STT-RAM cells with each cell has a circular planar area having a diameter in a range of 30-75 nm.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: January 28, 2020
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Chyu-Jiuh Torng, Lin Yang, Qi Dong
  • Patent number: 10546234
    Abstract: CNN based digital IC for AI contains a number of CNN processing units. A first CNN processing unit contains CNN logic circuits operatively coupling to a memory subsystem, which includes a first one-time-programming (OTP) memory for filter coefficients and a second memory for imagery data. A second CNN processing unit contains CNN logic circuits operatively coupling to a memory subsystem that includes a first memory for filter coefficients, a second memory for imagery data and a third OTP memory for unique data pattern (e.g., security purpose). Either STT-RAM or OST-MRAM can be configured as different memories of the memory subsystem.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: January 28, 2020
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Chyu-Jiuh Torng, Lin Yang, Qi Dong
  • Patent number: 10534996
    Abstract: CNN (Cellular Neural Networks or Cellular Nonlinear Networks) based digital Integrated Circuit for artificial intelligence contains multiple CNN processing units. Each CNN processing unit contains CNN logic circuits operatively coupling to a memory subsystem having first and second memories. The first memory contains magnetic random access memory (MRAM) cells for storing weights (e.g., filter coefficients) while the second memory is for storing input signals (e.g., imagery data). The first memory may store one-time-programming weights or filter coefficients. The memory subsystem may contain a third memory that contains MRAM cells for storing one-time-programming data for security purpose. The second memory contains MRAM cells or static random access memory cells. Each MRAM cell contains a voltage-controlled magnetic anisotropy (VCMA) based magnetic tunnel junction (MTJ) element. Magnetization direction in VCMA based MTJ element can be in-plane or out-of-plane.
    Type: Grant
    Filed: October 10, 2017
    Date of Patent: January 14, 2020
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Chyu-Jiuh Torng, Daniel Liu
  • Patent number: 10481815
    Abstract: CNN based digital IC for AI contains a number of CNN processing units. Each CNN processing unit contains CNN logic circuits operatively coupling to a memory subsystem. A first subsystem includes an array of first magnetic random access memory (RAM) cells for storing weights and an array of second magnetic RAM cells for storing input signals. A second subsystem includes an array of first magnetic RAM cells for storing one-time-programming weights and an array of second magnetic RAM cells for storing input signals. A third subsystem includes an array of first magnetic RAM cells for storing weights, an array of second magnetic RAM cells for storing input signals and an array of third magnetic RAM cells for storing one-time-programming unique data pattern for security identification. Either MLC STT-RAM or MLC OST-MRAM containing at least two MTJ elements can be configured as different memories for forming memory subsystem.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: November 19, 2019
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Chyu-Jiuh Torng, Lin Yang, Qi Dong
  • Patent number: 10331999
    Abstract: CNN based digital IC for AI contains a number of CNN processing units. Each CNN processing unit contains CNN logic circuits operatively coupling to a memory subsystem having first and second memories. The first memory includes an array of magnetic random access memory (RAM) cells for storing weights (e.g., filter coefficients) and the second memory contains SRAM for storing input signals (e.g., imagery data). The first memory may store one-time-programming weights. The memory subsystem may contain a third memory that contains magnetic RAM cells for storing one-time-programming data for security purpose. The magnetic RAM includes STT-RAM or OST-MRAM in SLC or MLC technology.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: June 25, 2019
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Chyu-Jiuh Torng, Lin Yang, Qi Dong
  • Patent number: 10102475
    Abstract: A control circuit including a first switch to a third switch, an inverter, a first capacitor and a second capacitor. The first switch includes a first terminal receiving a weighting signal, and a second terminal. The second switch includes a first terminal, a control terminal coupled to the second terminal of the first switch, and a second terminal coupled to a reference voltage terminal. The third switch includes a first terminal coupled to the reference voltage terminal, a control terminal, and a second terminal. The inverter includes an input terminal coupled to a data input terminal, and an output terminal. The first capacitor is coupled between the data input terminal and the control terminal of the second switch. The second capacitor is coupled between the output terminal of the inverter and the control terminal of the third switch.
    Type: Grant
    Filed: November 1, 2017
    Date of Patent: October 16, 2018
    Assignee: UNITED MICROELECTRONICS CORP.
    Inventors: Yun-Yuan Wang, Shao-Hui Wu
  • Patent number: 9165246
    Abstract: A neuristor-based reservoir computing device includes support circuitry formed in a complimentary metal oxide semiconductor (CMOS) layer, input nodes connected to the support circuitry and output nodes connected to the support circuitry. Thin film neuristor nodes are disposed over the CMOS layer with a first portion of the neuristor nodes connected to the input nodes and a second portion of the neuristor nodes connected to the output nodes. Interconnections between the neuristor nodes form a reservoir accepting input signals from the input nodes and outputting signals on the output nodes. A method for forming a neuristor-based reservoir computing device is also provided.
    Type: Grant
    Filed: January 29, 2013
    Date of Patent: October 20, 2015
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventor: Matthew D. Pickett
  • Patent number: 9087302
    Abstract: A synapse for a spike timing dependent (STDP) function cell includes a memory device having a variable resistance, such as a memristor, and a transistor connected to the memory device. A channel of the memory device is connected in series with a channel of the transistor.
    Type: Grant
    Filed: June 7, 2012
    Date of Patent: July 21, 2015
    Assignees: Samsung Electronics Co., Ltd., Postech Academy-Industry Foundation
    Inventors: Jae Yoon Sim, Hyun Surk Ryu, Jun Haeng Lee
  • Patent number: 9053429
    Abstract: Embodiments of the invention relate to mapping neural dynamics of a neural model on to a lookup table. One embodiment comprises defining a phase plane for a neural model. The phase plane represents neural dynamics of the neural model. The phase plane is coarsely sampled to obtain state transition information for multiple neuronal states. The state transition information is mapped on to a lookup table.
    Type: Grant
    Filed: December 21, 2012
    Date of Patent: June 9, 2015
    Assignee: International Business Machines Corporation
    Inventors: Rodrigo Alvarez-Icaza Rivera, John V. Arthur, Andrew S. Cassidy, Pallab Datta, Paul A. Merolla, Dharmendra S. Modha
  • Patent number: 8909577
    Abstract: A neuromorphic data processing device comprising a plurality of spiking neurons, with each of these neurons comprising: an integrator designed to receive successive analog pulses each having a certain value, and accumulate the values of the pulses received in a recorded value, referred to as accumulation value, and a discharger designed to emit a pulse, referred to as discharge pulse, according to the accumulation value, and a silicon support having two surfaces, the neurons being carried out on at least one of the two surfaces, the integrator of each neuron comprising a metal via of the TSV type between the two surfaces of the silicon support, the metal via of the TSV type forming a capacitor with the silicon support and having an electric potential forming the accumulation value wherein the values of the pulses received are accumulated and according to which the discharge pulse is emitted.
    Type: Grant
    Filed: July 16, 2012
    Date of Patent: December 9, 2014
    Assignee: Commissariat à l'énergie et aux énergies alternatives
    Inventors: Rodolphe Heliot, Marc Duranton, Antoine Joubert
  • Patent number: 8832010
    Abstract: According to a technique, an electronic device is configured to correspond to characteristic features of a biological synapse. The electronic device includes multiple bipolar resistors arranged in parallel to form an electronic synapse, an axonal connection connected to one end of the electronic synapse and to a first electronic neuron, and a dendritic connection connected to another end of the electronic synapse and to a second electronic neuron. An increase and decrease of synaptic conduction in the electronic synapse is based on a probability of switching the plurality of bipolar resistors between a low resistance state and a high resistance state.
    Type: Grant
    Filed: January 4, 2012
    Date of Patent: September 9, 2014
    Assignee: International Business Machines Corporation
    Inventors: Bipin Rajendran, Mark B. Ritter
  • Patent number: 8832011
    Abstract: According to a technique, an electronic device is configured to correspond to characteristic features of a biological synapse. The electronic device includes multiple bipolar resistors arranged in parallel to form an electronic synapse, an axonal connection connected to one end of the electronic synapse and to a first electronic neuron, and a dendritic connection connected to another end of the electronic synapse and to a second electronic neuron. An increase and decrease of synaptic conduction in the electronic synapse is based on a probability of switching the plurality of bipolar resistors between a low resistance state and a high resistance state.
    Type: Grant
    Filed: September 12, 2012
    Date of Patent: September 9, 2014
    Assignee: International Business Machines Corporation
    Inventors: Bipin Rajendran, Mark B. Ritter
  • Publication number: 20140164300
    Abstract: Disclosed is a method and system for analyzing a social network, the method comprising: segregating, by a processor, the social network into a plurality of groups of users, wherein each group of users has a unique identity in the social network; mining, by the processor, data from a group of users of the plurality of groups of users; identifying a plurality of social variables from the data, wherein the plurality of social variables comprises at least one of a number of users, connections of the users, interactions of the users, affinity of the users, or posts by the users; equating a social variable of the plurality of social variables with a thermodynamic variable of a plurality of thermodynamic variables; determining quantitative values of the plurality of thermodynamic variables based upon the plurality of social variables; generating a virtual thermodynamics system based upon the quantitative values for analyzing the social network.
    Type: Application
    Filed: December 12, 2013
    Publication date: June 12, 2014
    Applicant: Tata Consultancy Services Limited
    Inventors: Pratik Kumar Mishra, Dinesh Pothineni, Aadil Rasheed
  • Patent number: 8706624
    Abstract: Disclosed is a system and method for Facilitating Credit Transactions, which may allow for the division of a given purchase or cash-withdrawal transaction amount, into periodical installments by enabling the financing of said transaction.
    Type: Grant
    Filed: October 4, 2012
    Date of Patent: April 22, 2014
    Assignee: Pay It Simple Ltd.
    Inventors: Gil Don, Alon Feit, Victoria Niel Kraine
  • Patent number: 8694452
    Abstract: Certain embodiments of the present disclosure support techniques for power efficient implementation of neuron synapses with positive and/or negative synaptic weights.
    Type: Grant
    Filed: July 7, 2010
    Date of Patent: April 8, 2014
    Assignee: QUALCOMM Incorporated
    Inventors: Vladimir Aparin, Jeffrey A. Levin
  • Patent number: 8648357
    Abstract: A radiation-emitting device includes a first active semiconductor layer embodied for the emission of electromagnetic radiation and for direct contact with connection electrodes, and a second active semiconductor layer embodied for the emission of electromagnetic radiation and for direct contact with connection electrodes. The first active semiconductor layer and the second active semiconductor layer are arranged in a manner stacked one above another.
    Type: Grant
    Filed: December 3, 2008
    Date of Patent: February 11, 2014
    Assignee: OSRAM Opto Semiconductor GmbH
    Inventor: Siegfried Herrmann
  • Patent number: 8332340
    Abstract: Embodiments of the present invention include hybrid microscale-nanoscale neuromorphic integrated circuits that include an array of analog computational cells fabricated on an integrated-circuit-substrate. The analog electronic circuitry within each computational cell connected to one or more pins of a first type and to one or more pins of a second type that extend approximately vertically from the computational cells. The computational cells are additionally interconnected by one or more nanowire-interconnect layers, each nanowire-interconnect layer including two nanowire sublayers on either side of a memristive sublayer, with each nanowire in each nanowire sublayer of an interconnect layer connected to a single computational-cell pin and to a number of nanowires in the other nanowire sublayer of the interconnect layer.
    Type: Grant
    Filed: May 22, 2008
    Date of Patent: December 11, 2012
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventor: Gregory S. Snider
  • Patent number: 8170842
    Abstract: A method of modelling fabric properties and behavior first involves generating (16) a yarn model from fiber parameters, which may be empirically determined. The yarn model is homogenised (18, 20) to produce a homogenous representation of the yarn (YMM), suitable for use in finite element analysis. The method may then, secondly, involve generating (24) a fabric weave model by finite element analysis of the yarn representation (YMM). The fabric model is then also homogenised (26, 28) to produce a homogeneous representation of the fabric (FMM), suitable for use in finite element analysis. Finite element analysis of the fabric representation (FMM) can then be used to assess the suitability of various fabric materials for technical applications.
    Type: Grant
    Filed: November 29, 2005
    Date of Patent: May 1, 2012
    Assignee: Innoval Technology Limited
    Inventor: Rade Ognjanovic
  • Patent number: 7885198
    Abstract: A packet-network analyzer system for characterizing network conditions of a packet-network-under-test is provided. In this regard, one such system can be broadly summarized by a representative analyzer system that incorporates a data collection element to receive the raw digital data from a host analyzer, a data selection element to receive the raw digital data, a data processing element to process the selected data set to generate a normalized data set, a neural processing module to process the normalized data set to generate a set of rules and relationships, and a data mining module that uses the rules and relationships to generate a mined data set from the selected data set, the mined data set being used to characterize a packet-network-under test.
    Type: Grant
    Filed: January 5, 2004
    Date of Patent: February 8, 2011
    Assignee: JDS Uniphase Corporation
    Inventor: John M. Monk
  • Publication number: 20100217735
    Abstract: A neuron element is provided having an input part that receives a plurality of input signals and, in response to the respective input signals, creates weighted signals as the products of the input signals and connection weights corresponding to the input signals, an addition part that obtains the total sum of the plurality of weighted signals, and an output part that outputs an output signal as a function of the total sum, a functional molecular element having a current-voltage characteristic in which the current flowing through the element is represented as a function having an inflection point with respect to the applied voltage is used as an element that defines the output signal, and the output signal is defined as a function of the total sum based on the current-voltage characteristic of this element in the region including the inflection point.
    Type: Application
    Filed: May 27, 2008
    Publication date: August 26, 2010
    Applicant: SONY CORPORATION
    Inventors: Hajime Matsumura, Eriko Matsui
  • Patent number: 7620819
    Abstract: We develop a system consisting of a neural architecture resulting in classifying regions corresponding to users' keystroke patterns. We extend the adaptation properties to classification phase resulting in learning of changes over time. Classification results on login attempts of 43 users (216 valid, 657 impersonation samples) show considerable improvements over existing methods.
    Type: Grant
    Filed: September 29, 2005
    Date of Patent: November 17, 2009
    Assignees: The Penn State Research Foundation, Louisiana Tech University Foundation, Inc.
    Inventors: Vir V. Phoha, Sunil Babu, Asok Ray, Shashi P. Phoba
  • Patent number: 7441197
    Abstract: A graphical and interactive interface system manages risk management information. A secure database stores risk management information that is accessible by authorized access through a network. A graphics interface generates graphic data of the risk management information in response to the authorized access. One or more workflow process terminals connect in network with the database to provide updates to the risk management information. Summary reporting and statistical processing functionalities facilitate predictive accuracy of the system by permitting a user to compare relevant system inputs when selecting data to provide recommendations to customers for adjustment of insurance policies in accordance with risk management practices.
    Type: Grant
    Filed: April 12, 2003
    Date of Patent: October 21, 2008
    Assignee: Global Asset Protection Services, LLC
    Inventors: Mark A. Tschiegg, Linda P. Burrows, Todd A. Reinart, Peter F. Langan, Michael J. Sutherland, Mark R. Driscoll
  • Patent number: 7272585
    Abstract: A product-sum operation circuit includes a pulse width/digital conversion circuit (9) which converts a pulse signal having a pulse width representing an operand value into a digital signal, a sorting circuit (4) which outputs, in descending or ascending order of magnitude, a plurality of operand values Xi converted into digital signals by the pulse width/digital conversion circuit (9), and an accumulated sum circuit (1) which multiplies each operand value output from the sorting circuit (4) by a corresponding operand value Wi and calculates the accumulated sum of multiplication results. The pulse width/digital conversion circuit (9) includes a counter (10) which counts a clock and outputs a count value as a digital signal, and n trailing edge latch circuits (11-0-11-(n?1)) each of which latches a common count value output from the counter at the trailing edge of the input pulse signal.
    Type: Grant
    Filed: May 17, 2006
    Date of Patent: September 18, 2007
    Assignee: Canon Kabushiki Kaisha
    Inventors: Osamu Nomura, Takashi Morie, Teppei Nakano
  • Patent number: 6844582
    Abstract: A learning method of a semiconductor device of the present invention comprises a neuro device having a multiplier as a synapse in which a weight varies according to an input weight voltage, and functioning as a neural network system that processes analog data, comprising a step A of inputting predetermined input data to the neuro device and calculating an error between a target value of an output of the neuro device with respect to the input data and an actual output, a step B of calculating variation amount in the error by varying a weight of the multiplier thereafter, and a step C of varying the weight of the multiplier based on the variation amount in the error, wherein in the steps B and C, after inputting a reset voltage for setting the weight to a substantially constant value to the multiplier as the weight voltage, the weight is varied by inputting the weight voltage corresponding to the weight to be varied.
    Type: Grant
    Filed: May 9, 2003
    Date of Patent: January 18, 2005
    Assignee: Matsushita Electric Industrial Co., Ltd.
    Inventors: Michihito Ueda, Kenji Toyoda, Takashi Ohtsuka, Kiyoyuki Morita
  • Patent number: 6754645
    Abstract: A voltage-mode pulse width modulation (PWM) VLSI implementation of neural networks, comprising: a voltage-pulse converter for converting an input voltage into a neuron-state pulse; a synapse multiplier, including a multiplier cell for multiplying the neuron-state pulse by an input weight voltage and an integral and summation cell for integrating and summing up the multiplied output and producing a first output voltage; and a sigmoid circuit for converting the first output voltage into a second output voltage with the non-linear activation function of neuron.
    Type: Grant
    Filed: March 20, 2001
    Date of Patent: June 22, 2004
    Assignee: Winbond Electronics Corp.
    Inventors: Bingxue Shi, Chun Lu
  • Publication number: 20040006545
    Abstract: An analog neural computing medium, neuron and neural networks comprising same are disclosed. The neural computing medium includes a phase change material that has the ability to cumulatively respond to multiple synchronous or asynchronous input signals. The introduction of input signals induces transformations among a plurality of accumulation states of the disclosed neural computing medium. The accumulation states are characterized by a high electrical resistance that is substantially identical for all accumulation states. The high electrical resistance prevents the neural computing medium from transmitting signals. Upon cumulative receipt of energy from one or more input signals that equals or exceeds a threshold value, the neural computing medium fires by transforming to a low resistance state that is capable of transmitting signals. The neural computing medium thus closely mimics the neurosynaptic function of a biological neuron.
    Type: Application
    Filed: July 3, 2002
    Publication date: January 8, 2004
    Inventor: Stanford R. Ovhsinsky
  • Publication number: 20030220889
    Abstract: A neural network includes a neuron, an error determination unit, and a weight update unit. The weight update unit includes an analog accumulator. The analog accumulator requires a minimal number of multipliers.
    Type: Application
    Filed: May 21, 2002
    Publication date: November 27, 2003
    Inventors: Bingxue Shi, Chun Lu, Lu Chen
  • Patent number: 6625588
    Abstract: An associative artificial neuron and method of forming output signals of an associative artificial neuron includes receiving a number of auxiliary input signals; forming from the auxiliary input signals a sum weighted by coefficients and applying a non-linear function to the weighted sum to generate a non-linear signal. The neuron and method further include receiving a main input signal and forming, based on the main signal and the non-linear signal, the function S OR V, which is used to generate a main output signal, and at lest one of three logical functions S AND V, NOT S AND V, and S AND NOT V. The at least one logical function is used to generate an additional output signal for the associative artificial neuron.
    Type: Grant
    Filed: September 24, 1999
    Date of Patent: September 23, 2003
    Assignee: Nokia OYJ
    Inventor: Pentti Haikonen
  • Patent number: 6601049
    Abstract: A method and apparatus for using a neural network to process information includes multiple nodes arrayed in multiple layers for transforming input arrays from prior layers or the environment into output arrays for subsequent layers or output devices. Learning rules based on reinforcement are applied. Interconnections between nodes are provided in a manner whereby the number and structure of the interconnections are self-adjusted by the learning rules during learning. At least one of the layers is used as a processing layer, and multiple lateral inputs to each node of each processing layer are used to retrieve information. The invention provides rapid, unsupervised processing of complex data sets, such as imagery or continuous human speech, and captures successful processing or pattern classification constellations for implementation in other networks.
    Type: Grant
    Filed: May 26, 2000
    Date of Patent: July 29, 2003
    Inventor: David L. Cooper
  • Patent number: 6405184
    Abstract: A method for generating fault classification signals which identify faulty loops which develop in a multiphase energy supply network observed in the event of a fault from a protective device with a starting arrangement. To be able to generate such fault classification signals in a relatively simple manner, a neural network is used which is trained using input variables simulating faulty loops in the form of normalized resistance and reactance variables formed taking into consideration the starting characteristic of the starting arrangement. In the case of a fault, normalized resistance and reactance measured variables network for generating fault classification signals.
    Type: Grant
    Filed: March 1, 1999
    Date of Patent: June 11, 2002
    Assignee: Siemens Aktiengesellschaft
    Inventors: Klaus Böhme, Andreas Jurisch
  • Patent number: 6341275
    Abstract: A Hamming neural network circuit which can be programmed and expanded is disclosed. The Hamming neural network includes an I/O circuit for inputting and outputting a plurality of standard patterns. A bi-directional transmission gate array is connected to the I/O circuit and controlled by a programming signal for transmitting the standard patterns. A plurality of standard pattern memory units is connected to the bi-directional transmission gate array for storing the plurality of standard patterns respectively. An address decoder is connected to the plurality of standard pattern memory units for addressing one of the plurality of standard pattern memory units. A plurality of pattern matching calculation circuit units are respectively connected to the plurality of standard pattern memory units for generating a plurality of matching rates between a to-be-recognized pattern and the plurality of standard patterns.
    Type: Grant
    Filed: April 27, 1999
    Date of Patent: January 22, 2002
    Assignee: Winbond Electrnics Corp.
    Inventors: Bingxue Shi, Gu Lin
  • Patent number: 6269354
    Abstract: The invention comprises e-circuits built from basic modules of e-cells which are capable of: recognizing a previously memorized percept anywhere within an arbitrarily large input field without incurring delay related to size of the search space; isolating a previously memorized percept within the input field when in the adjacent presence of other percepts and closely related distractors; locating and recognizing all occurrences of a repeated subfield within the input field, even in the presence of closely related distractors; and performing sequential shift attention between a number of different percepts in the input field. The invention is applicable to various recognition tasks including those in sensory domains such as speech and music recognition, vision, olefaction, and touch.
    Type: Grant
    Filed: November 30, 1998
    Date of Patent: July 31, 2001
    Inventor: David W. Arathorn
  • Patent number: 6047276
    Abstract: A neural cellular network for implementing a so-called Chua's circuit, and comprising at least first, second and third cells having respective first and second input terminals and respective state terminals, the first and second input terminals being to receive a first and a second reference signal, respectively, and the first cell, and the second and third cells being of mutually different types.
    Type: Grant
    Filed: March 19, 1997
    Date of Patent: April 4, 2000
    Assignees: SGS-Thomson Microelectronics S.r.l., Consorzio per la Ricerca sulla Microelettronica nel Mezzogiorno
    Inventors: Gabriele Manganaro, Mario Lavorgna, Matteo Lo Presti, Luigi Fortuna
  • Patent number: 6041322
    Abstract: A digital artificial neural network (ANN) reduces memory requirements by storing sample transfer function representing output values for multiple nodes. Each nodes receives an input value representing the information to be processed by the network. Additionally, the node determines threshold values indicative of boundaries for application of the sample transfer function for the node. From the input value received, the node generates an intermediate value. Based on the threshold values and the intermediate value, the node determines an output value in accordance with the sample transfer function.
    Type: Grant
    Filed: April 18, 1997
    Date of Patent: March 21, 2000
    Assignee: Industrial Technology Research Institute
    Inventors: Wan-Yu Meng, Cheng-Kai Chang, Hwai-Tsu Chang, Fang-Ru Hsu, Ming-Rong Lee