Patents Assigned to Numenta, Inc.
  • Patent number: 9412067
    Abstract: Detecting patterns and sequences associated with an anomaly in predictions made a predictive system. The predictive system makes predictions by learning spatial patterns and temporal sequences in an input data that change over time. As the input data is received, the predictive system generates a series of predictions based on the input data. Each prediction is compared with corresponding actual value or state. If the prediction does not match or deviates significantly from the actual value or state, an anomaly is identified for further analysis. A corresponding state or a series of states of the predictive system before or at the time of prediction are associated with the anomaly and stored. The anomaly can be detected by monitoring whether the predictive system is placed in the state or states that is the same or similar to the stored state or states.
    Type: Grant
    Filed: August 29, 2013
    Date of Patent: August 9, 2016
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Rahul Agarwal
  • Patent number: 9189745
    Abstract: A processing node in a temporal memory system includes a spatial pooler and a sequence processor. The spatial pooler generates a spatial pooler signal representing similarity between received spatial patterns in an input signal and stored co-occurrence patterns. The spatial pooler signal is represented by a combination of elements that are active or inactive. Each co-occurrence pattern is mapped to different subsets of elements of an input signal. The spatial pooler signal is fed to a sequence processor receiving and processed to learn, recognize and predict temporal sequences in the input signal. The sequence processor includes one or more columns, each column including one or more cells. A subset of columns may be selected by the spatial pooler signal, causing one or more cells in these columns to activate.
    Type: Grant
    Filed: March 11, 2011
    Date of Patent: November 17, 2015
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
  • Patent number: 9159021
    Abstract: Embodiments relate to making predictions for values or states to follow multiple time steps after receiving a certain input data in a spatial and temporal memory system. During a training stage, relationships between states of the spatial and temporal memory system at certain times and spatial patterns of the input data detected a plurality of time steps later after the certain time steps are established. Using the established relationships, the spatial and temporal memory system can make predictions multiple time steps into the future based on the input data received at a current time.
    Type: Grant
    Filed: October 23, 2012
    Date of Patent: October 13, 2015
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Ronald Marianetti
  • Patent number: 8959039
    Abstract: A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.
    Type: Grant
    Filed: January 7, 2014
    Date of Patent: February 17, 2015
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Dileep George
  • Patent number: 8825565
    Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.
    Type: Grant
    Filed: August 25, 2011
    Date of Patent: September 2, 2014
    Assignee: Numenta, Inc.
    Inventors: Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
  • Publication number: 20140207842
    Abstract: A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.
    Type: Application
    Filed: March 27, 2014
    Publication date: July 24, 2014
    Applicant: Numenta, Inc.
    Inventors: Jeffrey L. Edwards, Wiliam C. Saphir, Subutai Ahmad, Dileep George, Frank Astier, Ronald Marianetti
  • Patent number: 8732098
    Abstract: A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.
    Type: Grant
    Filed: March 8, 2012
    Date of Patent: May 20, 2014
    Assignee: Numenta, Inc.
    Inventors: Subutai Ahmad, Dileep George, Jeffrey L. Edwards, William C. Saphir, Frank Astier, Ronald Marianetti
  • Publication number: 20140129499
    Abstract: Embodiments relate to recommending actions based on costs or benefits associated with predictions generated by a spatial and temporal memory system. The spatial and temporal memory system may generate a prediction indicating that more than one value or state may take place in the future where each value or state is associated with different costs and benefits. A configuration assistant facilitates a user to define costs and benefits associated with the more than one value or state. The spatial and temporal memory system uses the likelihood distribution in prediction, and its associated costs and benefits to recommend an action.
    Type: Application
    Filed: November 5, 2012
    Publication date: May 8, 2014
    Applicant: NUMENTA, INC.
    Inventor: Jeffrey C. Hawkins
  • Publication number: 20140122394
    Abstract: A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.
    Type: Application
    Filed: January 7, 2014
    Publication date: May 1, 2014
    Applicant: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Dileep George
  • Publication number: 20140114896
    Abstract: Embodiments relate to making predictions for values or states to follow multiple time steps after receiving a certain input data in a spatial and temporal memory system. During a training stage, relationships between states of the spatial and temporal memory system at certain times and spatial patterns of the input data detected a plurality of time steps later after the certain time steps are established. Using the established relationships, the spatial and temporal memory system can make predictions multiple time steps into the future based on the input data received at a current time.
    Type: Application
    Filed: October 23, 2012
    Publication date: April 24, 2014
    Applicant: NUMENTA, INC.
    Inventors: Jeffrey C. Hawkins, Ronald Marianetti
  • Publication number: 20140067734
    Abstract: Detecting patterns and sequences associated with an anomaly in predictions made a predictive system. The predictive system makes predictions by learning spatial patterns and temporal sequences in an input data that change over time. As the input data is received, the predictive system generates a series of predictions based on the input data. Each prediction is compared with corresponding actual value or state. If the prediction does not match or deviates significantly from the actual value or state, an anomaly is identified for further analysis. A corresponding state or a series of states of the predictive system before or at the time of prediction are associated with the anomaly and stored. The anomaly can be detected by monitoring whether the predictive system is placed in the state or states that is the same or similar to the stored state or states.
    Type: Application
    Filed: August 29, 2013
    Publication date: March 6, 2014
    Applicant: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Rahul Agarwal
  • Patent number: 8666917
    Abstract: A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.
    Type: Grant
    Filed: September 5, 2012
    Date of Patent: March 4, 2014
    Assignee: Numenta, Inc.
    Inventors: Robert G. Jaros, Dileep George, Jeffrey Hawkins, Frank Astier
  • Patent number: 8645291
    Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.
    Type: Grant
    Filed: August 25, 2011
    Date of Patent: February 4, 2014
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj
  • Patent number: 8504570
    Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.
    Type: Grant
    Filed: August 25, 2011
    Date of Patent: August 6, 2013
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
  • Patent number: 8504494
    Abstract: A spatio-temporal learning node is a type of HTM node which learns both spatial and temporal groups of sensed input patterns over time. Spatio-temporal learning nodes comprise spatial poolers which are used to determine spatial groups in a set of sensed input patterns. The spatio-temporal learning nodes further comprise temporal poolers which are used to determine groups of sensed input patterns that temporally co-occur. A spatio-temporal learning network is a hierarchical network including a plurality of spatio-temporal learning nodes.
    Type: Grant
    Filed: September 7, 2011
    Date of Patent: August 6, 2013
    Assignee: Numenta, Inc.
    Inventors: Robert G. Jaros, Jeffrey L. Edwards, Dileep George, Jeffrey C. Hawkins
  • Patent number: 8447711
    Abstract: A hierarchical temporal memory (HTM) based system may be provided as a software platform. The software platform includes: a runtime engine arranged to run an HTM network; a first interface accessible by a set of tools to configure, design, modify, train, debug, and/or deploy the HTM network; and a second interface accessible to extend a functionality of the runtime engine.
    Type: Grant
    Filed: April 14, 2008
    Date of Patent: May 21, 2013
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Subutai Ahmad, Dileep George, Frank E. Astier, Ronald Marianetti, II
  • Patent number: 8407166
    Abstract: A temporal pooler for a Hierarchical Temporal Memory network is provided. The temporal pooler is capable of storing information about sequences of co-occurrences in a higher-order Markov chain by splitting a co-occurrence into a plurality of sub-occurrences. Each split sub-occurrence may be part of a distinct sequence of co-occurrences. The temporal pooler receives the probability of spatial co-occurrences in training patterns and tallies counts or frequency of transitions from one sub-occurrence to another sub-occurrence in a connectivity matrix. The connectivity matrix is then processed to generate temporal statistics data. The temporal statistics data is provided to an inference engine to perform inference or prediction on input patterns. By storing information related to a higher-order Markov model, the temporal statistics data more accurately reflects long temporal sequences of co-occurrences in the training patterns.
    Type: Grant
    Filed: June 12, 2009
    Date of Patent: March 26, 2013
    Assignee: Numenta, Inc.
    Inventors: Jeffrey C. Hawkins, Dileep George, Charles Curry, Frank E. Astier, Anosh Raj, Robert G. Jaros
  • Publication number: 20130054552
    Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.
    Type: Application
    Filed: August 25, 2011
    Publication date: February 28, 2013
    Applicant: NUMENTA, INC.
    Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
  • Publication number: 20130054496
    Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.
    Type: Application
    Filed: August 25, 2011
    Publication date: February 28, 2013
    Applicant: NUMENTA, INC.
    Inventors: Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
  • Publication number: 20130054495
    Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.
    Type: Application
    Filed: August 25, 2011
    Publication date: February 28, 2013
    Applicant: NUMENTA, INC.
    Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj