Patents Assigned to Numenta, Inc.
-
Patent number: 10318878Abstract: Embodiments relate to a processing node in a temporal memory system that performs temporal pooling or processing by activating cells where the activation of a cell is maintained longer if the activation of the cell were previously predicted or activation on more than a certain portion of associated cells in a lower node was correctly predicted. An active cell correctly predicted to be activated or an active cell having connections to lower node active cells that were correctly predicted to become active contribute to accurate prediction, and hence, is maintained active longer than cells activated but were not previously predicted to become active. Embodiments also relate to a temporal memory system for detecting, learning, and predicting spatial patterns and temporal sequences in input data by using action information.Type: GrantFiled: March 18, 2015Date of Patent: June 11, 2019Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Subutai Ahmad, Yuwei Cui, Chetan Surpur
-
Patent number: 10275720Abstract: A processing node in a temporal memory system includes a spatial pooler and a sequence processor. The spatial pooler generates a spatial pooler signal representing similarity between received spatial patterns in an input signal and stored co-occurrence patterns. The spatial pooler signal is represented by a combination of elements that are active or inactive. Each co-occurrence pattern is mapped to different subsets of elements of an input signal. The spatial pooler signal is fed to a sequence processor receiving and processed to learn, recognize and predict temporal sequences in the input signal. The sequence processor includes one or more columns, each column including one or more cells. A subset of columns may be selected by the spatial pooler signal, causing one or more cells in these columns to activate.Type: GrantFiled: October 9, 2015Date of Patent: April 30, 2019Assignee: NUMENTA, INC.Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
-
Patent number: 9621681Abstract: A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.Type: GrantFiled: March 27, 2014Date of Patent: April 11, 2017Assignee: Numenta, Inc.Inventors: Jeffrey L. Edwards, Wiliam C. Saphir, Subutai Ahmad, Dileep George, Frank Astier, Ronald Marianetti
-
Patent number: 9552551Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.Type: GrantFiled: June 27, 2014Date of Patent: January 24, 2017Assignee: Numenta, Inc.Inventors: Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
-
Patent number: 9530091Abstract: Sophisticated memory systems and intelligent machines may be constructed by creating an active memory system with a hierarchical architecture. Specifically, a system may comprise a plurality of individual cortical processing units arranged into a hierarchical structure. Each individual cortical processing unit receives a sequence of patterns as input. Each cortical processing unit processes the received input sequence of patterns using a memory containing previously encountered sequences with structure and outputs another pattern. As several input sequences are processed by a cortical processing unit, it will therefore generate a sequence of patterns on its output. The sequence of patterns on its output may be passed as an input to one or more cortical processing units in next higher layer of the hierarchy. A lowest layer of cortical processing units may receive sensory input from the outside world. The sensory input also comprises a sequence of patterns.Type: GrantFiled: April 3, 2012Date of Patent: December 27, 2016Assignee: Numenta, Inc.Inventors: Jeffrey Hawkins, Dileep George
-
Patent number: 9424512Abstract: A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.Type: GrantFiled: January 7, 2015Date of Patent: August 23, 2016Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Dileep George
-
Patent number: 9412067Abstract: Detecting patterns and sequences associated with an anomaly in predictions made a predictive system. The predictive system makes predictions by learning spatial patterns and temporal sequences in an input data that change over time. As the input data is received, the predictive system generates a series of predictions based on the input data. Each prediction is compared with corresponding actual value or state. If the prediction does not match or deviates significantly from the actual value or state, an anomaly is identified for further analysis. A corresponding state or a series of states of the predictive system before or at the time of prediction are associated with the anomaly and stored. The anomaly can be detected by monitoring whether the predictive system is placed in the state or states that is the same or similar to the stored state or states.Type: GrantFiled: August 29, 2013Date of Patent: August 9, 2016Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Rahul Agarwal
-
Patent number: 9189745Abstract: A processing node in a temporal memory system includes a spatial pooler and a sequence processor. The spatial pooler generates a spatial pooler signal representing similarity between received spatial patterns in an input signal and stored co-occurrence patterns. The spatial pooler signal is represented by a combination of elements that are active or inactive. Each co-occurrence pattern is mapped to different subsets of elements of an input signal. The spatial pooler signal is fed to a sequence processor receiving and processed to learn, recognize and predict temporal sequences in the input signal. The sequence processor includes one or more columns, each column including one or more cells. A subset of columns may be selected by the spatial pooler signal, causing one or more cells in these columns to activate.Type: GrantFiled: March 11, 2011Date of Patent: November 17, 2015Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
-
Patent number: 9159021Abstract: Embodiments relate to making predictions for values or states to follow multiple time steps after receiving a certain input data in a spatial and temporal memory system. During a training stage, relationships between states of the spatial and temporal memory system at certain times and spatial patterns of the input data detected a plurality of time steps later after the certain time steps are established. Using the established relationships, the spatial and temporal memory system can make predictions multiple time steps into the future based on the input data received at a current time.Type: GrantFiled: October 23, 2012Date of Patent: October 13, 2015Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Ronald Marianetti
-
Patent number: 8959039Abstract: A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.Type: GrantFiled: January 7, 2014Date of Patent: February 17, 2015Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Dileep George
-
Patent number: 8825565Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.Type: GrantFiled: August 25, 2011Date of Patent: September 2, 2014Assignee: Numenta, Inc.Inventors: Ronald Marianetti, II, Anosh Raj, Subutai Ahmad
-
Publication number: 20140207842Abstract: A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.Type: ApplicationFiled: March 27, 2014Publication date: July 24, 2014Applicant: Numenta, Inc.Inventors: Jeffrey L. Edwards, Wiliam C. Saphir, Subutai Ahmad, Dileep George, Frank Astier, Ronald Marianetti
-
Patent number: 8732098Abstract: A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.Type: GrantFiled: March 8, 2012Date of Patent: May 20, 2014Assignee: Numenta, Inc.Inventors: Subutai Ahmad, Dileep George, Jeffrey L. Edwards, William C. Saphir, Frank Astier, Ronald Marianetti
-
Publication number: 20140129499Abstract: Embodiments relate to recommending actions based on costs or benefits associated with predictions generated by a spatial and temporal memory system. The spatial and temporal memory system may generate a prediction indicating that more than one value or state may take place in the future where each value or state is associated with different costs and benefits. A configuration assistant facilitates a user to define costs and benefits associated with the more than one value or state. The spatial and temporal memory system uses the likelihood distribution in prediction, and its associated costs and benefits to recommend an action.Type: ApplicationFiled: November 5, 2012Publication date: May 8, 2014Applicant: NUMENTA, INC.Inventor: Jeffrey C. Hawkins
-
Publication number: 20140122394Abstract: A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.Type: ApplicationFiled: January 7, 2014Publication date: May 1, 2014Applicant: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Dileep George
-
Publication number: 20140114896Abstract: Embodiments relate to making predictions for values or states to follow multiple time steps after receiving a certain input data in a spatial and temporal memory system. During a training stage, relationships between states of the spatial and temporal memory system at certain times and spatial patterns of the input data detected a plurality of time steps later after the certain time steps are established. Using the established relationships, the spatial and temporal memory system can make predictions multiple time steps into the future based on the input data received at a current time.Type: ApplicationFiled: October 23, 2012Publication date: April 24, 2014Applicant: NUMENTA, INC.Inventors: Jeffrey C. Hawkins, Ronald Marianetti
-
Publication number: 20140067734Abstract: Detecting patterns and sequences associated with an anomaly in predictions made a predictive system. The predictive system makes predictions by learning spatial patterns and temporal sequences in an input data that change over time. As the input data is received, the predictive system generates a series of predictions based on the input data. Each prediction is compared with corresponding actual value or state. If the prediction does not match or deviates significantly from the actual value or state, an anomaly is identified for further analysis. A corresponding state or a series of states of the predictive system before or at the time of prediction are associated with the anomaly and stored. The anomaly can be detected by monitoring whether the predictive system is placed in the state or states that is the same or similar to the stored state or states.Type: ApplicationFiled: August 29, 2013Publication date: March 6, 2014Applicant: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Rahul Agarwal
-
Patent number: 8666917Abstract: A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.Type: GrantFiled: September 5, 2012Date of Patent: March 4, 2014Assignee: Numenta, Inc.Inventors: Robert G. Jaros, Dileep George, Jeffrey Hawkins, Frank Astier
-
Patent number: 8645291Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.Type: GrantFiled: August 25, 2011Date of Patent: February 4, 2014Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj
-
Patent number: 8504570Abstract: A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems.Type: GrantFiled: August 25, 2011Date of Patent: August 6, 2013Assignee: Numenta, Inc.Inventors: Jeffrey C. Hawkins, Ronald Marianetti, II, Anosh Raj, Subutai Ahmad