Abstract: Lifelong Deep Neural Network (L-DNN) technology revolutionizes Deep Learning by enabling fast, post-deployment learning without extensive training, heavy computing resources, or massive data storage. It uses a representation-rich, DNN-based subsystem (Module A) with a fast-learning subsystem (Module B) to learn new features quickly without forgetting previously learned features. Compared to a conventional DNN, L-DNN uses much less data to build robust networks, dramatically shorter training time, and learning on-device instead of on servers. It can add new knowledge without re-training or storing data. As a result, an edge device with L-DNN can learn continuously after deployment, eliminating massive costs in data collection and annotation, memory and data storage, and compute power. This fast, local, on-device learning can be used for security, supply chain monitoring, disaster and emergency response, and drone-based inspection of infrastructure and properties, among other applications.

Abstract: The present technology involves collecting a new experience by an agent, comparing the new experience to experiences stored in the agent's memory, and either discarding the new experience or overwriting an experience in the memory with the new experience based on the comparison. For instance, the agent or an associated processor may determine how similar the new experience is to the stored experiences. If the new experience is too similar, the agent discards it; otherwise, the agent stores it in the memory and discards a previously stored experience instead. Collecting and selectively storing experiences based on the experiences' similarity to previously stored experiences addresses technological problems and yields a number of technological improvements. For instance, relieves memory size constraints, reduces or eliminates the chances of catastrophic forgetting by a neural network, and improves neural network performance.

Abstract: Lifelong Deep Neural Network (L-DNN) technology revolutionizes Deep Learning by enabling fast, post-deployment learning without extensive training, heavy computing resources, or massive data storage. It uses a representation-rich, DNN-based subsystem (Module A) with a fast-learning subsystem (Module B) to learn new features quickly without forgetting previously learned features. Compared to a conventional DNN, L-DNN uses much less data to build robust networks, dramatically shorter training time, and learning on-device instead of on servers. It can add new knowledge without re-training or storing data. As a result, an edge device with L-DNN can learn continuously after deployment, eliminating massive costs in data collection and annotation, memory and data storage, and compute power. This fast, local, on-device learning can be used for security, supply chain monitoring, disaster and emergency response, and drone-based inspection of infrastructure and properties, among other applications.

Abstract: In various embodiments, electronic apparatus, systems, and methods include a unified compact spatiotemporal method that provides a process for machines to deal with space and time and to deal with sensors and effectors. Additional apparatus, systems, and methods are disclosed.

Abstract: In various embodiments, electronic apparatus, systems, and methods include a unified compact spatiotemporal method that provides a process for machines to deal with space and time and to deal with sensors and effectors. Additional apparatus, systems, and methods are disclosed.

Abstract: In various embodiments, electronic apparatus, systems, and methods include a unified compact spatiotemporal method that provides a process for machines to deal with space and time and to deal with sensors and effectors. Additional apparatus, systems, and methods are disclosed.