Abstract: A computer-implemented method including the step of formulating a continual learning algorithm with both element similarity as well as relational similarity between the stable and plastic model in a dual-memory setup with rehearsal. While the method includes the step of using only two memories to simplify the analysis of impact of relational similarity, the method can be trivially extended to more than two memories. Specifically, the plastic model learns on the data stream as well as on memory samples, while the stable model maintains an exponentially moving average of the plastic model, resulting in a more generalizable model. Simultaneously, to mitigate forgetting and to enable forward transfer, the stable model distills instance-wise and relational knowledge to the plastic model on memory samples. Instance-wise knowledge distillation maintains element similarities, while relational similarity loss maintains relational similarities.

Abstract: A computer-implemented method to improve scale consistency and/or scale awareness in a model of self-supervised depth and ego-motion prediction neural networks processing a video stream of monocular images, wherein complementary GPS coordinates synchronized with the images are used to calculate a GPS to scale loss to enforce the scale-consistency and/or -awareness on the monocular self-supervised ego-motion and depth estimation. A relative weight assigned to the GPS to scale loss exponentially increases as training progresses. The depth and ego-motion prediction neural networks are trained using an appearance-based photometric loss between real and synthesized target images, as well as a smoothness loss on the depth predictions.

Abstract: A computer-implemented method for general continual learning combines rehearsal-based methods with dynamic modularity and compositionality. Concretely, the method aims at achieving three objectives: dynamic, sparse, and compositional response to inputs; competent application performance; and—reducing catastrophic forgetting. The proposed method can work without knowledge of task-identities at test-time, it does not employ task-boundaries and it has bounded memory even when training on longer sequences.

Abstract: An AI based change detection system for executing a method to detect changes in geo-tagged videos to update HD maps, the method employing a neural network of modular components including a keyframe extraction module for processing two or more videos relating to separate traversals of an area of interest to which the HD map which is to be updated relates, a deep neural network module processing output of the keyframe extraction module, a change detection module processing output of the deep neural network module, and an auxiliary computations module which is designed to aid the change detection module.

Abstract: A computer-implemented method of self-supervised learning in neural network for scene understanding in autonomously moving vehicles wherein the method to estimate the ego-motion and the intrinsics (focal lengths and principal point) robustly in a unified manner from a pair of input overlapping images captured from a monocular camera, within a self-supervised monocular depth and ego-motion estimation problem by including multi-head self-attention modules within a transformer architecture.

Abstract: A computer-implemented method to improve scale consistency and/or scale awareness in a model of self-supervised depth and ego-motion prediction neural networks processing a video stream of monocular images, wherein complementary GPS coordinates synchronized with the images are used to calculate a GPS to scale loss to enforce the scale-consistency and/or -awareness on the monocular self-supervised ego-motion and depth estimation. A relative weight assigned to the GPS to scale loss exponentially increases as training progresses. The depth and ego-motion prediction neural networks are trained using an appearance-based photometric loss between real and synthesized target images, as well as a smoothness loss on the depth predictions.