Abstract: There is provided a learning method and a learning device for performing transfer learning on an object detector that has been trained to detect first object classes such that the object detector is able to detect second object classes. Further, a testing method and a testing device are provided to allow at least part of the first object classes and the second object classes to be detected by using the object detector having been trained through the transfer learning. Accordingly, a detection performance can be improved for the second object classes that cannot be detected through training data set corresponding to the first object classes.

Abstract: A method for generating an object detector based on deep learning capable of detecting an extended object class is provided. The method is related to generating the object detector based on the deep learning capable of detecting the extended object class to thereby allow both an object class having been trained and additional object class to be detected. According to the method, it is possible to generate the training data set necessary for training an object detector capable of detecting the extended object class at a low cost in a short time and further it is possible to generate the object detector capable of detecting the extended object class at a low cost in a short time.

Abstract: A method for tracking an object in a low frame rate video is provided. Matching processes are performed between consecutive frames by using conversion feature maps acquired by converting each of features on feature maps of the consecutive frames into feature descriptors including each corresponding feature information and each corresponding location information, thereby allowing object tracking regardless of whether time interval per frame is long or short. The object tracking is performed by matching feature descriptors on a plurality of pyramid feature maps on an entire area of a next frame and feature descriptors on a plurality of cropped feature maps generated by cropping object areas extracted on a current frame, thereby allowing not only quick matching between the cropped areas and the entire area but also the increased accuracy due to no limitation of the feature searching area.

Abstract: A method for learning parameters of a CNN using a 1×K convolution operation or a K×1 convolution operation is provided to be used for hardware optimization which satisfies KPI. The method includes steps of: a learning device (a) instructing a reshaping layer to two-dimensionally concatenate features in each group comprised of corresponding K channels of a training image or its processed feature map, to thereby generate a reshaped feature map, and instructing a subsequent convolutional layer to apply the 1×K or the K×1 convolution operation to the reshaped feature map, to thereby generate an adjusted feature map; and (b) instructing an output layer to refer to features on the adjusted feature map or its processed feature map, and instructing a loss layer to calculate losses by referring to an output from the output layer and its corresponding GT.

Abstract: A method for on-device continual learning of a neural network which analyzes input data is provided to be used for smartphones, drones, vessels, or a military purpose. The method includes steps of: a learning device, (a) sampling new data to have a preset first volume, instructing an original data generator network, which has been learned, to repeat outputting synthetic previous data corresponding to a k-dimension random vector and previous data having been used for learning the original data generator network, such that the synthetic previous data has a second volume, and generating a batch for a current-learning; and (b) instructing the neural network to generate output information corresponding to the batch. The method can be performed by generative adversarial networks (GANs), online learning, and the like. Also, the present disclosure has effects of saving resources such as storage, preventing catastrophic forgetting, and securing privacy.

Abstract: A method for explainable active learning, to be used for an object detector, by using a deep autoencoder is provided. The method includes steps of an active learning device (a) (i) inputting acquired test images into the object detector to detect objects and output bounding boxes, (ii) cropping regions, corresponding to the bounding boxes, in the test images, (iii) resizing the test images and the cropped images into a same size, and (iv) inputting the resized images into a data encoder of the deep autoencoder to output data codes, and (b) (i) confirming reference data codes corresponding to the number of the resized images less than a counter threshold by referring to a data codebook, (ii) extracting specific data codes from the data codes, (iii) selecting specific test images as rare samples, and (iv) updating the data codebook by referring to the specific data codes.

Abstract: A method of generating training data for a deep learning network is provided.

Abstract: A method for learning a recurrent neural network to check an autonomous driving safety to be used for switching a driving mode of an autonomous vehicle is provided. The method includes steps of: a learning device (a) if training images corresponding to a front and a rear cameras of the autonomous vehicle are acquired, inputting each pair of the training images into corresponding CNNs, to concatenate the training images and generate feature maps for training, (b) inputting the feature maps for training into long short-term memory models corresponding to sequences of a forward RNN, and into those corresponding to the sequences of a backward RNN, to generate updated feature maps for training and inputting feature vectors for training into an attention layer, to generate an autonomous-driving mode value for training, and (c) allowing a loss layer to calculate losses and to learn the long short-term memory models.

Abstract: A learning method for acquiring at least one personalized reward function, used for performing a Reinforcement Learning (RL) algorithm, corresponding to a personalized optimal policy for a subject driver is provided. And the method includes steps of: (a) a learning device performing a process of instructing an adjustment reward network to generate first adjustment rewards, by referring to the information on actual actions and actual circumstance vectors in driving trajectories, a process of instructing a common reward module to generate first common rewards by referring to the actual actions and the actual circumstance vectors, and a process of instructing an estimation network to generate actual prospective values by referring to the actual circumstance vectors; and (b) the learning device instructing a first loss layer to generate an adjustment reward and to perform backpropagation to learn parameters of the adjustment reward network.

Abstract: A method for learning a recurrent neural network to check an autonomous driving safety to be used for switching a driving mode of an autonomous vehicle is provided. The method includes steps of: a learning device (a) if training images corresponding to a front and a rear cameras of the autonomous vehicle are acquired, inputting each pair of the training images into corresponding CNNs, to concatenate the training images and generate feature maps for training, (b) inputting the feature maps for training into long short-term memory models corresponding to sequences of a forward RNN, and into those corresponding to the sequences of a backward RNN, to generate updated feature maps for training and inputting feature vectors for training into an attention layer, to generate an autonomous-driving mode value for training, and (c) allowing a loss layer to calculate losses and to learn the long short-term memory models.

Abstract: A method for auto-labeling images by using a class-agnostic refinement module is provided. The method includes steps of: (a) an auto-labeling device inputting the images into a coverage controlling module, to thereby allow the coverage controlling module to label objects on the images and thus to output first labeling data including first object region data and first class data; (b) the auto-labeling device inputting the images and the first object region data into the class-agnostic refinement module, to thereby allow the class-agnostic refinement module to label the objects on the images and thus to generate second object region data, and allowing the class-agnostic refinement module to align the first object region data and the second object region data to thereby output refined object region data; and (c) the auto-labeling device generating second labeling data including the first class data and the refined object region data.

Abstract: A method for training an auto-labeling device is provided. The method includes: (a) inputting a training image to a pre-trained feature extraction module to generate a feature, (b) inputting the feature to a pre-trained first classification module to output a first class score and a first uncertainty score, inputting the feature to a pre-trained second classification module, to output a second class score and a second uncertainty score, generating a scaled second uncertainty score by applying a scale parameter to the second uncertainty score, and then inputting the feature to a fitness estimation module to output a fitness value; and (c) (i) updating the scale parameter by using an uncertainty loss generated based on the first uncertainty score and the scaled second uncertainty score, and (ii) training the fitness estimation module by using a cross-entropy loss generated based on the uncertainty loss and the fitness value.

Abstract: A method for training an auto labeling device capable of performing automatic verification by using uncertainty scores of labels is provided. The method includes steps of: a learning device (a) inputting unlabeled training images into a trained object detection network and a trained convolution network to generate bounding boxes for training and feature maps for training; and (b) (i) instructing an ROI pooling layer to generate pooled feature maps for training, (ii) at least one of (ii-1) inputting the pooled feature maps for training into a first classifier to generate first class scores for training and first box uncertainty scores for training, and (ii-2) inputting the pooled feature maps for training into a second classifier to generate second class scores for training and second box uncertainty scores for training, and (iii) training one of the first classifier using first class losses and the second classifier using second class losses.

Abstract: A method for training an auto labeling device performing automatic verification using uncertainty of labels is provided. The method includes steps of: a learning device (a) (i) inputting unlabeled training images into (i-1) an object detection network to generate bounding boxes for training and (i-2) a convolution network to generate feature maps for training, and (ii) allowing an ROI pooling layer to generate pooled feature maps for training and inputting the pooled feature maps for training into a deconvolution network to generate segmentation masks for training; and (b) (i) inputting the pooled feature maps for training into at least one of (i-1) a first classifier to generate first per-pixel class scores for training and first mask uncertainty scores for training and (i-2) a second classifier to generate second per-pixel class scores for training and second mask uncertainty scores for training and (ii) training the first classifier or the second classifier.

Abstract: A method for generating a lane departure warning (LDW) alarm by referring to information on a driving situation is provided to be used for ADAS, V2X or driver safety which are required to satisfy level 4 and level 5 of autonomous vehicles. The method includes steps of: a computing device instructing a LDW system (i) to collect information on the driving situation including information on whether a specific spot corresponding to a side mirror on a side of a lane, into which the driver desires to change, belongs to a virtual viewing frustum of the driver and (ii) to generate risk information on lane change by referring to the information on the driving situation; and instructing the LDW system to generate the LDW alarm by referring to the risk information. Thus, the LDW alarm can be provided to neighboring autonomous vehicles of level 4 and level 5.

Abstract: A method for achieving better performance in autonomous driving while saving computing power, by using confidence scores representing a credibility of an object detection which is generated in parallel with an object detection process is provided.

Abstract: A learning method of a CNN (Convolutional Neural Network) for monitoring one or more blind spots of a monitoring vehicle is provided. The learning method includes steps of: a learning device, if training data corresponding to output from a detector on the monitoring vehicle is inputted, instructing a cue information extracting layer to uses class information and location information on a monitored vehicle included in the training data, thereby outputting cue information on the monitored vehicle; instructing an FC layer for monitoring the blind spots to perform neural network operations by using the cue information, thereby outputting a result of determining whether the monitored vehicle is located on one of the blind spots; and instructing a loss layer to generate loss values by referring to the result and its corresponding GT, thereby learning parameters of the FC layer for monitoring the blind spots by backpropagating the loss values.

Abstract: Processes of explainable active learning, for an object detector, by using a Bayesian dual encoder is provided. The processes include: (a) inputting test images into the object detector to generate cropped images, resizing the test images and the cropped images, and inputting the resized images into a data encoder to output data codes; (b) (b1) one of (i) inputting the test images into the object detector, applying Bayesian output embedding and resizing the activation entropy maps and the cropped activation entropy maps, and (ii) inputting resized object images and applying the Bayesian output embedding and (b2) inputting the resized activation entropy maps into a model encoder to output model codes; and (c) (i) confirming reference data codes, selecting specific test images as rare samples, and updating the data codebook, and (ii) confirming reference model codes and selecting specific test images as hard samples.

Abstract: A method for training a deep learning network based on artificial intelligence is provided. The method includes steps of: a learning device (a) inputting unlabeled data into an active learning network to acquire sub unlabeled data and inputting the sub unlabeled data into an auto labeling network to generate new labeled data; (b) allowing a continual learning network to sample the new labeled data and existing labeled data to generate a mini-batch, and train the existing learning network using the mini-batch to acquire a trained learning network, wherein part of the mini-batch are selected by referring to specific existing losses; and (c) (i) allowing an explainable analysis network to generate insightful results on validation data and transmit the insightful results to a human engineer to transmit an analysis of the trained learning network and (ii) modifying at least one of the active learning network and the continual learning network.

Abstract: A learning method for calculating collision probability, to be used for determining whether it is appropriate or not to switch driving modes of a vehicle capable of an autonomous driving, by analyzing a recent driving route of a driver is provided. And the method includes steps of: (a) a learning device, on condition that a status vector and a trajectory vector are acquired, performing processes of (i) instructing a status network to generate a status feature map and (ii) instructing a trajectory network to generate a trajectory feature map; (b) the learning device instructing a safety network to calculate a predicted collision probability representing a predicted probability of an accident occurrence; and (c) the learning device instructing a loss layer to generate a loss by referring to the predicted collision probability and a GT collision probability, which have been acquired beforehand, to learn at least part of parameters.