Abstract: Provided are an object detection method and apparatus for an autonomous vehicle. A method of controlling a vehicle includes: detecting a surrounding environment using pieces of data on a driving environment of the vehicle and generating an indication of the surrounding environment; determining, among trained visual prompts received via a network from a server, a target visual prompt corresponding to the pieces of data; generating a merged image by combining a driving image of the autonomous vehicle with the target visual prompt using a predetermined operation; and performing object detection by inputting the merged image into a neural network model of the vehicle, the neural network model configured to infer objects from images inputted thereto.

Abstract: A learning method of generating a vector map and a method and apparatus for generating a vector map are disclosed. The learning method includes converting a first feature extracted by inputting a first modality sensed by a first sensor to a student model into a first feature vector in a bird eye view (BEV) space, converting a second feature extracted by inputting a multi-modality including the first modality and a second modality sensed by a second sensor to a teacher model into a second feature vector in the BEV space, and learning the student model to generate a vector map corresponding to the first modality by back-propagating cross-correlation loss by dimension that causes the first feature vector to replicate a cross-correlation with the second feature vector to the student model.

Abstract: A method and apparatus with object estimation model training is provided. The method include generating a cross-correlation loss based on a first feature vector, generated using an interim first neural network (NN) model provided an input based on first input data about a target object, and a second feature vector generated using a trained second neural network provided another input based on second input data about the target object; and generating a trained first NN model, including training the interim first NN model based on the cross-correlation loss.

Abstract: A method and apparatus for composing a traffic light image are provided, where the method includes separating a foreground and a background of each of the one or more actual images using a color separator, training a color transformation matrix configured to estimate a color value of the foreground, training a position estimator configured to estimate a position of a center of the foreground from a brightness value of each of the one or more actual images, and generating a target image based on inputting an input image to the position estimator and the color separator.