Abstract: Provided are a method for generating a summary and system therefor. The method according to some embodiments may include generating a first view sample corresponding to a local view of a reference sample. generating a second view sample corresponding to a view greater than the local view from the reference sample; generating a first output value by inputting the first view sample to a first embedding model. generating a second output value by inputting the second view sample to a second embedding model. and updating parameters of the first embedding model based on a difference between the first output value and the second output value.

Abstract: An apparatus for analyzing multimodal data includes an image processor configured to generate an activation embedding vector based on an index of an activation map obtained from image data through a convolutional neutral network, a text processor configured to receive text data to generate a text embedding vector, a vector concatenator configured to concatenate the activation embedding vector and the text embedding vector to each other to generate a concatenated embedding vector, and an encoder configured to generate a multimodal representation vector in consideration of an influence between elements constituting the concatenated embedding vector based on self-attention.