Abstract: The present application discloses an autoregression image abnormity detection method of enhancing a latent space based on memory, which belongs to the field of abnormity detection in computer vision. The present application comprises: selecting a training data set; constructing a network structure of an autoregression model of enhancing a latent space based on memory; preprocessing the training data set; initializing the autoregression model of enhancing a latent space based on memory; training the autoregression model of enhancing a latent space based on memory; verifying the model on the selected data set, and using the trained model to judge whether the input image is an abnormal image. In the present application, a prior distribution is not needed to be set such that the distribution of the data itself will not be destroyed, and it can prevent the model from reconstructing abnormal images, and ultimately can better judge abnormal images.

Abstract: This disclosure relates to improved sketch-based image retrieval (SBIR) techniques. The SBIR techniques utilize a neural network architecture to train a domain migration function and a hashing function. The domain migration function is configured to transform sketches into synthetic images, and the hashing function is configured to generate hash codes from synthetic images and authentic images in a manner that preserves semantic consistency across the sketch and image domains. The hash codes generated from the synthetic images can be used for accurately identifying and retrieving authentic images corresponding to sketch queries, or vice versa.

Abstract: The disclosure provides a method for enhancing audio-visual association by adopting self-supervised curriculum learning. With the help of contrastive learning, the method can train the visual and audio model without human annotation and extracts meaningful visual and audio representations for a variety of downstream tasks in the context of a teacher-student network paradigm. Specifically, a two-stage self-supervised curriculum learning scheme is proposed to contrast the visual and audio pairs and overcome the difficulty of transferring between visual and audio information in the teacher-student framework. Moreover, the knowledge shared between audio and visual modality serves as a supervisory signal for contrastive learning. In summary, with the large-scale unlabeled data, the method can obtain a visual and an audio convolution encoder. The encoders are helpful for downstream tasks and cover the training shortage causing by limited data.

Abstract: This disclosure relates to improved techniques for performing multi-view image clustering. The techniques described herein utilize machine learning functions to optimize the image clustering process. Multi-view features are extracted from a collection of images. A machine learning function is configured to jointly learn a fused binary representation that combines the multi-view features and one or more binary cluster structures that can be used to partition the images. A clustering function utilizes the fused binary representation and the one or more binary cluster structures to generate one or more image clusters based on the collection of images.

Abstract: This disclosure relates to improved sketch-based image retrieval (SBIR) techniques. The SBIR techniques utilize a neural network architecture to train a domain migration function and a hashing function. The domain migration function is configured to transform sketches into synthetic images, and the hashing function is configured to generate hash codes from synthetic images and authentic images in a manner that preserves semantic consistency across the sketch and image domains. The hash codes generated from the synthetic images can be used for accurately identifying and retrieving authentic images corresponding to sketch queries, or vice versa.

Abstract: This disclosure relates to improved techniques for performing multi-view image clustering. The techniques described herein utilize machine learning functions to optimize the image clustering process. Multi-view features are extracted from a collection of images. A machine learning function is configured to jointly learn a fused binary representation that combines the multi-view features and one or more binary cluster structures that can be used to partition the images. A clustering function utilizes the fused binary representation and the one or more binary cluster structures to generate one or more image clusters based on the collection of images.

Abstract: This disclosure relates to improved techniques for synthesizing three-dimensional (3D) scenes. The techniques can utilize a neural network architecture to analyze images for detecting objects, classifying scenes and objects, and determining degree of freedom information for objects in the images. These tasks can be performed by, at least in part, using inter-object and object-scene dependency information that captures the spatial correlations and dependencies among objects in the images, as well as the correlations and relationships of objects to scenes associated with the images. 3D scenes corresponding to the images can then be synthesized using the inferences provided by the neural network architecture.

Abstract: This disclosure relates to improved sketch-based image retrieval (SBIR) techniques. The SBIR techniques utilize an architecture comprising three interconnected neural networks to enable zero-shot image recognition and retrieval based on free-hand sketches. Zero-shot learning may be implemented to retrieve one or more images corresponding to the sketches without prior training on all categories of the sketches. The neural network architecture may do so, at least in part, by training encoder hashing functions to mitigate heterogeneity of sketches and images, and by applying semantic knowledge that is learned during a limited training phase to unknown categories.