Abstract: A technique is described herein for temporally and spatially interpolating input video information, to produce output video information having a higher frame rate and a higher resolution compared to that exhibited by the input video information. The technique generates feature information based on plural frames of the input video information. The technique then produces the output video information based on the feature information using an architecture having, in order, a multi-stage encoding operation, a query-generating operation, and a multi-stage decoding operation. Each encoding stage produces an instance of encoder attention information that expresses identified relations across the plural frames of the input video information. Each decoding stage operates on an instance of encoder attention information produced by a corresponding encoding stage. The transformer architecture is compact and is capable of interpolating the input video information in real time.

Abstract: A method performed by a processor of a computing system is described herein, where the method includes obtaining an image that includes an object having a shape, where a boundary of the shape of the object in the digital image is labeled in the digital image. The method also includes computing an encoding for the shape, where computing the encoding for the shape includes partitioning the shape into multiple partitions. Computing the encoding for the shape further includes, for the multiple partitions, computing angle-based contour descriptors that represent boundaries of the partitions, where the encoding for the shape of the object is based upon the angle-based contour descriptors.

Abstract: Technologies described herein relate to training and compressing a computer-implemented model. To that end, an untrained computer-implemented model is obtained, where the untrained computer-implemented model is to be trained and compressed. The untrained computer-implemented model includes an operator that comprises a structure. Further, training data is obtained, where the training data is to be employed to train the computer-implemented model. Upon receipt of a request from a user, the untrained computer-implemented model is trained and compressed based upon the training data. The untrained computer-implemented model is trained and compressed without further input from the user, such that a trained and compressed computer-implemented model is generated. The trained and compressed model does not include the structure.

Abstract: Systems and methods for generating interpolated images are disclosed. In examples, image features are extracted from a first image and a second image; such image features may be warped using first and second plurality of parameters. A first candidate intermediate frame may be generated based on the warped first features and the warped second features. Multi-scale features associated with the image features extracted from the first image and the second image may be obtained and warped using the first and second plurality of parameters. A second candidate intermediate frame may be generated based on the warped first multi-scale features and the warped second multi-scale features. By blending the first candidate intermedia frame with the second candidate intermediate frame, an interpolated image may be generated.

Abstract: A technique is described herein for temporally and spatially interpolating input video information, to produce output video information having a higher frame rate and a higher resolution compared to that exhibited by the input video information. The technique generates feature information based on plural frames of the input video information. The technique then produces the output video information based on the feature information using an architecture having, in order, a multi-stage encoding operation, a query-generating operation, and a multi-stage decoding operation. Each encoding stage produces an instance of encoder attention information that expresses identified relations across the plural frames of the input video information. Each decoding stage operates on an instance of encoder attention information produced by a corresponding encoding stage. The transformer architecture is compact and is capable of interpolating the input video information in real time.

Abstract: Systems and methods for generating interpolated images are disclosed. In examples, image features are extracted from a first image and a second image; such image features may be warped using first and second plurality of parameters. A first candidate intermediate frame may be generated based on the warped first features and the warped second features. Multi-scale features associated with the image features extracted from the first image and the second image may be obtained and warped using the first and second plurality of parameters. A second candidate intermediate frame may be generated based on the warped first multi-scale features and the warped second multi-scale features. By blending the first candidate intermedia frame with the second candidate intermediate frame, an interpolated image may be generated.