Abstract: A method of processing, prior to encoding using an external encoder, image data using an artificial neural network is provided. The external encoder is operable in a plurality of encoding modes. At the neural network, image data representing one or more images is received. The image data is processed using the neural network to generate output data indicative of an encoding mode selected from the plurality of encoding modes of the external encoder. The neural network trained to select using image data an encoding mode of the plurality of encoding modes of the external encoder using one or more differentiable functions configured to emulate an encoding process. The generated output data is outputted from the neural network to the external encoder to enable the external encoder to encode the image data using the selected encoding mode.

Abstract: Image data representing one or more images at a first resolution is received at a first artificial neural network (ANN). The image data is processed using the first ANN to generate upscaled image data representing the one or more images at a second, higher resolution. The first ANN is trained to perform image upscaling and is trained using first training image data representing one or more training images at the first resolution, the first training image data being at a first level of quality. The first ANN is also trained using features of a second ANN, wherein the second ANN is trained to perform image upscaling and is trained using second training image data representing one or more training images at the first resolution, the second training image data being at a second level of quality, higher than the first level of quality.

Abstract: Certain aspects of the present disclosure provide techniques for encoding image data for one or more images. In one embodiment, a method includes the steps of downscaling the one or more images, and encoding the one or more downscaled images using an image codec. Another embodiment concerns a computer-implemented method of decoding encoded image data, and a computer-implemented method of encoding and decoding image data.

Abstract: Certain aspects of the present disclosure provide techniques for preprocessing, prior to encoding with an external encoder, image data using a preprocessing network comprising a set of inter-connected weights is provided. At the preprocessing network, image data from one or more images is received. The image data is processed using the preprocessing network to generate an output pixel representation for encoding with the external encoder. The weights of the preprocessing network are trained to optimize a combination of at least one quality score indicative of the quality of the output pixel representation and a rate score indicative of the bits required by the external encoder to encode the output pixel representation.

Abstract: A method of preprocessing, prior to encoding with an external encoder, image data using a preprocessing network comprising a set of inter-connected learnable weights is provided. At the preprocessing network, image data from one or more images is received. The image data is processed using the preprocessing network to generate an output pixel representation for encoding with the external encoder. The preprocessing network is configured to take as an input display configuration data representing one or more display settings of a display device operable to receive encoded pixel representations from the external encoder. The weights of the preprocessing network are dependent upon the one or more display settings of the display device.

Abstract: A method of configuring an image encoder emulator. Input image data is encoded at an encoding stage comprising a network of inter-connected weights, and decoded at a decoding stage to generate a first distorted version of the input image data. The first distorted version is compared with a second distorted version of the input image data generated using an external encoder to determine a distortion difference score. A rate prediction model is used to predict an encoding bitrate associated with encoding the input image data to a quality corresponding to the first distorted version. A rate difference score is determined by comparing the predicted encoding bitrate with an encoding bitrate used by the external encoder to encode the input image data to a quality corresponding to the second distorted version. The weights of the encoding stage are trained based on the distortion difference score and the rate difference score.

Abstract: A method of preprocessing, prior to encoding with an external encoder, image data using a preprocessing network comprising a set of inter-connected learnable weights is provided. At the preprocessing network, image data from one or more images is received. The image data is processed using the preprocessing network to generate an output pixel representation for encoding with the external encoder. The preprocessing network is configured to take as an input encoder configuration data representing one or more configuration settings of the external encoder. The weights of the preprocessing network are dependent upon the one or more configuration settings of the external encoder.

Abstract: A method of processing image data at a server is provided. Image data from one or more images is received at a preprocessing network comprising a set of inter-connected learnable weights, the weights being dependent upon one or more display settings of a display device. The image data is processed using the preprocessing network to generate a plurality of output pixel representations corresponding to different display settings of the display device. The plurality of output pixel representations are encoded to generate a plurality of encoded bitstreams. At least one selected bitstream is transmitted from the server to the display device, wherein the at least one encoded bitstream is selected on the basis of the one or more display settings of the display device.

Abstract: In a method of generating a measure of video quality, a set of weightings (160) for a plurality of objective quality metrics is obtained. The objective quality metrics have themselves been calculated from a plurality of measurable objective properties (120) of video data files (100). The weightings (160) have been determined by fitting the objective quality metrics to a set comprising a ground-truth quality rating of each of the video data files coming from human scoring of quality (100). The method includes receiving a target video data file (180), the quality of which is to be measured. Values are calculated for the objective quality metrics (220) on the target video data file (180). The measure of video quality (240) is generated by combining the values for the objective quality metrics (220) on the target video data file (180) using the obtained set of weightings (160).

Abstract: A bit stream representing n-dimensional data structures may be encoded and decoded. A part of the data can be mappable within predefined similarity criteria to a part of the data of another data structure. The similarity criteria may include, a spatial or temporal shift of the data. The data structures are typically sequential video frames such as is used in motion estimation and/or compensation of moving pictures, and a part of the data structure may be a block of data within a frame. The shift may be any suitable shift such as linear translation, rotation, or change of size. Digital filtering may be applied to a reference or other frame of data to generate subbands of a set of subbands of an overcomplete representation of the frame by calculations performed at single rate. The digital filtering may be implemented in a separate filter module or in software.

Abstract: A method and apparatus is described for coding motion information in video processing of a stream of image frames and for avoiding the drift problem. The method or apparatus is for providing motion vectors of at least one image frame, and for coding the motion vectors to generate a quality-scalable representation of the motion vectors. The quality-scalable representation of motion vectors can comprise a set of base-layer motion vectors and a set of one or more enhancement-layers of motion vectors. The method of decoding and a decoder for such coded motion vectors as part of receiving and processing a bit stream at a receiver includes the base-layer of motion vectors being losslessly decoded, while the one or more enhancement layers of motion vectors are progressively received and decoded, optionally including progressive refinement of the motion vectors, eventually up to their lossless reconstruction.

Abstract: Method and apparatus for encoding and decoding a bit stream comprising a representation of a sequence of n-dimensional data structures or matrices, in which n is typically 2. A part of the data of one data structure of the sequence can be mappable within predefined similarity criteria to a part of the data of a another data structure of the sequence. The similarity criteria may include, for instance, a spatial or temporal shift of the data within an image of a video signal such as is used in motion estimation and/or compensation of moving pictures, e.g., video images as well as coders and encoders for coding such a bitstream, e.g., a video signal for use in motion compensation and/or estimation. The data structures are typically video frames and a part of the data structure may be a block of data within a frame.