Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in operation, selects an encoding mode from among candidates including a decoder-side motion vector refinement (DMVR) encoding mode and a partition encoding mode. When the DMVR encoding mode is selected, the circuitry: obtains a first motion vector for a first image block; derives a second motion vector from the first motion vector using motion search; and generates a prediction image for the first image block using the second motion vector. When the partition encoding mode is selected, the circuitry: determines a plurality of partitions in a second image block; obtains a third motion vector for each partition; and generates a prediction image for the second image block using the third motion vector, without deriving a fourth motion vector from the third motion vector using motion search.

Abstract: An image processing apparatus, including a memory configured to store one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to cause the image processing apparatus to: identify, in a previous frame, a prediction sample corresponding to a current sample of a current frame, generate a prediction frame for the current frame by changing a sample value of a collocated sample of the previous frame according to a sample value of the prediction sample, derive a weight by comparing a sample value of the current sample with the sample value of the prediction sample, apply the weight to a collocated sample of the prediction frame to obtain a weighted prediction frame, and obtain a current output frame by processing the current frame and the weighted prediction frame through a neural network comprising a convolution layer.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in operation, selects an encoding mode from among candidates including a decoder-side motion vector refinement (DMVR) encoding mode and a partition encoding mode. When the DMVR encoding mode is selected, the circuitry: obtains a first motion vector for a first image block; derives a second motion vector from the first motion vector using motion search; and generates a prediction image for the first image block using the second motion vector. When the partition encoding mode is selected, the circuitry: determines a plurality of partitions in a second image block; obtains a third motion vector for each partition; and generates a prediction image for the second image block using the third motion vector, without deriving a fourth motion vector from the third motion vector using motion search.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in operation, selects an encoding mode from among candidates including a decoder-side motion vector refinement (DMVR) encoding mode and a partition encoding mode. When the DMVR encoding mode is selected, the circuitry: obtains a first motion vector for a first image block; derives a second motion vector from the first motion vector using motion search; and generates a prediction image for the first image block using the second motion vector. When the partition encoding mode is selected, the circuitry: determines a plurality of partitions in a second image block; obtains a third motion vector for each partition; and generates a prediction image for the second image block using the third motion vector, without deriving a fourth motion vector from the third motion vector using motion search.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in operation, selects an encoding mode from among candidates including a decoder-side motion vector refinement (DMVR) encoding mode and a partition encoding mode. When the DMVR encoding mode is selected, the circuitry: obtains a first motion vector for a first image block; derives a second motion vector from the first motion vector using motion search; and generates a prediction image for the first image block using the second motion vector. When the partition encoding mode is selected, the circuitry: determines a plurality of partitions in a second image block; obtains a third motion vector for each partition; and generates a prediction image for the second image block using the third motion vector, without deriving a fourth motion vector from the third motion vector using motion search.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in operation, selects an encoding mode from among candidates including a decoder-side motion vector refinement (DMVR) encoding mode and a partition encoding mode. When the DMVR encoding mode is selected, the circuitry: obtains a first motion vector for a first image block; derives a second motion vector from the first motion vector using motion search; and generates a prediction image for the first image block using the second motion vector. When the partition encoding mode is selected, the circuitry: determines a plurality of partitions in a second image block; obtains a third motion vector for each partition; and generates a prediction image for the second image block using the third motion vector, without deriving a fourth motion vector from the third motion vector using motion search.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in operation, selects an encoding mode from among candidates including a decoder-side motion vector refinement (DMVR) encoding mode and a partition encoding mode. When the DMVR encoding mode is selected, the circuitry: obtains a first motion vector for a first image block; derives a second motion vector from the first motion vector using motion search; and generates a prediction image for the first image block using the second motion vector. When the partition encoding mode is selected, the circuitry: determines a plurality of partitions in a second image block; obtains a third motion vector for each partition; and generates a prediction image for the second image block using the third motion vector, without deriving a fourth motion vector from the third motion vector using motion search.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in operation, selects an encoding mode from among candidates including a decoder-side motion vector refinement (DMVR) encoding mode and a partition encoding mode. When the DMVR encoding mode is selected, the circuitry: obtains a first motion vector for a first image block; derives a second motion vector from the first motion vector using motion search; and generates a prediction image for the first image block using the second motion vector. When the partition encoding mode is selected, the circuitry: determines a plurality of partitions in a second image block; obtains a third motion vector for each partition; and generates a prediction image for the second image block using the third motion vector, without deriving a fourth motion vector from the third motion vector using motion search.

Abstract: An exemplary artificial intelligence/machine learning hardware computing environment having an exemplary DNN module cooperating with one or more memory components can perform data sharing and distribution as well reuse of a buffer data to reduce the number of memory component read/writes thereby enhancing overall hardware performance and reducing power consumption. Illustratively, data from a cooperating memory component is read according to a selected operation of the exemplary hardware and written to corresponding other memory component for use by one or more processing elements (e.g., neurons). The data is read in such a manner to optimize the engagement of the one or more processing elements for each processing cycle as well as to reuse data previously stored in the one or more cooperating memory components. Operatively, the written data is copied to a shadow memory buffer prior to being consumed by the processing elements.

Abstract: We provide a method of compressing a data stream for transmission, including: generating a data sequence representing a received data stream, generating a plurality of data substreams, each comprising a portion of the data sequence, identifying a formal concept defining a dependency between a first one of the data substreams and one or more further ones of the data substreams that are dependent on the first data substream, removing those dependent data substreams from the plurality of data substreams, and transmitting the remaining data substreams, and a method of reconstructing a data stream at a receiver, including: receiving a received data sequence representing a received data stream, identifying that a substream has been removed from the data stream prior to transmission, identifying a formal concept definition for regenerating the removed substream based on an identified substream of the received data sequence, regenerating a data substream using the formal concept definition and the identified substrea

Abstract: Disclosed are an image enhancement method and an image enhancement apparatus which can realize the edge enhancement for an image generated after a demosaicing process according to local characteristics of an input image (i.e. the image sharpening) and can realize the brightness noise suppression and the chroma noise suppression for the image. Thus, by using the image enhancement method and the image enhancement apparatus provided by the present disclosure, clear images can be generated.

Abstract: An image decoding method including: obtaining an old quantization scaling matrix which is a decoded quantization scaling matrix and is used for decoding a new quantization scaling matrix; obtaining, from the coded stream, an update parameter indicating an amount of change in the new quantization scaling matrix with respect to the old quantization scaling matrix; decoding the new quantization scaling matrix using the old quantization scaling matrix obtained in the obtaining of an old quantization scaling matrix and the update parameter obtained in the obtaining of an update parameter; and decoding the coded image using the new quantization scaling matrix decoded in the decoding of the new quantization scaling matrix.

Abstract: Disclosed herein are exemplary embodiments of methods, apparatus, and systems for performing content-adaptive deblocking to improve the visual quality of video images compressed using block-based motion-predictive video coding. For instance, in certain embodiments of the disclosed technology, edge information is obtained using global orientation energy edge detection (“OEED”) techniques on an initially deblocked image. OEED detection can provide a robust partition of local directional features (“LDFs”). For a local directional feature detected in the partition, a directional deblocking filter having an orientation corresponding to the orientation of the LDF can be used. The selected filter can have a filter orientation and activation thresholds that better preserve image details while reducing blocking artifacts. In certain embodiments, for a consecutive non-LDF region, extra smoothing can be imposed to suppress the visually severe blocking artifacts.

Abstract: The present disclosure relates to deblocking filtering, which may be advantageously applied for block-wise encoding and decoding of images or video signals. In particular, the present disclosure relates to an improved memory management in an automated decision on whether to apply or skip deblocking filtering for a block and to selection of the deblocking filter. The decision is performed on the basis of a segmentation of blocks in such a manner that memory usage is optimized. Preferably, the selection of appropriate deblocking filters is improved so as to reduce computational expense.

Abstract: Methods and apparatus to reduce compression artifacts in images are disclosed herein. An example method includes separating at least a portion of an image into a first component and a second component, reducing a first artifact in the first component to form a first cleaned component, reducing, using the first cleaned component, a second artifact in the second component to form a second cleaned component, and combining the first cleaned component and the second cleaned component to form a cleaned image.

Abstract: The present disclosure relates to deblocking filtering, which may be advantageously applied for block-wise encoding and decoding of images or video signals. In particular, the present disclosure relates to an improved memory management in an automated decision on whether to apply or skip deblocking filtering for a block and to selection of the deblocking filter. The decision is performed on the basis of a segmentation of blocks in such a manner that memory usage is optimized. Preferably, the selection of appropriate deblocking filters is improved so as to reduce computational expense.

Abstract: Systems and methods for generating domain-compliant image data. Domain-specific usage rights may be evaluated. The domain-specific usage rights may be associated with the transfer of particular encoded image data to a particular computing system other than the computing system. The domain-specific usage rights may specify maximum allowable spatial frequency content of the particular encoded image data. Domain-compliant image data may be generated by removing particular disallowable spatial frequency content from the encoded image data prior to transfer to the particular computing system.

Abstract: An image processing apparatus includes: an input unit adapted to input an image; a first acquisition unit adapted to acquire a low-frequency component image from the image input by the input unit; a first transformation unit adapted to transform the low-frequency component image acquired by the first acquisition unit; a second transformation unit adapted to transform the image input by the input unit; a second acquisition unit adapted to acquire a transformed high-frequency component image from the transformed image obtained by the second transformation unit; and a display control unit adapted to display, on a display unit, a combined image obtained by combining the transformed low-frequency component image obtained by the first transformation unit and the transformed high-frequency component image acquired by the second acquisition unit.

Abstract: A method and system detection of inherent noise present within a video source prior to digital video compression is disclosed. A noise image is extracted by subtracting a current image from its filtered version. Each pixel of the extracted noise image is normalized based on a determined principal edge image and the analog noise pixels are accumulated to generate an intermediate noise confidence value. Analog noise may be detected based on an analog noise confidence value generated based on the intermediate noise confidence value and a ringing metric, a blockiness metric, a motion vector cost of the current image, a blurriness exception weight, a flashiness exception weight, and a pan blur exception weight. The method may further comprise detection of high frequency noise based on determining a high frequency noise confidence value that may be based on a high frequency noise value and a frequency component with highest magnitude.

Abstract: Clusters of pixels are defined for image compression and decompression. The image information used to define the clusters may include pixel values at predetermined positions relative to a pixel or related motion vectors, gradients, texture etc. During compression of images, image information relative to pixels is examined to determine the cluster to which it belongs. Thus pixels can be classified according to the cluster for their image information. In an embodiment the definitions of the clusters are selected dynamically, dependent on image content. For each cluster a control parameter set is computed for a post-processing operation, such as filter coefficients for filtering or statistical data for locally generating texture. The control parameter set is selected dependent on the image content so that, when the post-processing operation is applied to the image after decompression it will improve image quality for the pixels that are classified as belonging to the cluster.

Abstract: According to an embodiment, a reproduction device includes an acquirer, a decoder, and a synthesizer. The acquirer is configured to acquire transmission information including first and second coded data. The first and second coded data are generated by encoding first and second image data, respectively. At least one of the first and the second image data is lossy encoded. The first and second image data being generated by performing conversion processes different from each other on original image data. The decoder is configured to decode the first and second coded data to generate first and second decoded data. The synthesizer is configured to synthesize the first and the second decoded data with adjusting pixel positions of the first and the second decoded data so that the pixel positions of the first and the second decoded data are identical to each other to generate reproduction image data.

Abstract: A method for generating an intermediate view on the basis of left and right views of a 3D picture and a disparity map, the method including: using pixel information contained in the left and right views and the disparity map for creating an intermediate view, identifying occlusion pixels in the created intermediate view, and filling the occlusion pixels with information gained from adjacent pixels.

Abstract: The present disclosure relates to deblocking filtering, which may be advantageously applied for block-wise encoding and decoding of images or video signals. In particular, the present disclosure relates to an improved memory management in an automated decision on whether to apply or skip deblocking filtering for a block and to selection of the deblocking filter. The decision is performed on the basis of a segmentation of blocks in such a manner that memory usage is optimized. Preferably, the selection of appropriate deblocking filters is improved so as to reduce computational expense.

Abstract: A system and method for removing noise from images are disclosed herein. An exemplary system includes an edge-detection-based adaptive filter that identifies edge pixels and non-edge pixels in an image and selects a filtering technique for at least one non-edge pixel based on a comparison of the at least one non-edge pixel to a neighboring pixel region, wherein such comparison indicates whether the at least one non-edge pixel is a result of low-light noise.

Abstract: Methods and systems for video image coding are provided. Sets of filters may be selected and applied to video information at least partially based on the type of inter layer prediction implemented in coding the video information. Different filters, or filter sets, may be used for inter layer intra prediction, difference domain intra prediction, and/or difference domain inter prediction. Filter selection information may be embedded in the video bit stream.

Abstract: A method for accurately measuring flicker, by first determining an original value based on a difference between pixel values in corresponding locations in a first picture and a second picture. Next, a reconstructed value is determined, based on a difference between pixel values in corresponding locations in a reconstruction from an encoding of the first picture and a reconstruction from an encoding of the second picture. Then, a determination is made to include a comparison value, which is determined on a difference between the reconstructed value and the original value, in a measurement of flicker between the first picture and the second picture.

Abstract: A method, system and device are provided for pre-filtering device for filtering a video signal prior to digitally encoding. The method includes receiving at least one input picture and at least one reconstructed picture from an encoding process and performing an in-loop temporal filtering process using at least one input picture and at least one reconstructed picture from an encoding process to output a pre-filtered video signal for use in an encoding process. The result is enabling an encoding process to produce an output with increased temporal correlation between adjacent pictures regardless of the coding type, since the artifacts introduced by the encoding process are also considered by the process.

Abstract: A system and method for removing impulsive noise from a digital signal are disclosed. The system and method determines either a neighborhood maximum and/or a neighborhood minimum for a pixel of interest. The intensity of the pixel of interest is then compared to the neighborhood maximum or the neighborhood minimum to determine whether the pixel of interest should be replaced.

Abstract: The present invention relates to an image processing technique, and in particular to a method for restoring a compressed image by using a hybrid motion compensation discrete cosine transform (hybrid MC/DCT) mechanism, including: a step of defining a smoothing functional having a smoothing degree of an image and reliability for an original image by pixels having an identical property in image block units; and a step of computing a restored image by performing a gradient operation on the smoothing functional in regard to the original image, thereby preventing the blocking artifacts and the ringing effects in regard to the pixels having an identical property in image blocks. In one embodiment, the method includes obtaining a pixel value in a current block and at least one adjacent pixel value. A type of the current block is one of an intra-coded type and inter-coded type. A smoothing value of the current block is determined based on the obtained pixel value in the current block and the adjacent pixel value.

Abstract: A video encoding method and apparatus is shown wherein image information is represented as a plurality of pixels, the pixels are organized into blocks, pixels transposition is performed on image information at the boundaries of the blocks, the blocks are transform coded and quantized. Pixel transposition involves transposition of alternate pixels at the boundaries of blocks with pixels of neighboring blocks found in a pre-determined direction. The pre-determined direction may be fixed by a system or may be applied on an image by image basis. In the event that the pre-determined direction is not established by a system, a pixel transposition circuit includes a transposition keyword in the output bit stream which is used by a decoded to determine the direction of pixel transposition.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In the method, a pixel of an image is filtered according to a filtering methodology. The filtering methodology includes selecting a filtering mask based on a position of a pixel to be filtered.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In one embodiment of the present invention, a pixel of an image is filtered according to a filtering methodology.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In one embodiment, the filtering unit is configured to select at least four pixels of successive pixels according to a position of a pixel to be filtered. The selected at least four pixels include the pixel to be filtered.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In the apparatus, a pixel of an image is filtered by a filtering unit. The filtering unit is configured to select at least four pixels of successive pixels according to a position of a pixel to be filtered.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In the method, a pixel of an image is filtered according to a filtering methodology. The filtering methodology includes selecting at least four pixels of successive pixels according to a position of a pixel to be filtered.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In one embodiment, a pixel of an image is filtered according to a filtering methodology.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. The filtering unit is configured to select at least one candidate pixel to be associated with an averaging operation, and compare a difference between the pixel to be filtered and the candidate pixel with a threshold.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In one embodiment, the apparatus includes a filtering unit configured to filter a pixel of an image.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In an embodiment of the present invention, a pixel of an image is filtered according to a filtering methodology.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In an embodiment, the filtering unit is configured to select at least four pixels of successive pixels according to a position of a pixel to be filtered.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In an embodiment, the filtering unit is configured to select a filtering mask based on a position of a pixel to be filtered. The filtering mask includes the pixel to be filtered and at least one candidate pixel.

Abstract: A method and apparatus to remove a block effect and a ring effect appearing in a compression-coded image is disclosed. The present invention is especially applicable to an image compression-coded at a low bit rate. In particular, the present invention includes a variety of masks for the removal of the block/ring effect. Thus, one mask is select for a pixel to be filtered. Moreover, candidate pixels to be averaged with the pixel to be filtered is selected from the pixels of the selected mask to better maintain the details of the image, and a weight is applied to improve the calculation speed of the averaging operation. More particularly, the masks according to the present invention have longer tabs toward adjacent blocks at boundaries of the given block to remove the block and ring effect. In the method, a pixel of an image is filtered according to a filtering methodology. The filtering methodology includes selecting at least four pixels of successive pixels according to a position of a pixel to be filtered.

Abstract: The present invention relates to an image processing technique, and in particular to a method for restoring a compressed image by using a hybrid motion compensation discrete cosine transform (hybrid MC/DCT) mechanism, including: a step of defining a smoothing functional having a smoothing degree of an image and reliability for an original image by pixels having an identical property in image block units; and a step of computing a restored image by performing a gradient operation on the smoothing functional in regard to the original image, thereby preventing the blocking artifacts and the ringing effects in regard to the pixels having an identical property in image blocks.