Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.

Abstract: A video sequence is coded in the form of a base level and an refinement level. A group of pictures of the base level comprises intra coded or mono-predicted end images (I,P) and bi-predicted images (B1, B2, B3), the refinement level comprises at least one image (E2, E4, . . . , E16) with no temporal correspondent in the base level. Use is made of predictive coding of said image with no temporal correspondent (E2, E4, . . . , E16) by making reference to a plurality of images, each image of said plurality being an image of the refinement level with no temporal correspondent in the base level (E4, E8, E12, E14) or an image of the refinement level (E1, E17) corresponding temporally to an end image (I1P).

Abstract: An invention is disclosed for performing differencing of graphical data in post-transform space for a remote presentation session. Graphical data is transformed from a first representation to a second representation (e.g. with a DWT), and then a difference is taken of the post-transform data and the post-transform data of the frame that preceded the current frame. This difference is then encoded and transmitted to a client, which decodes it, and creates a representation of the graphical data using the delta, and a previously determined representation of the previous frame. By performing differencing in post-transform space, fidelity of the remote presentation session is retained while it may decrease bandwidth. This may occur because the entropy of the delta representation is usually lower than a non-delta representation while the scheme retains the identical data of the final decoded image of the non-delta version of the same compression scheme.

Abstract: Images can be coded based on filters defined by filter coefficients or weights assigned to previously decoded pixel values of nearby lines. The filter coefficients can be selected based on evaluation of a set of predetermined filters, or filters can be adaptively generated and then evaluated. The filters generally are based on pixel values in previous rows or columns, but not values in the current row or column. In some examples, filters are adaptively generated pixel by pixel, or portions of previous rows, columns, or previously decoded portions of the current row or columns are used to provide line templates. A filter is generally selected to reduce coding error based on a least square difference between the current value and a prediction.

Abstract: Systems and methods are disclosed for generating super resolution images by building a set of multi-resolution bases from one or more training images; estimating a sparse resolution-invariant representation of an image, and reconstructing one or more missing patches at any resolution level.

Abstract: Provided is an adaptive motion search range determining apparatus and method for encoding UHD-class high-resolution images. The adaptive motion search range determining apparatus includes an MVD average/standard deviation calculation unit calculating an value average and a standard deviation of MVDs of neighboring macroblocks of a current macroblock, and a motion search range determination unit determining a motion search range of the current macroblock using the value average and the standard deviation. According to the adaptive motion search range determining apparatus, it is possible to enable each macroblock to have an adaptive search range by variably adjusting a motion vector search range of a current macroblock with reference to motion vectors of neighboring macroblocks of the current macroblock.

Abstract: Apparatuses and techniques relating to encoding a video are provided. An encoding device includes a motion coding module configured to determine a coding block level for processing an image data, and further configured to determine a block formation for a motion coding of the image data according to the coding block level; and a texture coding module configured to determine a block size for a texture coding of the image data according to the block formation to thereby generate a coded bit stream.

Abstract: A Method and apparatus for encoding and decoding a multi-view image are provided. The method of encoding a multi-view image includes determining whether each of pictures included in multi-view image sequences is a reference picture referred to by other pictures included in the multi-view image sequences for inter-view prediction, and encoding the pictures using at least one of inter-view prediction and temporal prediction based on the determination result, thereby efficiently encoding and decoding the multi-view image at high speed.

Abstract: Error concealment is used to hide the effects of errors detected within digital video information. A novel spatial error concealment technique is disclosed for use when the error concealment mode decision determines that spatial error concealment should be used for reconstruction. The novel spatial error concealment technique divides a corrupt macroblock into multiple regions, such as, a corner region, a row adjacent to the corner region, a column adjacent to the corner region, and a remainder main region. Those regions are then reconstructed and information from earlier reconstructed regions may be used in later reconstructed regions. Finally, a macroblock refreshment technique is disclosed for preventing error propagation from harming non-corrupt inter-blocks. Specifically, an inter-macroblock may be ‘refreshed’ using spatial error concealment if there has been significant error caused damage that may cause the inter-block to propagate the errors.

Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.

Abstract: A frame extraction unit detects a luminance change point frame in which the brightness change amount between frames is equal to or higher than a threshold value from a moving image formed by a plurality of frames. A flash check unit checks the presence/absence of a flash portion in the moving image on the basis of the detected luminance change point frame.

Abstract: An image-processing method is characterized by including a searching operation of searching for a local motion vector from each of blocks in the plural images, an electing operation of electing a representative motion vector from the local motion vectors of the respective blocks, and an approximating operation of approximating a motion vector distribution on the images based on the representative motion vector in order to detect motion between plural images with high precision without increasing the number of blocks made by dividing an image. In addition, when an approximate surface thereof is a plane, the operation amount for approximating the motion vector distribution and the information amount for representing the motion vector distribution can be minimized.

Abstract: A method and apparatus of improving the compression efficiency of a motion vector is provided. The method includes obtaining a motion vector in a base layer frame having a first frame rate from an input frame, obtaining a motion vector in a first enhancement layer frame having a second frame rate from the input frame, the second frame rate being greater than the first frame rate, generating a predicted motion vector by referring to a motion vector for at least one frame among base layer frames present immediately before and after the same temporal position as the first enhancement layer frame if there is no base layer frame at the same temporal position as the first enhancement layer frame, and coding a difference between the motion vector in the first enhancement layer frame and the generated predicted motion vector, and the obtained motion vector in the base layer.

Abstract: In a method and a device for determining an image quality of an image sequence comprising several images, the images are reconstructed from a data stream encoded by a predictive encoding process, and a respective flicker indicator is determined for an image range of the respective images of the image sequence, wherein the respective flicker indicator displays by two states whether flickering occurs or not in the image range of the respective image, an overall flicker indicator being generated such that the overall flicker indicator corresponds to that number of flicker indicators which display flickering, and the image quality being generated by division of the overall flicker indicator by a number of specific flicker indicators.

Abstract: Method and system for determining a measure of quality for images are presented. Multi-level decomposition of images in the wavelet domain using a variable number of levels of decomposition and aggregation of selected subbands is performed to obtain an accurate measure of quality. The processing time is reduced in comparison to that required by other methods for generating measures of quality.

Abstract: A camera-shake correction apparatus includes an image capturing unit configured to capture an object image, a camera-shake detection unit configured to detect a camera-shake applied to the camera-shake correction apparatus, a correction unit configured to correct the camera-shake of the object image by moving a correction member based on a camera-shake signal detected by the camera-shake detection unit, and a control unit configured to measure an amplitude of the camera-shake or a frequency of the camera-shake, or both the amplitude of the camera-shake and the frequency of the camera-shake, based on the camera-shake signal supplied from the camera-shake detection unit, and the control unit further configured to control to hold the correction member at a latest position if it is determined that the measured amplitude is smaller than a predetermined amplitude or if it is determined that the measured frequency is lower than a predetermined frequency, or if it is determined that the measured amplitude is smaller

Abstract: A method for processing a plurality of motion vectors is disclosed. The method includes determining a number of different block sizes in the video frame; and, performing a variable block size motion vector process if the number of different block sizes in the video frame is greater than one, the variable block size motion vector process comprising constructing a pyramid of motion vectors from the plurality of motion vectors, the pyramid having at least a first layer and a second layer of motion vectors, each of the first and second layers having a set of motion vectors based on a particular block size. An apparatus for performing the inventive method is also disclosed.

Abstract: A method for difference threshold encoding comprising designating a first frame of image data as a reference set. Designating a second frame of image data as a difference set. Comparing the reference set to the difference set to generate a difference metric. Encoding the second frame as a duplicate of the first frame if the difference metric is less than a threshold. Storing the second frame if the difference metric is equal to or greater than the threshold. Designating a third frame of image data as a second difference set. Comparing the second difference set to the reference set to generate a second difference metric. Designating the third frame of image data as a new reference set if the second difference metric is greater than a second threshold.

Abstract: In one embodiment, a method of predicting a motion vector for a current block in a current picture by a moving picture decoding device includes obtaining, by the moving picture decoding device, a direction of a reference picture of the current picture, based on comparison of a display order of the reference picture and a display order of the current picture, obtaining, by the moving picture decoding device, at least three motion vectors for at least three other blocks than the current block based on the direction of the reference picture, predicting, by the moving picture decoding device, a motion vector for the current block by using a median operation of the at least three motion vectors and decoding the current block in the current picture using the predicted motion vector for the current block.

Abstract: In one embodiment the present invention includes a digital image processing method for concealing errors. The method includes determining error pixel locations based on motion vectors and determining if the error pixel locations in a current frame are on an edge of an object in the current frame. If an error pixel location is on an edge, then a search of pixel values is performed in the current frame along the edge for a replacement pixel value. If the error pixel location is not on an edge, then a search of pixel values is performed in a region adjacent to the edge for the replacement pixel value.

Abstract: An image encoder including: a predicted-image generating unit that generates a predicted image in accordance with a plurality of prediction modes indicating predicted-image generating methods; a prediction-mode judging unit that evaluates prediction efficiency of a predicted image outputted from the predicted-image generating unit to judge a predetermined prediction mode; and an encoding unit that subjects an output of the prediction-mode judging unit to variable-length encoding.

Abstract: In one embodiment, the apparatus includes a decoder. The decoder is configured to obtain first and second motion vectors and a reference picture index of at least one block other than the current block. The other blocks neighbor the current block. The decoder configured to determine a direction of the first and second motion vectors of the other blocks. The decoder is configured to determine first and second motion vectors of the current block based on the determined directions using the first and second motion vectors of the other blocks. This determination includes applying a median operation to the first motion vectors of the other blocks and applying a median operation to the second motion vectors of the other blocks.

Abstract: Temporal classified filtering encodes image data by applying filters assigned to classes of pixels in a target frame to predict values for the pixels. The pixels are classified based on their associated motion vectors and the motion vectors are used to position the filters on the reference frame. Prediction error values are also calculated. The filters, motion vectors, and prediction errors represent the pixels in the encoded image data. The reference frame may be a past or future frame of the image data, and multiple reference frames of various combinations of past and future frames may be used. The filters for multiple reference frames are three-dimensional comprising a two-dimensional filter for each reference frame. The filters may be pre-determined or generated as the frames are encoded. The image data is recreated by applying the filters to the reference frames and correcting the resulting predictions with the prediction error values.

Abstract: An apparatus and method for generating predictors performs motion estimation of a target macroblock in a target field against data segments in reference fields. The same motion estimation engine is used to perform various image processing operations to efficiently use resources of the apparatus. Different reference fields are used depending on modes of operation. In a deinterlacing mode, deinterlacing is performed using directional interpolation, recursive motion compensated deinterlacing, and motion adaptive deinterlacing.

Abstract: A method and system for staggered parallelized video decoding system decodes a compressed video stream at approximately double the performance of conventional systems, and outputs the decoded stream to a video display device. Even and odd video frames from the video stream are identified and stored in a memory. A first decoder processes a first portion of a first even frame from among the stored even frames. After the first decoder completes processing the first portion of the first even frame, a second decoder begins processing a first odd frame from among the stored odd frames. The processing start times of the odd frames are staggered with respect to the even frames and vice versa, and the even and odd frames are simultaneously processed using first and second decoders.

Abstract: A system and method for determining a preferred motion vector is provided, which may be used to estimate motion in a series of video image frames. The system may include a video encoder having a motion vector selector. The motion vector selector may include a first generator to generate a cost associated with motion vectors in a first direction, a selector to set a cross over point corresponding to a lowest cost motion vector in the first direction, a direction indicator to sample a set of motion vectors about the cross over point to select a preferred direction, and a second generator to generate a cost associated with the motion vectors in the preferred direction. The method may include determining a final motion vector having the lowest cost within a search window.

Abstract: Provided is a multilayer picture encoding/decoding apparatus and method for reducing a dynamic range of residual pictures occurring in enhancement layers. The multilayer picture encoding method includes performing format down-conversion on an input picture, and generating a lower layer bitstream by encoding the format down-converted input picture; performing format up-conversion by adaptively or selectively applying a 1-dimensional (1-D) prediction filter to a picture of the lower layer depending on whether a lower layer prediction flag is set or not; and calculating a residual picture between the input picture and the format up-converted picture, and generating an enhancement bitstream by encoding the calculated residual picture.

Abstract: The present invention relates to a method for conducting interlayer texture prediction in encoding or decoding of video signal. The present method constructs a pair of frame macro blocks from vertically-adjacent two field macro blocks of a base layer, selectively applies a de-blocking filter to the constructed pair of frame macro blocks, and uses texture information of the pair of frame macro blocks in interlayer texture prediction of a pair of frame macro blocks of a current layer.

Abstract: An apparatus calculates a change predicted value of a value of an interest pixel included in an interest field. The apparatus calculates a change predicted value before correcting the value of the interest pixel based on the interest field and at least one of fields which neighbors the interest field and is stored in the plurality of field memories, respectively calculates interframe difference coefficients based on any of two fields having a field interval of 2 of a plurality of fields stored in the plurality of field memories, and a field which is being input, calculates a correction value of the change predicted value based on the interframe difference coefficients calculated, and corrects the change predicted value before correction calculated by the change predicted value calculator based on the correction value calculated by the correction value calculation unit and output a change predicted value after correction.

Abstract: A video/image processing apparatus includes a storage module, a motion estimation module, and a plurality of video/image processing blocks. The storage module is arranged for storing a plurality of images. The motion estimation module is coupled to the storage module, and arranged for retrieving the images from the storage module, and generating motion vectors according to the images. The video/image processing blocks are coupled to the motion estimation module, and arranged for performing a plurality of different video/image processing operations, respectively, wherein each of the video/image processing blocks receives the motion vectors generated from the motion estimation module, and refers to the received motion vectors to perform a designated video/image processing operation.

Abstract: A Method and apparatus for encoding and decoding a multi-view image are provided. The method of encoding a multi-view image includes determining whether each of pictures included in multi-view image sequences is a reference picture referred to by other pictures included in the multi-view image sequences for inter-view prediction, and encoding the pictures using at least one of inter-view prediction and temporal prediction based on the determination result, thereby efficiently encoding and decoding the multi-view image at high speed.

Abstract: A method to estimate segmented motion uses phase correlation to identify local motion candidates and a region-growing algorithm to group small picture units into few distinct regions, each of which has its own motion according to optimal matching and grouping criteria. Phase correlation and region growing are combined which allows sharing of information. Using phase correlation to identify a small number of motion candidates allows the space of possible motions to be narrowed. The region growing uses efficient management of lists of matching criteria to avoid repetitively evaluating matching criteria.

Abstract: A method of noise filtering of a digital video sequence is provided that includes computing a motion image for a frame, wherein the motion image includes a motion value for each pixel in the frame, and wherein the motion values are computed as differences between pixel values in a luminance component of the frame and corresponding pixel values in a luminance component of a reference frame, applying a first spatial noise filter to the motion image to obtain a final motion image, computing a blending factor image for the frame, wherein the blending factor image includes a blending factor for each pixel in the frame, and wherein the blending factors are computed based on corresponding motion values in the final motion image, generating a filtered frame, wherein the blending factors are applied to corresponding pixel values in the reference frame and the frame, and outputting the filtered frame.

Abstract: An image formed in units of macroblocks of 16×16 pixels attached with a band area having a width of “a” pixels serving as a margin area is extracted as a motion compensation image from a reference frame and is regarded as an input image of a filtering process. “a” is a value that is determined in accordance with the number of taps of an FIR filter. A filtering process is performed using such a motion compensation image as an input image, and a prediction image of 16×16 pixels is output as an output image of the filtering process. The prediction image is added to an output image of an inverse orthogonal transformation circuit in an adder circuit, and an image as a result of the addition is used as a macroblock constituting a decoded frame.

Abstract: An image encoding device includes: a first encoding unit for calculating a generated code amount by encoding image data for each GOP (Group of Picture); a code amount control unit for setting quantization information for realizing a target generated code amount based on the generated code amount; a quantization information distinguishing unit for calculating a DCT (Discrete Cosine Transform) coefficient, and distinguishing quantization information that minimizes the summation for each picture of remainders when performing division of the DCT coefficient, as quantization information used for performing the last encoding; a picture-type setting unit for setting a picture type to the image data for each GOP, and when this set picture type differs from the picture type of the distinguished quantization information, matching the picture types by controlling the settings of the subsequent picture types; and a second encoding unit for encoding the image data based on the set picture type.

Abstract: Various embodiments are disclosed relating to providing multiple and native representations of an image. According to an example embodiment, multiple realizations of an image may be generated and provided, rather than only a single realization, for example. Also, in another embodiment, the generation and output of multiple realizations may use one or more native objects to natively perform the transforms or image processing to provide the images or realizations.

Abstract: A method for constructing a motion-compensated composite image of a scene includes acquiring a plurality of images of a scene over time, the plurality of images including an earlier-acquired image of the scene and a later-acquired image scene. The relative motion between the earlier and later acquired images are estimated, and an exposure parameter is computed based upon the estimated relative motion occurring between the earlier and later acquired images. A new image of the scene is acquired using the computed exposure parameter, and the earlier, later, and newly acquired images are combined to produce a motion-compensated composite image of the scene.

Abstract: An encoding method of screen frame and its application of electronic devices, which rapidly detect motion regions and motionless regions from lossless screen frames captured by software, and then encode the motion regions with lower image quality while encode motionless regions with higher quality to display higher quality images and smooth video at a receiving end in real-time. Furthermore, the above-mentioned encoding method is optimized for lossless screen frames which does not need complicated operations of video encoder of prior art, such as motion estimation, motion compensation, etc., so that the method can be implemented with minor system resources and lower latency delay.

Abstract: In one embodiment, the apparatus includes a decoder. The decoder is configured to obtain first and second motion vectors and a reference picture index of a block other than the current block. The decoder is configured to obtain a direction of the first and second motion vectors. The decoder is configured to determine first and second prediction motion vectors of the current block using the first and second motion vectors of the other block such that the first prediction motion vector of the current block has the obtained direction of the first motion vector of the other block and the second prediction motion vector of the current block has the obtained direction of the second motion vector of the other block.

Abstract: To provide an intra prediction apparatus which can circumvent a hazard problem and improve the time reduction effect. An intra prediction apparatus 11 performs intra predictions of a picture. The intra predictions include: second intra predictions of respective second blocks (blocks) which are obtained by dividing a first pixel block; and a first intra prediction of the first block (macroblock) which constitutes the picture. The intra prediction apparatus 11 includes: an intra prediction unit (a prediction unit 113, an orthogonal transform and quantization unit 115, an inverse orthogonal transform and inverse quantization unit 116, and an adder 117) which performs the intra predictions; and a control unit 119 which controls the intra prediction unit to perform in parallel the intra prediction of the macroblock and the intra predictions of the respective pixel blocks.

Abstract: An image capturing control method includes obtaining temporally-continued image data items while driving the image capturing unit at one of predetermined continuous capturing speeds, temporarily holding the obtained image data items, sequentially compressing the temporarily held image data items at a predetermined compression ratio, determining whether or not the compressed image data items falls within a predetermined data volume, performing control of recompressing the image data items at a compression ratio higher than the predetermined compression ratio, when it is determined that compressed image data items does not fall within the predetermined data volume, and setting the number of recompression for each of the image data items according to a continuous capturing speed of the driven image capturing unit.

Abstract: In one embodiment, the method includes obtaining first and second motion vectors and a reference picture index of a block other than the current block. First and second prediction motion vectors of the current block are determined using the first and second motion vectors of the other block such that the first prediction motion vector of the current block has the obtained direction of the first motion vector of the other block and the second prediction motion vector of the current block has the obtained direction of the second motion vector of the other block.

Abstract: In one embodiment, the method includes obtaining first and second motion vectors of a block other than the current block. The other block neighbors the current block at one of a left, top and top right position. First and second motion vectors of the current block are determined using the first and second motion vectors of the other block such that the first motion vector of the current block has a same direction as the first motion vector of the other block and the second motion vector of the current block has a same direction as the second motion vector of the other block.

Abstract: In one embodiment, the method includes obtaining first and second motion vectors of blocks other than the current block. The other blocks neighbor the current block at one of a left, top and top right position. A direction of the first and second motion vectors of the at least one neighboring block is obtained by a decoder. First and second prediction motion vectors of the current block are determined based on the obtained directions of the at least one neighboring block and by applying a median operation to the first motion vectors of the at least one neighboring block and applying a median operation to the second motion vectors of the at least one neighboring block.

Abstract: An apparatus comprising a processor configured to receive a current block of an image, determine an optimal prediction mode of a plurality of prediction modes for the current block, wherein the optimal prediction mode corresponds to either a standard predictor set or a non-standard predictor set, predict a predicted predictor set based on a first known predictor set and a second known predictor set, clear a first flag if the predicted predictor set matches the optimal predictor set; and set the first flag if the predicted predictor set does not match the optimal predictor set.

Abstract: A method for calculating a prediction motion vector of a block to be coded, by performing a median operation using motion vectors of neighboring blocks. If one of the neighboring blocks has motion vectors MV1 and MV2, direction (forward or backward) information of reference pictures referred to, respectively, by the motion vectors are acquired and one of the motion vectors is selected with reference to the acquired direction information. Then, the median operation including the selected motion vector is performed to obtain the prediction motion vector of the block to be coded.

Abstract: The invention relates to encoding and decoding pixel blocks of a video frame through a hybrid mode involving usage of a first prediction of a pixel block and at least a second prediction of the pixel block. An initial first weighting factor is modified using a factor modifier to generate a first weighting factor comprising multiple different factor values that are assignable to the different pixel-based first prediction values of the first prediction. The first weighting factor is applied to the first prediction and a second weighting factor is applied to the second block prediction. The at least two weighted predictions are then combined to form a hybrid prediction of the current pixel block.

Abstract: A method for testing a motion vector is described, which has: provision of at least one item of motion information assigned to the image sequence; storing a first image section of the first image in a first buffer memory and storing a second image section of the second image in a second intermediate memory, whereby a position of the first image section in the first image and a position of the second image section in the second image have reciprocal offset, which is dependent on the at least one item of motion information; determining a first image block in the first image section and a second image block in a second image section using the motion vector; comparing the contents of the first and of the second image block.

Abstract: A method and system for monitoring video assets provided by a multimedia content distribution network (MCDN) includes an expert test monitoring platform (ETMP) configured to emulate MCDN client systems at a facility of an MCDN service provider. The ETMP may be used to test monitor MCDN performance by acquiring a baseband video signal and performing a test operation including at least one check point condition. The check point condition may be associated with a masked region of the video signal and may also involve a test of an audio channel. A plurality of test operations and/or check point conditions may be defined and executed on the baseband video signal, while the results of the test operation may be logged.

Abstract: Adjacent blocks are identified in an image. Coding parameters for the adjacent blocks are identified. Deblock filtering between the identified adjacent blocks is skipped if the coding parameters for the identified adjacent blocks are similar and not skipped if the coding parameters for the identified adjacent blocks are substantially different.