Abstract: An offset can be applied to intermediate values obtained while performing an interpolation filtering operation such that applying the offset reduces the bitdepth of the intermediate value. The intermediate value can be stored with the reduced bitdepth, and when retrieved, the offset can be added back such that future calculation can be performed using the intermediate value with the original bitdepth.

Abstract: A moving picture encoding/decoding apparatus and method for processing a moving picture, which is divided in units of slices are provided. The encoding method includes: dividing a moving picture in units of slices when the moving picture is received; determining an encoding order of moving pictures divided in units of slices; and generating a bitstream by encoding moving pictures, which are divided in units of slices, according to a corresponding order when the encoding order had been determined.

Abstract: When a prediction is made between fields with different parity, the predicative efficiency of a chrominance vector is improved by adaptively switching the generation of a chrominance motion vector depending on a encoding/decoding field parity (top/bottom) and a reference field parity (top/bottom), and the coding efficiency is improved accordingly.

Abstract: When a prediction is made between fields with different parity, the predicative efficiency of a chrominance vector is improved by adaptively switching the generation of a chrominance motion vector depending on a encoding/decoding field parity (top/bottom) and a reference field parity (top/bottom), and the coding efficiency is improved accordingly.

Abstract: This disclosure describes various interpolation techniques performed by an encoder and a decoder during the motion compensation process of video coding. In one example, an encoder interpolates pixel values of reference video data based on a plurality of different pre-defined interpolation filters. In this example, the decoder receives a syntax element that identifies an interpolation filter, and interpolates pixel values of reference video data based on the interpolation filter identified by the syntax element. In another example, a method of interpolating predictive video data includes generating half-pixel values based on integer pixel values, rounding the half-pixel values to generate half-pixel interpolated values, storing the half-pixel values as non-rounded versions of the half-pixel values, and generating quarter-pixel values based on the non-rounded versions of the half-pixel values and the integer pixel values.

Abstract: The present invention provides video encoding and decoding methods using block merging, which can be applied to a high resolution video of more than HD (High Definition) resolution. A video encoding method includes partitioning a current block into a first and a second prediction unit by using asymmetric partitioning, constructing a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from adjacent blocks of the current block, selecting at least one candidate block from among the list of common merging candidate blocks and sending information of the selected candidate block to a decoder for each of the first and the second prediction unit.

Abstract: In one embodiment, a macroblock is determined in an incoming bitstream. In one example, the macroblock may be a 16×16 macroblock for a first coding standard, such as MPEG-2. The macroblock is then divided into a plurality of segmented blocks. For example, an arbitrary sized segment of blocks may be used to divide the macroblock into segmented blocks. In one example, the macroblock is divided into four 8×8 segmented blocks. A plurality of statistical measures are then determined for the plurality of segmented blocks. For example, for each segmented block, a sum of absolute differences (SAD) is determined. Then, one or more sizes for the sub-blocks are determined based on the comparison. For example, a variable sub-block size for an AVC bitstream is determined.

Abstract: A perceptual mechanism for residue selection in a video encoder may be provided. The mechanism may comprise a method, system, or device for receiving video frames comprising pluralities of pixels. For each video frame, a sensitivity threshold may be determined for each pixel of a previous video frame. The pixels of the video frame may compared in turn to the pixels of the previous video frame to determine a residue value. The residue value may be compared to the sensitivity threshold such that when the residue value is less than the sensitivity threshold, the pixel data in the video frame may be zeroed out prior to encoding the video frame for transmission.

Abstract: Techniques and tools for video coding/decoding with motion resolution switching and sub-block transform coding/decoding are described. For example, a video encoder adaptively switches the resolution of motion estimation and compensation between quarter-pixel and half-pixel resolutions; a corresponding video decoder adaptively switches the resolution of motion compensation between quarter-pixel and half-pixel resolutions. For sub-block transform sizes, for example, a video encoder adaptively switches between 8×8, 8×4, and 4×8 DCTs when encoding 8×8 prediction residual blocks; a corresponding video decoder switches between 8×8, 8×4, and 4×8 inverse DCTs during decoding.

Abstract: A method for calculating pixel values of interpolated pixel positions located between integer pixel positions in frames of a video picture by a predefined filter operation, the method including: storing the pixel values of the integer pixel position; determining to which of a number of predefined resolution formats the video picture is adapted; defining a fixed width (W) and fixed height value (H) for the frames corresponding to a resolution format determined by the determining; loading a first set of memory addresses for the memory of the video processing apparatus corresponding to a plurality of the pixel values of integer pixel positions; and executing a filter operation on the plurality of the pixel values of integer pixel positions and calculating a plurality of the pixel values of the interpolated pixel positions.

Abstract: For a frame set of a moving image sequence, a motion estimate is accessed. The motion estimate describes a change to a region of a reference frame with respect to at least one other frame. The reference frame and the other frames are displaced from each other within the frame set from over a temporal window. The regions of the two frames contain at least a portion of an image feature. The motion estimate is smoothed over the temporal window. The smoothing may facilitate aligning, at least in part, the image feature within the set of frames.

Abstract: The disclosure is directed to techniques for encoder-assisted adaptive interpolation of video frames. According to the disclosed techniques, an encoder generates information to assist a decoder in interpolation of a skipped video frame, i.e., an S frame. The information permits the decoder to reduce visual artifacts in the interpolated frame and thereby achieve improved visual quality. The information may include interpolation equation labels that identify selected interpolation equations to be used by the decoder for individual video blocks. As an option, to conserve bandwidth, the equation labels may be transmitted for only selected video blocks that meet a criterion for encoder-assisted interpolation. Other video blocks without equation labels may be interpolated according to a default interpolation technique.

Abstract: Video analytics systems and methods are described that typically comprise a video encoder operable to generate macroblock video analytics metadata (VAMD) from a video frame. Functional modules receive the VAMD and an encoded version of the video frame is configured to generate video analytics information related to the frame using the VAMD and the encoded video frame. The downstream decoder can use the VAMD to obtain a global motion vector related to the frame, detect and track motion of an object within the frame and monitor a line provided or found within the frame. Traversals of the line by a moving object can be detected and counted using information in the VAMD and the line may be part of a polygon that delineates an area to be monitored within the encoded frame. The VAMD can comprise macroblock level and video frame level information.

Abstract: This disclosure describes techniques applied during video encoding and decoding processes. In one example, a method of encoding video data comprises calculating a plurality of offset values for a coded unit of the video data, wherein the offset values are associated with a plurality of different integer and sub-integer pixel locations, applying the offset values to predictive video blocks to generate offset predictive video blocks, and encoding video blocks of the coded unit based on the offset predictive video blocks. In another example, a method of decoding video data comprises receiving a plurality of offset values for a coded unit of the video data, wherein the offset values are associated with a plurality of different integer and sub-integer pixel locations, applying the offset values to predictive video blocks to generate offset predictive video blocks, and decoding video blocks of the coded unit based on the offset predictive video blocks.

Abstract: Medium having image decoding program effecting: extracting motion vector information, quantized DCT coefficients, and rounding method information; dequantizing quantized DCT coefficients to DCT coefficients; performing inverse DCT conversion on the DCT coefficients to an error image; synthesizing a prediction image of a currently decoded image via motion compensation using motion vector information, rounding method information, and a previously-decoded reference image; and adding the prediction and error images to a decoded image; wherein motion compensation is performed with half-pixel accuracy and uses bilinear interpolation to calculate intensity values of chrominance or luminance where no pixels exist in the reference image, using a positive or negative rounding method; wherein interpolation is performed using a rounding method specified by the rounding method information included in a header section of coded information of the current image; wherein the rounding method specifies one of two values specify

Abstract: Medium having image decoding program effecting: extracting motion vector information, quantized DCT coefficients, and rounding method information; dequantizing quantized DCT coefficients to DCT coefficients; performing inverse DCT conversion on the DCT coefficients to an error image; synthesizing a prediction image of a currently decoded image via motion compensation using motion vector information, rounding method information, and a previously-decoded reference image; and adding the prediction and error images to a decoded image; wherein motion compensation is performed with half-pixel accuracy and uses bilinear interpolation to calculate intensity values of chrominance or luminance where no pixels exist in the reference image, using a positive or negative rounding method; wherein interpolation is performed using a rounding method specified by one-bit rounding method information included in a header section of coded information of the current image; wherein the rounding method specifies one of two values spe

Abstract: A coding system includes a decoding block and a reconstruction loop with first and second adaptive restoration blocks. The decoding block receives and decodes an encoded bitstream to derive residues, prediction information, and adaptive restoration information. The reconstruction loop reconstructs a current frame according to the residues and prediction information. The first adaptive restoration block performs restoration on a first set of processed data according to a first set of the adaptive restoration information, and the second adaptive restoration block performs restoration on an output of the first adaptive restoration block according to a second set of the adaptive restoration information.

Abstract: A method of improving accuracy and reliability of motion estimation is described herein. In one aspect, a 2D neighborhood of phase correlation peak is approximated with an outer-product of two 1D vectors to eliminate the sub-pixel error. In another aspect, estimation of reliability is improved. In yet another aspect, two-pass phase correlation is implemented to eliminate sub-pel motion bias.

Abstract: A method for reconstruction of a picture sequence coded in accordance with a coding method specifying a set of coding tools and/or their associated coding parameters is disclosed. The pictures being divided into coding entities. The method for reconstruction according to the invention comprises the following steps for each coding entity coded in INTER mode: determining for the coding entity at least one reference picture, and reconstructing the coding entity from the at least one reference picture with coding tools configured by coding parameters associated with the coding tools. Advantageously, the coding tools and/or the associated coding parameters depend on the reference picture.

Abstract: A high-performance block-matching VLSI architecture with low memory bandwidth for power-efficient multimedia devices is disclosed. The architecture uses several current blocks with the same spatial address in different current frames to search the best matched blocks in the search window of the reference frame based on the best matching algorithm (BMA) to implement the process of motion estimation in video coding. The scheme of the architecture using several current blocks for one search window greatly increases data reuse, accelerates the process of motion estimation, and reduces the data bandwidth and the power consumption.

Abstract: This invention is directed to a method for decoding coded video data in which decoder performance is regulated based on perceptual masking. The method includes, upon receipt of coded video data, applying the coded video data to a multi-stage decoding process; computing perceptual masking measures for the coded video data; and switching a stage of the decoding process to a lower performance level based on the computed perceptual masking measures. The method may be applied to non-reference frames and reference frames with low numbers of dependent frames. The method provides scalability among decoders to allow for various decoder and/or coded data complexity.

Abstract: It is a purpose of the present invention to provide a video encoding apparatus and a video decoding apparatus which are capable of providing real-time processing having improved coding performance. A video encoding apparatus AA includes an inter-encoding predicted value generating unit 2 configured to receive, as input signals, an input image a, a local decoded value d acquired from an encoded block, prediction direction information e acquired from the encoded block, and interpolation filter initial control information b. The inter-encoding predicted value generating unit 2 includes a filter control unit 21. The filter control unit 21 extracts the tap size N of the interpolation filter and the initial value c0(i,j) of the filter coefficient of the interpolation filter from the interpolation filter initial control information b, and uses the initial value c0(i,j) of the filter coefficient of the interpolation filter as the filter coefficient c(i,j) of the interpolation filter.

Abstract: Provided is a motion compensating apparatus that includes: a motion compensation position determining unit that determines, based on a motion vector, a position of pixels for which compensated pixels should be generated; a necessary pixel determining unit that determines pixels necessary for performing 6-tap filtering; a data transfer controlling unit that controls the order or the like of taking out data to be transferred; an intermediate pixel storage memory for storing pixel data with half-pixel accuracy; a high-order tap filtering unit that generates pixel data with half-pixel accuracy by successively performing filtering operations in a predetermined direction; and a linear interpolation calculating unit that performs linear interpolation based on the position of pixels to be motion compensated, and generates and outputs pixel data with motion compensation accuracy of less than half-pixel accuracy.

Abstract: An encoding apparatus having a direct mode as a prediction mode, when a pixel with opposite parity from a top field to a bottom field, for example, is referred to for obtaining a reference vector in the direct mode, performs correction by adding or subtracting a value corresponding to a half pixel to or from a value of the obtained reference vector. The encoding apparatus, when a pixel with opposite parity is referred to for obtaining a first and a second direct vector by temporally scaling the corrected reference vector, performs correction by adding or subtracting a value corresponding to a half pixel to or from values of the obtained direct vectors.

Abstract: In one embodiment, the method includes predicting at least a portion of a current image in a current layer based on at least a residual coded portion of a base image in a base layer, a reference image, shift information for samples in the predicted current image, and offset information indicating a position offset between at least one boundary pixel of the reference image and at least one boundary pixel of the current image. The residual coded portion represents difference pixel data.

Abstract: In one embodiment, decoding of a video signal includes predicting at least a portion of a current image in a current layer based on at least a portion of a base image in a base layer and shift information for samples in the predicted current image.

Abstract: Method and system for transcoding a sequence of input images into a sequence of output images that can effectively handle one or more transcoding uses cases are presented. The embodiments of the invention exploit the incoming metadata retrieved from the decoding process to adapt the video content and to achieve a significant speed-up in comparison to the traditional cascaded approach while maintaining high quality for output images.

Abstract: An apparatus and method for deriving a motion vector predictor are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted or stored. Motion vector prediction has been used to further conserve the bitrate associated with motion vector coding. In a conventional coding system, a motion vector predictor (MVP) is selected from the spatial MVPs and temporal MVP. The spatial MVP according to a conventional approach is based on motion vectors (MVs) of neighboring blocking pointing to a target reference picture in a given reference list. Embodiments according to the present invention perform the MVP search among an extended search set including MVs pointing to other reference pictures in the given reference list or the other reference list and MVs pointing to the target reference picture in the given reference list or the other reference list.

Abstract: Techniques and tools for video coding/decoding with sub-block transform coding/decoding and re-oriented transforms are described. For example, a video encoder adaptively switches between 8×8, 8×4, and 4×8 DCTs when encoding 8×8 prediction residual blocks; a corresponding video decoder switches between 8×8, 8×4, and 4×8 inverse DCTs during decoding. The video encoder may determine the transform sizes as well as switching levels (e.g., frame, macroblock, or block) in a closed loop evaluation of the different transform sizes and switching levels. When a video encoder or decoder uses spatial extrapolation from pixel values in a causal neighborhood to predict pixel values of a block of pixels, the encoder/decoder can use a re-oriented transform to address non-stationarity of prediction residual values.

Abstract: Provided are an image encoding method and apparatus for generating an interpolation filter using an adjacent area of a current block and a corresponding adjacent area of a reference picture and interpolating the reference picture using the generated interpolation filter, and an image decoding method and apparatus therefor. By interpolating an adjacent area of a reference picture corresponding to an adjacent area of a current block according to fractional pixel resolution of a motion vector of the current block and determining interpolation filter coefficients to minimize a difference between an interpolated adjacent area of the reference picture and the adjacent area of the current block, an interpolation filter needed for motion compensation of the current block is adaptively generated using information on the adjacent area.

Abstract: A framework for efficient sum of absolute difference (SAD) computations for variable block size, sub-pixel motion estimation is presented. Simultaneous, or parallelized, SAD computations can be performed by storing and re-using previous SAD computational information, which can speed up the performance of a motion estimation module by reducing the number of cycles necessary to perform a particular motion estimation algorithm.

Abstract: One embodiment provides a moving picture decoding device for decoding a compression-coded moving picture stream, including: an inter-view predicting module configured to perform inter-view prediction processing on processing subject blocks of each frame to be decoded; a load detector configured to detect a magnitude of an apparatus processing load including a processing load for decoding; a judging module configured to judge whether the magnitude of the apparatus processing load detected by the load detector is small; and a controller configured to control the inter-view predicting module so as to cause simplification of the inter-view prediction processing if the judging module judges that the magnitude of the apparatus processing load is not small.

Abstract: Described are methods and systems for processing data. A motion estimator uses a block of an input frame of video data and a block of a reference frame of video data to generate motion vectors according to a first encoding scheme. A motion compensator produces half pel motion vectors from the motion vectors according to a second encoding scheme that is different from the first encoding scheme.

Abstract: A video transmission method is provided, which includes receiving state information from at least one mobile terminal that intends to perform a video stream service through a wireless network, determining a size of an image by selecting a specified spatial layer bit stream on the basis of the state information of the mobile terminal from a plurality of spatial layer bit streams generated at different bit rates during encoding of the bit stream, selecting a specified time and an SNR layer bit stream by increasing or decreasing time of the image and a layer position of the SNR layer bit stream on the basis of network parameters included in the state information of the mobile terminal, and transmitting the bit stream generated by extracting the specified layer bit stream of the selected layer to the mobile terminal.

Abstract: Provided are a method and apparatus for interpolating an image, that improve frequency characteristics of a motion compensated interpolation by combining motion compensation and a de-blurring filter. The image interpolation method includes: estimating a motion vector between adjacent frames; determining a location of a pixel that is to be interpolated between adjacent frames based on the estimated motion vector; selecting values of candidate pixels of the location of the pixel that is to be interpolated; and filtering the values of the candidate pixels by applying each filter coefficient according to locations of pixels to the values of the candidate pixels.

Abstract: An image coding method determines one of frame coding and field coding while suppressing an increase in the complexity. The image coding method includes coding a current picture included in the pictures; determining whether a picture next to the current picture is to be coded in frame coding or field coding, depending on motion information that is information for indicating a motion in the current picture; and coding the next picture in frame coding when it is determined in the determining that the next picture is to be coded in frame coding, and coding the next picture in field coding when it is determined in the determining that the next picture is to be coded in field coding.

Abstract: A method and apparatus are provided for motion estimation in a sequence of images. One or more motion vectors representing movement of a camera or viewer position or direction are determined between each pair of fields or frames in the sequence of images. A set of candidate motion vectors is then determined for deriving positions of objects in a field or frame from the positions of objects in a previous field or frame. This set of candidate motion vectors is adjusted using the motion vectors representing movement of the camera or viewer position and thus a set of motion vectors is derived for a sequence of images using the adjusted set of candidate motion vectors.

Abstract: In one embodiment, the method includes predicting at least a portion of a current image in a current layer based on at least an intra-coded portion of a base image in a base layer, a reference image, shift information for samples in the predicted current image, and offset information indicating a position offset between at least one boundary pixel of the reference image and at least one boundary pixel of the current image.

Abstract: A video transmission system includes a transceiver module that receives a device parameter from a remote device and that transmits a video signal to the remote device, wherein the video signal is transmitted as at least one separate video layer stream chosen from, an independent video layer stream and at least one dependent video layer streams that require the independent video layer for decoding. A control module chooses the at least one separate video layer stream based on the device parameter.

Abstract: An image coding device (300) according to the present invention includes: a signal division unit (302) which divides each of pictures included in an input image signal (310) into a first coding target region (315A) and a second coding target region (315B); a first coding unit (303A) which codes the first coding target region (315A) to generate a first coded signal (313A); a second coding unit (303B) which codes the second coding target region (315B) to generate a second coded signal (313B); and a signal combining unit (307) which combines the first coded signal (313A) and the second coded signal (313B) to generate an output coded signal (314), wherein the signal division unit (302) determines, as a range to be used for motion vector search by the first coding unit (303A), a range including the first coding target region (315A) and a first overlap region (316A), and changes a size of the first overlap region (316A) according to a predetermined condition.

Abstract: A RAM_HIME used for integer pixel motion estimation by an IME stores integer pixel luminance data from a SDRAM while satisfying the conditions that improve efficiency in reading an extracted rectangular area. A RAM_HSME used for motion estimation of quarter-pixel accuracy by a SME stores partial quarter-pixel luminance data while satisfying the conditions that improve efficiency in obtaining a rectangular area after calculation by calculation. A RAM_HMEC used for chrominance data generation of quarter-pixel accuracy by a QPG stores integer pixel chrominance data from the SDRAM while satisfying the conditions that improve efficiency in obtaining rectangular areas after calculation by calculation.

Abstract: An apparatus for coding video information according to certain aspects includes a memory unit and a processor in communication with the memory unit. The memory unit stores difference video information associated with a difference video layer of pixel information derived from a difference between an enhancement layer and a corresponding base layer of the video information. The processor determines pixel accuracy of motion predictor information, determines a motion vector based on the pixel accuracy of the motion predictor information, and determines a value of a video unit based at least in part on the motion vector.

Abstract: A method of distributed statistical multiplexing of video data. The method includes generating a plurality of blocks forming a pre-processed video media corresponding to an original video media, the plurality of blocks including, for one or more sub-portions of the original video media, a plurality of interchangeable blocks that represent the sub-portion. Optionally, at least some of the blocks are transmitted to at least one multiplexer and reconstructed by the at least one multiplexer, for a plurality of communication channels, from at least some of the transmitted blocks.

Abstract: Provided are frame interpolation apparatus and methods in which motion estimation is performed by separation into a static object and a moving object. The frame interpolation apparatus interpolates multiple frames including an nth frame and an (n?1)th frame located adjacent the nth frame in order to generate an interpolation frame. Some embodiments of the apparatus include a static object separation unit, a motion vector (MV) estimation unit, and an interpolation frame generation unit. The static object separation unit may compare a macroblock (MB) of the nth frame with an MB of the (n?1)th frame, which may correspond to the MB of the nth frame, in order to separate each MB of the nth frame into a static object and a moving object. The MV estimation unit may search in the (n?1)th frame for an MB that matches with each of MBs of the nth frame, which may be determined to be the moving object, to estimate an MV.

Abstract: Video decoding innovations for multithreading implementations and graphics processor unit (“GPU”) implementations are described. For example, for multithreaded decoding, a decoder uses innovations in the areas of layered data structures, picture extent discovery, a picture command queue, and/or task scheduling for multithreading. Or, for a GPU implementation, a decoder uses innovations in the areas of inverse transforms, inverse quantization, fractional interpolation, intra prediction using waves, loop filtering using waves, memory usage and/or performance-adaptive loop filtering. Innovations are also described in the areas of error handling and recovery, determination of neighbor availability for operations such as context modeling and intra prediction, CABAC decoding, computation of collocated information for direct mode macroblocks in B slices, reduction of memory consumption, implementation of trick play modes, and picture dropping for quality adjustment.

Abstract: A scalable video coding method is provided. The scalable video coding method includes dividing an enhancement layer into macroblocks; when base_mode_flag or residual_prediction_flag of the macroblock is equal to 1, calculating a reference block coordinate value of a reference layer to refer to in the block up-sampling of the enhancement layer and up-sampling the macroblocks of the enhancement layer using the coordinate value; and coding the up-sampled macroblock. The execution speed of the scalable video codec can be raised and the memory usage required for the spatial inter-layer prediction of the scalable video can be saved.

Abstract: There are provided spatial scalable video encoder and decoders and corresponding methods for scalable video encoding and decoding. A method for spatial scalable video encoding includes selecting between scalable coding and non-scalable coding of motion vectors on a slice basis.

Abstract: Provided are a hybrid prediction apparatus and method for entropy encoding that may enhance an existing image compression scheme and prediction scheme by including and selectively using a plurality of predictors configured to perform a per-pixel prediction of an image frame, and may also supplement a performance of a prediction scheme, excessively occurring in a particular pixel.

Abstract: Methods, medium, and machines which compress, enhance, encode, transmit, decode, decompress and display digital video images. Real time compression is achieved by sub-sampling each frame of a video signal, filtering the pixel values, and encoding. Real time transmission is achieved due to high levels of effective compression. Real time decompression is achieved by decoding and decompressing the encoded data to display high quality images. A receiver can alter various setting including, but not limited to, the format for the compression, image size, frame rate, brightness and contrast. In a Doppler improvement aspect of the invention, Doppler velocity scales are incorporated into grayscale compression methods using two bits. Variable formats may be selected and Doppler encoding can be turned on and off based on the image content. Frames or sets of pixels may be distinguished by automated analysis of the characteristics of an image, such as the presence of Doppler enhanced pixels.

Abstract: Methods for motion estimation with adaptive motion accuracy of the present invention include several techniques for computing motion vectors of high pixel accuracy with a minor increase in computation. One technique uses fast-search strategies in sub-pixel space that smartly searches for the best motion vectors. An alternate technique estimates high-accurate motion vectors using different interpolation filters at different stages in order to reduce computational complexity. Yet another technique uses rate-distortion criteria that adapts according to the different motion accuracies to determine both the best motion vectors and the best motion accuracies. Still another technique uses a VLC table that is interpreted differently at different coding units, according to the associated motion vector accuracy.