Abstract: The invention concerns a method for encoding a multi-view video stream comprising at least two video sequences, comprising a step of motion information prediction for a square or rectangular block of a current picture of a current view from a list of candidate motion information predictors, a motion information predictor including at least a motion vector, and a step of entropic encoding of an item of information representative of the position of a selected motion information predictor in the list.

Abstract: Techniques and tools for encoding and decoding motion vector information for video images are described. For example, a video encoder yields an extended motion vector code by jointly coding, for a set of pixels, a switch code, motion vector information, and a terminal symbol indicating whether subsequent data is encoded for the set of pixels. In another aspect, an encoder/decoder selects motion vector predictors for macroblocks. In another aspect, a video encoder/decoder uses hybrid motion vector prediction. In another aspect, a video encoder/decoder signals a motion vector mode for a predicted image. In another aspect, a video decoder decodes a set of pixels by receiving an extended motion vector code, which reflects joint encoding of motion information together with intra/inter-coding information and a terminal symbol. The decoder determines whether subsequent data exists for the set of pixels based on e.g., the terminal symbol.

Abstract: In one example, a device includes a video coder configured to determine a first co-located reference picture for generating a first temporal motion vector predictor candidate for predicting a motion vector of a current block, determine a second co-located reference picture for generating a second temporal motion vector predictor candidate for predicting the motion vector of the current block, determine a motion vector predictor candidate list that includes at least one of the first temporal motion vector predictor candidate and the second temporal motion vector predictor candidate, select a motion vector predictor from the motion vector predictor candidate list, and code the motion vector of the current block relative to the selected motion vector predictor.

Abstract: This disclosure describes techniques for processing motion vectors such that the resulting motion vectors better correlate with the true motion of a video frame. In one example, the techniques may include comparing a block motion vector corresponding to a video block to a sub-block motion vector corresponding to a sub-block contained within the video block. The techniques may further include selecting one of the block motion vector and the sub-block motion vector as a spatially-estimated motion vector for the sub-block based on the comparison. Motion vectors that better correlate with true motion may be useful in applications such as motion compensated frame interpolation (MCI), moving object tracking, error concealment, or other video post-processing that requires the true motion information.

Abstract: A method and apparatus for predicting reference data transfer scheme for motion estimation. The method includes computing, via the processor, hypothetical rectangle region in reference frame containing all the predicting and reference data for doing motion estimation search around the region, if the macroblock is not the first in a row, utilizing overlap with previously fetched reference data, computing overlap with previously fetched reference data, and transferring needed data, invalidating any predictor, wherein the predictor is not part of the fetched data, and regulating the motion estimation and setting the motion vector to an effective value based on the fetched and computed data.

Abstract: In one embodiment, the method includes determining a motion vector of a current image block equal to a motion vector of an image block based on a reference picture index indicating a reference picture for the image block. For example, the motion vector of the current image block may be equal to the motion vector of the image block if the reference picture index indicates a long-term reference picture for the image block.

Abstract: In video encoding and decoding predictions may be generated by intra-frame prediction. Intra-frame prediction uses reconstructed pixels in a reconstructed frame. Intra-frame prediction is performed by extending the reconstructed pixels into a predicted block using intra-frame prediction modes, each intra-frame prediction mode indicating a direction of the extension. In order to reduce the number of possible intra-frame prediction modes, a subset is selected from a predetermined set of possible intra-frame prediction modes. A subset of intra-frame prediction modes can be created by forming preselection sets of intra-frame prediction modes on the basis of similarity of their associated predicted blocks and selecting a representative intra-frame prediction mode from each preselection set.

Abstract: Motion vectors of a first reference frame are permitted to point to a plurality of further reference frames. A method of storing the motion vectors comprises, when a block of the first reference frame has two motion vectors initially, selecting one of the two motion vectors, the non-selected motion vector not being stored. The selected motion vector may be scaled. This can reduce the motion vector memory size.

Abstract: The transmitting end of a content distribution system selectively employs a redundancy mechanism to encoded video data based on the frame type of each frame being transmitted. In the event that a particular frame contains information upon which the decoding of multiple frames may depend, the transmitting end can apply a redundancy mechanism to redundantly distribute the data of the frame throughout a set of data segments, each of which is separately transmitted via the network to the receiving end. Otherwise, in the event that a particular frame to be transmitted does not contain substantial information upon which the decoding of multiple frames may depend, the loss of some or all of the data of the frame may not appreciably affect the presentation of the video content at the receiving end and thus the transmitting end can forgo application of the redundancy mechanism to such frames so as to avoid unnecessarily processing and reduce the overall network bandwidth used to transmit the encoded video data.

Abstract: A video encoding method and apparatus are provided. The video encoding method includes determining whether a current block includes an affine-transformation object having an affine transformation; if the current block includes an affine-transformation object, generating a prediction block by performing affine transformation-based motion compensation on the current block in consideration of an affine transformation of the affine-transformation object; and if the current block does not include any affine-transformation object, generating a prediction block by performing motion vector-based motion compensation on the current block using a motion vector of the current block. Therefore, it is possible to achieve high video encoding/decoding efficiency even when a block to be encoded or decoded includes an affine transformation.

Abstract: A video transmitter comprising a plurality of encoders may be operable to determine, for a transport stream, a constant overall number of bits per time interval corresponding to a frame in the transport stream. For each time interval corresponding to a start and an end of encoding of each of frames using each of the encoders, the video transmitter may allocate a target number of bits to each of the frames to achieve the constant overall number of bits. The allocation of the target number of bits may be based on frame types of the frames and CODEC types of the encoders, where the allocated target number of bits for each of the frames meets buffer overflow/underflow requirements associated with each of the encoders. A quantization parameter (QP) may be calculated and adjusted at each of one or more layers for generating an actual number of bits during encoding.

Abstract: A method of receiving video data comprising the steps of: receiving at least one chunk of video data comprising a number of sequential key video frames where the number is at least two and, constructing at least one delta frame between a nearest preceding key frame and a nearest subsequent key frame from data contained in the either or each of the nearest preceding and subsequent frames.

Abstract: A first vector predictor candidate list generating unit generates a first motion vector predictor candidate list from motion vectors of encoded neighboring blocks to blocks to be encoded. A second vector predictor candidate list generating unit generates a second motion vector predictor candidate list from motion vectors of blocks at the same positions as the blocks to be encoded in an encoded image and neighboring blocks to the blocks at the same positions. A combination determining unit determines whether to generate a third vector predictor candidate list combining the first and second vector predictor candidate lists by comparison of a block size of the blocks to be encoded and a threshold size. A vector predictor candidate list deciding unit generates the third vector predictor candidate list from the first vector predictor candidate list.

Abstract: A motion vector coding apparatus includes a motion vector coding unit that codes a motion vector inputted from a motion vector detecting unit. A motion vector for each current block is coded based on a difference between the motion vector and a predicted vector obtained from motion vectors for previously coded neighboring blocks. The predicted vector is generated by one of: the motion vectors referring to the same picture are selected from among the motion vectors for the neighboring blocks; the motion vectors for neighboring blocks are ordered in the predetermined order and the motion vectors of the same order rank are selected; and the predicted vector for a second motion vector of the current block is the first motion vector, and when the second motion vector and the first motion vector refer to different pictures, the first motion vector is scaled based on temporal distance between the pictures.

Abstract: A motion vector coding apparatus includes a motion vector coding unit that codes a motion vector inputted from a motion vector detecting unit. A motion vector for each current block is coded based on a difference between the motion vector and a predicted vector obtained from motion vectors for previously coded neighboring blocks. The predicted vector is generated by one of: the motion vectors referring to the same picture are selected from among the motion vectors for the neighboring blocks; the motion vectors for neighboring blocks are ordered in the predetermined order and the motion vectors of the same order rank are selected; and the predicted vector for a second motion vector of the current block is the first motion vector, and when the second motion vector and the first motion vector refer to different pictures, the first motion vector is scaled based on temporal distance between the pictures.

Abstract: A video encoding method and apparatus and a video decoding method and apparatus. In the video encoding method, a first predicted coding unit of a current coding unit that is to be encoded is produced, a second predicted coding unit is produced by changing a value of each pixel of the first predicted coding unit by using each pixel of the first predicted coding unit and at least one neighboring pixel of each pixel, and the difference between the current coding unit and the second predicted coding unit is encoded, thereby improving video prediction efficiency.

Abstract: A picture coding apparatus includes a motion vector estimation unit and a motion compensation unit. The motion vector estimation unit selects one method for deriving a motion vector of a block to be motion-compensated, depending on a motion vector of a block located in a corner of a decoded macroblock from among a group of blocks that compose the decoded macroblock corresponding to the current macroblock to be coded and determines the motion vector derived by the selected method for derivation to be a candidate of the motion vector of the current macroblock to be coded. The motion compensation unit generates a predictive image of the block to be motion-compensated based on the estimated motion vector.

Abstract: A method for transcoding from an H.264 format to a VC-1 format. The method generally comprises the steps of (A) decoding an input video stream in the H.264 format to generate a picture having a plurality of macroblock pairs that used an H.264 macroblock adaptive field/frame coding; (B) determining a mode indicator for each of the macroblock pairs; and (C) coding the macroblock pairs into an output video stream in the VC-1 format using one of (i) a VC-1 field motion compensation mode coding and (ii) a VC-1 frame motion compensation mode coding as determined from the mode indicator.

Abstract: Apparatuses and methods for compressing a video signal having at least one frame with at least one block of pixel data are disclosed. A target block is selected, and an alternate reference block that is a predictor for blocks of a sequence of frames is compared to a predictor block to determine whether to create a second alternate reference block as a predictor. When a difference between the alternate reference block and the predictor block is less than a threshold, certain blocks from the sequence of frames that are more different from the first alternate reference block than other non-selected blocks are selected, and the second alternate reference block is created using the selected blocks. In this way, a predictor block that is different from a golden frame predictor is made available when an existing alternate reference block is too similar to the golden frame predictor to be useful.

Abstract: A video encoder and a decoder analyze the spatial content video data in an H.264 stream using the discrete cosine transform (DCT). Although the DCT is computed as part of the H.264 encoding process, it is not computed as part of the decoding process. Thus, one would compute the DCT of the video data after it has been reconstructed by the video decoder for video post-processing or enhanced video encoding. A method for accelerating the computation of the DCT at the decoder side when transmitting intra-mode macroblocks uses information computed by the encoder and transmitted as part of the H.264 video stream.

Abstract: A first reference index value indicates a position, within a reference picture list associated with a current prediction unit (PU) of a current picture, of a first reference picture. A reference index of a co-located PU of a co-located picture indicates a position, within a reference picture list associated with the co-located PU of the co-located picture, of a second reference picture. When the first reference picture and the second reference picture belong to different reference picture types, a video coder sets a reference index of a temporal merging candidate to a second reference index value. The second reference index value is different than the first reference index value.

Abstract: Systems and methods for efficiently encoding and/or reformatting video data including transparent overlay portions are disclosed. In one embodiment, the method includes using two prediction regions for predicting the portion of the video including the transparent overlay. In one embodiment, a first of the two prediction regions is determined based on motion compensated prediction in reference to another video frame and a second of the two prediction regions is a collocated portion of video in another frame as referenced by a virtual zero motion vector. A mixing weight factor to be used for combining the two predictions is determined. In one embodiment, the mixing weight factor is determined based on the relative values of two error metrics, a first error metric related to the motion compensated prediction and a second error metric related to the collocated prediction of the virtual zero motion vector.

Abstract: Provided are methods and apparatuses for encoding and decoding a motion vector. The method of encoding a motion vector includes: selecting a mode from among a first mode in which information indicating a motion vector predictor of at least one motion vector predictor is encoded and a second mode in which information indicating generation of a motion vector predictor based on pixels included in a previously encoded area adjacent to a current block is encoded; determining a motion vector predictor of the current block according to the selected mode and encoding information about the motion vector predictor of the current block; and encoding a difference vector between a motion vector of the current block and the motion vector predictor of the current block.

Abstract: There are provided methods and apparatus for video coding. Using the method, a video encoder (100) performs filtering of at least one reference picture to obtain at least one filtered reference picture (310), and predictively codes the picture using the at least one filtered reference picture (315). In an exemplary embodiment, the filtering is done using parametric filtering.

Abstract: Disclosed are an image encoding method using a skip mode and a device using the method. The image encoding method may comprise the steps of: judging whether there is residual block data of a prediction target block on the basis of predetermined data indicating whether residual block data has been encoded; and, if there is residual block data, restoring the prediction target block on the basis of the residual block data and an intra-screen predictive value of the prediction target block. Consequently, encoding and decoding efficiency can be increased by carrying out the encoding and decoding of screen residual data only for prediction target blocks where there is a need for a residual data block in accordance with screen similarity.

Abstract: Provided are a motion estimation apparatus and method and an image encoding apparatus and method employing the same. The motion estimation apparatus includes an optimal motion estimation unit performing motion estimation in an initial block mode while skipping remaining block modes excluding the initial block mode from a plurality of block modes of the current block, or performing motion estimation in candidate block modes determined from the plurality of block modes.

Abstract: A method includes examining a statistical distribution of motion vectors employed for motion compensation in a first frame of image data. The examining is to produce a distribution model of the motion vectors in the first frame. The method further includes selecting, based at least in part on the distribution model, a block-matching search pattern for use with respect to a second frame of image data. The second frame follows the first frame in a sequence of frames of image data.

Abstract: Video-coded information is transmitted over a network at a priority level that is determined based on feedback from the network. In an embodiment, the feedback comprises a response to a request for information on whether the network currently has the available capacity to transmit additional high priority traffic. In an embodiment, a candidate base layer frame is transmitted over a network as a base layer frame if permission to send high priority data was granted and is transmitted over the network as an enhancement layer frame if permission to send high priority data was denied. In a further embodiment, the candidate base layer frame is deleted if permission to send high priority data was denied.

Abstract: In a video signal processing device that generates an interpolated frame between original-image frames formed by an existing video signal, a frame interpolation unit generates pixel interpolation information indicating for each pixel a process in which a pixel forming the interpolated frame is generated. Next, an enhancement-filter-coefficient adjusting unit determines for each pixel a level of enhancement to be applied to the pixel forming the interpolated frame by using pixel interpolation information, and adjusts for each pixel a coefficient of an enhancement filter according to a determined level. An enhancement-filter applying unit then applies the enhancement filter of which coefficient is adjusted for each pixel, to each pixel forming the interpolated frame.

Abstract: A method, apparatus, article of manufacture, and a memory structure for encoding or decoding a sequence comprising a plurality of pictures, each of the plurality of pictures partitionable into one or more slices, each of the one or more slices processed at least in part according to a slice header. In one embodiment, all the relative syntax and function calls under the condition of slice type equal to P or B are grouped together, and syntax describing the initial value for a quantization parameter to be used in coding blocks of data and deblocking related syntax are put before this group of syntax and function calls.

Abstract: The method includes receiving a multi-view video stream including a random access picture, which includes a random access slice. The random access slice references only a slice corresponding to a same time and a different view of the random access picture. Type information indicating whether the random access slice is predicted from one or two reference pictures is obtained, and a reference picture list is initialized using view number information and view identification information included in obtained initialization information according to the type information. The initialization information is obtained based on a value indicating decoding order between the plurality of views. The initialized reference picture list is modified based on modification information representing how to assign an inter-view reference index in the initialized reference picture list.

Abstract: A video encoding method and apparatus and a video decoding method and apparatus. In the video encoding method, a first predicted coding unit of a current coding unit that is to be encoded is produced, a second predicted coding unit is produced by changing a value of each pixel of the first predicted coding unit by using each pixel of the first predicted coding unit and at least one neighboring pixel of each pixel, and the difference between the current coding unit and the second predicted coding unit is encoded, thereby improving video prediction efficiency.

Abstract: Provided is an image processing system that can uniquely identify a motion vector for each pixel of an interpolation frame and accurately identify a motion vector. A motion vector candidate selection unit (301) sequentially selects predetermined motion vector candidates in an interpolation frame. A differential image generation unit (302), a binary image generation unit (303) and an area image generation unit (304) generate a differential image, a binary image and an area image, respectively, based on a selected motion vector candidate. For each pixel of the interpolation frame, a motion vector determination unit (305) identifies a motion vector candidate with which a pixel value of a pixel in the area image corresponding to the pixel is the largest as a motion vector. A pixel value determination unit (306) determines each pixel value of the interpolation frame by using the motion vector identified for each pixel, thereby generating an interpolation frame.

Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.

Abstract: A moving picture coding method includes: coding a coding target block using a motion vector; generating a plurality of motion vector predictors; and coding the motion vector using one of the plurality of motion vector predictors generated in the generating of a plurality of motion vector predictors. In the generating of a plurality of motion vector predictors, a replacement vector which replaces a temporal motion vector predictor is added to the plurality of motion vector predictors when it is impossible to obtain the temporal motion vector predictor from a block which is included in a coded picture different from the coding target picture and corresponds to the coding target block.

Abstract: Embodiments of the present invention provide a motion prediction or compensation method during a video coding and decoding process. A motion prediction or compensation method provided in the embodiments of the present invention includes: acquiring a candidate motion vector set; conducting a refined search for an optimal motion vector based on information of the candidate motion vector set; and performing motion prediction or compensation by using the motion vector acquired by the refined search. This improves coding performance and meanwhile maintains reasonable complexity.

Abstract: Digital signal processing and, more particularly, digital video coding is described. Video encoding or decoding of frames includes accessing a plurality of values that can include at least one quantized DC default value and a plurality of quantized DC block values for neighboring blocks with respect to an intra block. A direction of change for the intra block is determined using predictor values obtained from the accessed values.

Abstract: An apparatus comprising a processor configured to receive a current block of an image, select an optimal prediction mode of a plurality of prediction modes for the current block, wherein the selected prediction mode corresponds to a selected one of a plurality of group-numbers and a selected one of a plurality of index-numbers, predict one of the plurality of group-numbers based on a first known group-number and a second known group-number, wherein the predicted group-number is predicted independent from any known index-numbers, clear a first flag when the predicted group-number matches the selected group-number, and set the first flag and encode the selected group-number into a coded data stream when the predicted group-number does not match the selected group-number, wherein the first flag is located in an overhead of the coded data stream.

Abstract: A method for encoding a video frame. The method including obtaining a current frame from a video stream, where the video stream includes a number of frames, determining a first base QP value for the current frame, and sending the first base QP value for the current frame to a decoder. The method also includes obtaining a first macroblock from the current frame, where the first macroblock includes a first image on the current frame, determining a first actual quantization parameter (QP) value for the first macroblock, and determining a first reference block for the first macroblock. The method also includes determining a first predicted QP value for the first macroblock using the first reference block, calculating a first ?QP value for the first macroblock, and sending the first ?QP value, a first prediction mode, and a first reference vector to the decoder.

Abstract: Techniques and tools for video coding/decoding with sub-block transform coding/decoding and re-oriented transforms are described. For example, a video encoder adaptively switches between 8×8, 8×4, and 4×8 DCTs when encoding 8×8 prediction residual blocks; a corresponding video decoder switches between 8×8, 8×4, and 4×8 inverse DCTs during decoding. The video encoder may determine the transform sizes as well as switching levels (e.g., frame, macroblock, or block) in a closed loop evaluation of the different transform sizes and switching levels. When a video encoder or decoder uses spatial extrapolation from pixel values in a causal neighborhood to predict pixel values of a block of pixels, the encoder/decoder can use a re-oriented transform to address non-stationarity of prediction residual values.

Abstract: A predictive coding system performs predictive encoding by determination of an optimum prediction mode from prediction methods for a pixel signal of a target block. A predicted signal is generated according to the determined mode, and a residual signal is determined. The residual signal and the optimum prediction mode are encoded to generate a compressed signal, which is decoded. The decoded signal is stored as a reconstructed picture sample. During encoding, a candidate prediction mode list is generated that contains elements of optimum prediction modes of previously-reproduced blocks neighboring the target block. A flag indicating whether the list contains an element corresponding to the optimum prediction mode is encoded, and an index to the corresponding element is encoded if the corresponding element is included in the list. The optimum prediction mode can be encoded based on identifying the elements in the list, unless no corresponding element appears on the list.

Abstract: An optical imaging system and associated methods for capturing images from an aircraft, such as a UAV. A camera unit on-board the aircraft is remotely controlled from an image control station. The image control station receives image data from the camera unit, and also delivers control signals for determining a viewing mode of the image.

Abstract: A method of decoding video data includes receiving syntax elements extracted from an encoded video bitstream, determining a candidate list for an enhancement layer block, and selectively pruning the candidate list. The syntax elements include information associated with a base layer block of a base layer of the video data. The candidate list is determined at least in part on motion information associated with the base layer block. The enhancement layer block is in an enhancement layer of the video data. The candidate list includes at least one motion information candidate that includes the motion information associated with the base layer block. The candidate list includes a merge list or an AMVP list. Pruning includes comparing one or more motion information candidates and at least one motion information candidate associated with the base layer block that is in the candidate list.

Abstract: Techniques for reducing bus traffic during texture decoding of a video bitstream are provided. In one configuration, a wireless communication device (e.g., cellular phone, etc.) comprises a processor configured to execute instructions operative to decode and separate in a bitstream macroblock (MB) information and residual packet data. The residual packet data is used to generate codec-independent non-zero MB-packets having a universal order that is codec independent. The codec-independent non-zero MB-packets and MB information are then used for reconstructing pixels of a respective frame of the video bitstream.

Abstract: This disclosure describes techniques for scanning coefficients of video blocks, e.g., quantized and transformed coefficients. Rather than use conventional zig-zag scanning, the techniques of this disclosure adapt the scanning order based on statistics associated with previously coded blocks that were coded in the same prediction mode. For each prediction mode, statistics of the coefficients are stored, e.g., indicating probabilities that given coefficients are zero or non-zero. Periodically, adjustments to the scanning order can be made in order to better ensure that non-zero coefficients are grouped together and zero value coefficients are grouped together, which can improve the effectiveness of entropy coding. The techniques of this disclosure provide thresholds and threshold adjustments that can reduce the frequency that the scanning order adjustments occur, yet still achieve desired improvements in compression due to such scanning order adjustments.

Abstract: There are provided video encoders and corresponding methods for encoding video data for an image that is divisible into macroblocks. A video encoder includes an encoder for performing into mode selection when encoding a current macroblock by testing a first subset of intra modes to compute a rate distortion cost, and utilizing the rate distortion cost to determine whether to terminate the intra mode selection and which additional intra modes, if any, are to be examined with respect to the current macroblock.

Abstract: The image encoding apparatus of one embodiment of the present invention comprises a coding mode determination unit, a prediction image generation unit, a storage unit, and an encoding unit. The coding mode determination unit determines a coding mode relating to which of the first image prediction processing or second image prediction processing is used for generating prediction image of a partial area of input images. The prediction image generation unit extracts the prediction assist information by the first image prediction processing and generates a prediction image based on the prediction assist information. The storage unit stores the reproduced image that is based on the prediction image. The encoding unit generates a bit stream comprising data obtained by encoding the coding mode information and prediction assist information.

Abstract: The method includes receiving a multi-view video stream including a random access picture, which includes a random access slice. Type information indicating whether the random access slice is predicted from one or two reference pictures is obtained, and a reference picture list is initialized using view number information and view identification information included in obtained initialization information according to the type information. The initialized reference picture list is modified based on modification information representing how to assign an inter-view reference index in the initialized reference picture list. A prediction value of a macroblock in the random access picture is determined based on the modified reference picture list.

Abstract: A scalable video coding method is provided. The scalable video coding method includes dividing an enhancement layer into macroblocks; when base_mode_flag or residual_prediction_flag of the macroblock is equal to 1, calculating a reference block coordinate value of a reference layer to refer to in the block up-sampling of the enhancement layer and up-sampling the macroblocks of the enhancement layer using the coordinate value; and coding the up-sampled macroblock. The execution speed of the scalable video codec can be raised and the memory usage required for the spatial inter-layer prediction of the scalable video can be saved.

Abstract: An image coding apparatus which includes a frame memory selecting unit (35) for selecting, in response to a selection signal, an image to be continuously stored in a plurality of frame memories (9, 10) as a background image and storing the background image into the plurality of frame memories (9, 10), and a background motion compensating unit (14, 39) for performing motion compensating prediction corresponding to an input image based on the background image to generate a predicted image based on the motion compensating prediction, and an image decoding apparatus corresponding to the image coding apparatus.