Abstract: The present invention is directed to a method for encoding video data in an embedded fashion in order to achieve fine granular scalable video. The method includes the video data being transformed into a plurality of DCT coefficients. Further, the DCT coefficients are arranged into sub-groups and the DCT coefficients are scanned according to the sub-groups. The DCT coefficients being scanned by the sub-groups enables a higher level of scalability to be achieved.

Abstract: There is disclosed a video encoder comprising a base layer encoder and an enhancement layer encoder. The base layer encoder receives an input stream of video frames and generates compressed base layer video data suitable for transmission to a streaming video receiver. The enhancement layer encoder receives the input stream of video frames and a decoded version of the compressed base layer video data and generates enhancement layer video data associated with the compressed base layer video data and suitable for transmission to the streaming video receiver. The video encoder also comprises a controller associated with the enhancement layer circuitry for receiving a quantization parameter associated with the base layer video data and determining therefrom at least one all-zero bit plane associated with at least one block of the enhancement layer video data. The controller is capable of causing the enhancement layer circuitry not to transmit the at least one all-zero bit plane to the streaming video receiver.

Abstract: In a Fine Granular Video encoding system, a method for determining the number of transmission bits of SNR encoded and temporally encoded video data within a frame to balance image quality and object motion is presented. In accordance with the principles of the invention, a number of transmission bits at a known bit-rate for a quality enhanced video frame and a temporal enhanced video frame is determined to balance image quality and object motion smoothness. In one aspect of the invention, the number of bits transmitted in each frame is determined by comparing a ratio of a measure of video encoded information within the quality enhanced video frame and a measure of video encode information within the quality enhanced video frame and the temporally enhanced video frame to a known threshold level. The number of transmission bits in each enhancement layer is then determined using a first method when the ratio is above a known threshold and using a second method otherwise.

Abstract: A method for storing a block of data consisting of N rows and M columns, which includes the step of transposing the block of data by 90° to thereby produce a transposed block of data consisting of M rows and N columns, and, the step of storing the transposed block of data. The transposed block of data is preferably retrieved by using one or more fetch commands, with the number of fetch commands required to retrieve the transposed block of data being less than the number of fetch commands required to retrieve the same data if stored in its original form, thereby reducing memory bandwidth. In a presently contemplated implementation, the block of data is a reference macroblock of decoded MPEG video data that is used in motion compensation operations, and each of the fetch commands is an A×B fetch command, where A represents the number of columns of data and B represents the number of rows of data to be fetched in response thereto, and wherein further, A>B.

Abstract: Methods and devices for applying motion compensation to wavelet encoded video images and for transmitting the motion compensated wavelet encoded video images. One aspect of the invention involves an encoding device and method operable for organizing wavelet encoded images into a plurality of bit-planes, inverse wavelet transforming selected ones of the bit-planes wherein an image corresponding to the inverse wavelet transformed bit-planes is representative of said video image and estimating motion between the video image and the inverse wavelet transformed images. Another aspect involves, a transmitting device and method for identifying a type of frame and initiating a first significance based transmission process when a first type of frame is determined and initiating a second significance based transmission process when a second type of frame is determined.

Abstract: A method, system and apparatus for improving network transmission efficiency using MDS and Fine Granular Spatial coding is disclosed. In accordance with the method, a video image is partitioned into a plurality of information item frames, each frame is independently layer encoded into a base layer and an enhancement layer, at least one channel of the communication is then selected, each of the base layers are associated with one of the selected communication channels, and each base layer is transmitted over the associated communication channel. In other aspect, a residual bandwidth is determined on each associated channel and a level of an associated enhancement layer comparable to the residual bandwidth is transmitted over the associated channel.

Abstract: The present invention is directed to rearranging the transmission order of the enhancement-layer frames. By making the display and transmission order of the enhancement layer frames identical, a frame memory is not required on the decoder-side to hold the enhancement-layer frame until being displayed since the display can take place immediately after the decoding. Reducing the amount of memory is desirable for mobile applications or other low-power consumption devices.

Abstract: A decoder system having a motion compensation system that scales the processing of B pictures in order to save computational resources. The motion compensation system has a first scaling system that includes comparing a motion vector magnitude of each macroblock in a B picture with a predetermined threshold. A system for performing a routine decoding operation for each macroblock in which the motion vector magnitude is greater than the predetermined threshold and a system for copying a corresponding macroblock from a previous picture for each macroblock in which the motion vector magnitude is less than or equal to the predetermined threshold. A second scaling system that includes calculating an average motion vector magnitude for a first B picture and replacing a next contiguous B picture with the first B picture if the average motion vector magnitude is less than or equal to a predetermined threshold.

Abstract: The present invention is directed to a method and device for encoding video. According to the present invention, a first region in a first frame is matched to a second region in a second frame. A first partially encoded frame is produced including a difference between pixel values of the first and second region. A second partially encoded frame is produced including pixel values of either the first or second region. Further, the first and second partially encoded frame is transformed into wavelet coefficients.

Abstract: A method for decoding a stream of data includes the steps of: identifying a relationship (100) between quality of a decoded image and a bit rate for decoding the image; selecting a desired quality (110) of images to be decoded from the stream of data; determining a bit rate (112) corresponding to the desired quality using the relationship; and decoding a minimum number of bit-planes corresponding to the determined bit rate from the stream of data.

Abstract: A method and apparatus for coding video includes constructing motion-compensated extended reference frames from at least portions of temporal residual image frames. The motion-compensated extended reference frames are used for bi-directionally and/or uni-directionally predicting additional levels of FGS motion-compensated residual image or temporal frames.

Abstract: The present invention is directed to a method and device for encoding a group of video frames. According to the present invention, a number of frames from the group is selected. Regions in each of the number of frames are matched to regions in multiple reference frames. A difference between pixel values of the regions in each of the number of frames and the regions in the multiple reference frames is calculated. The difference is transformed into wavelet coefficients. The present invention is also directed to a method and device for decoding a group of frames by performing the inverse of the above described encoding.

Abstract: The present invention is directed to a method and device for encoding a group of video frames. According to the present invention, a first number of frames in the group is motion compensated temporally filtered based on multiple frames. A second number of frames in the group is motion compensated temporally filtered based on single reference frames. The first and second number of frames are transformed into wavelet coefficients. Further, the wavelet coefficients are entropy encoded. In one example, the first number of frames are located within a first portion of the group and the second number of frames is located within a second portion of the group. In another example, the first number of frames and the second number of frames are interleaved within the group.

Abstract: The present invention is directed to a method and device for encoding a group of video frames. According to the present invention, regions in at least one frame in the group are matched to regions in multiple reference frames. The difference between pixel values of the regions in the at least one frame and the regions in the multiple reference frames is calculated. The difference is transformed into wavelet coefficients. The present invention is also directed to a method and device for decoding a group of frames by performing the inverse of the above described encoding.

Abstract: The present invention is directed to fine granular coding technique that includes both quality and temporal scalability. This is accomplished by utilizing a hybrid temporal/SNR scalability structure that is readily adaptable to fine granular coding techniques. In one example of this structure, temporal enhancement frames and FGS enhancement frames are included in a single enhancement layer. In another example, two distinct enhancement layers are used to achieve the hybrid temporal-SNR scalability. The two layers include a temporal scalability layer to achieve the temporal enhancement for the base-layer (i.e., better motion), while an FGS layer is used to improve the quality SNR of the base-layer and/or the temporal-scalability enhancement layer.

Abstract: A method and apparatus for providing a smooth transition of the transmission over a network between a first FGS encoded video stream and a second FGS encoded video stream wherein each of the FGS encoded video streams contains a base layer. The method comprises selecting a transmitted P-frame of the first video stream, selecting a next P-frame to be transmitted in the second video stream, determining a difference between the transmitted P-frame of the first video stream and the next to be transmitted P-frame of the second video-stream, and transmitting the difference between said P-frames over said network in place of said next to be transmitted P-frame.

Abstract: A method and apparatus for coding video includes constructing motion-compensated extended base layer reference frames from base layer frames and at least portions of base layer residual image frames. The motion-compensated extended base layer reference frames are used for bi-directionally or uni-directionally predicting FGS motion-compensated residual image or temporal frames.

Abstract: A method and apparatus for fine granular scalability encoding. The following steps are repeated, for each individual transform block in an image frame. A respective plurality of residual coefficients are decomposed for the respective transform block. A respective plurality of bit-planes or discrete quantization steps are processed for the respective transform block before decomposing coefficients for a next one of the transform blocks in the image frame.

Abstract: A method and apparatus for minimizing prediction drift at low bitrates in a fine granular scalable video coding scheme that utilizes motion compensation in an enhancement layer. The method and apparatus measures motion activity within at least a portion a video; determines whether the measured motion activity is below a predetermined threshold value; codes the portion of the video with the fine granular scalable video coding scheme that utilizes motion compensation in the enhancement layer if the measured motion activity is below the predetermined threshold value; and codes the portion of the video with a fine granular scalable video coding that does not utilize motion compensation in the enhancement layer if the measured motion activity is above the predetermined threshold value.

Abstract: A server or proxy server transmits streaming video data. An identification is made of either: an average or minimum available bandwidth of a link over which a data stream of a given video segment is to be transmitted or a capability of a recipient host to which the data stream is to be transmitted. A selection is made of either: a corresponding one of a plurality of predetermined ranges of bandwidths so that the selected range contains the identified average minimum available bandwidth; or a corresponding one of a plurality of different data stream types so that the identified capability of the recipient host is used to process data of the selected data stream type. The data stream is coded in a manner which takes advantage of the range of bandwidths or type of data stream that has been or is to be selected. The coded data stream is transmitted over the link to a recipient.