Abstract: A method for improving real-time video communications using a Foveation-based unequal error protection scheme (UEP) and error resilience. In a preferred embodiment of the present invention, a real time processing module partitions a video image into at least two data bit stream signals based on a directional pointing device or a pattern filter definition of “areas of importance.” These different data bit stream signals are then processed via different algorithms based on the importance of correcting errors in the data signals. The data is then transmitted. After reception at a receiving device, the data signals are regenerated and corrected to their original form.

Abstract: An encoder generates an estimate of apparent inter-image motion utilizing a dense motion field in a sequence of video frames or other images. The estimate in an illustrative embodiment includes a motion vector for each pixel of the dense motion field. The estimate is generated at least in part as a solution to a constrained optimization problem based on a multiscale data model characterizing the motion between pixels of the dense motion field and designated neighbor pixels. The estimate is used for motion compensation in encoding the corresponding images, and is itself encoded for transmission to a decoder for use in decoding the encoded images. In the illustrative embodiment, the multiscale data model characterizes spatial, temporal and scale coherence properties of the motion as a Markov random field (MRF), thereby ensuring that the resulting motion vectors can be efficiently coded for transmission to the decoder.

Abstract: A video signal is encoded in a progressive video coder so as to generate a progressive coded video bit stream for transmission over a heterogeneous network. The progressive coded video bit stream is configured so as to be decodable at any one of a series of increasing bit rates up to a maximum bit rate, depending on which of a number of corresponding portions of the progressive coded video bit stream are received by a decoder. Each of the portions is associated with a different bit rate, and one or more of the portions may each also be associated with different values of other parameters such as frame rate, spatial resolution, and peak signal-to-noise ratio. Each of the series of increasing bit rates produces progressively better reconstructed video quality at an output of the decoder. The progressive coded bit stream is transmitted over a first part of the heterogeneous network at a first one of the bit rates.

Abstract: Digital watermark information is inserted into an image by first separating the image into components, e.g., discrete cosine transform (DCT) blocks or image subbands, and then associating one or more bits of the digital watermark information with each of the components. For example, a single bit may be associated with each of the components by modulating the components with selected waveforms representative of the corresponding digital watermark information bits. As another example, the digital watermark information bits may be coded, e.g., using a repetition code, linear block code or convolutional code, to form channel bits, such that the modulating waveforms are selected for the image components based on the corresponding channel bits. The digital watermark information may include a total of B bits of information for representing a particular watermark, such that M=2B distinct watermarks can be generated using the B information bits.

Abstract: Channel error protection is provided for a source coded bit stream in a communication system by a combination of outer channel coding and inner channel coding implemented across different network layers of the system. One or more of a number of different portions of the source coded bit stream are outer channel coded in a first network layer of the system, e.g., an application layer, using a designated outer channel code, so as to provide an outer channel coded bit stream having different levels of error protection for each of the different portions of the source coded bit stream. The outer channel coded bit stream is then inner channel coded in a second network layer of the system, e.g., a physical layer, using a designated inner channel code to thereby generate a channel coded bit stream. The channel coded bit stream may then be subject to further processing operations prior to transmission in the communication system.

Abstract: Unequal channel error protection is provided for a bit stream, e.g., a progressive source coded bit stream, by puncturing of a channel code. The channel code has a specified rate associated with a corresponding level of error protection, and is used to code a first portion of the bit stream. The channel code is subsequently punctured for at least a second portion of the bit stream so as to provide a rate higher than that of the designated rate. Commencement of the puncturing is deliberately delayed by an amount determined based at least in part on a memory of the channel code. Advantageously, the delay prevents propagation of errors in a channel decoder used to decode the channel coded bit stream. The progressive bit stream may be a progressive source coded video or audio bit stream, any other type of progressive information bit stream, or a partitioned source coded bit stream.

Abstract: A method for optimizing a wavelet packet structure for subsequent tree-structured coding which preserves coherent spatial relationships between parent coefficients and their respective four offspring at each step. A valid frequency tree is defined by a wavelet packet decomposition algorithm. Constraints are placed on the pruning of the frequency tree in order to select valid frequency trees as each step. These constraints include considering any four offspring sub-bands as candidates for pruning only when their current frequency decomposition level is the same as that of their respective spatially co-located parent sub-band, and pruning the spatially co-located offspring sub-bands when pruning only the parents results in an invalid wavelet packet structure.

Abstract: A method for improving real-time video communications using a Foveation-based unequal error protection scheme (UEP) and error resilience. In a preferred embodiment of the present invention, a real time processing module partitions a video image into at least two data bit stream signals based on a directional pointing device or a pattern filter definition of “areas of importance.” These different data bit stream signals are then processed via different algorithms based on the importance of correcting errors in the data signals. The data is then transmitted. After reception at a receiving device, the data signals are regenerated and corrected to their original form.

Abstract: Channel error protection is provided for a source coded bit stream in a communication system by a combination of outer channel coding and inner channel coding implemented across different network layers of the system. One or more of a number of different portions of the source coded bit stream are outer channel coded in a first network layer of the system, e.g., an application layer, using a designated outer channel code, so as to provide an outer channel coded bit stream having different levels of error protection for each of the different portions of the source coded bit stream. The outer channel coded bit stream is then inner channel coded in a second network layer of the system, e.g., a physical layer, using a designated inner channel code to thereby generate a channel coded bit stream. The channel coded bit stream may then be subject to further processing operations prior to transmission in the communication system.

Abstract: A method and apparatus for recognition of objects such as faces in images using signal compression techniques (i.e., coding techniques) in which a portion of the image which includes the object to be recognized (e.g., the face) is coded, and the resultant coded data is matched against previously coded and stored training data which makes up a known object database. A given object in an input image signal is matched to one of a plurality of known objects stored in a database, wherein the stored representation of each of the known objects comprises a codebook generated based on training image signals comprising the known object. A first illustrative embodiment comprises the steps of decomposing the given object into blocks; performing a plurality of encodings of the given object, each encoding comprising coding the object with use of one of the codebooks; determining a coding error for each encoding; and matching the given object to one of the known objects based on the coding errors.

Abstract: A method and apparatus for low bit rate coding of color video signals in which the use of the codebook entry identified by the codebook index may be bypassed in the coding of chrominance information when it is determined that it is advantageous to do so. In particular and in accordance with an illustrative embodiment of the present invention, the method comprises the steps of generating a codebook index signal based on the luminance information of the block being coded; determining a coding error based on a comparison of the chrominance information contained in the given block and the chrominance vector represented by the generated codebook index signal; and generating a chrominance vector bypass signal based on whether the coding error exceeds a threshold. Specifically, the chrominance vector bypass signal is used to indicate whether the chrominance information of the given block has or has not been coded with use of the codebook.