Abstract: A method for temporal decomposition and reconstruction of an input video signal is disclosed. The method can use a prediction process and an update process in the framework of motion compensated temporal filtering (MCTF), the method can employ a block based video codec having an encoder and a decoder. A residual picture signal and a low-pass picture signal are received, the low-pass picture signal having a lesser precision than that of the residual picture signal, and in response to the residual picture signal being decoded in the decoder, the residual picture signal is clipped and reduced in precision, such that the low-pass picture signal, a reconstructed picture, and the residual picture signal have equal precisions. An inverse MCTF process, using a lifting scheme, can be performed on the clipped residual signal.

Abstract: A logic circuit is configured to calculate a sliding sum of absolute differences of a plurality of numbers from a plurality of members respectively selected successively from all members of a sequence of numbers. The logic circuit reduces an amount of logic that is required to perform the sum of absolute differences, and thereby saves resources and latency.

Abstract: A method and system for low-latency processing of intra-frame video pixel block prediction including: predicting a pixel block based on boundary pixels of left and upper neighbor blocks of said pixel block; subtracting said predicted pixel block from a source pixel block to generate a prediction error; forward transforming and quantizing said prediction error to generate a residual data; inverse transforming and quantizing said residual data; adding said predicted pixel block to said inverse transformed and quantized residual data to generate a reconstructed pixel block; pre-computing blocks of DC-coefficients used with luma and chroma intra prediction modes; pre-computing mode selection of a best prediction mode of said luma and chroma intra prediction modes; and outputting said residual data to be used in entropy or arithmetic coding, and a reconstructed data used for motion prediction.

Abstract: Reference frames are selected for use in a frame reference buffer in a video encoding system, so as to provide long term prediction of motion in video sequences. Candidate reference frames are characterized by characteristic vectors. From the candidate reference frames, a number of reference frames are maintained in the frame buffer so as to obtain a specified distribution of the characteristic vectors over a vector space. Frames are selected for use in encoding a current frame based on the characteristic vector of the current frame and the reference frames in the frame buffer.

Abstract: The present invention relates to an encoding apparatus, an encoding method, an encoding program, a decoding apparatus, a decoding method and a decoding program for encoding and decoding efficiently a video signal in interlace scanning. An adder 12 and a subtractor 13 respectively perform addition and subtraction operations on an odd field and an even field of moving image data in interlace scanning. An intra encoder 14 and an intra encoder 15 wavelet transform addition image data and subtraction image data, quantize transform coefficients W, and entropy encode quantization coefficients q. Encoded data output from the intra encoder 14 and the intra encoder 15 is multiplexed into a single encoded stream to be output. Since data with the addition and subtraction operations performed on the odd field and the even field thereof is encoded, dynamic range is doubled while compression efficiency is increased.

Abstract: A method and apparatus for encoding and decoding video performs transformation of at least a portion of a high-resolution video frame into a low resolution image and a plurality of enhancement data sets, encodes the low resolution image as a primary coded picture in a bitstream format and encodes each of the plurality of enhancement data sets as a different redundant coded picture in the bitstream format. For decoding, a decoded low resolution image and a plurality of decoded enhancement data sets are generated and an inverse transform is performed to construct a decoded high-resolution image. The primary coded picture and a redundant coded picture may be formatted according to the ITU-T H.264 Advanced Coding specification. The transform may be a polyphase or a sub-band transform.

Abstract: A transcoder for decoding a motion picture stream encoded by using a first coding scheme, which provides intraframe coding and interframe predictive coding, and encoding the decoded motion picture stream by using a second coding scheme, the transcoder including: at decoder for decoding an input motion picture stream and detecting sub-information indicating whether an intraframe coding scheme or an interframe predictive coding scheme is used; and an encoder for changing the frame to be referenced at the time of coding depending on whether the sub-information indicates the use of the intraframe coding scheme or the interframe predictive coding scheme.

Abstract: A scalable coder having a grid motion estimation and compensation module (110), a motion compensation temporal filtering module (105), a scalable coding module (115), a discrete transformation module (120), and a packetization module (135). The grid-motion estimation and compensation module (110) outputs a scalable motion vector from the source video data, supplied resolution and bit rate parameters. The motion compensation temporal filtering module (105) generates, from the source video data and the scalable motion vector, a residual image corresponding to the difference between the present and previous image frames. The scalable coding module (115) is coupled to receive and encode the scalable motion vector. The discrete transformation module (120) is configured to receive and domain transform the supplied video to a sequence of coefficients.

Abstract: Embodiments of the present invention comprise systems and methods for image noise characterization, parameterization, removal, reconstruction and/or re-combination with a denoised image.

Abstract: Techniques and tools for skip modes in encoding and decoding of inter-layer residual video are described. For example, an encoder encodes multiple macroblocks of a picture of inter-layer residual video. For a current macroblock that is skipped, the encoder selects a skip mode from among multiple available skip modes and uses the selected skip mode when encoding the current macroblock. The skip modes can include intra skip mode and predicted-motion skip mode. A corresponding decoder, for the current macroblock, selects and uses the skip mode for the current macroblock during decoding. As another example, an encoder encodes multiple channels of a picture of inter-layer residual video. For each channel, the encoder determines whether to skip the channel. The encoder signals channel skip information to indicate which channels are skipped. A corresponding decoder parses the channel skip information and determines on a channel-by-channel basis whether to skip the respective channels.

Abstract: A video image sequence including coefficients of frequency sub-bands with different spatial resolutions is coded. A data stream including at least one restitution level (Niv N?2, Niv N?1, Niv N) is formed. The restitution levels have coefficients of frequency sub-bands whose spatial resolution equals a spatial resolution of the restitution level. There are inserted, in at least one restitution level, coefficients of frequency sub-bands with a spatial resolution higher than the spatial resolution or resolutions of the restitution level.

Abstract: System and method of providing improved signal compression using frame decimation through frame simplification and generating an encoded bitstream of video frames therefrom are disclosed. The encoding method comprises zeroing a difference frame generated by an encoder by using a feedback loop that injects a reconstructed frame, generated by the encoder of the difference frame, as a next frame of the video frames to be processed by the encoder. The encoding system comprises an input configured to provide a stream of video frames; a first process configured to generate a difference frame, and a second process configured to generate a reconstructed frame. A feedback loop of the system is configured to inject a generated reconstructed frame from the second process of a generated difference frame from the first process as a next frame of the video frames in the stream to be processed into the encoded bitstream by the encoding system.

Abstract: An intraprediction encoding and decoding apparatus and method to improve compression efficiency are provided. A video encoding method includes dividing an input video of a predetermined size into at least two sub-planes, performing intraprediction encoding on at least one of the divided at least two sub-planes, and performing interprediction encoding on at least one of the remaining sub-planes by using the intraprediction encoded sub-plane as a reference sub-plane.

Abstract: A video encoding apparatus provides with a generator to generate a decoded image corresponding to an image obtained by decoding an encoded image obtained by encoding an original image by a first prediction scheme, a selector to select one of the original image and the decoded image as an input image according to a flicker of an image, and an encoder to encode the input image by a second prediction scheme to generate encoded data.

Abstract: Provided are an apparatus and method for compression-encoding a moving picture at high speed while minimizing image quality deterioration. In H.264 moving picture encoding, the apparatus and method perform rate-distortion optimization (RDO) indispensable for high-definition encoding by feedback prediction, and minimize the amount of discrete cosine transform (DCT)-inverse DCT (IDCT) calculation performed for RDO many times, thereby performing H.264 encoding at high speed.

Abstract: The method realizes a motion compensated temporal filtering (MCTF), the temporal filtering being replaced by an intra mode coding to obtain at least one low (L) or high (H) frequency picture if the current picture has a level of correlation with a lower previous picture at a threshold, the low frequency pictures obtained (L) being thus scaled to be adapted, at the energy level, to the pictures obtained by motion compensated temporal filtering, and comprises, at the end of analysis: a selection of the pictures obtained by intra coding of a picture of a low decomposition level with the additional condition, for the high frequency pictures, that this picture is derived itself from an intra coding. a calibration of the picture selected by carrying out at least one reverse step of the scaling step. The applications relate to video compression with temporal prediction.

Abstract: A method and apparatus are provided for effectively predicting a video frame that use all of the advantages of an intra mode and an intra BL mode in multi-layer structure based-video coding. The method includes reconstructing the intra block of a lower layer using the previously reconstructed first neighboring blocks of the intra block; subtracting the first neighboring blocks from previously stored the second neighboring blocks of an upper layer corresponding to the first neighboring blocks; creating a differential predicted block based on a predetermined intra prediction mode by performing intra prediction using virtual differential neighboring blocks that are created as a result of the subtraction; adding the differential predicted block and the reconstructed intra block; and subtracting a predicted block, which is created as a result of the addition, from a block of the upper layer corresponding to the intra block.

Abstract: The process for coding a mosaic of images giving a stream of coded data the mosaic being composed of subimages, the subimages being composed of image elements, resynchronization markers in the stream allowing resynchronization of the data at reception level, wherein the subimages are placed under one another in the image to be coded so as to give a mosaic, the mosaic is coded element by element according to a TV-type scan so as to provide data of the stream, the first element of each subimage being identified, and a resynchronization marker is placed in the stream, before each first element of a subimage, so as to identify the data relating to the subimage.

Abstract: A method of temporal error concealment for generating the image data of the missing macro-blocks in the current frame by using the previous frame and the correct data of the current frame is disclosed. The method includes the steps: first using Optimal Regression Plane to estimate the space motion vectors for each block in the missing macro-blocks; selecting appropriate motion vectors from the estimated space motion vectors and the correct temporal motion vectors in the previous frame as the candidate motion vectors; dividing the missing macro-block into sub-blocks with optimal size; fine tuning the candidate motion vectors as the predicted motion vectors; and using the predicted motion vectors to generate the predicted image data for the missing macro-block and further concealing the effect of the missing macro-blocks upon the image quality of the current frame. The method reduces the computation time, speeds up the process, and improves the image quality.

Abstract: An apparatus, method, and medium for video synchronization are provided. The apparatus may include a PTS register storing a presentation time stamp (PTS) of a picture to be reproduced and skip enable flag information indicating whether the picture can be skipped, by using a position of the picture in a video decoder buffer in which pictures to be decoded are stored; and a controller controlling the picture reproduction by skipping, repeating, or reproducing the picture with reference to the PTS and the skip enable flag information stored in the PTS register.

Abstract: Various embodiments provide methods and systems for streaming data that can facilitate streaming during bandwidth fluctuations in a manner that can enhance the user experience. In one aspect, a forward-shifting technique is utilized to buffer data that is to be streamed, e.g. an enhancement layer in a FGS stream. Various techniques can drop layers actively when bandwidth is constant. The saved bandwidth can then be used to pre-stream enhancement layer portions. In another aspect, a content-aware decision can be made as to how to drop enhancement layers when bandwidth decreases. During periods of decreasing bandwidth, if a video segment does not contain important content, the enhancement layers will be dropped to keep the forward-shifting of the enhancement layer unchanged. If the enhancement layer does contain important content, it will be transmitted later when bandwidth increases.

Abstract: A hybrid high-definition encoder and method are disclosed, for processing signal data as a plurality of block transform coefficients for each of base layer data and enhancement layer data, where the encoder includes a two-layer decomposition unit for decomposing an original high-definition signal data sequence into base layer data and enhancement layer data, a standard-definition encoder coupled to the decomposition unit for encoding the base layer data as a base layer bitstream embodying a standard-definition data sequence, and a high-definition encoder coupled to the decomposition unit and the standard-definition encoder for encoding only the difference between the high-definition data and the standard-definition data as base layer picture user data embodying a high-definition data sequence.

Abstract: A series of decoded images is generated from a series of original images encoded by a first encoding technique following movement-compensated, predictive encoding, where a starting image of a group of successive original images that are to be encoded is defined by a second encoding technique following movement-compensated, temporally filtered partial band encoding based on a determined encoding property of a decoded image of the group of images that are to be encoded, the decoded image is used for generating an output image having a low resolution level, before the images are encoded. At least one output image is generated on each level of resolution from the successive original images of the group of from at least one decoded image during image encoding. The decoded images are provided only with a reduced quality while the reconstituted images are of great quality.

Abstract: A process and system for improving a digital image of an object defined by pixels, acquired at the instant t and generated from an X-ray detector receiving X-rays emitted by a source. The process includes: determining a predicted image of the object at the instant t as a function of the images of the object acquired at the instants t?i, i being a positive whole number greater than or equal to 1, and moving of each of the layers constituting the image acquired at the instant t, the number of layers being previously fixed and the moving of each of the layers being previously determined; and generating a visualized image corresponding to a weighted sum of the predicted image and the image of the object acquired at the instant t, so as to attenuate the noise of the image of the object acquired at the instant t.

Abstract: Provided is an apparatus for and a method of transcoding video, in which, in the transmission of a compressed video, the compressed video is transcoded into multiple descriptions in an error prone environment and is transcoded into a single description in an lower error or errorless environment. Video transcoder includes a decoding unit, a single description/multiple description determining unit, and a transcoding unit. The decoding unit decodes a compressed video to generate video header, a motion vector, and a DCT (discrete cosine transform) coefficient for each frame. The single description/multiple description determining unit determines whether to perform transcoding into a single description or multiple descriptions based on the possibility of errors occurring in a transmission channel of the compressed video.

Abstract: In video encoding, the video frames are spatio-temporally filtered for reduction of spatial and temporal redundancy before they are entropy encoded. Known filtering schemes consider temporally successive frames and are static. It is probable but not necessary that successive frames are most efficient to encode. Therefore, a plurality or all possible frame order permutations are considered for a group of frames (GOP) and evaluated based on a global criterion, which is the sum of local criterion values computed over successive subsets of permuted frames. The local criterion value is deduced from motion estimation processed on each considered set of frames. The best ordering is chosen as the one that minimizes the global criterion value.

Abstract: Various embodiments provide methods and systems for streaming data that can facilitate streaming during bandwidth fluctuations in a manner that can enhance the user experience. In one aspect, a forward-shifting technique is utilized to buffer data that is to be streamed, e.g. an enhancement layer in a FGS stream. Various techniques can drop layers actively when bandwidth is constant. The saved bandwidth can then be used to pre-stream enhancement layer portions. In another aspect, a content-aware decision can be made as to how to drop enhancement layers when bandwidth decreases. During periods of decreasing bandwidth, if a video segment does not contain important content, the enhancement layers will be dropped to keep the forward-shifting of the enhancement layer unchanged. If the enhancement layer does contain important content, it will be transmitted later when bandwidth increases.

Abstract: Systems and methods for using selective inter-layer prediction during layered video coding operations are described. In one aspect, a layered coded video structure is generated by selectively employing only objectively efficient inter-layer predictions between respective frames. Responsive to receiving a request for coded video data, one or more layers of the layered coded video structure are communicated to an application for decoding and presentation of video data to a user.

Abstract: A method and apparatus for decoding a video signal. The video signal being a scalably-encoded video signal corresponding to a base layer and enhanced layer. Various residual signals are determined by comparing, among other things, a corresponding block with the current block. The current block is ultimately decoded using weight information, a reference index and a residual signal.

Abstract: Wavelet transformation is performed at a plurality of levels as to image signals. A first buffer stores, independently for each of the levels, a part of coefficients from results of analysis filtering in a horizontal direction of the image signals. A second buffer stores, independently for each of the levels, a part of coefficients generated in a computation process of analysis filtering in a vertical direction of the image signals. A vertical filtering unit performs the vertical direction analysis filtering, using coefficients read out from the first and second buffers. A horizontal filtering unit performs analysis filtering in the horizontal direction, using coefficients from the results of the vertical direction analysis filtering as the input of the horizontal direction analysis filtering for the next level, except for the final level of the levels.

Abstract: In some embodiments, a method of determining encoding type and predictive mode(s) selections for a macroblock of a video frame is provided. In some embodiments, a general method 1) selects the encoding type (16×16 or 4×4) that is initially considered for a macroblock using an encoding type selection algorithm (based on an attribute of the macroblock that is easy to compute), 2) if the 16×16 encoding type is selected in step 1, consider the four 16×16 prediction modes that may be used on the macroblock using conventional methods or an improved 16×16 predictive mode search algorithm based on distortion thresholds, and 3) if the 4×4 encoding type is selected in step 1, select the 4×4 prediction mode to be used for each of the sixteen 4×4 blocks of the macroblock using conventional methods or an improved 4×4 predictive mode search algorithm based on the positional relationships between predictive modes.

Abstract: An intraprediction encoding/decoding method and apparatus are provided. The intraprediction encoding method includes forming a flipped reference block by flipping pixels of a reference block used for intraprediction symmetrically with respect to a straight line of a predetermined direction passing through the center of the reference block, and performing intraprediction using the flipped reference block.

Abstract: A wavelet transformation device for performing wavelet transformation at a plurality of division levels as to image signals. A horizontal filtering unit subjects the image signals to horizontal direction lowband analysis filtering and highband analysis filtering. Buffers which are independent for each of the division levels, hold frequency components, which are generated as the results of the horizontal direction analysis filtering by the horizontal filtering unit, for each of the division levels. Interleaving devices comprising at least one interleaving unit interleaving brightness components and color difference components of the image signals and interleaving highband components and lowband components of buffered filter results.

Abstract: Systems and methods for the processing of images over bandwidth-limited transmission interfaces, such as processing of high resolution video images over standard analog video interfaces, using multi-stream and/or multi-resolution analog methodology. The disclosed systems and methods may also be implemented to provide video resolutions across standard analog video interfaces in a manner that supports digital capture and imaging techniques obtain useful information from digitally zoomed and enhanced video.

Abstract: Highly efficient lossless decoding is realized under the condition that codes transmitted as a base part are compatible with the H.264 standard. An orthogonal transformation section (12) performs orthogonal transformation of residual signals (Rorig), acquires transform coefficients (Xorig), and a quantization section (13) quantizes the transform coefficients. An existential space determination section (14) obtains information on upper limits and lower limits of the respective coefficients (an existential space of transform coefficients) from quantization information.

Abstract: Video-coded information is transmitted over a network at a priority level that is determined based on feedback from the network. In an embodiment, the feedback comprises a response to a request for information on whether the network currently has the available capacity to transmit additional high priority traffic. In an embodiment, a candidate base layer frame is transmitted over the network as a base layer frame if permission to send high priority data was granted and is transmitted over the network as an enhancement layer frame if permission to send high priority data was denied. In a further embodiment, the candidate base layer frame is deleted if permission to send high priority data was denied.

Abstract: A system and method for monitoring a sequence of video packets for quantifying video quality includes a video picture monitor that accesses data in a header of a video packet included in the sequence of video packets. The header is separate from video content stored in the video packet. The video picture monitor also determines from the accessed data, a relationship between a portion of a picture included in the video packet and at least a portion of a picture included in another video packet. Both video packets are included in the sequence of video packets. This relationship indicates whether to use the video content stored in the first video packet to quantify video quality.

Abstract: MPEG video uses motion compensated prediction for coding pictures. A GOP includes at least one intra-coded picture to start decoding with and a number of inter-coded pictures and normally also includes bi-directionally predicted pictures. However, the GOP structure is not constructed for playing GOPs in backward direction in a trickplay mode across GOP boarders. The invention facilitates, for different GOP structures, a smooth backward video mode thereby reducing the required number of frame buffers and achieving near real-time speed presentation. In some embodiments some I and/or P pictures are decoded more than once. The invention also allows backwards decoding of MPEG-4-AVC GOPs including B-stored pictures.

Abstract: In a transcoder that decodes and encodes a motion picture stream, a highly compressed motion picture stream cannot be obtained if the same corresponding frame is referenced for coding purposes in a situation where an intraframe coding mode, in which an unconverted stream is not provided with vector information, is used and in a situation where an interframe predictive coding mode, in which the unconverted stream is provided with vector information, is used. Further, if an additional frame is referenced after searching for the corresponding frame, the circuit scale and power consumption increase.

Abstract: A moving image decoding apparatus for decoding encoded moving image data, which is generated by decomposing each frame of moving image data into a plurality of subbands, and bitplane-encoding coefficients of the subbands for each predetermined unit, includes a decoding process time measurement unit (105) for acquiring information used to examine a difference of a time required for the decoding process of encoded moving image data for the predetermined unit, a non-decoding bitplane determination unit (107) for determining bitplanes which are not to be decoded on the basis of the obtained information, a bitplane decoder for reclaiming the coefficients of the subbands from encoded data of bitplanes other than the non-decoding bitplanes, and an inverse discrete wavelet transformer (104) for generating frame data by compositing the reclaimed coefficients of the subbands.

Abstract: A method and apparatus for estimating the motion of an image region (the “center” region) from a source video frame to a target video frame. The motion estimation is locally constrained in that the estimated motion of the “center region” is affected by the estimated motion of neighboring regions. Advantageously, this may reduce common motion matching problems such as false and ambiguous matches. In one embodiment, the locally-constrained motion estimation may be implemented by biasing an error map of the center region using error maps of the neighboring regions.

Abstract: A WLAN system adapted to apply QoS differentiation to a media stream to be transmitted from a transmitting station (STA) to a receiving STA of that system. The transmitting STA processes the media stream to generate a base sub-stream and one or more enhancement sub-streams for subsequent transmission over a wireless communication channel and assigns different priorities to different sub-streams. Depending on the channel conditions, the transmitting STA may select to discard, without transmission, portions of data from enhancement sub-streams. The selection process is based on the assigned priority and operates to preserve as much of relatively high-priority data as possible. The receiving STA then processes the received data to generate a reconstructed media stream, which provides signal quality equal to or better than the signal quality supported by the base sub-stream.

Abstract: A method, system, and computer programs for improving the image quality of one or more predicted frames in a video image compression system, where each frame comprises a plurality of pixels. A picture region or macroblock of certain types of frames can be encoded by reference to one or more referenceable frames in some cases, and by reference to two or more referenceable frames in other cases. Such encoding may include interpolation, such as an unequal weighting. The DC value or AC pixel values of a picture region may be interpolated as well, with or without weighting. A code pattern of such frames having a variable number of bidirectional predicted frames can be dynamically determined. Frames can be transmitted from an encoder to a decoder in a delivery order different from a display order. Sharpening and/or softening filters can be applied to a picture region of certain frames during motion vector compensated prediction.

Abstract: The present invention relates to a method and apparatus for producing a fully scalable compressed representation of video sequences, so that they may be transmitted over networks, such as the Internet, for example. Because the signal is scalable, users receiving the signal can obtain the signal at the appropriate resolution and quality that their system will handle or that they desire. The invention implements a “motion compensated temporal wavelet transform” in order to enable compression of the video in a scalable fashion while still taking advantage of inter-frame redundancy in a manner which is sensitive to scene and camera motion. The motion compensated temporal wavelet transform is implemented by decomposing the video sequence into a set of temporal frequency bands and then applying a sequence of motion compensated lifting operations to alternately update an odd frame sub-sequence based upon an even sub-sequence and vice versa in a manner which is sensitive to motion.

Abstract: A method of encoding and decoding a sequence of frames uses 3-D subband decomposition involving temporal filtering. Under certain conditions, for at least one pixel, the value of said pixel is approximated using one or more pixel values in the same frame.

Abstract: A bit stream representing n-dimensional data structures may be encoded and decoded. A part of the data can be mappable within predefined similarity criteria to a part of the data of another data structure. The similarity criteria may include, a spatial or temporal shift of the data. The data structures are typically sequential video frames such as is used in motion estimation and/or compensation of moving pictures, and a part of the data structure may be a block of data within a frame. The shift may be any suitable shift such as linear translation, rotation, or change of size. Digital filtering may be applied to a reference or other frame of data to generate subbands of a set of subbands of an overcomplete representation of the frame by calculations performed at single rate. The digital filtering may be implemented in a separate filter module or in software.

Abstract: Systems and methods for enhancement layer transcoding of fine-granular scalable video bitstreams are described. In one aspect, an enhancement layer bitstream is decoded from encoded video data. The encoded video data includes a base layer and one or more enhancement layers. The encoded video data is encoded according to a high HQRB (high quality reference bit-rate). Data throughput characteristics of a network coupled to a client computing device are determined. A new HQRB is calculated based on the data throughput characteristics. The decoded enhancement layer bitstream is then encoded based on the new HQRB to generate a transcoded enhancement layer for streaming to the client computing device. The base layer is not decoded for streaming to the client computing device.

Abstract: A seamless bitstream switching schema is presented. The schema takes advantage of both the high coding efficiency of non-scalable bitstreams and the flexibility of scalable bitstreams. Small bandwidth fluctuations are accommodated by the scalability of the bitstreams, while large bandwidth fluctuations are tolerated by switching among scalable bitstreams. This seamless bitstream switching schema significantly improves the efficiency of scalable video coding over a broad range of bit rates.

Abstract: In some embodiments, a method of determining encoding type and predictive mode(s) selections for a macroblock of a video frame is provided. In some embodiments, a general method 1) selects the encoding type (16×16 or 4×4) that is initially considered for a macroblock using an encoding type selection algorithm (based on an attribute of the macroblock that is easy to compute), 2) if the 16×16 encoding type is selected in step 1, consider the four 16×16 prediction modes that may be used on the macroblock using conventional methods or an improved 16×16 predictive mode search algorithm based on distortion thresholds, and 3) if the 4×4 encoding type is selected in step 1, select the 4×4 prediction mode to be used for each of the sixteen 4×4 blocks of the macroblock using conventional methods or an improved 4×4 predictive mode search algorithm based on the positional relationships between predictive modes.

Abstract: A PC-based system for monitoring and storing representative images from video cameras may be utilized for security or other monitoring applications. Camera inputs from digital or analog sources are individually and independently digitized and displayed at a first set of image sizes, sampling rates, and frame rates, and may be stored in digital form on various recording media at a second set of image sizes, sampling rates, and frame rates, and these two sets of sizes and rates may or may not be identical. Provisions are included for adding detection or alarm systems which will automatically alter image size, sampling rate and/or frame rate of an individual input source, or activate other physical responses. In addition to security system monitoring, further applications of the invention are disclosed for process monitoring in manufacturing environments and also for applications in videoconferencing.