Abstract: A method and system for determining a measure of reliability of a computed motion estimate based on the histogram of the error block obtained based on the computed motion estimate taking into account some aspects of the image content.

Abstract: The system described herein is a unified approach to three-dimensional filtering for the reduction of video noise. The technique is based on weight averaging pixels of the filter's output value in a three-dimensional neighborhood, in space and time, of the filter's output value. The weights can be computed for individual factors, such as distance, regional differences, etc., or can be combined into a weight that is indicative of all individual weights.

Abstract: An adaptive temporal noise reduction method that adaptively combines motion adaptive filtering results and motion compensated results to reduce Gaussian additive noise in video sequences is described herein. The system determines the motion detection and motion compensation results from the current frame and the filtered previous frame. Measurements on the video are used to determine a probabilistic measure of noise that is employed to adaptively combine the motion detection and motion compensation results.

Abstract: A system and method for more efficiently determining motion vectors of uncovering areas adjacent the edge of frames when the frame image is moving in the direction of the frame boundary. Backwards motion estimation is used to determine a block of video data which is, in one implementation, the block of video data adjacent the frame edge having a reliable motion vector known from the first frame. Once the block is identified, the blocks of video data in the uncovering area between the identified block and the frame boundary can then be assigned the motion vector data of the identified block.

Abstract: A method and a system for adaptively (dynamically) reducing quantization layer reduction for removing quantization artifacts in quantized video signals is provided. Adaptively reducing quantization layer reduction involves detecting if a selected pixel in a quantized image belongs to a ramp area in each of multiple pre-defined directions, dynamically selecting a quantization level for each of the pre-defined directions based on the corresponding detection results, and refining the pixel based on the selected quantization levels.

Abstract: An image processing method and system removes block artifacts in compressed image/video. Block artifacts are detected based on content analysis performed based on knowledge of the contents of the image/video. Then, a set of priority conditions is evaluated to generate a detection decision for each pixel at the block boundary. A higher priority is given to a short-term temporal processing result and a spatial processing result. The long-term temporal processing result and quantization information are treated as auxiliary information to adjust the strength of filtering. Depending on the result of the detection decision, appropriate filtering is applied to the pixel to remove the block artifacts.

Abstract: A method and a system for adaptively (dynamically) reducing quantization layer reduction for removing quantization artifacts in quantized video signals is provided. Adaptively reducing quantization layer reduction involves detecting if a selected pixel in a quantized image belongs to a ramp area in each of multiple pre-defined directions, dynamically selecting a quantization level for each of the pre-defined directions based on the corresponding detection results, and refining the pixel based on the selected quantization levels.

Abstract: A method and apparatus estimates the strength of block artifacts in compressed video is described. Block artifacts are associated with the block-based image/video compression schemes. The block artifacts deteriorate the quality of compressed image and video, especially at low bit rates. A deblocking method measures the strength of the block artifacts at each block boundary and adjusts the deblocking parameters accordingly to improve the performance of the overall deblocking process. A method and device to measure the strength of block artifacts based on the global and local edge information of the current picture is provided.

Abstract: Embodiments include a scene classification system and method. In one embodiment, a method includes forming a first plurality of image features from an input image, processing the first plurality of image features in the first scene classifier using a set of first sub-classifiers, each first sub-classifier determining first classification data for one of the first plurality of image feature, classifying the image through a first final classifier as an indoor scene or an outdoor scene based on the first classification data, if the image is classified as an outdoor scene, forming a second plurality of image features from the input image, processing each of the second plurality of image features using a set of second sub-classifiers, each second sub-classifier determining second classification data for one of the second plurality of image features, and classifying the image through a second final classifier as an outdoor urban scene or an outdoor natural scene based on the second classification data.

Abstract: A method and corresponding systems for using remote control to realize standard colors on displays. Two examples of remote controls are provided, one with color sensors and the other with white LEDs. For each example a calibration pattern is displayed which allows a user to calibrate the display color conveniently. For using the remote control with color sensors, an algorithm for the display to adjust the input RGB color, based on the color measurements from the remote control is provided. This allows the display output RGB color so that the display shows the same color as the input RGB signal is sent to standard color display.

Abstract: A video quality adaptive coding artifact reduction system has a video quality analyzer, an artifact reducer, and a filter strength controller. The video quality analyzer employs input video quality analysis to control artifact reduction. The video quality analyzer accesses the video quality of the decoded video sequence to estimate the input video quality. The filter strength controller globally controls the filter strength of the artifact reducer based on the video quality estimate by the video quality analyzer. For low quality input video, the filter strength controller increases the artifact reduction filter strength to more efficiently reduce the artifact. For high quality input video, the filter strength controller decreases the artifact reduction filter strength to avoid blurring image detail.

Abstract: Embodiments include systems and methods for interpolating frames. In one embodiment, a system and method provides reduced halo and consequently a higher degree of accuracy/fidelity. In one embodiment, a method of video frame interpolation includes receiving first motion data based on a first video frame and a second video frame, receiving second motion data based on the second video frame and a third video frame, and estimating a block of an interpolated frame based on the second motion data and the first motion data. In one embodiment, the estimating comprises selectively using the second motion data based on the first motion data.

Abstract: A color quantization or re-quantization method is provided that combines two dimensional halftoning with luminance preserving quantization (LPQ) for better perception results of high precision color video quantization. A combination of LPQ and error diffusion, and a combination of LPQ and spatial dithering, is provided. To combine LPQ and spatial dithering, the spatial dithering is regarded as a two-step processing, a mapping and a simple rounding. To combine LPQ and dithering together, a rounding step is replaced by the LPQ algorithm in the combination. Further a method is provided for post-processing which is applicable to both cases to reduce the color perception for grayscale image.

Abstract: A system and method for video frame interpolation are disclosed. In one embodiment, the method comprises receiving first motion estimation data representing estimated motion of blocks between a first frame and a second frame, receiving second motion estimation data representing estimated motion of blocks between the second frame and a third frame, determining whether an area in an interpolated frame between the first and second frame is an occlusion area based at least in part on the first and second motion estimation data, and estimating characteristics of pixels of the area based in part on the determination.

Abstract: An image processing method and system is provided for reducing the quantization layer in an input quantized image. The system detects if a pixel in a quantized input image belongs to a ramp area in a selected direction. Based on such ramp detection, a quantization level is dynamically selected. Then, a pre-segmentation operation is performed on a smoothly changing image area for each pixel in that direction. That area can then be refined by segmentation. A low-pass filtering process can then be applied to the refined segment to obtain filtered pixels. An overall gain value is then determined and used to adjust the filtered pixel luminance values to obtain output luminance values with higher precision values than that of the input image luminance values. This provides an output video image with reduced quantization layer and less perceivable quantization artifacts.

Abstract: A system and method which determines an adaptive vertical search range used to provide motion estimation in digital video content are disclosed. In some embodiments, a fixed-size vertical search range for the motion estimation is defined and utilized. A reference frame and target frame are stored in memory, and a block in the reference frame is selected for consideration. An offset value is determined which is indicative of a directional shift of the fixed-size vertical search range and the vertical search range is shifted based on the offset value. A motion vector is then estimated using the shifted vertical search range.

Abstract: A general shoot suppression method and system for image detail enhancement that provides good suppression in shoot areas while preserving the enhancement (with less or no suppression) in non-shoot areas. Asymmetry checker checks the luminance variation of pixels around the current pixel within a filtering range. Based on the checking result, different patterns of luminance variation in the neighborhood of the current pixel are categorized. Higher suppression is applied to those patterns that are more likely to cause overshoot/undershoot. Optionally, suppression is further associated with the intensity of detail signal at each pixel position. An intensity checker checks the magnitude of the detail signal. If the detail signal is weak at a current pixel position, it is unlikely that obvious shoot artifacts appear at that position, and little or no suppression is applied. Such a method and system provide shoot suppression only in shoot areas while maintaining good enhancement in non-shoot areas.

Abstract: A superior Color Transient Improvement technique is adaptive to the local image features, so that more natural color edge transition improvement can be accomplished. A gain control function is provided that depends on the local image feature so that different regions of the image can be treated differently. Further, a correction signal is controlled in such a way (by the local image feature) that neither undershoot nor overshoot occurs, eliminating the need for post-processing for undershoot/overshoot removal.

Abstract: An example-based method and system for electronic display color calibration is provided. By comparing the colors of commonly available objects with a color database under a controlled lighting condition, the user adjusts the gain and offset parameters of the Red, Green and Blue color components of the display. Two different methods are provided, wherein one method involves manipulating the comparison colors in the RGB color space, and the other method involves manipulating the comparison colors in the CIE x-y plane. Two different systems that incorporate the example-based color calibration methods are also provided, wherein one system directly implements the calibration method in the television system, while the other system implements the calibration method as a separate tool for viewers to calibrate the color of their displays.

Abstract: Embodiments include systems and methods of measuring a blockiness level in video data that has been encoded and decoded. In one embodiment, a Q-value is calculated that indicates the blockiness level of a decompressed image. The Q-value can be based on a block map having indicators corresponding to each of a plurality of pixels in an input image, each indicator signaling if a block edge is present at the corresponding pixel location in the input image, and also based on block locations indicative of the alignment block edge locations in the input image. The Q-value can be calculated in a vertical direction and a horizontal direction with respect to the input image. The Q-value is determined based on a flatness measurement of pixel values around certain considered pixels in the input image. The Q-value can be provided to a deblocking filter to improve the performance of deblocking the input image.