Abstract: In a method of block-based motion estimation a motion vector map is obtained by obtaining a motion vector of each macroblock (MB) in the current frame with respect to the reference frame. The motion vector of each MB in an interpolated frame is then determined according to the motion vector map.

Abstract: An image processing apparatus includes a pixel difference calculator, a summing unit, a determining unit, and an output unit. The pixel difference calculator receives a present image having first pixels and a previous image having second pixels, calculates pixel differences between corresponding first and second pixels, and outputs positive and negative pixel difference values. The summing unit obtains a first output value by adding up those of the positive pixel difference values and a second output value by adding up those of the negative pixel difference values. The determining unit determines a noise level of the present image from the first and second output values, and outputs a blended value. The output unit adds together weights of pixels at the same positions of the present and previous images according to the blended value to generate an output image. An image processing method is also disclosed.

Abstract: An imaging device of the present invention includes an image capturing unit, a noise obtaining unit, a fixed noise calculating unit, and a noise eliminating unit. The image capturing unit generates image data by photoelectrically converting, pixel by pixel, a subject image formed on an available pixel area of a light-receiving surface. The noise obtaining unit reads a noise output from a partial area of the available pixel area. The fixed noise calculating unit calculates an estimation of fixed pattern noise of the available pixel area based on the noise output read from the partial area. The noise eliminating unit subtracts the fixed pattern noise from the image data.

Abstract: Various embodiments of a system are provided for detecting scrolling text in a mixed-mode video sequence. The system of certain embodiments includes a motion estimator that generates a plurality of motion vectors between blocks of two or more extracted frames of a mixed-mode video sequence. An extracted frame motion analyzer analyzes the motion vectors to detect substantially constant motion of at least some of the blocks between the two or more extracted frames, wherein the presence of substantially constant motion is indicative of the presence of scrolling text in the mixed-mode video sequence. A consecutive frame motion analyzer calculates differences in pixel values between blocks of two or more consecutive frames in the mixed-mode video sequence, wherein the differences in pixel values are further indicative of the presence of scrolling text in the mixed-mode video sequence.

Abstract: A frame rate up-conversion apparatus comprises a motion vector detecting circuit, a dynamic quality control circuit, a motion compensation circuit and a pull-down recovery circuit. According to quality of motion vectors, a corresponding image output mode is determined dynamically. A visual impact due to incorrect motion vectors is reduced and the visual experience is also improved.

Abstract: A system and method for video frame interpolation are disclosed. In one embodiment, the method comprises receiving first motion estimation data representing estimated motion of blocks between a first frame and a second frame, receiving second motion estimation data representing estimated motion of blocks between the second frame and a third frame, determining whether an area in an interpolated frame between the first and second frame is an occlusion area based at least in part on the first and second motion estimation data, and estimating characteristics of pixels of the area based in part on the determination.

Abstract: According to one embodiment, an image processing apparatus includes a motion estimation module, a redundant frame determination module and an interpolation frame generation module. The motion estimation module calculates motion vectors for respective pixel blocks in each frame in moving image data by estimating motion between frames in the moving image data. The redundant frame determination module determines whether a target frame is a redundant frame based on the motion vectors corresponding to the target frame and the motion vectors corresponding to a frame preceding the target frame. The interpolation frame generation module discards the target frame if the target frame is a redundant frame, and generates an interpolation frame between the target frame and the preceding frame by motion compensation using the motion vectors corresponding to the target frame and outputs the interpolation frame and the target frame, if the target frame is a non-redundant frame.

Abstract: An image noise detection method is disclosed. The image noise detection method includes the following steps: obtaining a spatial information of an image; obtaining a temporal information of the image; and determining a spatial noise or a temporal noise of the image according to both the spatial information, and the temporal information.

Abstract: Embodiments of the present invention are directed to a system and method for recursive noise reduction. An exemplary method comprises receiving a first film frame having a first frame rate and a second film frame having the first frame rate and converting the first film frame into a first plurality of video frames having a second frame rate. The exemplary method further comprises converting the second film frame into a second plurality of video frames having the second frame rate, wherein the first plurality of video frames is positioned adjacent the second plurality of video frames at a border between the first plurality of video frames and the second plurality of video frames and updating a noise reduction correction signal only on the border between the first plurality of video frames and the second plurality of video frames when operating in a first mode.

Abstract: The method, system, and apparatus of source statistics based intra prediction type is disclosed. In one embodiment, a method includes classifying a four-pixel square block in an edge class (e.g., may include a DC edge class, a vertical edge class, a horizontal edge class, a diagonal edge class, and/or a planar edge class) based on an edge classifier, classifying an eight-pixel square block having the four-pixel square block and other four-pixel square blocks as a homogenous class if the four-pixel square block and the other four-pixel square blocks of the eight-pixel square block belong to the edge class, assigning a direction to the edge class of the eight-pixel square block, and determining an optimal intra-prediction type through the classification such that empirical testing of all possible ones of the edge class and the direction is avoided when the homogenous class is identified.

Abstract: Methods, apparatus and products for administering a time-shifting cache in a media playback device are disclosed, where the media playback device receives from a digital media provider a digital media stream of digital media content and administering the time-shifting cache includes caching the digital media content of the digital media stream in the time-shifting cache; dynamically identifying one or more non-preferred segments of the cached digital media content; and managing the time-shifting cache in dependence upon the identified non-preferred segments.

Abstract: A video-signal processing method for measuring a noise level of an input video signal includes the steps of detecting an intra-field or intra-frame feature for each region that is set in the input video signal, the intra-field or intra-frame feature representing a noise level in the input video signal within a field or frame; checking the intra-field or intra-frame feature against a noise-free-region threshold, and excluding regions with which the infra-field or intra-frame feature is less than the noise-free-region threshold from subjects of noise-level measurement; and outputting a result of noise-level measurement by statistically processing the intra-field or intra-frame features of regions remaining without being excluded.

Abstract: A combing artifacts detection apparatus includes a feature-value calculating unit that calculates a feature value from an input image; a film-mode detecting unit that detects a film mode by using the feature value; and a pixel-difference calculating unit that calculates a pixel difference between fields by using 2:3 pulldown sequence detection information and input-image combination information that are results of the film mode detection. The apparatus also includes a luminance-variation determining unit that determines luminance variation based on a calculation result of the pixel-difference calculating unit; a combing artifacts-candidate detecting unit that detects a combing artifacts candidate per line based on a determination result of the luminance-variation determining unit; and a combing artifacts determining unit that determines whether a combing artifacts occurs for each image based on a detection result of the combing artifacts-candidate detecting unit.

Abstract: A method for adaptive spatio-temporal filtering is disclosed. Local motion vectors between a current video frame and other nearby video frames are determined. Local motion-aligned temporal confidence parameters are determined. Local spatial orientation parameters are determined. The local motion vectors, the local motion-aligned temporal confidence parameters, and the local spatial orientation parameters are used to adaptively determine spatio-temporal kernel weights. The spatio-temporal kernel weights are used to perform spatio-temporal filtering on input video data.

Abstract: Methods and systems are described for detecting a video field parity pattern in a video signal comprising a plurality of interlaced video fields, wherein each video field includes a plurality of pixels located in a plurality of positions in a plurality of scan lines. One method includes receiving pixel data of a plurality of current pixels in a current video field, and pixel data of a plurality of first pixels in a first previous video field, where the first previous video field immediately precedes the current video field and together form an image frame.

Abstract: Faults resulting in reception of a still, but unknown, frame are recognized by comparing each received frame of the video signal with its predecessor, incrementing a counter in the event that the difference between the frames falls below a threshold; and generating an alarm signal in the event that the count of the counter exceeds a predetermined count. Other types of fault such as loss of signal (i.e. reception of just noise) are recognized by incrementing the counter whenever the difference exceeds a threshold. Similar results may be obtained by instead the monitoring quantization step size and/or number of transmitted bits of a digitally coded signal, and noting that it falls below, or exceeds, a threshold. A preferred option is to compute a complexity measure, being a monotonically increasing function (e.g the product) of the quantization step size and of the number of coded bits and compare this with the threshold value.

Abstract: A video noise reducer processes a frame difference signal equal to the difference between the video signal of the current frame and the video signal of the preceding frame or the difference between the video signal of the current frame and the noise-reduced video signal of the preceding frame to obtain a motion detection signal and a noise detection signal. The difference between the motion detection signal and the noise detection signal is then processed to obtain a recursion coefficient. The frame difference signal is multiplied by the recursion coefficient and the resulting product is additively combined with the video signal of the current frame to reduce noise without generating significant motion artifacts.

Abstract: Noise-reduced pixels may be generated using outputs of filtering via a first filter and/or a second filter, and/or a blend of both outputs. Blending a current pixel and an output of filtering of current pixel via the first filter may generate a first blended current pixel. Filtering via the first filter may be based on the current pixel, a previous collocated pixel, and a next collocated pixel. Blending the current pixel and an output of filtering of current pixel via the second filter may generate a second blended current pixel. Filtering via the second filter may be based on the current pixel and a collocated pixel of the previous second blended video image or of the previous filtered output video image. Blending the first blended current pixel and the second blended current pixel using an adaptive blending factor may dynamically generate a filtered output pixel.

Abstract: A method and system for detecting and estimating noise in a video signal. For example, with a video signal containing low power Gaussian noise, identifying a low-activity region in the input video signal, in which the pixels in the identified region have magnitude values within a range, and creating a histogram from the pixels in the identified region. Once a minimum number of pixels have been sorted into the histogram, estimating the standard deviation on the magnitude values of the pixels to estimate the noise that should be removed from the signal. An edge map or a binary map indicating pixels for inclusion in the estimation may be used to aid in the detection of low-activity regions of the input video signal.

Abstract: The invention concerns a device and a method for protecting display time. The image processing method according to the invention comprises a step of shifting pictures by a pattern at a pixel shift frequency characterized in that the frequency is changed for a group of at least one picture depending on a motion degree of the group.

Abstract: A system, method and computer program product are provided. After receipt of visual data, an aspect of the frequency response associated with the visual data is changed. Thereafter, subsequent processing is performed on the visual data, based on information extracted from and related to the aspect of the frequency response change.

Abstract: A histogram has ranges, a value for each range, and a time value. A pattern is generated, having a zero value for each range having a zero value, and a one value for each range having a non-zero value. Any non-zero values of the ranges are compressed into a compressed value. The pattern and the time value match or do not match any given entry of a pattern table having a number of entries, each of which has an index value, a time range, and a pattern. Where the pattern and the time value do not match any given entry of the pattern table, a new entry is added to the pattern table, and is considered the given entry. An entry is then added to a histogram table. This entry has the time value, the index value of the given entry of the pattern table, and the compressed value.

Abstract: The invention provides an image processing apparatus for processing an interlaced video which includes a judging module, a determining module and a processing module. The judging module is used for judging if a pixel in the kth frame among P frames of the interlaced video relates to a moving object. If the result judged by the determining module is YES, the determining module determines one between two pixels adjacent to the judged pixel in the frame as an edge pixel relative to an edge of the moving object. The first processing module is used for calculating a gray scale of the edge pixel determined by the determining module in an average way.

Abstract: A method for processing video data including a plurality of fields is disclosed. The method includes: dividing the plurality of fields into a plurality of image blocks; examining each image block of a target field to determine whether each image block of the target field corresponds to a film mode or a non-film mode, wherein the target field is one of the plurality of fields; examining each image block of the target field that corresponds to the film mode to determine whether each image block corresponds to a pure film mode or a mix film mode; and utilizing a specific image processing mechanism to process each of the plurality of image blocks.

Abstract: A method of converting a frame rate of a video signal includes the steps of: receiving a pulldown film sequence existing in or converted from a sequence of successive-in-time frames of the video signal, in which the pulldown film sequence comprises a plurality of diverse original frames each having a corresponding number of duplicate frames; modifying the original frames; performing estimation of at least one motion vector associated with the modified original frames; and interpolating new frames between the modified original frames in accordance with the motion vector.

Abstract: The invention comprises a system and method for employing video in development processes. A new theory of operation for mapping video to formal models is disclosed. The present invention combines a runtime component and an object memory with an transformer component and offers several inputs and outputs. At least one capture device allows input of video. Video is structurally decomposed into shots and annotated following a semiology-based video model and stored in object memory. A runtime component determines the shots that are played back on one or more displays. A spectator may influence the runtime component by changing its state via at least one controller. One or more downstream development processes can access the object memory to extract customary models for requirements specification.

Abstract: According to one embodiment, to detect a still subtitle part included as a part of an image in a video signal, the still subtitle detection apparatus detects in pixel units a subtitle part from a video frame formed of pixels. The apparatus includes a subtitle part determination module and a still subtitle detection module. The subtitle part determination module determines, as the subtitle part, a pixel or pixel group on the high-luminance region side (white peak) that neighbors the detection position of an image edge where a luminance level changes or on the low-luminance region side (black bottom) that neighbors the detection position of the image edge where the luminance level changes. When it is detected that the subtitle part remains unchanged by comparing two continuous video frames along the time axis, the still subtitle detection module detects the subtitle part as a still subtitle.

Abstract: The distances representative of the edge orientation at a current points of a video picture generated are particularly used for the deinterlacing or format conversion of video pictures. It can be implemented in a video coder or decoder. According to the invention, the distances representative of the edge orientation calculated are filtered with a conditional median filter applied to a window of p by q distances. This filter only takes into account the distances of points for which the local gradient module of the video components is greater than a threshold.

Abstract: A system, apparatus, and method are provided for a video detector that computes a measure of how much a given video content resembles one of a de-interlaced video content or a progressive video content. More particularly, the present invention determines the position of original and interpolated lines and the scaling factor of an input content whenever that content was scaled after de-interlacing.

Abstract: Included are: a prefilter (101) for outputting, based on filter characteristics control data, predetermined frequency components in an input video signal as current image data; encoding means (116) for subjecting the current image data to an encoding process, and outputting encoding parameters together with a bit stream corresponding to current image data as a result of the encoding process; and filter control means (117) for outputting the filter characteristics control data that is set based only on one or two of the encoding parameters.

Abstract: A TV or monitor with a sensor sensing radiation or light from the surroundings, where a controlling unit, on the basis of the sensed radiation or parameters of a video signal, frame rate converts an original video signal to an up converted video signal by determining additional images for the video signal, the additional images being determined on the basis of the determined radiation/light or parameter of the video signal in order to relatively reduce frame rate conversion generated artefacts when the radiation or light intensity is higher.

Abstract: The system described herein is a unified approach to three-dimensional filtering for the reduction of video noise. The technique is based on weight averaging pixels of the filter's output value in a three-dimensional neighborhood, in space and time, of the filter's output value. The weights can be computed for individual factors, such as distance, regional differences, etc., or can be combined into a weight that is indicative of all individual weights.

Abstract: Flicker occurs in a flicker-noticeable area consisting of pixels with no pixel value variations. An image processing device (100) includes a variance calculation unit (101) that obtains a variance of an area consisting of a target pixel and neighboring pixels included in a first frame, and changes, according to the variance, the rate at which an error generated at the target pixel through tone level restriction is distributed within the frame and between frames. The image processing device (100) includes an error diffusion unit (113) that distributes the error generated at the target pixel to the neighboring pixels included in the first frame based on an intra-frame error diffusion rate and an intra-frame error distribution weight, and distributes the error generated at the target pixel to a target pixel and neighboring pixels included in the second frame based on an inter-frame error diffusion rate and an inter-frame error distribution weight.

Abstract: An image noise measurement system performs a noise estimation on a current image. A storage device stores a previous image. A noise estimator performs a noise estimation on sub-areas of the current image and the previous image to thereby produce a noise estimation index for the sub-area of the current image. A distribution calculator calculates a distribution of positive and negative signs of pixel differences in the sub-areas of the current image and the previous image to thereby output a positive sign number and a negative sign number. A confidence generator produces a confident level index according to the positive sign number and the negative sign number. A recursive filter performs a recursive filtering operation on the noise estimation index according to the confident level index to thereby produce a noise estimate for the current image.

Abstract: A motion detection method for detecting the difference in colors and an object position between a current frame and a previous frame through processing a composite video signal corresponding to both frames. The method includes: calculating a plurality of composite signal values included in the composite video signal to generate a calculation result; determining whether the calculation result conforms to a requirement to obtain a detecting result; and determining whether the colors and the object position are changed in two frames corresponding to the composite video signal according to the detecting result.

Abstract: An adaptive temporal noise reduction method that adaptively combines motion adaptive filtering results and motion compensated results to reduce Gaussian additive noise in video sequences is described herein. The system determines the motion detection and motion compensation results from the current frame and the filtered previous frame. Measurements on the video are used to determine a probabilistic measure of noise that is employed to adaptively combine the motion detection and motion compensation results.

Abstract: A method and apparatus for scaling video images, which applies more particularly to techniques for converting video sequence formats and deinterlacing. The invention comprises a parameterized interpolation (101) which computes interpolations at each new point of the output. An insensitive interval estimation (102) computes an interval where the probability distribution of the output image value is estimated to have its maximum, and an insensitive loss calculation (103) derives for each interpolation value a negative log likelihood measurement from an interval-insensitive probability distribution. After a spatial regularization (104) the invention includes a minimum loss selection (105) which selects the minimum loss interpolation at each new point and provides it as an output image value. The invention also includes a total variation increment module and a directional matching error module that can penalize the insensitive loss, for the minimum loss selection.

Abstract: A method and system for analog video noise detection are provided. A motion metric (MM) value may be determined for pixels in a video image. The MM values may be collected and accumulated for a number of noise level intervals to determine average noise levels for each interval. An early-exit algorithm (EEA) or an interpolation estimate algorithm (IEA) may be utilized to determine the noise level. The EEA may select the noise level based on a first noise level interval with a number of collected samples larger than a threshold. The IEA may determine the noise level based on an average of a plurality of noise levels associated with consecutive noise level intervals with collected samples that are larger than the threshold. A noise level indicator (NLI) may be the noise level of the current image or an average based on noise levels from the current and previous images.

Abstract: The method, system, and apparatus of source statistics based intra prediction type is disclosed. In one embodiment, a method includes classifying a four-pixel square block in an edge class (e.g., may include a DC edge class, a vertical edge class, a horizontal edge class, a diagonal edge class, and/or a planar edge class) based on an edge classifier, classifying an eight-pixel square block having the four-pixel square block and other four-pixel square blocks as a homogenous class if the four-pixel square block and the other four-pixel square blocks of the eight-pixel square block belong to the edge class, assigning a direction to the edge class of the eight-pixel square block, and determining an optimal intra-prediction type through the classification such that empirical testing of all possible ones of the edge class and the direction is avoided when the homogenous class is identified.

Abstract: A video noise reduction technique is presented. Generally, the technique involves first decomposing each frame of the video into low-pass and high-pass frequency components. Then, for each frame of the video after the first frame, an estimate of a noise variance in the high pass component is obtained. The noise in the high pass component of each pixel of each frame is reduced using the noise variance estimate obtained for the frame under consideration, whenever there has been no substantial motion exhibited by the pixel since the last previous frame. Evidence of motion is determined by analyzing the high and low pass components.

Abstract: Controlling artifacts in video data. Image data of collocated pixels of a plurality of frames of the video data is sampled (310), wherein at least a portion of each of the plurality of frames corresponds to an object that does not move across the plurality of frames. A statistical curve fit is performed (320) on sampled image data of the collocated pixels, wherein the statistical curve fit places less consideration on a sampled collocated pixel that corresponds to movement of an object across the plurality of frames. An adjusted frame is generated (330) based at least in part on at least one parameter of the statistical curve fit.

Abstract: According to one embodiment, a video analyzer includes a still image detector, a characteristic detector, and a boundary position detector. The still image detector detects a still image in video frames of content including video and audio data, and create a still image group of substantially the same still images. The characteristic detector includes at least one of a monochrome detector that detects a monochrome video frame in the video frames of the content and a silence detector that detects a silent portion in which the sound volume of the audio data is lower than a predetermined threshold. The boundary position detector detects a position where the type of the content changes based on information on at least one of the monochrome video frame and the silent portion contained in a segment where the still image group is present and a segment where no still image group is present.

Abstract: A method and system for reducing the appearance of jaggies when deinterlacing moving edges in a video processing system are provided. The method may comprise detecting the direction of an angled edge in an interlaced video image to determine a filtering direction to be used for approximating absent pixels in deinterlacing the interlaced video. In detecting the direction of the angled edge, a group of windows of different sizes may be used to look at the edge, where a missing pixel is the center of each of the windows. Detecting the direction of the edge, and therefore the direction of filtering, may comprise: determining the angle associated with the edge, determining the strength of the edge, examining the pixels surrounding the absent pixel, and adjusting the first angle measure and the second angle measure based on the pattern of the surrounding pixels.

Abstract: In a method for detecting the cadence of a sequence of images, each pixel in each current field in the sequence of images is compared to at least one pixel in at least one previous field. A pixel motion phase value is assigned to each pixel in the field as a function of the result of that comparison. For each block of pixels in the current field, a block motion phase value is determined from the motion phase values of the pixels in the block. The current field is segmented into at least one region, with each region comprising a whole number of blocks, as a function of at least the determined block motion phase values. A region motion phase value is assigned to each region, based on the block motion phase values for the blocks in the region.

Abstract: A technique for detecting original scan lines is disclosed. The technique involves receiving a deinterlaced signal with even scan lines and odd scan lines. After the deinterlaced signal is received, a determination is made as to whether the even scan lines or the odd scan lines are the original scan lines. In certain embodiments, an interlaced signal can be generated from the original scan lines. In other embodiments, an optimized deinterlaced signal can be generated using the original scan lines.

Abstract: A system determines a plurality of frames. The plurality of frames is a subset of a set of frames comprising at least a portion of a video clip. The frames are candidates to represent the set of frames. The system calculates a motion vector for each of the frames within the plurality of frames. The motion vector indicates an amount of motion in each of the frames with respect to at least one other frame from the plurality of frames. The system assesses a strength value for each of the frames. The strength value indicates an assessment of pictorial quality of each of the frames. The system selects a representative frame from the plurality of frames based on the motion vector and strength value. The representative frame indicates a most favorable representation of the plurality of frames.

Abstract: Interlaced-to-progressive conversion with (1) 3-2 pulldown detection, (2) pre-filtering for field motion detection, (3) field motion detection with feedback, (4) field edge detection including direction angle detection by comparison of pixel differences with sets of more than pairs of pixels and a lateral edge detection probability by a lack of non-lateral angle detection, and (5) blending moving pixel interpolation and still pixel interpolation using field uniformity.

Abstract: Method and apparatus for detecting transitions in a video sequence, which include detecting an abrupt transition including, for each image It?2k included in said video sequence and with a processing time rank t?2k: calculating a first distance D(It?k), between an image It?k and a reference image for said image It?k, which precedes said image It?k in the video sequence; calculating a second distance D(It?2k), between an image It?2k and a reference image for said image It?2k, which precedes said image It?2k in the video sequence; calculating a third distance D(It?3k), between an image It?3k and a reference image for said image It?3k, which precedes said image It?3k in the video sequence; calculating a criterion C? indicating whether said second distance D(It?2k) is significantly greater than the largest of the first and third distances, D(It?k) and D(It?3k); deciding, according to said criterion C?, on the belonging of the image It?2k to an abrupt transition.

Abstract: Some embodiments allow a video editor to remove unwanted camera motion from a sequence of video images (e.g., video frames). Some embodiments are implemented in a video editing application. Some of these embodiments distinguish unwanted camera motion from the intended underlying motion of a camera (e.g., panning and zooming) and/or motion of objects within the video sequence.

Abstract: Provided are apparatuses and methods for reproducing a data structure for managing reproduction of still images recorded on a recording medium. In the recording medium, a data area stores at least first and second still images and a playlist area stores at least one playlist. The playlist includes mark information, and the mark information provides presentation information on the first and second images to allow for at least skipping from reproducing the first image to reproducing the second image.