Abstract: There is provided a method of detecting repeated pictures in a sequence of video picture data, each picture of said video picture data comprising a plurality of macroblocks, the method comprising performing hierarchical motion estimation on the video picture data to provide best motion vectors for each macroblock, best motion vector sum of absolute difference values for each macro block and zero motion vector sum of absolute difference values for each macroblock, wherein the hierarchical motion estimation includes a plurality of levels, and said best motion vectors, best motion vector sum of absolute difference values and zero motion vector sum of absolute difference values for each macroblock are provided for at least a top level, providing a noise threshold value based upon the zero motion vector sum of absolute difference values from the top level of the hierarchical motion estimation, accumulating the best motion vector sum of absolute difference values for macroblocks having best motion vector sum of abs

Abstract: There is disclosed in aspects of the invention a method of evaluating the profit of a substream of encoded video data, a method of operating servers, a network and an apparatus. In the method, a data portion is identified comprising at least some of the data in the substream being evaluated; comparing a decoded version of the video with the data portion present and a decoded version of the video with the data portion removed and calculating an error metric indicative of the distortion between the two versions; and, calculating a profit for the substream dependent upon the error metric.

Abstract: A method for de-interlacing interlaced video includes receiving a first video field and a second video field, generating a first video frame by inserting the first video field in the first video frame on every second line of the first video frame, and by inserting a first synthesized video field on the lines of the first video frame not populated by the first video field. The video data of the first synthesized video field is based on video data of the first and second video fields. A second video frame is generated by inserting the second video field in the first video frame on every second line of the second video frame and by inserting a second synthesized video field on the lines of the second video frame not populated by the second video field. Two de-interlaced video frames are output for every received interlaced video frame.

Abstract: In one embodiment, a method includes analyzing characteristics of a media program to label portions of the media program with a plurality of labels. Portions of the media program that are determined to be substantially similar are labeled with a same label. The method then analyzes different partitionings of a sequence of the labels to determine partitions for the media program based on a weighting function. A plurality of partitions of the media program are outputted based on comparing the different partitionings of the sequence of labels using the weighting function. The plurality of partitions partition the media program into a plurality of portions and provide points for insertion of information for a service in the media program.

Abstract: A video processing device may compare a pixel or group of pixels of a current video picture to a pixel or group of pixels of a previous video picture. The video processing device may generate a motion vector for the pixel or group of pixels of the current video picture based on the comparison. The video processing device may determine an amount of filtering to be applied to the pixel or group of pixels of the current video picture. The video processing device may adjust the determined amount of filtering to be applied to the pixel or group of pixels based on the generated motion vector and based on a brightness value.

Abstract: A filter for a video stream is provided. The filter generates a filtered picture according to a current picture and its previous picture. A motion difference calculator accumulates differences between current picture values and previous picture values within a neighborhood of each pixel to provide a corresponding motion difference. A histogram counter performs histogram counting according to motion differences of the pixels. A filter value calculator provides a filter value for each pixel according to operations of the motion difference calculator and the histogram counter. A blender blends the current picture value and the previous picture value of each pixel according to weightings correlated to the filter value, and provides a filtered picture value for each pixel of the filtered picture.

Abstract: Apparatus for identifying video content includes a scene detector to detect a plurality of consecutive scenes in the video content. The video content may include a video program and an advertisement contained within the video program. A signature generator determines a scene change signature for each of the plurality of consecutive scenes. A content identifier provides the plurality of scene change signatures to a comparator that compares the plurality of scene change signatures to a database having a plurality of video content items to identify the video program. The database includes an ordered plurality of previously determined scene change signatures for each item of video content in the database. The content identifier receives an identification of the video content from the comparator. The content identifier may further receive information related to a position of the plurality of scene change signatures within the ordered plurality of previously determined scene change signatures.

Abstract: Systems and methods for determining insertion points in a first video stream are described. The insertions points being configured for inserting at least one second video into the first video. In accordance with one embodiment, a method for determining the insertion points includes parsing the first video into a plurality of shots. The plurality of shots includes one or more shot boundaries. The method then determines one or more insertion points by balancing a discontinuity metric and an attractiveness metric of each shot boundary.

Abstract: A method and system for detecting and estimating noise in a video signal. For example, detail edges may be identified in a plurality of pixels, wherein each detail edge has an edge magnitude value. The detail edges in the plurality of pixels may be identified by: determining one or more directionality values for the plurality of pixels by passing the input video signal through at least one directional filter, and identifying the detail edges by assigning edge magnitude values based on whether the one or more directionality values exceed predetermined threshold levels. An edge map of the detail edges may be created, where the edge map is configured to indicate areas of the plurality of pixels to be considered or ignored in estimating the noise in the input video signal. The noise in the input video signal may then be estimated based on the indicated areas of the edge map.

Abstract: Large-scale matching of videos is performed by matching a set of probe videos against a set of reference videos to determine if they are visually and/or aurally similar. The visual and audio fingerprints of all probe videos and reference videos are divided into subfingerprints, which are divided into LSH bands. The LSH bands of the probe videos are sorted in one list, and the LSH bands of the reference videos are sorted in another list. Then, the two sorted lists are linearly scanned for matching LSH bands. The matching LSH bands are sorted by probe video ID, and each probe video ID is searched to find matches between probe videos and reference videos. Further, an incremental matching process identifies matches as groups of new probe videos and/or new reference videos are added, without unnecessary repetition of matching old probe videos against old reference videos.

Abstract: A video apparatus such as a television signal receiver enables a video display that readily indicates the detected degree of a video attribute such as motion and/or other video attribute present in the video display. According to an exemplary embodiment, the video apparatus includes first circuitry operative to receive video data. Second circuitry is operative to enable a video display corresponding to the video data. The video display includes first and second video attributes. The first video attribute varies in proportion to a detected degree of the second video attribute.

Abstract: An apparatus for detecting video film with mix mode is provided. The apparatus includes: a field motion detection unit receiving the field motion value of a current field image or a fed back last field image to detect out at least a motion block; an expanding block unit expanding the motion block into an expanded motion block; a delay unit delaying the received current field image by a predetermined time; an AND processing unit performing an AND processing on the current field image and the last expanded motion block to obtain a confirmed motion block; an inverse telecine (IVTC) unit excluding the confirmed motion block to decide an IVTC mode; a deinterlace unit recovering the continuously input current field image into a video image according to the IVTC mode, wherein the motion block is further recovered with weighted inverse IVTC mode according to a motion intensity value.

Abstract: Devices, methods, and other embodiments associated with cadence detection are discussed. In one embodiment, an apparatus analyzes a progressive video stream and determines a cadence pattern from the progressive video stream.

Abstract: A system includes a computing device that includes a memory for storing content of a sequence of frames, and a frame predictor. The frame predictor determines a difference between content of a first frame and content of a second frame, in which the first and second frames are adjacent in the sequence of frames. The difference between the content of the first and second frames is representative of image changes included in the content of first and second frames. The frame predictor is configured to produce an intermediate frame using at least one of the first and second frames, and the determined difference. The frame predictor is further configured to insert the intermediate frame into the frame sequence.

Abstract: Systems and methods directed to determining motion in a video signal are provided. A plurality of pixels of a plurality of adjacent field lines of alternating parity of the video signal are evaluated to generate a plurality of differential values. A sign of each differential value is determined, and when each differential value has the same sign, at least one differential value can be compared with a threshold value. Responsive to the comparison of at least one differential value with a threshold value, a motion coefficient indicative of a magnitude of motion associated with one of the plurality of pixels can be generated.

Abstract: Methods and systems for video retargeting and view selection using motion saliency are described. Salient features in multiple videos may be extracted. Each video may be retargeted by modifying the video to preserve the salient features. A crop path may be estimated and applied to a video to retarget each video and generate a modified video preserving the salient features. An action score may be assigned to portions or frames of each modified video to represent motion content in the modified video. Selecting a view from one of the given modified videos may be formulated as an optimization subject to constraints. An objective function for the optimization may include maximizing the action score. This optimization may also be subject to constraints to take into consideration optimal transitioning from a view from a given video to another view from another given video, for example.

Abstract: When scenes of a story are divided and dubbed to a plurality of recording media, the recording media are added with information about a total number of recording media used and sequential numbers of the recording media.

Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation is disclosed. Certain embodiments utilize a hierarchical processing technique. A first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds can be user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.

Abstract: A video processing method and a device thereof are described. The method includes the steps as follows. An input video signal is received, in which a single period of the input video signal has a plurality of first input frames and a plurality of second input frames. The input video signal is processed, so as to generate an output video signal, in which a single period of the output video signal has a plurality of first output frames and a plurality of second output frames, and an amount of the first output frames is the same as an amount of the second output frames. A sum of the amount of the first output frames and the amount of second output frames is an integer multiple of a sum of an amount of the first input frames and an amount of the second input frames.

Abstract: A method of noise filtering of a digital video sequence to reduce ghosting artifacts, the method including computing motion values for pixels in a frame of the digital video sequence based on a reference frame, computing blending factors for the pixels based on the motion values, generating filtered output pixel values by applying the blending factors to corresponding pixel values in the reference frame and the frame, wherein selected filtered output pixel values are converged toward corresponding pixel values in the frame to reduce ghosting artifacts, and outputting the filtered frame.

Abstract: An input video is compared with a background model. Based on the comparison result, a duration time during which a difference region different from the background model continues in the input video is measured. The difference region whose duration time is less than a predetermined threshold is determined as a foreground. A scene change in the input video is detected based on the comparison result. Upon detecting the scene change, the predetermined threshold is changed.

Abstract: Apparatus and methods of motion detection for mosquito noise reduction in video sequences are provided. In one aspect, a method of motion detection in a sequence of digital images classifies a pixel of a plurality of pixels of a current image frame represented by a digital video input signal as a motion or non-motion pixel. A motion value for the pixel is calculated based on the classification of the pixel. The motion value is mapped to a coefficient of a temporal filter based on a control curve. A digital video output signal is generated based on the coefficient.

Abstract: A system having a memory and a processor is disclosed. The memory may be arranged as (i) a first pipeline to buffer a plurality of full resolution fields and (ii) a second pipeline to buffer a plurality of low resolution fields. The processor is generally configured to (i) receive a particular one or more of the full resolution fields and a particular one or more of the low resolution fields from the memory and (ii) generate a film mode signal based on the particular low resolution fields, the film mode signal indicating a current mode among a plurality of pull-down modes related to a current field being deinterlaced.

Abstract: An image processing method of generating a target image block of a position to be currently interpolated in an interpolated frame between two frames includes: performing a motion estimation for generating a motion vector by referring to a plurality of image blocks of the two frames and generating a first image block according to the motion vector; generating a second image block according to two image blocks which are respectively in the two frames and both correspond to the position to be currently interpolated; and generating the target image block according to the first image block and the second image block.

Abstract: A frequency distribution monitor unit partitions, into a plurality of classes, a size of a vertical component of a motion vector, and detects a frequency of the number of occurrences at which the vertical component occurs in each of the classes. In a case where the vertical component of the motion vector exceeds a predetermined threshold value in predetermined specific classes, the offset control unit creates offset signals which shift read addresses in the vertical direction in delay units. A selection control unit controls to shift, in the vertical direction, pixel data selected by delay selection units.

Abstract: A method and system for non-linear blending in motion-based video processing is described. Aspects of a system for processing images may include circuitry within a chip that computes a blending factor, with a nonlinear relationship to a motion metric, which defines an amount of motion between a current video picture, and at least one preceding video picture and/or at least one subsequent video picture. At least one pixel in the current video picture may be adjusted based on the computed blending factor. Aspects of a method for processing images may include computing a blending factor, with a nonlinear relationship to a motion metric, which defines an amount of motion between a current video picture, and at least one preceding video picture and/or at least one subsequent video picture. At least one pixel in the current video picture may be adjusted based on the computed blending factor.

Abstract: A video encoding method and apparatus, and a video decoding method and apparatus, which are capable of improving efficiency of encoding a luminance component video signal by predicting information on various encoding modes of the luminance component video signal by using a result obtained by encoding a chrominance component video signal, are provided. Accordingly, a block mode and an intra-prediction mode of the luminance component video signal are predicted from a previously encoded and recovered chrominance component video signal, and the predicted block mode and the predicted intra-prediction mode are used to encode the luminance component video signal.

Abstract: An image-processing method determines the interpolation reliability for interpolated pixels in a progressive image, generated by interpolation of an interlaced image, by combining at least any of a first interpolation reliability determined based on the absolute value of the difference between pixels in an upper line and pixels in a lower line used to calculate the value of the interpolated pixels, a second interpolation reliability determined based on the width of the region used to determine the pixels in the upper line and the pixels in the lower line used to calculate the value of the interpolated pixels, and a third interpolation reliability determined by combining the change in luminance for the upper line and the change in luminance for the lower line within the region.

Abstract: An apparatus calculates a change predicted value of a value of an interest pixel included in an interest field. The apparatus calculates a change predicted value before correcting the value of the interest pixel based on the interest field and at least one of fields which neighbors the interest field and is stored in the plurality of field memories, respectively calculates interframe difference coefficients based on any of two fields having a field interval of 2 of a plurality of fields stored in the plurality of field memories, and a field which is being input, calculates a correction value of the change predicted value based on the interframe difference coefficients calculated, and corrects the change predicted value before correction calculated by the change predicted value calculator based on the correction value calculated by the correction value calculation unit and output a change predicted value after correction.

Abstract: Aspects of the invention are directed towards an apparatus and method for detecting local video pixels in mixed cadence video. The local video detector comprises a comb detector that is adaptive to the contour of moving objects and local contrast, a motion detector that is robust to false motion due to vertical details, and a fader value estimator that provides a video confidence value to a fader that combines film mode and video mode processing results. The coupling of the local video detector to a film mode detector increases the robustness, accuracy, and efficiency of local film/video mode processing as compared to the prior art.

Abstract: A noise reduction method, medium, and system. The noise reduction method includes calculating a noise level of an input image and removing noise from a central pixel within a window of a predetermined size in the input image using a weight determined based on a difference between signal intensities of the central pixel and a plurality of adjacent pixels within the window and the calculated noise level.

Abstract: A method for a motion detection in an interlaced field sequence includes selecting two initial fields from the interlaced field sequence. Each of the two initial fields have different scan lines. The method also includes interpolating each of the two initial fields to generate two respective new fields. The new fields have raster lines that are congruent. The method further includes generating a value of a pixel of each new field using pixel values of at least two scan lines of a corresponding initial field surrounding the pixel. Further, the method includes performing a motion detection based on the new fields.

Abstract: A histogram has ranges, a value for each range, and a time value. A pattern is generated, having a zero value for each range having a zero value, and a one value for each range having a non-zero value. Any non-zero values of the ranges are compressed into a compressed value. The pattern and the time value match or do not match any given entry of a pattern table having a number of entries, each of which has an index value, a time range, and a pattern. Where the pattern and the time value do not match any given entry of the pattern table, a new entry is added to the pattern table, and is considered the given entry. An entry is then added to a histogram table. This entry has the time value, the index value of the given entry of the pattern table, and the compressed value.

Abstract: A video signal processing device includes: a correction unit which performs correction such that when a first frame to be displayed at a first time includes a pixel different from a pixel to be included in the first frame, the pixel different from the pixel to be included in the first frame is corrected to the pixel to be included in the first frame, and when a second frame to be displayed at a second time prior to the first time includes a pixel different from a pixel to be included in the second frame, the pixel different from the pixel to be included in the second frame is corrected to the pixel to be included in the second frame; and a motion compensation unit which generates an interpolation frame to be displayed at a time between the first and second times by referring to the first and second frames.

Abstract: An electrical apparatus to reduce noise and minimize a drop in resolution. A recording unit records a processing target frame image and prior and future frame images; a first pixel-extracting section extracts pixels in a prescribed region; a second pixel-extracting section extracts pixels in a region corresponding to the prescribed region in the prior and future frame images; a first distance calculating section calculates temporospatial distances; a second distance calculating section calculates inter-pixel-value distances; and a noise reduction section reduces the processing target frame image on the basis of the temporospatial distance and the inter-pixel-value distance.

Abstract: A field pair correlation acquisition part obtains a correlation for six or more fields which are continuous in time series for each field pair formed of two adjacent fields having the same attribute. A first determination part determines an input image as a 2:2 pull-down image based on a determination condition, the determination condition being that a pattern in which the correlation of each of the field pairs of one attribute changes along with a time direction matches a pattern in which the correlation of each of the field pairs of the other attribute changes along with the time direction.

Abstract: A method for multi-scale spatio-temporal steering kernel regression may include repeatedly spatially downsampling input video data, thereby obtaining spatially downsampled video data at a coarsest spatial resolution scale. The spatially downsampled video data at the coarsest spatial resolution scale may be temporally upscaled to generate an estimate of temporally upscaled video data at the coarsest spatial resolution scale. The temporal upscaling may be achieved using spatio-temporal steering kernel regression. Estimates of the temporally upscaled video data may be repeatedly spatially upscaled to generate an estimate of the temporally upscaled video data at the original spatial resolution. The spatial upscaling may be achieved using spatio-temporal steering kernel regression.

Abstract: Techniques that enable flexible key-frame extraction from video. Key-frame extraction according to the present teachings includes segmenting a video into a set of shots each having a set of video frames and selecting a set of key-frames from the shots in response to an image quality of the corresponding video frames. The present techniques include a set of user selectable modes that enable key-frame extraction to be adapted to an underlying platform.

Abstract: A circuit for detecting motion pictures includes a first-stage motion picture detecting unit and a second-stage motion picture detecting unit. The first-stage motion picture detecting unit analyzes a current image frame and a previous image frame to calculate a first motion value associated with the current image frame. The second-stage motion picture detecting unit receives the first motion value, compares the first motion value against an adjusted motion value, and outputs and stores a larger one as a second motion value. The adjusted motion value is a value derived by adjusting an adjacent previous second motion value.

Abstract: A caption detection device including a delay unit which delays a current-frame image to output a previous-frame image, a current feature detection unit which receives the current-frame image to detect a caption feature in each region, a previous feature detection unit which receives the previous-frame image from the delay unit to detect a caption feature in each region, a caption emergence region detection unit which detects a region where the caption emerges based on a temporal change between the feature in each region of the current-frame image and the feature in each region of the previous-frame image, and a caption disappearance region detection unit which detects a region where the caption disappears based on the temporal change between the feature in each region of the current-frame image from the current feature detection unit and the feature in each region of the previous-frame image.

Abstract: One embodiment of the present invention sets forth a technique that enables a user to reverse through video content based on scene transitions. By employing a graphics processing unit to compute one or more frame-to-frame correlation coefficients that measure the consistency of sequential images and a central processing unit to analyze the one or more correlation coefficients, a list of scene transitions may be generated in real-time. The list of scene transitions forms the basis for a content-based reverse user control within the playback application. The content-based reverse user control enables a more natural mechanism for reversing through video content, providing the user with a superior overall viewing experience.

Abstract: A method and system for reducing the appearance of jaggies when deinterlacing moving edges in a video processing system are provided. The method may comprise detecting the direction of an angled edge in an interlaced video image to determine a filtering direction to be used for approximating absent pixels in deinterlacing the interlaced video. In detecting the direction of the angled edge, a group of windows of different sizes may be used to look at the edge, where a missing pixel is the center of each of the windows. Detecting the direction of the edge, and therefore the direction of filtering, may comprise: determining the angle associated with the edge, determining the strength of the edge, examining the pixels surrounding the absent pixel, and adjusting the first angle measure and the second angle measure based on the pattern of the surrounding pixels.

Abstract: A motion vector detection apparatus is configured to calculate a temporal distance between a frame to be coded and each of a plurality of reference candidate frames referred to by the frame to be coded. The motion vector detection apparatus searches for a candidate motion vector between the frame to be coded and each the plurality of reference candidate frames and detects a motion vector for the frame to be coded from the candidate motion vectors. In searching for and detecting a candidate motion vector, the motion vector detection apparatus changes an amount of the calculation performed during the detection of a candidate motion vector according to the calculated temporal distance between the frame to be coded and the reference candidate frame, and a coding type of the reference candidate frame.

Abstract: An image processing apparatus, in which an interpolation frame is inserted between a current frame and a first delayed frame preceding the current frame by one frame, includes a motion vector detector, a motion vector converter, and an interpolation frame generator; wherein the motion vector detector includes a test interpolator outputting test interpolation data, an interpolation data evaluator evaluating a correlation of each of the test interpolation data with reference to the first-delayed-frame block data, thereby outputting evaluation data indicating results of the evaluating, and a motion vector determiner outputting a motion vector of an item of the evaluation data having highest correlation in the plurality of items of the evaluation data; and the first to third test interpolation data are obtained as the test interpolation data from a plurality of items of the second-delayed-frame block data and a plurality of items of the current-frame block data.

Abstract: In a pixel interpolation apparatus for interpolating pixels, an edge pixel detection unit detects edge pixels constituting an edge among pixels on lines positioned above/below the interpolation pixel. A continuous edge detection unit detects edge pixels in which two pixels or more consecutively line up among edge pixels detected by the edge pixel detection unit as a continuous edge. A continuous edge pair detection unit determines the combination of the continuous edges detected on each of the lines above and below the interpolation pixel among the continuous edges detected by the continuous edge detection unit. An edge direction determination unit determines the edge direction of the interpolation pixel on the basis of the positional relation of one set of continuous edges determined by the continuous edge pair detection unit. An interpolation pixel calculation unit calculates an interpolation pixel using the edge direction determined by the edge direction determination unit.

Abstract: An image processing device includes a target correction amount calculating unit operable to calculate a target correction amount based on input image signals, a frame memory operable to store the input image signals, and a scene change amount calculating unit operable to calculate a scene change amount based on an input image signal of a present frame and an input image signal of a previous frame. Moreover, the image processing device includes a correction amount calculating unit operable to calculate a correction amount for the input image signal of the present frame, based on the target correction amount and the scene change amount, and a correcting unit operable to perform image quality correction to the input image signal of the present frame to generate a corrected input image signal, thereby outputting a corrected input image signal as an output image signal.

Abstract: Methods and systems for processing video information are disclosed herein and may comprise calculating at least one vertical gradient of a plurality of adjacent pixels within a current field. A two-field difference may be calculated between a plurality of pixels within a first field and a corresponding plurality of pixels within a second field. At least one pixel may be deinterlaced within the current field based at least in part on the calculated at least one vertical gradient and the calculated two-field difference. The two-field difference may indicate an amount of motion between the plurality of pixels within the first field and the corresponding plurality of pixels within the second field. Phase shifting may be applied to at least one of the plurality of pixels within the first field and the corresponding plurality of pixels within the second field to effect in-phase alignment.

Abstract: An image processing device, method, an image display device and method which can obtain a high-definition display image by properly controlling processing of reducing the blur of a displayed image caused by the time integration effect of an image sensor. The image display device comprises a motion detection part (1) which detects the moving amount of an input image signal, and an edge emphasis part (2) which subjects the input image signal to edge emphasis processing, and the image display device increases an edge emphasis degree of edge emphasis processing to an area where the moving amount of the input image signal is large.

Abstract: A noise reduction method for reducing noise in an input video signal to output an output video signal includes the steps of generating a motion-compensated reference video signal from the output video signal; delaying the output video signal to generate a non-motion-compensated reference video signal; mixing the motion-compensated reference video signal with the non-motion-compensated reference video signal to generate a reference video signal; subtracting the generated reference video signal from the input video signal to generate a differential signal; compensating the differential signal to generate a noise reduction signal; and subtracting the noise reduction signal from the input video signal.

Abstract: Methods, systems, and computer-readable media for transmitting data between a local computer and a remote computer are provided. An amount of data capable of being transmitted per frame from the local computer to the remote computer is determined. An amount of data associated with a current frame of data to be transmitted to the remote computer is also determined. A quality level for the data to be transmitted to the remote computer is then selected such that the amount of the data to be transmitted to the remote computer is less than or equal to the amount of data capable of being transmitted per frame to the remote computer.