Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method. The method includes: (A) receiving a selection of a 3D model stored in one or more memories, the 3D model corresponding to an object, and (B) setting a camera parameter set for a camera for use in detecting a pose of the object in a real scene. The method also includes (C) receiving a selection of data representing a view range, (D) generating at least one 2D synthetic image based on the camera parameter set by rendering the 3D model in the view range, (E) generating training data using the at least one 2D synthetic image to train an object detection algorithm, and (F) storing the generated training data in one or more memories.

Abstract: A method for motion estimation for screen and non-natural content coding is disclosed. In one aspect, the method may include selecting a candidate block of a first frame of the video data for matching with a current block of a second frame of the video data, calculating a first partial matching cost for matching a first subset of samples of the candidate block to the current block, and determining whether the candidate block has a lowest matching cost with the current block based at least in part on the first partial matching cost.

Abstract: According to an embodiment, an image encoding apparatus includes a background control information generator, a background image generator, and an image encoder. The background control information generator generates background control information based on an input image. The background control information is used for generating a first background image from at least one first image. The background image generator generates the first background image, based on the background control information and at least one first image. The image encoder encodes the input image using the first background image to generate encoded data.

Abstract: Various embodiments relating to selecting a motion vector in a hardware encoder are disclosed. In one example, a plurality of candidate predicted motion vectors are selected, and a plurality of motion searches are performed in an image region surrounding each candidate predicted motion vector to produce a plurality of resulting motion vectors, wherein each resulting motion vector has an initial cost score determined using a corresponding candidate predicted motion vector. After an actual predicted motion vector becomes available, the initial cost score of each resulting motion vector is re-scored using the actual predicted motion vector to produce an updated cost score, and video data is encoded using a motion vector selected from the plurality of resulting motion vectors based on the updated cost score of that motion vector.

Abstract: Video analytics may be used to assist video encoding by selectively encoding only portions of a frame and using, instead, previously encoded portions. Previously encoded portions may be used when succeeding frames have a level of motion less than a threshold. In such case, all or part of succeeding frames may not be encoded, increasing bandwidth and speed in some embodiments.

Abstract: Briefly, methods and/or systems of processing content entries are described. An example may comprise determining equivalent byte values of characters that form the content entries. The content entries may be transformed based, at least in part, on the equivalent byte values and compressed using, for example, delta compression.

Abstract: An image processing method is provided. The method is for calculating a first weighted sum of absolute difference (WSAD) of a first search window and a corresponding first target window, and a second WSAD of a second search window and a corresponding second target window. The first and second search windows have a common matching window, and the first and second target windows have a common target block. The method includes: a) calculating a plurality of absolute differences of the common matching window and the common target block; b) determining a first weight coefficient group and a second weight coefficient group; and c) summing up products of multiplying the absolute differences by the first weight coefficient group to generate the first WSAD, and summing up products of multiplying the absolute differences by the second weight coefficient group to generate the second WSAD.

Abstract: Multi-resolution encoded files are stored on a plurality of disk drives using systematic network coded storage. In some embodiments, the stored files are used to provide video streaming services for users.

Abstract: There is set forth herein a system including a camera device. In one embodiment the system is operative to perform image processing for detection of an event involving a human subject. There is set forth herein in one embodiment, a camera equipped system employed for fall detection.

Abstract: Out of regions extracted from a frame image, regions assigned the same identification information as that of a region unselected in a past frame immediately before the frame are defined as nonselection regions, and nonselection regions in number equal to or smaller than a predetermined number are selected out of the nonselection regions.

Abstract: An automatic tracking camera system includes: a rotating unit for panning and tilting an image pickup unit including a lens apparatus and an image pickup apparatus; a tracking object detector; a motion vector detector for detecting a motion vector of the object to be tracked; a capture position setting unit for setting a capture position of the object to be tracked in the picked up image; and a controller for controlling drive of the rotating unit. The controller controls the rotating unit in a capture mode to capture the object to be tracked at the capture position based on the motion vector detected by the motion vector detector after the tracking object detector has detected the object to be tracked in the picked up image, and a maintenance mode to continuously capture the object to be tracked at the capture position after the capture mode.

Abstract: A motion vector extraction method includes: deciding on a search start position in an original video and performing a spiral motion search; and determining whether or not to perform a search in a sub-sampling video, during P picture search.

Abstract: Apparatus and methods of using content information for encoding multimedia data are described. A method of processing multimedia data includes obtaining content information of multimedia data, and encoding the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information. In another aspect, a method of processing multimedia data includes obtaining a content classification of the multimedia data, and encoding blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data. Apparatus that can process multimedia data described in these methods are also disclosed.

Abstract: The invention relates to a method for generating for at least one block of pixels of a picture of a sequence of interlaced pictures at least one motion predictor and at least one texture predictor from motion data, respectively texture data, associated with the pictures of a sequence of low resolution interlaced pictures.

Abstract: A method for encoding pictures within a groups of pictures using prediction, where a first reference picture from a group of pictures and a second reference pictures from the subsequent group of pictures are used in predicting pictures in the group of pictures associated with the first reference picture. A plurality of anchor pictures in the group of pictures associated with the first reference picture may be predicted using both the first and second reference pictures to ensure a smooth transition between different groups of pictures within a video frame.

Abstract: An image processing apparatus includes: a normal interpolated image generation unit to generate an image that is interpolated between a plurality of original images reproduced along time series, the image being a normal interpolated image, based on each of the plurality of original images; a high-frequency area extraction unit to extract a high-frequency area having a spatial frequency higher than a predetermined value in each of the plurality of original images; a high-frequency area interpolated image generation unit to generate an image that is interpolated between the plurality of original images, the image being a high-frequency area interpolated image, based on a change in position of the high-frequency area along with an elapse of time on the time series and on each of the plurality of original images; and a combination unit to execute combining processing to combine the normal interpolated image and the high-frequency area interpolated image.

Abstract: A method of obtaining a disparity vector and its encoding/decoding in the multi-view coding process is disclosed. The present invention includes essentially: determining a disparity vector between two views during the multi-view image coding, and computing a disparity vector between the other two views according to the disparity vector between the two views and the known relative location information between each of the views. Thereafter, the disparity vector is used for multi-view encoding/decoding. The present invention further makes use of the correlation between the disparity vector and depth information of the spatial vector on one hand, and on the other hand makes use of the direct relationship between the disparity vector and the location of each of the cameras. It is experimentally proved that the disparity vector between several views can be accurately computed during the multi-view coding, thereby improving the performance of multi-view coding.

Abstract: A display method and display apparatus are provided. The display method includes receiving a broadcast signal that contains a main image and a sub-image, setting a restriction area where motion estimation is restricted in the sub-image, performing motion estimation in areas corresponding to the broadcast signal other than the set restriction area, and displaying the broadcast signal obtained after the motion estimation is performed.

Abstract: The invention concerns image processing and, in particular, the processing of picture attribute fields for an image. A method of obtaining a new picture attribute field of an image is disclosed in which a picture attribute value at one position is allocated to a new position in the image in dependence upon the value of a parameter, such as luminance data, at the original position and at the new position and/or in dependence on the distance between the original position and the new position. The invention may be used to process picture attribute fields comprising: motion vectors; motion vector confidence; segment labels; depth labels; texture labels.

Abstract: A motion compensation module, that can be used in a video encoder for encoding a video input signal, includes a motion search module that generates a motion search motion vector for each macroblock of a plurality of macroblocks by contemporaneously evaluating a top frame macroblock and bottom frame macroblock from a frame of the video input signal and a top field macroblock and a bottom field macroblock from corresponding fields of the video input signal. A motion refinement module, when enabled, generates a refined motion vector for each macroblock of the plurality of macroblocks, based on the motion search motion vector.

Abstract: A motion vector calculation unit calculates inter-frame movement amounts. A masked region specification unit separates the entire edge image of frame feature data into (i) an edge image showing relatively large movement amounts and (ii) an edge image showing relatively small movement amounts. The masked region specification unit then specifies the edge image showing relatively large movement amounts as a region to be masked. This way, a correction parameter is detected from a region other than the masked region. When the correction parameter is a slang angle, a slant correction unit performs slant correction on a frame picture obtained by an image sensor.

Abstract: Image processing herein reduces the computational complexity required to estimate a disparity map of a scene from a plurality of monoscopic images. Image processing includes calculating a disparity and associated matching cost for at least one pixel block in a reference image, and then predicting, based on this disparity and associated matching cost, a disparity and associated matching cost for a pixel block that neighbors the at least one pixel block. Image processing continues with calculating a tentative disparity and associated matching cost for the neighboring pixel block, by searching for a corresponding pixel block in a different monoscopic image over a reduced range of candidate pixel blocks focused around the disparity predicted. Searching over a reduced range avoids significant computational complexity. Image processing concludes with determining the disparity for the neighboring pixel block based on comparing the matching costs associated with the tentative disparity and the disparity predicted.

Abstract: A motion compensation module, that can be used in a video encoder for encoding a video input signal, includes a motion search module that generates a motion search motion vector for each motion search macroblock of a plurality of motion search macroblocks in at least one of a horizontally compressed and vertically uncompressed field of the video input signal and a horizontally compressed and vertically uncompressed frame of the video input signal. A motion refinement module generates a refined motion vector for each motion refinement macroblock of a plurality of macroblocks of at least one of an uncompressed field of the video input signal and an uncompressed frame of the video input signal, based on the motion search motion vector.

Abstract: The invention relates to a method of estimating motion between two video frames. According to the invention, the motion estimation is done by using first one motion estimation in the horizontal direction and then one motion estimation in the vertical direction. Preferably, a plurality of motion estimations in the horizontal direction are used alternately with motion estimations in the vertical direction. It allows reducing the complexity of the estimation.

Abstract: An image processing apparatus, in which an interpolation frame is inserted between a current frame and a first delayed frame preceding the current frame by one frame, includes a motion vector detector, a motion vector converter, and an interpolation frame generator; wherein the motion vector detector includes a test interpolator outputting test interpolation data, an interpolation data evaluator evaluating a correlation of each of the test interpolation data with reference to the first-delayed-frame block data, thereby outputting evaluation data indicating results of the evaluating, and a motion vector determiner outputting a motion vector of an item of the evaluation data having highest correlation in the plurality of items of the evaluation data; and the first to third test interpolation data are obtained as the test interpolation data from a plurality of items of the second-delayed-frame block data and a plurality of items of the current-frame block data.

Abstract: An intermediate image is generated between a reference image and a corresponding image. To achieve this, moving subject images are detected in respective ones of a first image and second image captured at a fixed interval. A moving subject image of an intermediate image is positioned at a position that is intermediate the moving subject images. The intermediate image is generated utilizing the reference image in a portion of the image other than occupied by the moving subject image. A correction is applied in such a manner that the second image will coincide with the first image with the exception of the portion of the second image occupied by the moving subject image.

Abstract: In a system for stereo vision including two cameras shooting the same scene, a method is performed for determining scattered disparity fields when the epipolar geometry is known, which includes the steps of: capturing, through the two cameras, first and second images of the scene from two different positions; selecting at least one pixel in the first image, the pixel being associated with a point of the scene and the second image containing a point also associated with the above point of the scene; and computing the displacement from the pixel to the point in the second image minimizing a cost function, such cost function including a term which depends on the difference between the first and the second image and a term which depends on the distance of the above point in the second image from a epipolar straight line, and a following check whether it belongs to an allowability area around a subset to the epipolar straight line in which the presence of the point is allowed, in order to take into account errors

Abstract: In one embodiment, the method includes obtaining a first reference frame picture list and a second reference frame picture list including multiple reference frame pictures respectively and determining a reference frame picture index based on display order information for the multiple reference frame pictures. A first reference field picture having a different parity from the macroblock is selected if the first reference field picture index is an odd number, and a second reference field picture having a same parity as the macroblock is selected if the second reference field picture index is an even number. The macroblock is decoded based on the first and second motion vector information and the selected first and second reference field pictures.

Abstract: An apparatus for detecting a cut change based on a similarity between a first image and a second image, includes a unit for generating one of a luminance histogram and a color histogram of each of the first image and the second image, a unit for generating a spatial correlation image representing a correlation between spatial layouts of the first image and the second image, a unit for calculating a histogram similarity representing a similarity between the histogram of the first image and the histogram of the second image, a unit for calculating a spatial correlation image similarity representing a similarity between the spatial correlation image of the first image and the spatial correlation image of the second image, and a unit for determining whether a border between the first image and the second image is a cut change based on the histogram similarity and the spatial correlation image similarity.

Abstract: In one embodiment, the method includes obtaining a reference frame picture list including multiple reference frame pictures and determining reference frame picture index of the multiple reference frame pictures in the reference frame picture list based on display order information for the multiple reference frame pictures. Motion vector information for the current field macroblock and a reference field picture index associated with the current field marcoblock are obtained. A reference field picture having a different parity from the current field macroblock is selected if the reference field picture index is an odd value. The current macroblock is decoded based on the motion vector information and the selected reference field picture.

Abstract: In one embodiment, the method includes obtaining a reference frame picture list including multiple reference frame pictures and determining reference frame picture index of the multiple reference frame pictures in the reference frame picture list based on display order information for the multiple reference frame pictures. The method further includes obtaining motion vector information for the current field macroblock and obtaining a reference field picture index associated with the current field macroblock. A reference field picture having a same parity as the current field macroblock is selected if the reference field picture index is an even value. The current macroblock is decoded based on the motion vector information and the selected reference field picture.

Abstract: In one embodiment, the method includes obtaining a first reference frame picture list and a second reference frame picture list including multiple reference frame pictures respectively. A reference frame picture index is determined based on display order information for the multiple reference frame pictures. The method further includes obtaining first motion vector information and second motion vector information for the macroblock and obtaining a first reference field picture index and a second reference field picture index associated with the macroblock. First and second reference frame pictures are determined. A first and second reference field pictures are selected. The macroblock is decoded based on the first and second motion vector information and the selected first and second reference field pictures.

Abstract: In encoding an interlace picture in a field picture, a motion-vector detecting apparatus changes over a reference picture of a P-picture in a field unit, and changes over a reference picture of a B-picture in a frame unit. Moreover, in detecting the motion vector in different predictive directions, the motion-vector detecting apparatus simultaneously carries out a process of the same reference picture by changing over original picture frames.

Abstract: A method and apparatus for filtering video data. First and second frames of the video data are stored. Motion adapted spatio-temporal filter (MASTF) pixel values of the second frame are calculated using pixel values of the first and second frames. The second frame is compared to the first frame to estimate motion vectors (MVs) for the second frame. Pixel MV error level indicators for the second frame are determined using the pixel values of the first and second frames and the MVs of pixels in the second frame. Motion compensated temporal filter (MCTF) pixel values of the second frame are calculated using the pixel values of the first and second frames and the MVs of pixels in the second frame. For each pixel in the second frame, a filtered pixel value is calculated using its MASTF and MCTF pixel values and its pixel MV error level indicator.

Abstract: Techniques and tools for switching distortion metrics during motion estimation are described. For example, a video encoder determines a distortion metric selection criterion for motion estimation. The criterion can be based on initial results of the motion estimation. To evaluate the criterion, the encoder can compare the criterion to a threshold that depends on a current quantization parameter. The encoder selects between multiple available distortion metrics, which can include a sample-domain distortion metric (e.g., SAD) and a transform-domain distortion metric (e.g., SAHD). The encoder uses the selected distortion metric in the motion estimation. Selectively switching between SAD and SAHD provides rate-distortion performance superior to using only SAD or only SAHD. Moreover, due to the lower complexity of SAD, the computational complexity of motion estimation with SAD-SAHD switching is typically less than motion estimation that always uses SAHD.

Abstract: Systems and methods to selectively combine video frame image data are disclosed. First image data corresponding to a first video frame and second image data corresponding to a second video frame are received from an image sensor. The second image data is adjusted by at least partially compensating for offsets between portions of the first image data with respect to corresponding portions of the second image data to produce adjusted second image data. Combined image data corresponding to a combined video frame is generated by performing a hierarchical combining operation on the first image data and the adjusted second image data.

Abstract: A method for determining values of motion vectors includes receiving an irregular pattern of motion vectors for a target image, estimating an initial value for each of the motion vectors, using the motion vectors to generate a tap structure for an adaptive temporal prediction filter, and using the tap structure to re-estimate the value of each motion vector.

Abstract: A graphic system includes a pipelined graphic engine for generating image frames for display. The pipelined graphic engine includes a geometric processing stage for performing motion extraction, and a rendering stage for generating full image frames at a first frame rate for display at a second frame rate. The second frame rate is higher than the first frame rate. A motion encoder stage receives motion information from the geometric processing stage, and produces an interpolated frame signal representative of interpolated frames. A motion compensation stage receives the interpolated frame signal from the motion encoder stage, and the full image frames from the rendering stage for generating the interpolated frames. A preferred application is in graphic systems that operate in association with smart displays through a wireless connection, such as in mobile phones.

Abstract: A system determines a plurality of frames. The plurality of frames is a subset of a set of frames comprising at least a portion of a video clip. The frames are candidates to represent the set of frames. The system calculates a motion vector for each of the frames within the plurality of frames. The motion vector indicates an amount of motion in each of the frames with respect to at least one other frame from the plurality of frames. The system assesses a strength value for each of the frames. The strength value indicates an assessment of pictorial quality of each of the frames. The system selects a representative frame from the plurality of frames based on the motion vector and strength value. The representative frame indicates a most favorable representation of the plurality of frames.

Abstract: A method of performing adaptive temporal prediction includes receiving a target image, wherein a position of an object in the target image is different from a position of the object in a reference image, using a boundary of the object to generate an irregular pattern of target image motion vectors, using the target image motion vectors to partition the target image into area of influence cells, wherein each area of influence cell contains a unique one of the target image motion vectors, and generating a prediction of the target image by applying an adaptive area of influence filter to the area of influence cells.

Abstract: The present invention relates to an apparatus for processing an image signal etc. that are well applicable to removal of coding noise from, for example, an image signal. Based on five consecutive frames of an image signal Va, a memory portion 121 outputs as pixel data xi of predictive taps plural items of pixel data located in a space directional and time directional peripheries with respect to a target position in an image signal Vb. In the case, frames before and after a current frame are subjected to motion compensation by using a motion vector. A class classification portion 124 obtains a class code CL indicating a class to which pixel data of the target position in the image signal Vb belongs, by using the pixel data xi and motion vectors BWV(0), BWV(?1), FWV(0), and FWV(+1). A calculating circuit 126 obtains pixel data y of the target position in the image signal Vb based on an estimation equation by using the pixel data xi and coefficient data Wi that corresponds to the class code CL.

Abstract: In a method to determine a selection vector that indicates a displacement of an image area from a first position in a first image to a second position in a second image, a set of prediction vectors and a set of test vectors are provided. Using selected test vectors, an image comparison is performed to supply an image comparison result for each selected test vector. The selected test vectors and at least one prediction vector are compared to provide at least one test vector comparison result for each selected test vector. The image comparison result and the at least one test vector comparison result are linked to provide at least one quality characteristic for each selected test vector. A ranking order is determined for these quality characteristics, where at least one test vector is selected as the displacement vector based on the ranking order determined.

Abstract: The invention relates to a method for rendering an image sequence. wherein an individual image is rendered by rendering monochromatic subimages in temporal succession. A subimage sequence obtained by temporal sequencing of the subimages is generated in motion-compensated fashion.

Abstract: An apparatus for detecting a mixed area in frames. An object extracting unit extracts a foreground object from an input image and generates an area-specified object formed of the foreground object and a value indicating that the foreground object belongs to a background area. A motion compensator compensates for the motion of the area-specified object based on a motion vector and positional information thereof. A subtracting unit subtracts the pixel value of a pixel belonging to a foreground object of a current frame from the corresponding pixel of the foreground object of a preceding frame, so as to obtain a frame difference between the pixels belonging to the foreground area. A threshold-value processor detects a mixed area based on the difference.

Abstract: A method and apparatus of encoding digital video according to the ISO/IEC MPEG standards (ISO/IEC 11172-2 MPEG-1 and ISO/IEC 13818-2 MPEG-2) using an adaptive motion estimator. A plurality of global motion vectors are derived from the motion vectors of a previous picture in a sequence, and the global motion vectors are analyzed to determine motion characteristics. The video encoding is arranged to enable switching among different types of local motion estimators based on the motion characteristics of the moving pictures sequence. This gives rise to a motion estimation algorithm that can adaptively change its search range, search area and block matching scheme to suit different types of moving sequences.

Abstract: A vibration compensation apparatus comprises: an angular velocity detector that detects a plurality of angular velocities in two orthogonal detection axes directions and outputs corresponding angular velocity signals; a compensation unit that compensates vibration in a plurality of compensation axis directions; and a conversion unit that converts the plurality of angular velocity signals obtained by the angular velocity detector or a plurality of vibration compensation signals based on the plurality of angular velocity signals into vibration compensation signals expressed in the coordinates of the compensation axes of the compensation unit. The compensation unit compensates the vibration based on the vibration correction signals converted by the conversion unit.

Abstract: A block motion estimation method for estimating a motion vector on the basis of a position of a frame block in a current picture compared to a position of said frame block in a reference picture, by determining, at a plurality of search points of said current picture, a variation of the current picture as compared to the reference picture, said search points defining a polygonal search area along the perimeter thereof, said search area including some reference search points and inner search points, the method comprising the following steps: sub-dividing a plurality of n-tuples each n-tuple comprising n of said search points, wherein n is any integer from 1 (normally 2, 3 or more); determining a selected n-tuple of said sub-plurality of n-tuples having the smallest sum of distortions; and comparing the distortion at said central reference search point and at least one inner search point adjacent to the selected n-tuple such as to determine that search point thereof having the smallest distortion which is used

Abstract: To achieve the foregoing, and in accordance with the purpose of the present invention, an apparatus and method for generating refined sub-pixel vectors for motion estimation from vector correlation values and converged vector correlation values using quadratic approximations respectively is disclosed. The apparatus and method includes defining a minimum vector position value of a converged vector and then determining a predetermined number of vector correlation samples around the minimum vector position value. The predetermined number of vector correlation samples provide a coarse correlation surface estimation of the minimum vector position value. A correlation surface fitting of the predetermined number of vector correlation samples using a quadratic approximation of the coarse correlation surface estimation of the minimum value is then performed. The correlation surface fitting resulting in a refined sub-pixel minimum vector position with horizontal and vertical components.

Abstract: In an encoding method of moving pictures which generates a predictive picture for a current picture based on a reference picture and a motion vector, a macroblock is divided into subblocks. In each of the plurality of subblocks, an initial value of the motion vector is set and an evaluated value E on a difference between the current picture and the reference picture is calculated along a steepest descent direction to determine the minimum value. Then, the smallest evaluated value is selected among the minimum values obtained on the plurality of subblocks to determine the motion vector based on the pixel position of the smallest value.

Abstract: A method and system of reducing the computation load of an MPEG decoder by changing the encoding algorithms in a video-processing system are provided. During an encoding mode, a stream of data blocks is received and at least one motion vector and one motion compensation prediction value for each macro-block are generated. The prediction value is transformed into a set of DCT coefficients. Prior to the quantizing step, the set of DCT coefficients are modified according to predetermined criteria. To this end, the total energy level of the DCT coefficients excluding the lowest 2×2 DCT coefficients is computed, and last column and last row of the DCT coefficients is discarded alternatively until the total energy level of the DCT coefficients reaches a predetermined energy level. Therafter, the discarded column or row is assigned to a predetermined value.