Half-pixel Refinement Patents (Class 375/240.17)
  • Publication number: 20080037647
    Abstract: An apparatus and a method for quarter-pel motion compensated search are described in the context of an array processor with tightly coupled, multi-cycle hardware assist attached to each node. A quarter-pel motion compensated search (QPMCS) instruction initiates the quarter-pel motion compensated search pipeline operation. An instruction decode and instruction operation control unit generates a starting address for a 4×4 block of a current macro block search operation indicating where to fetch the pel values. An interpolation unit determines at least eight neighboring quarter-pels per pipeline stage based on the 4×4 block of pel values. An absolute value of difference function computes the absolute value of difference values between a current macro block pel and the at least eight neighboring quarter-pels per pipeline stage. An accumulator accumulates at least eight summation values for the 4×4 block at quarter-pel positions per pipeline stage.
    Type: Application
    Filed: April 18, 2007
    Publication date: February 14, 2008
    Inventors: Mihailo M. Stojancic, Gerald George Pechanek
  • Patent number: 7324597
    Abstract: A method of transcoding from H.263 coded video frames to H.261 coded video frames, the method comprising for each INTER coded macro block (MB) of each frame, determining whether a component of the motion vector (MV) of the MB has a half pixel value, if yes, carrying out a MV search using the current H.263 decoded MB and a previous decoded frame to determine a new MV, the MV search being restricted to the vicinity of the H.263 coded MV, and coding the MB into an H.261 format using the new MV.
    Type: Grant
    Filed: March 4, 2002
    Date of Patent: January 29, 2008
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Arto Mahkonen, Kaisa Kettunen
  • Publication number: 20080013632
    Abstract: A RAM_HIME used for integer pixel motion estimation by an IME stores integer pixel luminance data from a SDRAM while satisfying the conditions that improve efficiency in reading an extracted rectangular area. A RAM_HSME used for motion estimation of quarter-pixel accuracy by a SME stores partial quarter-pixel luminance data while satisfying the conditions that improve efficiency in obtaining a rectangular area after calculation by calculation. A RAM_HMEC used for chrominance data generation of quarter-pixel accuracy by a QPG stores integer pixel chrominance data from the SDRAM while satisfying the conditions that improve efficiency in obtaining rectangular areas after calculation by calculation.
    Type: Application
    Filed: June 15, 2007
    Publication date: January 17, 2008
    Applicant: MegaChips Corporation
    Inventors: Kazuhiro SAITO, Akira OKAMOTO
  • Patent number: 7305034
    Abstract: Various techniques and tools for rounding control in multi-stage interpolation are described. For example, during motion estimation and compensation, a video encoder uses stage-alternating rounding control when computing pixel values in reference video frames by multi-stage interpolation. Or, during motion compensation, a video decoder uses stage-alternating rounding control when computing pixel values in reference video frames by multi-stage interpolation.
    Type: Grant
    Filed: March 4, 2003
    Date of Patent: December 4, 2007
    Assignee: Microsoft Corporation
    Inventor: Sridhar Srinivasan
  • Patent number: 7302015
    Abstract: A motion estimation method for moving picture compression coding that finds a motion vector at a high speed without degrading compression rate and image quality that includes estimating an initial motion point; performing a Newton-Raphson Method (“NRM”) using a Mean Absolute Difference of the estimated motion point as an objective function, and finding a new motion point; determining whether a difference between the new and estimated motion points is less than a minimum error range, estimating the new motion point as the initial motion point when the difference is more than the minimum error range, and performing the NRM; and determining whether a difference between the new and estimated motion points is less than a minimum error range, estimating the new motion point as a final motion point when the difference is less than the minimum error range, and determining a motion vector.
    Type: Grant
    Filed: May 2, 2003
    Date of Patent: November 27, 2007
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Dae-Won Kim, Hyun-Seung Lee
  • Patent number: 7292283
    Abstract: To achieve the foregoing, and in accordance with the purpose of the present invention, an apparatus and method for generating refined sub-pixel vectors for motion estimation from vector correlation values and converged vector correlation values using quadratic approximations respectively is disclosed. The apparatus and method includes defining a minimum vector position value of a converged vector and then determining a predetermined number of vector correlation samples around the minimum vector position value. The predetermined number of vector correlation samples provide a coarse correlation surface estimation of the minimum vector position value. A correlation surface fitting of the predetermined number of vector correlation samples using a quadratic approximation of the coarse correlation surface estimation of the minimum value is then performed. The correlation surface fitting resulting in a refined sub-pixel minimum vector position with horizontal and vertical components.
    Type: Grant
    Filed: November 16, 2004
    Date of Patent: November 6, 2007
    Assignee: Genesis Microchip Inc.
    Inventor: Steve Selby
  • Patent number: 7280598
    Abstract: A method for prediction of the motion vector of a pixel block in a video picture that is to be coded. The actual motion vectors of two adjacent blocks close to the uppermost left corner of the block are selected as candidates for the prediction. One additional block, also adjacent to the block, is selected to decide which of the motion vectors to be used as the prediction. The vector difference to the motion vector of the decision block is decisive for the final selection.
    Type: Grant
    Filed: November 28, 2003
    Date of Patent: October 9, 2007
    Inventor: Gisle Bjontegaard
  • Patent number: 7280599
    Abstract: A method of interpolation in video coding in which an image comprising pixels arranged in rows and columns and represented by values having a specified dynamic range, the pixels in the rows residing at unit horizontal locations and the pixels in the columns residing at unit vertical locations, is interpolated to generate values for sub-pixels at fractional horizontal and vertical locations, the method comprising: a) when values for sub-pixels at half unit horizontal and unit vertical locations, and unit horizontal and half unit vertical locations are required, interpolating such values directly using weighted sums of pixels residing at unit horizontal and unit vertical locations; b) when values for sub-pixels at half unit horizontal and half unit vertical locations are required, interpolating such values directly using a weighted sum of values for sub-pixels residing at half unit horizontal and unit vertical locations calculated according to step (a); and c) when values for sub-pixels at quarter unit horiz
    Type: Grant
    Filed: March 25, 2005
    Date of Patent: October 9, 2007
    Assignee: Nokia Corporation
    Inventors: Marta Karczewicz, Antti Olli Hallapuro
  • Publication number: 20070206678
    Abstract: The present invention provides an image processing device which is able to reconstruct a high-resolution (HR) picture from low-resolution (LR) pictures, by modifying instability in the pictures due to movement of hands in capturing the images, and also by preventing increase of a circuit size and processing amounts required for motion estimation between the pictures. In the image processing device, a motion estimation unit reads the LR pictures from a memory, and estimates respective motion vectors between the pictures. A stabilization parameter calculation unit calculates a stabilized global motion parameter based on the motion vector. A motion vector compensation unit stabilizes the motion vectors calculated by the motion estimation unit, using the stabilized global motion parameter. A picture integration unit combines (integrates) a target picture and reference pictures with sub-pixel precision, using the stabilized motion vectors.
    Type: Application
    Filed: March 2, 2007
    Publication date: September 6, 2007
    Inventor: Satoshi Kondo
  • Patent number: 7251278
    Abstract: A method and system for performing motion estimation in video image compression is provided. In the method and system, an associative memory device is used in motion estimation, and the group of the image blocks to be processed is restricted on the basis of a mean error and the best match is searched among the image blocks using the PDE method. The method and system can perform motion estimation via software in a regular PC environment and still more efficiently than before.
    Type: Grant
    Filed: June 28, 2000
    Date of Patent: July 31, 2007
    Inventor: Seppo Valli
  • Patent number: 7236634
    Abstract: In an encoding method of moving pictures which generates a predictive picture for a current picture based on a reference picture and a motion vector, a macroblock is divided into subblocks. In each of the plurality of subblocks, an initial value of the motion vector is set and an evaluated value E on a difference between the current picture and the reference picture is calculated along a steepest descent direction to determine the minimum value. Then, the smallest evaluated value is selected among the minimum values obtained on the plurality of subblocks to determine the motion vector based on the pixel position of the smallest value.
    Type: Grant
    Filed: November 10, 2003
    Date of Patent: June 26, 2007
    Assignee: Semiconductor Technology Academic Research Center
    Inventors: Junichi Miyakoshi, Masayuki Miyama, Masahiko Yoshimoto, Hideo Hashimoto, Kousuke Imamura
  • Patent number: 7224733
    Abstract: To generate an improved image signal when estimating motion, a motion vector is first determined with pel accuracy, and a two-step interpolation filtering is subsequently carried out with sub-pel accuracy. The interpolation coefficients are selected with a view to reducing aliasing. More neighboring pixels are used for the interpolation than in usual interpolation methods. One is able to improve the quality of the prediction signal for video images and, consequently, enhance coding efficiency.
    Type: Grant
    Filed: July 11, 1998
    Date of Patent: May 29, 2007
    Assignee: Robert Bosch GmbH
    Inventors: Ulrich Benzler, Oliver Werner
  • Patent number: 7206346
    Abstract: A motion vector predictive encoding method, a motion vector decoding method, a predictive encoding apparatus, a decoding apparatuses, and storage media storing motion vector predictive encoding and decoding programs are provided, thereby reducing the amount of generated code with respect to the motion vector, and improving the efficiency of the motion-vector prediction. If the motion-compensating mode of the target small block to be encoded is the global motion compensation, the encoding mode of an already-encoded small block is the interframe coding mode, and the motion-compensating mode of the already-encoded small block is the global motion compensation, then the motion vector of the translational motion model is determined for each pixel of the already-encoded small block, based on the global motion vector (steps S1–S5). Next, the representative motion vector is calculated as the predicted vector, based on the motion vector of each pixel of the already-encoded small block (step S6).
    Type: Grant
    Filed: January 30, 2003
    Date of Patent: April 17, 2007
    Assignee: Nippon Telegraph and Telephone Corporation
    Inventors: Atsushi Shimizu, Hirohisa Jozawa, Kazuto Kamikura, Hiroshi Watanabe, Atsushi Sagata, Seishi Takamura
  • Patent number: 7203238
    Abstract: In one embodiment, a 3:2 pull-down detection component of a video encoder uses motion vectors to determine whether a repeated field exists in a video sequence. The 3:2 pull-down detection component uses field motion vectors determined by a motion estimator and compares the field motion vectors to a threshold to determine whether a repeated field exists. If a repeated field exists, a video encoder can then eliminate the repeated field.
    Type: Grant
    Filed: December 11, 2001
    Date of Patent: April 10, 2007
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventors: Ming-Chang Liu, Wei-Jen Li, Ikuo Tsukagoshi
  • Patent number: 7197076
    Abstract: A method for locating partitions of a video image is provided. The method is used to simplify the process of obtaining the related information of neighboring partitions during the coding and decoding process for the video image. The method starts by mapping the storage units of a matrix to adjacent sub-blocks of a video image. The related information of the partitions is stored in the corresponding storage units. The related information of the neighboring partitions is obtained according to the relative locations of the storage units and the mapping relationship between the storage units and the sub-blocks.
    Type: Grant
    Filed: January 20, 2005
    Date of Patent: March 27, 2007
    Assignee: An Lnternet Products & Technology Company
    Inventors: Chih-Feng Chang, Chun-Wen Hsu
  • Patent number: 7133454
    Abstract: A method and apparatus for coding an image includes calculation of motion vectors of vertices of a patch in an image being encoded and transmitting information of horizontal and vertical components of the motion vectors of the vertices and information specifying that values of the horizontal and vertical components of a motion vector for each pixel in the patch are integral multiples of 1/d of a distance between adjacent pixels, where d is an integer not less than 2.
    Type: Grant
    Filed: June 20, 2005
    Date of Patent: November 7, 2006
    Assignee: Hitachi, Ltd.
    Inventors: Yuichiro Nakaya, Junichi Kimura
  • Patent number: 7126991
    Abstract: The present invention provides a 16×16-sliding window using vector register file with zero overhead for horizontal or vertical shifts to incorporate motion estimation into SIMD vector processor architecture. SIMD processor's vector load mechanism, vector register file with shifting of elements capability, and 16×16 parallel SAD calculation hardware and instruction are used. Vertical shifts of all sixteen-vector registers occur in a ripple-through fashion when the end vector register is loaded. The parallel SAD calculation hardware can calculate one 16-by-16-block match per clock cycle in a pipelined fashion. In addition, hardware for best-match SAD value comparisons and maintaining their pixel location reduces the software overhead. Block matching for less than 16 by 16 block areas is supported using a mask register to mask selected elements, thereby reducing search area to any block size less than 16 by 16.
    Type: Grant
    Filed: February 3, 2003
    Date of Patent: October 24, 2006
    Inventor: Tibet Mimar
  • Patent number: 7113543
    Abstract: Motion compensation as for video compression with motion estimation with either frame mode or field mode by initial prediction of motion mode and when prediction error is small enough truncate motion estimation search.
    Type: Grant
    Filed: February 3, 2003
    Date of Patent: September 26, 2006
    Assignee: Texas Instruments Incorporated
    Inventors: Ngai-Man Cheung, Yuji Itoh
  • Patent number: 7110456
    Abstract: A method and a video decoder for decoding an encoded bitstream of video data in a picture encoding and decoding system are disclosed. The video decoder includes a motion compensation unit for calculating a position for a sample image portion using an encoded bitstream of video data having a motion vector and rounding information. The calculated position of a sample image is rounded with the rounding information. The rounding information indicates the accuracy for rounding, and it is decoded from the bitstream. An image reconstruction unit reconstructs a decoded image portion of the video data from the sample image portion.
    Type: Grant
    Filed: March 4, 2002
    Date of Patent: September 19, 2006
    Assignee: Mitsubishi Denki Kabushiki Kaisha
    Inventors: Shunichi Sekiguchi, Kohtaro Asai, Tokumichi Murakami, Hirofumi Nishikawa, Shinichi Kuroda, Yoshimi Isu, Yuri Hasegawa
  • Patent number: 7099391
    Abstract: An image capturing device for capturing an image by an imaging device comprises first compression means for compressing and coding a captured image as a moving image, extracting means for extracting object information relating to a desired object from moving image information obtained in the process of compressing and coding the captured image, image processing means for performing desired image processing on the desired object on the basis of the object information extracted by the extracting means, second compression means for compressing and coding an image including the desired object processed by the image processing means as a still image, and recording means for recording, on a recording medium, at least one of moving image data obtained by the first compression means and still image data obtained by the second compression means.
    Type: Grant
    Filed: July 2, 2001
    Date of Patent: August 29, 2006
    Assignee: Olympus Corporation
    Inventor: Kazuhiro Haneda
  • Patent number: 7088775
    Abstract: An image data converting apparatus comprising an MPEG2-image data decoding section 19, a scan-converting section 20, an MPEG4-image encoding section 21, and a picture-type determining section 18. The MPEG2-image data decoding section 19 decodes input MPEG2-image compressed data in both the vertical direction and the horizontal direction by using only lower, fourth-order coefficients. The scan-converting section 20 converts interlaced-scan pixel data to sequential-scan pixel data. The MPEG4-image encoding section 21 generates MPEG4-image compressed data from the sequential-scan pixel signals. The sections 19, 20 and 21 are connected in series. The picture-type determining section 18 is connected to the input of the MPEG2-image data decoding section 19. The section 18 determines the picture type of each frame data contained in the interlaced-scan MPEG4-picture compressed data, outputs only the frame data about I/P pictures, discards the frame data about B pictures, thereby converting the frame rate.
    Type: Grant
    Filed: January 19, 2001
    Date of Patent: August 8, 2006
    Assignee: Sony Corporation
    Inventors: Kazushi Sato, Kuniaki Takahashi, Zhu Yiwen, Teruhiko Suzuki, Yoichi Yagasaki
  • Patent number: 7079579
    Abstract: There is provided a block matching processor and method for flexibly supporting block matching motion estimation at motion vector prediction modes using matching blocks of various sizes. Each of difference unit (D-unit) arrays takes each smallest size matching block, calculates the difference between the pixels of a current frame and the pixels of a reference frame, and converts the differences to absolute values. An accumulator generates SADs (Sum of Absolute Difference) for the smallest size matching blocks and SADs for all the matching blocks of various sizes by tree-like hierarchical addition of the absolute values of the smallest size matching blocks received from the D-unit arrays.
    Type: Grant
    Filed: July 13, 2001
    Date of Patent: July 18, 2006
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Tae-Hee Han, Seung Ho Hwang
  • Patent number: 7046732
    Abstract: A decomposed original video sequence includes one or more original camera-motion layers and zero or more original fixed-frame layers decomposed from an original video sequence. The decomposed original video sequence is edited by editing at least one of the original camera-motion layers to obtain modified camera-motion layers such that each frame of a composite modified video sequence composed from the modified camera-motion layers and the original fixed-frame layers is obtained without editing each frame of said original video sequence. The editing comprises performing an edge operation to one of said original camera-motion layers.
    Type: Grant
    Filed: October 18, 2001
    Date of Patent: May 16, 2006
    Assignee: ObjectVideo, Inc.
    Inventors: Thomas E. Slowe, Paul C. Brewer, Robert J. Douglass, Thomas M. Strat, Thomas J. Burns, Andrew J. Chosak
  • Patent number: 7031389
    Abstract: A current video block of a frame to be encoded comprises a set of first data values, and at least one other video block of another frame comprises a set of second data values. Data value pairs are formed of data values from said set of first data values and equal number of corresponding data values from said set of second data values. A combined comparison value is formed by defining comparison values, each of which is defined by using data values of one data value pair of said data value pairs. Said data value pairs are divided into at least two sub-sets of data value pairs each sub-set comprising equal number of data value pairs. The calculation of the comparison values is interlaced such that the calculation of comparison values of one sub-set of data value pairs is initiated in a time after initiating and before completing the calculation of comparison values of another sub-set of data value pairs.
    Type: Grant
    Filed: August 27, 2002
    Date of Patent: April 18, 2006
    Assignee: Nokia Corporation
    Inventors: David Guevorkian, Aki Launiainen, Petri Liuha
  • Patent number: 7027511
    Abstract: The present invention proposes a fast motion estimation using N-queen pixel decimation, whereby after a reference block and a block to be processed are selected in a video sequence, an N×N queens pattern is used for pixel decimation to perform block match, thereby obtaining a good enough block difference value. The present invention combines pixel decimation with fast motion estimation for search points reduction to achieve the object of simplifying computational complexity of motion estimation. Therefore, the present invention can sieve out sufficiently representative pixels and will not increase extra computational complexity.
    Type: Grant
    Filed: April 9, 2002
    Date of Patent: April 11, 2006
    Assignee: National Chiao Tung University
    Inventors: Chung-Neng Wang, Shin-Wei Yang, Chi-Min Liu, Tihao Chiang
  • Patent number: 7020202
    Abstract: Decimating MPEG or other video data by subsampling the output of an inverse discrete cosine transform (IDCT) module. The decimation process is useful for reducing the volume of data that must be processed to display images on a display device, particularly when the volume of video data received at the decoder is greater than the amount needed to take advantage of the resolution of the display device. For example, high definition television data can be decimated for display on a standard television display device or in a picture-in-picture window, thereby reducing the amount of processing resources needed at the decoder and reducing the size of the frame buffers. Subsampling the output of the IDCT module reduces the volume of data and, for relatively static or constant pans, there is not a significant compounded loss of image quality as successive frames are decoded.
    Type: Grant
    Filed: May 28, 2004
    Date of Patent: March 28, 2006
    Assignee: Microsoft Corporation
    Inventor: John A. Tardif
  • Patent number: 7016419
    Abstract: Decimating MPEG or other video data by subsampling the output of an inverse discrete cosine transform (IDCT) module. The decimation process is useful for reducing the volume of data that must be processed to display images on a display device, particularly when the volume of video data received at the decoder is greater than the amount needed to take advantage of the resolution of the display device. For example, high definition television data can be decimated for display on a standard television display device or in a picture-in-picture window, thereby reducing the amount of processing resources needed at the decoder and reducing the size of the frame buffers. Subsampling the output of the IDCT module reduces the volume of data and, for relatively static or constant pans, there is not a significant compounded loss of image quality as successive frames are decoded.
    Type: Grant
    Filed: May 28, 2004
    Date of Patent: March 21, 2006
    Assignee: Microsoft Corporation
    Inventor: John A. Tardif
  • Patent number: 7010036
    Abstract: The present invention relates to a descriptor for the representation, from a video indexing viewpoint, of motions of a camera or any kind of observer or observing device within any sequence of frames in a video scene. The motions are at least one or several of the following basic operations: fixed, panning (horizontal rotation), tracking (horizontal transverse movement) tilting (vertical rotation), booming (vertical transverse movement), zooming (changes of the focal length), dollying (translation along the optical axis) and rolling (rotation around the optical axis), or any combination of at least two of these operations. Each of said motion types, except fixed, is oriented and subdivided into two components that stand for two different directions, and represented by means of an histogram in which the values correspond to a predefined size of displacement. The invention also relates to an image retrieval system in which a video indexing device uses said descriptor.
    Type: Grant
    Filed: January 31, 2000
    Date of Patent: March 7, 2006
    Assignee: Koninklijke Philips Electronics N.V.
    Inventor: Benoit Mory
  • Patent number: 6996180
    Abstract: A method of locating a half-pixel resolution motion vector. The method first determines a sum of absolute difference for a predetermined number of neighbors to a current pixel. The gradient of these sums of absolute differences is then calculated. A motion vector is then selected based upon the gradient that indicates which vector lies in a direction of steepest descent. This motion vector is then used in motion compensation for video compression.
    Type: Grant
    Filed: September 5, 2001
    Date of Patent: February 7, 2006
    Assignee: Intel Corporation
    Inventors: Hyun Mun Kim, Hyung-Suk Kim, Tinku Acharya
  • Patent number: 6993077
    Abstract: An experimental design for motion estimation in video compression that reduces the number of search locations within a search window by selecting the search locations from a predefined orthogonal table. The search locations are then compared with a reference block to generate match-values that are used to generate level-values reflecting dispositional relationships of the search locations and the relative magnitudes of the match-values. A preliminary motion vector is generated according to the relative magnitudes of the level-values. Candidate results are also generated based on the match-values. A final motion vector is generated by applying predetermined formulas to the level-values and altering the preliminary motion vector according to the candidate results when indicated to do so by the results of the formulas.
    Type: Grant
    Filed: November 28, 2002
    Date of Patent: January 31, 2006
    Assignee: Faraday Technology Corp.
    Inventor: Heng-Kuan Lee
  • Patent number: 6985527
    Abstract: A method and apparatus for estimating the motion of an image region (the “center” region) from a source video frame to a target video frame. The motion estimation is locally constrained in that the estimated motion of the “center region” is affected by the estimated motion of neighboring regions. Advantageously, this may reduce common motion matching problems such as false and ambiguous matches. In one embodiment, the locally-constrained motion estimation may be implemented by biasing an error map of the center region using error maps of the neighboring regions.
    Type: Grant
    Filed: March 7, 2002
    Date of Patent: January 10, 2006
    Assignee: PTS Corporation
    Inventors: Michial Gunter, David B. Kita, Oliver W. Shih, Carroll Philip Gossett
  • Patent number: 6970509
    Abstract: A method, apparatus, computer medium, and other embodiments for motion estimation and compensation processing of video and image signals are described. Within a sequence of frames, block-based differences are taken between frames to exploit redundancies between pictures by taking a matchblock from the current picture and by determining a spatial offset in a corresponding reference picture which signifies a good prediction of where the current macroblock can be found. Multi-level motion estimation is performed in three stages to refine the resolution of the motion vector with reduced computational bandwidth. First, a matchblock from a reference frame is decomposed equally into several sub-matchblocks, each of which is searched in parallel over a search area decomposed into sub-blocks by a similar factor so as to determine a preliminary motion vector in the reference picture.
    Type: Grant
    Filed: August 7, 2001
    Date of Patent: November 29, 2005
    Assignee: WIS Technologies, Inc.
    Inventors: Shuhua Xiang, Li Sha, Yaojun Luo
  • Patent number: 6968008
    Abstract: Methods for motion estimation with adaptive motion accuracy of the present invention include several techniques for computing motion vectors of high pixel accuracy with a minor increase in computation. One technique uses fast-search strategies in sub-pixel space that smartly searches for the best motion vectors. An alternate technique estimates high-accurate motion vectors using different interpolation filters at different stages in order to reduce computational complexity. Yet another technique uses rate-distortion criteria that adapts according to the different motion accuracies to determine both the best motion vectors and the best motion accuracies. Still another technique uses a VLC table that is interpreted differently at different coding units, according to the associated motion vector accuracy.
    Type: Grant
    Filed: July 13, 2000
    Date of Patent: November 22, 2005
    Assignee: Sharp Laboratories of America, Inc.
    Inventors: Jordi Ribas-Corbera, Jiandong Shen
  • Patent number: 6965644
    Abstract: A programmable motion estimator includes one dual ported memory for storing an image block, the prediction error, and a temporary block used in interpolation, and a pixel-group random access dual ported memory for storing a search window. The two ports of the two memories are selectively applied to an arithmetic logic unit, or ALU, through a multiplexer. One output of the ALU provides an absolute difference, which is furnished to a tree adder. Another output of the ALU provides an average value or a difference value, as selected, which is routed to the inputs of the image memory and the search memory. In motion vector searching, the ALU performs pixel absolute difference arithmetic using the pixel groups from the image memory and from the search memory, and determines a sum of absolute differences in the tree adder. In half pixel interpolation, the ALU performs pixel averaging arithmetic using pixel groups from the search memory, and writes back to the search memory.
    Type: Grant
    Filed: March 1, 2001
    Date of Patent: November 15, 2005
    Assignee: 8×8, Inc.
    Inventors: Jan Fandrianto, Chi Shin Wang, Sehat Sutardja, Hedley K. J. Rainnie, Bryan R. Martin
  • Patent number: 6952450
    Abstract: In a first embodiment according to the present invention, a method for data transmission is provided. A multimedia stream is received through an electronic medium. Within the stream are a plurality of vectors. Based on the vectors, a plurality of error protection units are added to the multimedia stream.
    Type: Grant
    Filed: February 15, 2002
    Date of Patent: October 4, 2005
    Assignee: Koninklijke Philips Electronics, N.V.
    Inventor: Robert Cohen
  • Patent number: 6950470
    Abstract: An apparatus for optimizing of motion estimation in moving picture coding comprises a macro block comparing unit for being inputted a previous video signal and a present video signal and comparing the signals as macro block unit, a pixel modularizing unit for modularizing the compared block as a plurality of pixels unit, and an SAD (Sum of the Absolute Difference) calculator for being inputted modularized plurality of pixels and calculating the most similar previous signal, and a method for optimizing of motion estimation in moving picture coding comprises a step of modularizing searching pixels included in a macro block of N×N size as a plurality of pixels unit and a step of performing the SAD calculation using the modularized searching pixels, in order to increase processing speed and minimize a lowering of picture quality by deciding a searching area as selecting some of pixel modules which include four pixels respectively using a certain rule and reducing the SAD calculation amount.
    Type: Grant
    Filed: December 11, 2001
    Date of Patent: September 27, 2005
    Assignee: LG Electronics Inc.
    Inventor: Yeong An Jeong
  • Patent number: 6950469
    Abstract: A method of interpolation in video coding in which an image comprising pixels arranged in rows and columns and represented by values having a specified dynamic range, the pixels in the rows residing at unit horizontal locations and the pixels in the columns residing at unit vertical locations, is interpolated to generate values for sub-pixels at fractional horizontal and vertical locations, the method comprising: a) when values for sub-pixels at half unit horizontal and unit vertical locations, and unit horizontal and half unit vertical locations are required, interpolating such values directly using weighted sums of pixels residing at unit horizontal and unit vertical locations; b) when values for sub-pixels at half unit horizontal and half unit vertical locations are required, interpolating such values directly using a weighted sum of values for sub-pixels residing at half unit horizontal and unit vertical locations calculated according to step (a); and c) when values for sub-pixels at quarter unit horiz
    Type: Grant
    Filed: September 17, 2001
    Date of Patent: September 27, 2005
    Assignee: Nokia Corporation
    Inventors: Marta Karczewicz, Antti Olli Hallapuro
  • Patent number: 6934336
    Abstract: The present invention provides an area expansion apparatus, an area expansion method, and an area expansion program, which can reduce an area to be subjected to image area expansion associated with motion compensation, and reduce a consumed power. The area expansion apparatus of the present invention includes a subtracter 804 for subtracting a logical start address 803 of a pixel that is located at the upper-left corner of a reference block from a logical address 802 that successively indicates all pixel data in the reference block, and a converter 805 for converting an obtained address into a physical address 806 with referring to a predetermined table, and reads a pixel from a memory 807 in accordance with the obtained physical address 806.
    Type: Grant
    Filed: July 24, 2002
    Date of Patent: August 23, 2005
    Assignee: Matsushita Electric Industrial Co., Ltd.
    Inventor: Miki Kurohmaru
  • Patent number: 6931064
    Abstract: In the motion picture data converter, an MPEG-2 decoding unit decodes motion picture data in an MPEG-2 format into motion picture data in an non-compressed format, a motion vector extraction unit extracts motion vector information from the motion picture data being decoded in said MPEG-2 decoding unit, a motion compensation unit generates the motion vector information in the MPEG-4 format, by causing the extracted motion vector information to be reflected in the motion compensation processing for the MPEG-4 format, and executes the motion compensation processing based on the motion vector information, and an MPEG-4 encoding unit encodes motion picture data in the MPEG-4 format, using the motion compensation processed data and the motion picture data in the non-compressed format.
    Type: Grant
    Filed: February 11, 2002
    Date of Patent: August 16, 2005
    Assignee: Mitsubishi Denki Kabushiki Kaisha
    Inventors: Masashi Mori, Kunio Nakaoka, Hiroaki Sakai, Yoshinari Sugegaya, Akihiko Naito, Masaki Yamakawa
  • Patent number: 6928117
    Abstract: A method and apparatus for coding an image includes calculation of motion vectors of vertices of a patch in an image being encoded and transmitting information of horizontal and vertical components of the motion vectors of the vertices and information specifying that values of the horizontal and vertical components of a motion vector for each pixel in the patch are integral multiples of 1/d of a distance between adjacent pixels, where d is an integer not less than 2.
    Type: Grant
    Filed: January 15, 2003
    Date of Patent: August 9, 2005
    Assignee: Hitachi, Ltd.
    Inventors: Yuichiro Nakaya, Junichi Kimura
  • Patent number: 6925121
    Abstract: A system of detecting a motion vector for an object block in a current frame of an orthogonally transformed video with respect to a stored reference frame. The motion vector is detected by: extracting a predetermined pattern of lower frequency components from the object block; orthogonally inverse transforming the extracted lower frequency components within the pattern to yield the pattern of pixel data; searching the reference frame for a block having a maximum correlation with the pattern of pixel data; and calculating the motion vector from the object block to the block having a maximum correlation. As an orthogonal transform, DCT (discrete cosine transform) is preferable. Creating a row and a column image comprising sums obtained by adding all the pixels in each column and each row of the object block and applying the above searching and calculating process to the row and the column image enables the motion vector detection from a normal or noncompressed video.
    Type: Grant
    Filed: October 1, 1998
    Date of Patent: August 2, 2005
    Assignee: Matsushita Electric Industrial Co., Ltd.
    Inventors: Daisaku Komiya, Tsutomu Uenoyama, Kazunori Yamada, Hiroaki Yoshio
  • Patent number: 6912296
    Abstract: A motion estimation method is provided. In the method, respective mean difference values for a current search point within a search block and neighboring search points within the search block are calculated. Then, motion estimation is performed around the current search point if the mean difference value of the current search point is smaller than the mean difference values of the neighboring search points. On the other hand, motion estimation is performed based on the mean difference values of at least some of the neighboring search points if the mean difference value of the current search point is not smaller than the mean difference values of at least one the neighboring search points. The motion estimation method of the present invention does not deteriorate the quality of pictures during image compression in contrast to conventional motion estimation methods and enhances image compression speed by reducing remarkably computational complexity.
    Type: Grant
    Filed: February 15, 2001
    Date of Patent: June 28, 2005
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Woo-sung Sim
  • Patent number: 6909750
    Abstract: The present invention is directed to MPEG decoding with embedded resizing that includes detecting and interpolating moving areas in interlaced video in order to eliminate irregularities in the output video. According to the present invention, the decoding includes down scaling a motion vector. Also, detecting a moving area in an interlaced video reference frame and modifying the reduced resolution motion vector. Further, retrieving pixel values from the interlaced video reference frame according to the modified motion vector.
    Type: Grant
    Filed: May 1, 2001
    Date of Patent: June 21, 2005
    Assignee: Koninklijke Philips Electronics N.V.
    Inventors: Zhun Zhong, Yingwei Chen, Tse-Hua Lan
  • Patent number: 6898244
    Abstract: A movement vector generating apparatus generates a movement vector for a movement compensation by means of an inter-frame prediction, when encoding a preset image information including an image of a plurality of frames by using the movement compensation. The movement vector generating apparatus is provided with a plurality of generating devices each for generating the movement vector corresponding to a search range and a search accuracy between one frame and another frame, for each pixel block e.g., each macro block which is located within said one frame respectively in the image information and includes a plurality of pixels, the generating devices respectively using search ranges different from each other and search accuracies different from each other.
    Type: Grant
    Filed: March 18, 1999
    Date of Patent: May 24, 2005
    Assignee: Pioneer Electronic Corporation
    Inventor: Tsutomu Takahashi
  • Patent number: 6891890
    Abstract: A method and system is provided for calculating motion vectors of macroblocks in a digital image of a digital video stream. The method and system reduces the computational overhead of calculating motion vectors computing difference measures using a multi-phase computational scheme. Specifically, the pixel blocks the previous image are divided into different groups. The closest matching pixel block of each group is determined in a first phase. Then a more accurate difference measure is used to determine the origin block from among the closest matching pixel blocks.
    Type: Grant
    Filed: April 24, 2001
    Date of Patent: May 10, 2005
    Assignee: VWEB Corporation
    Inventors: Cheung Auyeung, Sho Long Chen, Stanley H. Siu
  • Patent number: 6888890
    Abstract: In a motion vector searching device which includes a motion vector searching portion (101-110) supplied with an input picture signal representative of a succession of pictures for dividing each of the pictures of the input picture signal into blocks and for searching for a motion vector as a searched motion vector for each of the blocks of each of the pictures in a search area of the input picture signal for each of the blocks of each of the pictures, a learning portion (113, 313) learns tendencies of the searched motion vectors for previous pictures previous to a current picture of the pictures of the input picture signal to produce tendency information representative of the tendencies.
    Type: Grant
    Filed: March 28, 2001
    Date of Patent: May 3, 2005
    Assignee: NEC Corporation
    Inventor: Mayumi Nagasaki
  • Patent number: 6876769
    Abstract: A digital portable terminal is utilized to obtain high quality images without error accumulation using plus and/or minus rounding of images. Such a digital portable terminal comprises an antenna for sending digital signals; an input device for acquiring image information; a frame memory for recording a decoded image of a reference frame; a block matching section for estimating motion vectors and synthesizing a predicted image of a current frame by performing motion compensation between the decoded image of the reference frame and an input image of the current frame; a DCT converter for performing DCT conversion of a difference between the input image of the current frame and the predicted image of the current frame to obtain DCT coefficients; a quantizer for quantizing the DCT coefficients; and a multiplexer for multiplexing information related to quantized DCT coefficients, the motion vectors and a rounding method used for pixel value interpolation in said motion compensation.
    Type: Grant
    Filed: July 22, 2003
    Date of Patent: April 5, 2005
    Assignee: Hitachi, Ltd.
    Inventor: Yuichiro Nakaya
  • Patent number: 6862318
    Abstract: Introduced in an image data encoding device is a logic-memory combined chip in which a memory device and a signal processing device are combined. A logic part and a memory part can be connected to each other with a wide bus, allowing to improve processing capability of data transfer. However, the memory part of the logic-memory combined chip has a small capacity, so that an attempt to increase the capacity will lead to upsizing of the chip, resulting in an increase in costs. Therefore, in a processing that data transfer results in bottlenecks (i.e., motion search), image data is transferred to/from an internal memory capable of transferring data at high speed. In a processing that high-speed data transfer is not required, image data is transferred to/from an external memory.
    Type: Grant
    Filed: September 18, 2001
    Date of Patent: March 1, 2005
    Assignee: Renesas Technology Corp.
    Inventors: Tetsuya Matsumura, Satoshi Kumaki, Atsuo Hanami
  • Patent number: 6859493
    Abstract: The system and method of the present invention provides an innovative technique and efficient hardware structure for recovering lost or damaged (lost/damaged) compression constants in the encoded domain. In one embodiment, a lost/damaged compression constant is recovered by estimating a compression constant of the block using encoded data of at least one neighboring block of data and other recoverable compression constants of the block.
    Type: Grant
    Filed: June 29, 1999
    Date of Patent: February 22, 2005
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventors: Tetsujiro Kondo, James J. Carrig, Yasuhiro Fujimori, Sugata Ghosal
  • Patent number: 6845130
    Abstract: An encoding method for reducing motion video data sizes using a multitude of variable-sized data blocks that are derived from spatial translation vectors and the motion field of an image. Using variable-block sizes to characterize the groups of picture elements (pixels) in an image frame allows for the inter-mixing of coarse (for static areas) and fine (for areas of complex motion) resolution data descriptions in the same descriptive data block. A comparison of motion event areas is made between successive video frames, and a motion displacement vector is calculated for each pixel location in the frame. A data tree is constructed from these pixel motion vectors and is pruned to eliminate static areas. The remaining leaves of the pruned tree are encoded differentially and applied to a lossless arithmetic encoder to provide a significantly reduced data block that still retains the highest resolution of the image.
    Type: Grant
    Filed: October 12, 2000
    Date of Patent: January 18, 2005
    Assignee: Lucent Technologies Inc.
    Inventors: Soo-Chul Han, Christine Podilchuk