Half-pixel Refinement Patents (Class 375/240.17)
  • Patent number: 12143629
    Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.
    Type: Grant
    Filed: December 15, 2023
    Date of Patent: November 12, 2024
    Assignee: KDDI Corporation
    Inventors: Kyohei Unno, Kei Kawamura, Sei Naito
  • Patent number: 11882308
    Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.
    Type: Grant
    Filed: March 7, 2023
    Date of Patent: January 23, 2024
    Assignee: KDDI CORPORATION
    Inventors: Kyohei Unno, Kei Kawamura, Sei Naito
  • Patent number: 11877005
    Abstract: An image decoding method performed by a decoding apparatus according to the present document includes constituting a candidate list for deriving motion information of a sub-block unit for a current block, wherein the merge candidate list includes constructed candidates; deriving control point motion vectors (CPMVs) for control points (CPs) of the current block based on the merge candidate list; deriving prediction samples for the current block based on the CPMVs; and generating a reconstructed picture for the current block based on the derived prediction samples, wherein the constructed candidates are derived based on combination of at least two of a first neighboring block in a first group, a second neighboring block in a second group, a third neighboring block in a third group and a fourth neighboring block, and the first neighboring block, the second neighboring block and the third neighboring block and the fourth neighboring block constituting the combination have the same reference picture index.
    Type: Grant
    Filed: February 1, 2023
    Date of Patent: January 16, 2024
    Assignee: LG ELECTRONICS, INC.
    Inventors: Jaeho Lee, Seunghwan Kim
  • Patent number: 11627336
    Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.
    Type: Grant
    Filed: July 8, 2022
    Date of Patent: April 11, 2023
    Assignee: KDDI CORPORATION
    Inventors: Kyohei Unno, Kei Kawamura, Sei Naito
  • Patent number: 11483584
    Abstract: A motion vector encoding apparatus includes: a predictor configured to obtain motion vector predictor candidates of a plurality of predetermined motion vector resolutions by using a spatial candidate block and a temporal candidate block of a current block, and to determine motion vector predictor of the current block, a motion vector of the current block, and a motion vector resolution of the current block by using the motion vector predictor candidates; and an encoder configured to encode information representing the motion vector predictor of the current block, a residual motion vector between the motion vector of the current block and the motion vector predictor of the current block, and information representing the motion vector resolution of the current block, wherein the plurality of predetermined motion vector resolutions include a resolution of a pixel unit that is greater than a resolution of one-pel unit.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: October 25, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jin-Young Lee, Seung-Soo Jeong, Jung-hye Min, Sun-Il Lee
  • Patent number: 11461919
    Abstract: A neural network system for detecting at least one object in at least one image, the system includes a plurality of object detectors. Each object detector receives respective image information thereto. Each object detector includes a respective neural network. Each the neural network including a plurality of layers. Layers in different object detectors are common layers when the layers receive the same input thereto and produce the same output therefrom. Common layers are computed only once during object detection for all the different object detectors.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: October 4, 2022
    Assignee: Ramot at Tel Aviv University Ltd.
    Inventors: Lior Wolf, Assaf Mushinsky
  • Patent number: 11438625
    Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.
    Type: Grant
    Filed: August 29, 2019
    Date of Patent: September 6, 2022
    Assignee: KDDI CORPORATION
    Inventors: Kyohei Unno, Kei Kawamura, Sei Naito
  • Patent number: 11341750
    Abstract: An image processing system includes a processor and optical flow (OF) determination logic for quantifying relative motion of a feature present in a first frame of video and a second frame of video that provide at least one of temporally and spatially ordered images with respect to the two frames of video. The OF determination logic configures the processor to implement performing OF estimation between the first frame and second frame using a pyramidal block matching (PBM) method to generate an initial optical flow (OF) estimate at a base pyramid level having integer pixel resolution, and refining the initial OF estimate using at least one pass of a modified Lucas-Kanade (LK) method to provide a revised OF estimate having fractional pixel resolution.
    Type: Grant
    Filed: February 5, 2019
    Date of Patent: May 24, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Hrushikesh Tukaram Garud, Manu Mathew, Soyeb Noormohammed Nagori
  • Patent number: 11303919
    Abstract: A video decoding method performed by a decoding apparatus comprises deriving control points (CPs) for the current block; obtaining motion vectors for the CPs; deriving a motion vector of a sub-block or a sample unit in the current block on the basis of the obtained motion vectors; deriving a prediction sample for the current block on the basis of the derived motion vector; and generating a reconstruction sample on the basis of the prediction sample. The method enables effective performance of inter prediction through the motion vectors (transformation prediction), not only when an image in the current block is moved in a plane, but also when the image in the current block is rotated, zoomed in, zoomed out, or transformed into a parallelogram. Accordingly, the amount of data for the residual signal for the current block can be eliminated or reduced, and the overall coding efficiency can be improved.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: April 12, 2022
    Assignee: LG Electronics Inc.
    Inventors: Naeri Park, Jaehyun Lim, Junghak Nam
  • Patent number: 11297324
    Abstract: The invention relates to an apparatus and method for inter prediction of a sample value of a current full-integer pixel of a plurality of pixels of a current block of a current frame of a video signal.
    Type: Grant
    Filed: May 6, 2020
    Date of Patent: April 5, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventor: Maxim Borisovitch Sychev
  • Patent number: 11272203
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. For example, the processing circuitry decodes prediction information of a current block in a current picture from a coded video bitstream. The prediction information is indicative of a prediction mode that uses a first optical flow refinement coding tool. The first optical flow refinement coding tool uses a grid structure that is used additionally by at least a second optical flow refinement coding tool during operations of optical flow refinement. Then, the processing circuitry calculates, using the first optical flow refinement coding tool, refinements to predictions of samples of the current block based on the grid structure, and reconstructs the samples of the current block based on the refinements and the predictions of the samples.
    Type: Grant
    Filed: July 20, 2020
    Date of Patent: March 8, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Guichun Li, Xiang Li, Xiaozhong Xu, Shan Liu
  • Patent number: 11202078
    Abstract: A system comprises an encoder configured to compress attribute information for a dynamic point cloud and/or a decoder configured to decompress compressed attribute information for a dynamic point cloud. The dynamic point cloud may include multiple versions of the point cloud at multiple moments in time Attribute values for the point cloud may be compressed at a reference frame using an intra-prediction process and may be compressed at one or more reference frames using an inter-prediction process that takes advantage of temporal relationships between different frames (e.g. versions) of the dynamic point cloud at the different moments in time.
    Type: Grant
    Filed: September 24, 2020
    Date of Patent: December 14, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, Liviu Traian Christian Tulvan, Marius Preda
  • Patent number: 11182613
    Abstract: In one embodiment, a method includes a system accessing an image, which may comprise covered and uncovered portions, and an overlay image comprising opaque pixels. The covered portion may be configured to be covered by the opaque pixels of the overlay image. The system may generate a data structure comprising data elements associated with pixels of the image. Each of the data elements associated with a covered pixel in the covered portion of the image may be configured to identify an uncovered pixel in the uncovered portion of the image that is closest to the covered pixel. Each covered pixel in the covered portion of the image may be modified by accessing the data element associated with the covered pixel, determining a distance between the covered pixel and an associated closest uncovered pixel using the accessed data element, and modifying a color of the covered pixel based on the distance.
    Type: Grant
    Filed: June 9, 2017
    Date of Patent: November 23, 2021
    Assignee: Facebook, Inc.
    Inventors: William S. Bailey, Ficus Kirkpatrick, Houman Meshkin, Ryan Keenan Olson, Hermes Germi Pique Corchs
  • Patent number: 11178426
    Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: November 16, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Jeeva Raj A
  • Patent number: 11153600
    Abstract: To improve a coding efficiency. There are included a PU level search unit configured to search for a motion vector for each prediction block by using a matching process, and a sub-block level search unit configured to search for a motion vector of each of sub-blocks in the prediction block, wherein a precision of a local search by the PU level search unit is lower than a precision of a local search by the sub-block level search unit.
    Type: Grant
    Filed: February 1, 2017
    Date of Patent: October 19, 2021
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tomohiro Ikai, Tomoyuki Yamamoto
  • Patent number: 11153567
    Abstract: Computer processor hardware receives settings information for a first image. The first image includes a set of multiple display elements. The computer processor hardware receives motion compensation information for a given display element in a second image to be created based at least in part on the first image. The motion compensation information indicates a coordinate location within a particular display element in the first image to which the given display element pertains. The computer processor hardware utilizes the coordinate location as a basis from which to select a grouping of multiple display elements in the first image. The computer processor hardware then generates a setting for the given display element in the second image based on settings of the multiple display elements in the grouping.
    Type: Grant
    Filed: March 15, 2017
    Date of Patent: October 19, 2021
    Assignee: V-NOVA INTERNATIONAL LIMITED
    Inventors: Luca Rossato, Guido Meardi
  • Patent number: 11146814
    Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: October 12, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Jeeva Raj A
  • Patent number: 10848780
    Abstract: A motion vector encoding apparatus includes: a predictor configured to obtain motion vector predictor candidates of a plurality of predetermined motion vector resolutions by using a spatial candidate block and a temporal candidate block of a current block, and to determine motion vector predictor of the current block, a motion vector of the current block, and a motion vector resolution of the current block by using the motion vector predictor candidates; and an encoder configured to encode information representing the motion vector predictor of the current block, a residual motion vector between the motion vector of the current block and the motion vector predictor of the current block, and information representing the motion vector resolution of the current block, wherein the plurality of predetermined motion vector resolutions include a resolution of a pixel unit that is greater than a resolution of one-pel unit.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: November 24, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jin-young Lee, Seung-soo Jeong, Jung-hye Min, Sun-il Lee
  • Patent number: 10750178
    Abstract: Computer processor hardware receives zone information specifying multiple elements of a rendition of a signal belonging to a zone. The computer processor hardware also receives motion information associated with the zone. The motion information can be encoded to indicate to which corresponding element in a reference signal each of the multiple elements in the zone pertains. For each respective element in the zone as specified by the zone information, the computer processor hardware utilizes the motion information to derive a corresponding location value in the reference signal; the corresponding location value indicates a location in the reference signal to which the respective element pertains.
    Type: Grant
    Filed: July 6, 2017
    Date of Patent: August 18, 2020
    Assignee: V-Nova International Limited
    Inventors: Luca Rossato, Guido Meardi
  • Patent number: 10659801
    Abstract: A video decoding method performed by a decoding apparatus comprises: deriving control points (CPs) for the current block; obtaining motion vectors for the CPs; deriving a motion vector of a sub-block or a sample unit in the current block on the basis of the obtained motion vectors; deriving a prediction sample for the current block on the basis of the derived motion vector; and generating a reconstruction sample on the basis of the prediction sample. The method enables effective performance of inter prediction through the motion vectors (transformation prediction), not only when an image in the current block is moved in a plane, but also when the image in the current block is rotated, zoomed in, zoomed out, or transformed into a parallelogram. Accordingly, the amount of data for the residual signal for the current block can be eliminated or reduced, and the overall coding efficiency can be improved.
    Type: Grant
    Filed: March 24, 2016
    Date of Patent: May 19, 2020
    Assignee: LG Electronics Inc.
    Inventors: Naeri Park, Jaehyun Lim, Junghak Nam
  • Patent number: 10659805
    Abstract: A video intermodal transcoder converts a compressed bitstream formulated according a type-1 compression scheme to a type-2 compressed bitstream formulated according to a type-2 compression scheme. The transcoder includes an augmented type-1 decoder, a transcoder kernel, and an augmented type-2 encoder. The transcoder kernel performs processes of creating motion-vector candidates and pre-computing prediction errors for each cell of a predefined image coding block and for each candidate motion vector for repetitive use in evaluating various image partitions. In an implementation where the type-1 compression scheme follows the H.264 standard and the type-2 compression scheme follows the HEVC standard, the transcoder exploits the flexibility of the coding-tree structure and other HEVC features to significantly reduce the bit rate of the compressed bit stream. The pre-computation of prediction errors significantly reduces the processing effort, hence increases the throughput of the transcoder.
    Type: Grant
    Filed: January 29, 2016
    Date of Patent: May 19, 2020
    Assignee: ECOLE DE TECHNOLOGIE SUPERIEURE
    Inventors: Jean-François Franche, Stéphane Coulombe
  • Patent number: 10609314
    Abstract: A pixel array system for high accuracy detection of displacement, speed or acceleration includes: an array including a plurality of pixels, each pixel touching at least one other pixel in a same row and touching at least one other pixel in a different row. At least one row is offset with respect to a preceding row of the array by less than 50% of a pixel width. The array receives an input from an object passing over at least the offset row and the preceding row, and detects displacement, speed or acceleration of the object when said object passes over the array, in order to generate an output representing at least one of the detected displacement, speed or acceleration of the object.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: March 31, 2020
    Assignee: PixArt Imaging Inc.
    Inventors: Sai Mun Lee, Wui Pin Lee
  • Patent number: 10609383
    Abstract: A method receives an image from a video. The image is split into a first set of first blocks of a first size and then the first blocks are split into a second set of second blocks of a second size. The method tests a first set of down-sampling patterns for the second set of second blocks in a first block in the set of first blocks to determine if a quality of reconstruction of the down-sampled second blocks meets a threshold associated with the respective first set of down sampling patterns. Second blocks satisfying the threshold are down-sampled using the first set of down-sampling patterns. Also, the method tests a second set of down-sampling patterns for the first block using a second set of down-sampling patterns to select one of the second set of down sampling patterns to use to down-sample second blocks that did not satisfy the threshold.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: March 31, 2020
    Assignee: HULU, LLC
    Inventor: Yuxiang Shen
  • Patent number: 10536697
    Abstract: Provided is a re-encoding method including obtaining a first quantization table from a bitstream including an image encoded using the first quantization table; obtaining a second quantization table based on a pattern representing a size distribution of values of elements of the first quantization table, the second quantization table including elements respectively corresponding to the elements of the first quantization table; and re-encoding a reconstructed image by using the second quantization table, the reconstructed image being obtained by decoding the encoded image by using the first quantization table.
    Type: Grant
    Filed: December 29, 2014
    Date of Patent: January 14, 2020
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Dai-woong Choi, Woong-il Choi, Dae-sung Cho
  • Patent number: 10506177
    Abstract: There are provided an image processing device, image processing method, image processing program, image capture device, and image display device that prevent increase of computational complexity in image enlargement while mitigating degradation in image quality. An image input unit inputs a planar image signal containing signal values of pixels arranged on a plane and depth information including depth values corresponding to the pixels. An interpolation unit calculates a signal value for an interpolation coordinate between pixels on the plane by interpolating between the signal values of adjacent pixels which are present within a predetermined range from the interpolation coordinate. A weight decision unit determines a weighting factor for use in the interpolation based on the depth value of a reference pixel that is closest to the interpolation coordinate and the depth value of an adjacent pixel.
    Type: Grant
    Filed: January 9, 2013
    Date of Patent: December 10, 2019
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Keisuke Omori, Kei Tokui, Nao Shibuhisa
  • Patent number: 10489928
    Abstract: An image processing system for inspecting object distance and dimensions is disclosed. A calibrated hand-held camera with an integrated collimated laser is deployed in order to capture input images. The images are then processed in order to determine the object distance and related parameters such as displacements and surface dimensions.
    Type: Grant
    Filed: February 23, 2018
    Date of Patent: November 26, 2019
    Assignee: Librestream Technologies Inc.
    Inventors: Radeon Shamilov, Scott Brewer
  • Patent number: 10477236
    Abstract: An image acquisition device includes: an image acquisition unit that acquires images of a subject in time series; a hierarchical motion-detection unit that can detect a motion vector between the images acquired by the image acquisition unit, by using images at two or more levels having different resolutions; a pixel-value-change detecting unit that divides the images acquired by the image acquisition unit into a plurality of partial regions and that detects a temporal change of the pixel value at a detection pixel set in each of the partial regions; and a hierarchical-motion-detection setting unit that sets a larger number of levels used in the hierarchical motion-detection unit, for any of the partial regions that includes the detection pixel at which the temporal change detected by the pixel-value-change detecting unit is larger.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: November 12, 2019
    Assignee: OLYMPUS CORPORATION
    Inventor: Eiji Furukawa
  • Patent number: 10368087
    Abstract: A processing apparatus is provided that includes an encoder configured to encode current frames of video data using previously encoded reference frames and perform motion searches within a search window about each of a plurality of co-located portions of a reference frame. The processing apparatus also includes a processor configured to determine, prior to performing the motion searches, which locations of the reference frame to reload the search window according to a threshold number of search window reloads using predicted motions of portions of the reference frame corresponding to each of the locations. The processor is also configured to cause the encoder to reload the search window at the determined locations of the reference frame and, for each of the remaining locations of the reference frame, slide the search window in a first direction indicated by the location of the next co-located portion of the reference frame.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: July 30, 2019
    Assignees: ATI Technologies ULC, Advanced Micro Devices, Inc.
    Inventors: Ihab Amer, Gabor Sines, Edward Harold, Jinbo Qiu, Lei Zhang, Yang Liu, Zhen Chen, Ying Luo, Shu-Hsien Wu, Zhong Cai
  • Patent number: 10257541
    Abstract: Disclosed herein is a method of encoding and decoding a video signal using adaptive sampling. The method may include determining an adaptive sampling rate based on information about the properties of a decoded picture and performing interpolation filtering using samples to which the adaptive sampling rate has been applied. The adaptive sampling rate corresponds to one of a uniform sampling rate, a reduced sampling rate, and a variable sampling rate.
    Type: Grant
    Filed: December 19, 2014
    Date of Patent: April 9, 2019
    Assignee: LG ELECTRONICS INC.
    Inventor: Dmytro Rusanovskyy
  • Patent number: 10158861
    Abstract: Various embodiments are described herein for methods and systems for operating a video compression system. In one example embodiment, the method of operating a video compression system includes determining an encoding complexity limit for an encoding module within the video compression system, determining signal complexity of an input signal to the video compression system, comparing the encoding complexity limit to the signal complexity at an adaptive scaling module within the video compression system, and if the signal complexity is determined to be greater than the encoding complexity limit, manipulating the resolution of the input signal at the adaptive scaling module to generate an output signal.
    Type: Grant
    Filed: February 2, 2017
    Date of Patent: December 18, 2018
    Assignee: Evertz Microsystems Ltd.
    Inventors: Sunil Koteyar, Rakesh Patel, Tarek Amara, Alpesh Patel
  • Patent number: 9710922
    Abstract: An image processing apparatus which reduces an operation amount while maintaining accuracy in detecting a motion vector, includes a contrast value calculating circuit calculating a contrast value for each processing region including a pixel of interest at a center in a standard image which is one of input images, a bit length determining circuit determining a bit length for calculating a motion vector for the pixel of interest among the images to be smaller than a bit length when the contrast value is calculated, a quantization circuit converting a bit length of the processing region and a region corresponding to at least the processing region among the images to be the bit length determined by the bit length determining circuit, and a motion vector calculating circuit calculating a motion vector for the pixel of interest among the images in the processing region for which the bit length is converted.
    Type: Grant
    Filed: June 3, 2015
    Date of Patent: July 18, 2017
    Assignee: OLYMPUS CORPORATION
    Inventor: Hisumi Esaki
  • Patent number: 9445123
    Abstract: The present invention relates to a method and apparatus for intra prediction. The intra prediction method for a decoder, according to the present invention, comprises the steps of entropy-decoding a received bitstream, generating reference pixels to be used in the intra prediction of a prediction unit; generating a prediction block from the reference pixels on the basis of a prediction mode for the prediction unit and reconstructing an image from the prediction block and a residual block, which is obtained as a result of entropy encoding, wherein the reference pixels and/or the prediction block pixels are predicted on the basis of a base pixel, and the predicted pixel value can be the sum of the pixel value of the base pixel and the difference between the pixel values of the base pixel and the generated pixel.
    Type: Grant
    Filed: December 15, 2015
    Date of Patent: September 13, 2016
    Assignee: KT CORPORATION
    Inventors: Jae Cheol Kwon, Joo Young Kim
  • Patent number: 9445126
    Abstract: In one example, this disclosure describes a method of loop filtering of reconstructed video data during a video coding process. The method may comprising applying a one-dimensional (1D) switched filter to the video data in a first dimension that is either horizontal or vertical, and applying a 1D adaptive filter to the video data in a second dimension that is perpendicular to the first dimension.
    Type: Grant
    Filed: December 28, 2011
    Date of Patent: September 13, 2016
    Assignee: QUALCOMM Incorporated
    Inventors: Wei-Jung Chien, Marta Karczewicz
  • Patent number: 9432669
    Abstract: The present invention relates to a method and apparatus for intra prediction. The intra prediction method for a decoder, according to the present invention, comprises the steps of entropy-decoding a received bitstream, generating reference pixels to be used in the intra prediction of a prediction unit; generating a prediction block from the reference pixels on the basis of a prediction mode for the prediction unit and reconstructing an image from the prediction block and a residual block, which is obtained as a result of entropy encoding, wherein the reference pixels and/or the prediction block pixels are predicted on the basis of a base pixel, and the predicted pixel value can be the sum of the pixel value of the base pixel and the difference between the pixel values of the base pixel and the generated pixel.
    Type: Grant
    Filed: December 30, 2015
    Date of Patent: August 30, 2016
    Assignee: KT CORPORATION
    Inventors: Jae Cheol Kwon, Joo Young Kim
  • Patent number: 9424625
    Abstract: Provided are a method and apparatus for interpolating an image. The method includes: selecting a first filter, from among a plurality of different filters, for interpolating between pixel values of integer pixel units, according to an interpolation location; and generating at least one pixel value of at least one fractional pixel unit by interpolating between the pixel values of the integer pixel units by using the selected first filter.
    Type: Grant
    Filed: March 3, 2015
    Date of Patent: August 23, 2016
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Alexander Alshin, Nikolay Shlyakhov, Byeong-doo Choi, Yoon-mi Hong, Woo-jin Han, Tammy Lee
  • Patent number: 9390470
    Abstract: Provided are a method and apparatus for interpolating an image. The method includes: selecting a first filter, from among a plurality of different filters, for interpolating between pixel values of integer pixel units, according to an interpolation location; and generating at least one pixel value of at least one fractional pixel unit by interpolating between the pixel values of the integer pixel units by using the selected first filter.
    Type: Grant
    Filed: March 3, 2015
    Date of Patent: July 12, 2016
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Alexander Alshin, Nikolay Shlyakhov, Byeong-doo Choi, Yoon-mi Hong, Woo-jin Han, Tammy Lee
  • Patent number: 9326004
    Abstract: A method and system to decode a video stream are provided. The method comprises receiving macroblocks, filtering and decimating the macroblocks to create decimated macroblocks and storing the decimated macroblocks. The method further comprises creating a decimated reference block from one or more decimated macroblocks of a decimated reference picture and interpolating selected pixels of the decimated reference block to create an interpolated reference block. The method further comprises pre-processing selected columns of the interpolated reference block to create a processed reference block for motion compensation.
    Type: Grant
    Filed: June 3, 2008
    Date of Patent: April 26, 2016
    Assignee: Broadcom Corporation
    Inventors: Bhatia Sandeep, Jason Demas, Subramanian M. K. Kuppuswamy, Bhaskar Mala Sherigar, Parijat Gupta, Darren Neuman, Ramakrishnan Lakshman
  • Patent number: 9317896
    Abstract: An image interpolation method and apparatus are provided. The image interpolation method includes: selecting different interpolation filters according to locations of sub pixels between integer pixels; and generating sub pixel values at the locations of the sub pixels using the selected interpolation filters.
    Type: Grant
    Filed: July 11, 2011
    Date of Patent: April 19, 2016
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Tammy Lee, Woo-Jin Han
  • Patent number: 9294767
    Abstract: The invention discloses an inter picture prediction method for video coding and decoding and a codec. The inter picture prediction method for video coding comprises: performing motion estimation over integer pixel positions of a reference picture, to determine an optimal motion vector for a current prediction unit in a current picture; and performing interpolation filtering processing for motion estimation over fractional pixel position by using the integer pixel position information to which the optimal motion vector directs in the reference picture, and spatially neighboring pixel information of the current prediction unit in the current picture.
    Type: Grant
    Filed: August 31, 2011
    Date of Patent: March 22, 2016
    Assignee: LG ELECTRONICS (CHINA) R&D CENTER CO., LTD.
    Inventor: Jie Jia
  • Patent number: 9288503
    Abstract: The present invention relates to a method and apparatus for intra prediction. The intra prediction method for a decoder, according to the present invention, comprises the steps of entropy-decoding a received bitstream, generating reference pixels to be used in the intra prediction of a prediction unit; generating a prediction block from the reference pixels on the basis of a prediction mode for the prediction unit and reconstructing an image from the prediction block and a residual block, which is obtained as a result of entropy encoding, wherein the reference pixels and/or the prediction block pixels are predicted on the basis of a base pixel, and the predicted pixel value can be the sum of the pixel value of the base pixel and the difference between the pixel values of the base pixel and the generated pixel.
    Type: Grant
    Filed: January 26, 2015
    Date of Patent: March 15, 2016
    Assignee: KT CORPORATION
    Inventors: Jae Cheol Kwon, Joo Young Kim
  • Patent number: 9165205
    Abstract: In an image processing device, an edge image generation part detects an edge in an original image and generates an edge image constituted from the detected edge. A connected pixel extraction part extracts connected pixel groups in the edge image. A binary image generation part classifies the connected pixel groups under respective colors of the connected pixel groups, and generates a character image for each color. A background image generation part generates a background image of the original image based on the character image so that a pixel value at the position of the character image in the original image is set by an average value of the pixel values in the original image with regard to at least a portion of pixels around a rectangle circumscribing the connected pixel groups. An image compression part compresses respective image data of the character image and background image by different compression manners.
    Type: Grant
    Filed: November 25, 2013
    Date of Patent: October 20, 2015
    Assignee: KYOCERA Document Solutions Inc.
    Inventors: Toshiaki Mutsuo, Masaki Baba
  • Patent number: 9158990
    Abstract: A system, computer readable medium and a method for motion detection, the method includes: receiving multiple frames; generating a set of digits for each pixel of multiple pixels of each frame of the multiple frames; wherein each set of digits represents a pixel that belongs to a patch of a frame and represents relationships between (a) first similarities between the patch and a set of patches of a next frame that are located in locations that differ from each other and differ from a location of the patch; and (b) second similarities between the patch and a set of patches of a previous frame that are located in locations that differ from each other and differ from a location of the patch; and processing the sets of digits to detect motion.
    Type: Grant
    Filed: September 21, 2010
    Date of Patent: October 13, 2015
    Assignee: RAMOT AT TEL-AVIV UNIVERSITY LTD.
    Inventor: Lior Wolf
  • Patent number: 9143799
    Abstract: A video processing system, method and computer program storage device cooperate to provide a resource and performance efficient sub-pixel motion search operation. Using on the fly calculations it is possible to provide approximations of sub-pixel positions on one image with respect to another image in an image sequence. A sub-pixel position used to set a motion vector for an encoding process may then be identified with reduced processing and memory resources relative to conventional techniques. Also, by later performing a full encoding cost analysis on the earlier identified sub-pixel position, and keeping track of differences, an interpolation accuracy may be dynamically improved by applying the differences to subsequent image frames.
    Type: Grant
    Filed: May 27, 2011
    Date of Patent: September 22, 2015
    Assignee: Cisco Technology, Inc.
    Inventors: Lars Petter Endresen, Steinar Midtskogen, Stian Selnes
  • Patent number: 9143796
    Abstract: Provided is a multi-view video coding/decoding method and apparatus which uses coded and decoded multi-view videos to code and decode depth information videos corresponding to the multi-view videos. The multi-view video coding method includes: controlling the scales of first and second depth information videos corresponding to a multi-view video such that the scales are equalized; and coding the second depth information video, of which the scale is controlled, by referring to the first depth information video of which the scale is controlled.
    Type: Grant
    Filed: December 8, 2009
    Date of Patent: September 22, 2015
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Gun Bang, Gi-Mun Um, Taeone Kim, Eun-Young Chang, Namho Hur, Jin-Woong Kim, Soo-In Lee
  • Patent number: 9131202
    Abstract: Systems and methods for encoding and playing back video at adjustable playback speeds by interpolating frames to achieve smooth playback in accordance with embodiments of the invention are described. One embodiment includes a source encoder that includes a processor, memory including an encoder application, where the encoder application directs the processor to: select a subset of frames from a first video sequence; generate motion vectors describing frames from the first video sequence that are not part of the selected subset of frames, where each motion vector describes movement between a frame in the subset of frames and a frame not included in the subset of frames; store the motion vectors; decimate frames not included in the subset of frames from the first video sequence to generate a second video sequence having a nominal frame rate less than the frame rate of the first video sequence; and encode the second video sequence at the nominal frame rate.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: September 8, 2015
    Assignee: PAOFIT HOLDINGS PTE. LTD.
    Inventors: Tonny Espeset, Andrei Richard Frank, Marc Scott Hardy
  • Patent number: 9113170
    Abstract: A motion vector decision apparatus used in a moving image encoding apparatus for performing inter-prediction encoding of an encoding target image using a reference image and a motion vector, which decides the motion vector based on a cost calculated using a first weight coefficient as a weight coefficient when a block image included in an encoding target image includes no repetitive pattern, and decides the motion vector based on a cost calculated using a second weight coefficient larger than the first weight coefficient as the weight coefficient when the block image includes the repetitive pattern.
    Type: Grant
    Filed: March 31, 2011
    Date of Patent: August 18, 2015
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hiroaki Endo
  • Patent number: 9083979
    Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.
    Type: Grant
    Filed: December 10, 2014
    Date of Patent: July 14, 2015
    Assignee: Dolby Laboratories Licensing Corporation
    Inventor: Gary A. Demos
  • Patent number: 9083983
    Abstract: This disclosure describes techniques for coding a video block based on an unclipped version of a motion vector predictor candidate. The techniques include determining a motion vector predictor candidate list including motion vector predictor candidates from neighboring video blocks without clipping the motion vector predictor candidates. More specifically, if one of the motion vector predictor candidates points to a prediction block located outside of a reference picture boundary relative to the current video block, the techniques allow an unclipped version of the motion vector predictor candidate to be included in the candidate list. The current video block is then coded based on a determined unclipped motion vector predictor candidate of the candidate list. Elimination of the motion vector predictor candidate clipping process reduces complexity at both the video encoder and the video decoder.
    Type: Grant
    Filed: June 25, 2012
    Date of Patent: July 14, 2015
    Assignee: QUALCOMM Incorporated
    Inventors: Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: RE47004
    Abstract: The present invention relates to a A moving image coding apparatus and method involving the simultaneous parallel running of respective modules, namely: a segment-unit-coding module in which an input image frame is divided into segment units and the integer pel (integer pixel) motion is estimated while at the same time the 1/n pixel images are generated with respect to the segments of the image coded in the coding module; and a macroblock-unit-coding module in which the segments of the image frame whose the integer pel motion has been estimated in the segment-unit-coding module are received as input in the form of macroblock units and are coded in macroblock units through the 1/n pixel motion estimation. By separating the coding units into different modules and employing the techniques of parallel processing and pipelining, the present invention makes it possible to effect high-speed encoding with reduced delay in the coding rate due to differences in the processing speeds of the respective modules.
    Type: Grant
    Filed: July 28, 2015
    Date of Patent: August 21, 2018
    Assignee: SK PLANET CO., LTD.
    Inventor: Tae Meon Bae
  • Patent number: RE48451
    Abstract: The present invention relates to a A moving image coding apparatus and method involving the simultaneous parallel running of respective modules, namely: a segment-unit-coding module in which an input image frame is divided into segment units and the integer pel (integer pixel) motion is estimated while at the same time the 1/n pixel images are generated with respect to the segments of the image coded in the coding module; and a macroblock-unit-coding module in which the segments of the image frame whose the integer pel motion has been estimated in the segment-unit-coding module are received as input in the form of macroblock units and are coded in macroblock units through the 1/n pixel motion estimation. By separating the coding units into different modules and employing the techniques of parallel processing and pipelining, the present invention makes it possible to effect high-speed encoding with reduced delay in the coding rate due to differences in the processing speeds of the respective modules.
    Type: Grant
    Filed: July 28, 2015
    Date of Patent: February 23, 2021
    Assignee: SK Planet Co., Ltd.
    Inventor: Tae Meon Bae