Half-pixel Refinement Patents (Class 375/240.17)
-
Patent number: 12143629Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.Type: GrantFiled: December 15, 2023Date of Patent: November 12, 2024Assignee: KDDI CorporationInventors: Kyohei Unno, Kei Kawamura, Sei Naito
-
Patent number: 11882308Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.Type: GrantFiled: March 7, 2023Date of Patent: January 23, 2024Assignee: KDDI CORPORATIONInventors: Kyohei Unno, Kei Kawamura, Sei Naito
-
Patent number: 11877005Abstract: An image decoding method performed by a decoding apparatus according to the present document includes constituting a candidate list for deriving motion information of a sub-block unit for a current block, wherein the merge candidate list includes constructed candidates; deriving control point motion vectors (CPMVs) for control points (CPs) of the current block based on the merge candidate list; deriving prediction samples for the current block based on the CPMVs; and generating a reconstructed picture for the current block based on the derived prediction samples, wherein the constructed candidates are derived based on combination of at least two of a first neighboring block in a first group, a second neighboring block in a second group, a third neighboring block in a third group and a fourth neighboring block, and the first neighboring block, the second neighboring block and the third neighboring block and the fourth neighboring block constituting the combination have the same reference picture index.Type: GrantFiled: February 1, 2023Date of Patent: January 16, 2024Assignee: LG ELECTRONICS, INC.Inventors: Jaeho Lee, Seunghwan Kim
-
Patent number: 11627336Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.Type: GrantFiled: July 8, 2022Date of Patent: April 11, 2023Assignee: KDDI CORPORATIONInventors: Kyohei Unno, Kei Kawamura, Sei Naito
-
Patent number: 11483584Abstract: A motion vector encoding apparatus includes: a predictor configured to obtain motion vector predictor candidates of a plurality of predetermined motion vector resolutions by using a spatial candidate block and a temporal candidate block of a current block, and to determine motion vector predictor of the current block, a motion vector of the current block, and a motion vector resolution of the current block by using the motion vector predictor candidates; and an encoder configured to encode information representing the motion vector predictor of the current block, a residual motion vector between the motion vector of the current block and the motion vector predictor of the current block, and information representing the motion vector resolution of the current block, wherein the plurality of predetermined motion vector resolutions include a resolution of a pixel unit that is greater than a resolution of one-pel unit.Type: GrantFiled: October 23, 2020Date of Patent: October 25, 2022Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jin-Young Lee, Seung-Soo Jeong, Jung-hye Min, Sun-Il Lee
-
Patent number: 11461919Abstract: A neural network system for detecting at least one object in at least one image, the system includes a plurality of object detectors. Each object detector receives respective image information thereto. Each object detector includes a respective neural network. Each the neural network including a plurality of layers. Layers in different object detectors are common layers when the layers receive the same input thereto and produce the same output therefrom. Common layers are computed only once during object detection for all the different object detectors.Type: GrantFiled: April 9, 2020Date of Patent: October 4, 2022Assignee: Ramot at Tel Aviv University Ltd.Inventors: Lior Wolf, Assaf Mushinsky
-
Patent number: 11438625Abstract: An image decoding device includes a prediction unit configured to generate a prediction signal included in a prediction block based on a motion vector. The prediction unit is configured to perform refinement processing of setting a search range based on a reference position specified by the motion vector, specifying a corrected reference position having the smallest predetermined cost from the search range, and correcting the motion vector based on the corrected reference position. When a block size of the prediction block is larger than a predetermined block size, the prediction unit is configured to divide the prediction block into sub-block groups and perform the refinement processing for each sub-block.Type: GrantFiled: August 29, 2019Date of Patent: September 6, 2022Assignee: KDDI CORPORATIONInventors: Kyohei Unno, Kei Kawamura, Sei Naito
-
Patent number: 11341750Abstract: An image processing system includes a processor and optical flow (OF) determination logic for quantifying relative motion of a feature present in a first frame of video and a second frame of video that provide at least one of temporally and spatially ordered images with respect to the two frames of video. The OF determination logic configures the processor to implement performing OF estimation between the first frame and second frame using a pyramidal block matching (PBM) method to generate an initial optical flow (OF) estimate at a base pyramid level having integer pixel resolution, and refining the initial OF estimate using at least one pass of a modified Lucas-Kanade (LK) method to provide a revised OF estimate having fractional pixel resolution.Type: GrantFiled: February 5, 2019Date of Patent: May 24, 2022Assignee: TEXAS INSTRUMENTS INCORPORATEDInventors: Hrushikesh Tukaram Garud, Manu Mathew, Soyeb Noormohammed Nagori
-
Patent number: 11303919Abstract: A video decoding method performed by a decoding apparatus comprises deriving control points (CPs) for the current block; obtaining motion vectors for the CPs; deriving a motion vector of a sub-block or a sample unit in the current block on the basis of the obtained motion vectors; deriving a prediction sample for the current block on the basis of the derived motion vector; and generating a reconstruction sample on the basis of the prediction sample. The method enables effective performance of inter prediction through the motion vectors (transformation prediction), not only when an image in the current block is moved in a plane, but also when the image in the current block is rotated, zoomed in, zoomed out, or transformed into a parallelogram. Accordingly, the amount of data for the residual signal for the current block can be eliminated or reduced, and the overall coding efficiency can be improved.Type: GrantFiled: April 30, 2020Date of Patent: April 12, 2022Assignee: LG Electronics Inc.Inventors: Naeri Park, Jaehyun Lim, Junghak Nam
-
Patent number: 11297324Abstract: The invention relates to an apparatus and method for inter prediction of a sample value of a current full-integer pixel of a plurality of pixels of a current block of a current frame of a video signal.Type: GrantFiled: May 6, 2020Date of Patent: April 5, 2022Assignee: Huawei Technologies Co., Ltd.Inventor: Maxim Borisovitch Sychev
-
Patent number: 11272203Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. For example, the processing circuitry decodes prediction information of a current block in a current picture from a coded video bitstream. The prediction information is indicative of a prediction mode that uses a first optical flow refinement coding tool. The first optical flow refinement coding tool uses a grid structure that is used additionally by at least a second optical flow refinement coding tool during operations of optical flow refinement. Then, the processing circuitry calculates, using the first optical flow refinement coding tool, refinements to predictions of samples of the current block based on the grid structure, and reconstructs the samples of the current block based on the refinements and the predictions of the samples.Type: GrantFiled: July 20, 2020Date of Patent: March 8, 2022Assignee: TENCENT AMERICA LLCInventors: Guichun Li, Xiang Li, Xiaozhong Xu, Shan Liu
-
Patent number: 11202078Abstract: A system comprises an encoder configured to compress attribute information for a dynamic point cloud and/or a decoder configured to decompress compressed attribute information for a dynamic point cloud. The dynamic point cloud may include multiple versions of the point cloud at multiple moments in time Attribute values for the point cloud may be compressed at a reference frame using an intra-prediction process and may be compressed at one or more reference frames using an inter-prediction process that takes advantage of temporal relationships between different frames (e.g. versions) of the dynamic point cloud at the different moments in time.Type: GrantFiled: September 24, 2020Date of Patent: December 14, 2021Assignee: Apple Inc.Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, Liviu Traian Christian Tulvan, Marius Preda
-
Patent number: 11182613Abstract: In one embodiment, a method includes a system accessing an image, which may comprise covered and uncovered portions, and an overlay image comprising opaque pixels. The covered portion may be configured to be covered by the opaque pixels of the overlay image. The system may generate a data structure comprising data elements associated with pixels of the image. Each of the data elements associated with a covered pixel in the covered portion of the image may be configured to identify an uncovered pixel in the uncovered portion of the image that is closest to the covered pixel. Each covered pixel in the covered portion of the image may be modified by accessing the data element associated with the covered pixel, determining a distance between the covered pixel and an associated closest uncovered pixel using the accessed data element, and modifying a color of the covered pixel based on the distance.Type: GrantFiled: June 9, 2017Date of Patent: November 23, 2021Assignee: Facebook, Inc.Inventors: William S. Bailey, Ficus Kirkpatrick, Houman Meshkin, Ryan Keenan Olson, Hermes Germi Pique Corchs
-
Patent number: 11178426Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.Type: GrantFiled: November 24, 2020Date of Patent: November 16, 2021Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Sriram Sethuraman, Jeeva Raj A
-
Patent number: 11153600Abstract: To improve a coding efficiency. There are included a PU level search unit configured to search for a motion vector for each prediction block by using a matching process, and a sub-block level search unit configured to search for a motion vector of each of sub-blocks in the prediction block, wherein a precision of a local search by the PU level search unit is lower than a precision of a local search by the sub-block level search unit.Type: GrantFiled: February 1, 2017Date of Patent: October 19, 2021Assignee: SHARP KABUSHIKI KAISHAInventors: Tomohiro Ikai, Tomoyuki Yamamoto
-
Patent number: 11153567Abstract: Computer processor hardware receives settings information for a first image. The first image includes a set of multiple display elements. The computer processor hardware receives motion compensation information for a given display element in a second image to be created based at least in part on the first image. The motion compensation information indicates a coordinate location within a particular display element in the first image to which the given display element pertains. The computer processor hardware utilizes the coordinate location as a basis from which to select a grouping of multiple display elements in the first image. The computer processor hardware then generates a setting for the given display element in the second image based on settings of the multiple display elements in the grouping.Type: GrantFiled: March 15, 2017Date of Patent: October 19, 2021Assignee: V-NOVA INTERNATIONAL LIMITEDInventors: Luca Rossato, Guido Meardi
-
Patent number: 11146814Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.Type: GrantFiled: November 24, 2020Date of Patent: October 12, 2021Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Sriram Sethuraman, Jeeva Raj A
-
Patent number: 10848780Abstract: A motion vector encoding apparatus includes: a predictor configured to obtain motion vector predictor candidates of a plurality of predetermined motion vector resolutions by using a spatial candidate block and a temporal candidate block of a current block, and to determine motion vector predictor of the current block, a motion vector of the current block, and a motion vector resolution of the current block by using the motion vector predictor candidates; and an encoder configured to encode information representing the motion vector predictor of the current block, a residual motion vector between the motion vector of the current block and the motion vector predictor of the current block, and information representing the motion vector resolution of the current block, wherein the plurality of predetermined motion vector resolutions include a resolution of a pixel unit that is greater than a resolution of one-pel unit.Type: GrantFiled: November 12, 2019Date of Patent: November 24, 2020Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jin-young Lee, Seung-soo Jeong, Jung-hye Min, Sun-il Lee
-
Patent number: 10750178Abstract: Computer processor hardware receives zone information specifying multiple elements of a rendition of a signal belonging to a zone. The computer processor hardware also receives motion information associated with the zone. The motion information can be encoded to indicate to which corresponding element in a reference signal each of the multiple elements in the zone pertains. For each respective element in the zone as specified by the zone information, the computer processor hardware utilizes the motion information to derive a corresponding location value in the reference signal; the corresponding location value indicates a location in the reference signal to which the respective element pertains.Type: GrantFiled: July 6, 2017Date of Patent: August 18, 2020Assignee: V-Nova International LimitedInventors: Luca Rossato, Guido Meardi
-
Patent number: 10659801Abstract: A video decoding method performed by a decoding apparatus comprises: deriving control points (CPs) for the current block; obtaining motion vectors for the CPs; deriving a motion vector of a sub-block or a sample unit in the current block on the basis of the obtained motion vectors; deriving a prediction sample for the current block on the basis of the derived motion vector; and generating a reconstruction sample on the basis of the prediction sample. The method enables effective performance of inter prediction through the motion vectors (transformation prediction), not only when an image in the current block is moved in a plane, but also when the image in the current block is rotated, zoomed in, zoomed out, or transformed into a parallelogram. Accordingly, the amount of data for the residual signal for the current block can be eliminated or reduced, and the overall coding efficiency can be improved.Type: GrantFiled: March 24, 2016Date of Patent: May 19, 2020Assignee: LG Electronics Inc.Inventors: Naeri Park, Jaehyun Lim, Junghak Nam
-
Patent number: 10659805Abstract: A video intermodal transcoder converts a compressed bitstream formulated according a type-1 compression scheme to a type-2 compressed bitstream formulated according to a type-2 compression scheme. The transcoder includes an augmented type-1 decoder, a transcoder kernel, and an augmented type-2 encoder. The transcoder kernel performs processes of creating motion-vector candidates and pre-computing prediction errors for each cell of a predefined image coding block and for each candidate motion vector for repetitive use in evaluating various image partitions. In an implementation where the type-1 compression scheme follows the H.264 standard and the type-2 compression scheme follows the HEVC standard, the transcoder exploits the flexibility of the coding-tree structure and other HEVC features to significantly reduce the bit rate of the compressed bit stream. The pre-computation of prediction errors significantly reduces the processing effort, hence increases the throughput of the transcoder.Type: GrantFiled: January 29, 2016Date of Patent: May 19, 2020Assignee: ECOLE DE TECHNOLOGIE SUPERIEUREInventors: Jean-François Franche, Stéphane Coulombe
-
Patent number: 10609314Abstract: A pixel array system for high accuracy detection of displacement, speed or acceleration includes: an array including a plurality of pixels, each pixel touching at least one other pixel in a same row and touching at least one other pixel in a different row. At least one row is offset with respect to a preceding row of the array by less than 50% of a pixel width. The array receives an input from an object passing over at least the offset row and the preceding row, and detects displacement, speed or acceleration of the object when said object passes over the array, in order to generate an output representing at least one of the detected displacement, speed or acceleration of the object.Type: GrantFiled: December 4, 2018Date of Patent: March 31, 2020Assignee: PixArt Imaging Inc.Inventors: Sai Mun Lee, Wui Pin Lee
-
Patent number: 10609383Abstract: A method receives an image from a video. The image is split into a first set of first blocks of a first size and then the first blocks are split into a second set of second blocks of a second size. The method tests a first set of down-sampling patterns for the second set of second blocks in a first block in the set of first blocks to determine if a quality of reconstruction of the down-sampled second blocks meets a threshold associated with the respective first set of down sampling patterns. Second blocks satisfying the threshold are down-sampled using the first set of down-sampling patterns. Also, the method tests a second set of down-sampling patterns for the first block using a second set of down-sampling patterns to select one of the second set of down sampling patterns to use to down-sample second blocks that did not satisfy the threshold.Type: GrantFiled: April 7, 2017Date of Patent: March 31, 2020Assignee: HULU, LLCInventor: Yuxiang Shen
-
Patent number: 10536697Abstract: Provided is a re-encoding method including obtaining a first quantization table from a bitstream including an image encoded using the first quantization table; obtaining a second quantization table based on a pattern representing a size distribution of values of elements of the first quantization table, the second quantization table including elements respectively corresponding to the elements of the first quantization table; and re-encoding a reconstructed image by using the second quantization table, the reconstructed image being obtained by decoding the encoded image by using the first quantization table.Type: GrantFiled: December 29, 2014Date of Patent: January 14, 2020Assignee: Samsung Electronics Co., LtdInventors: Dai-woong Choi, Woong-il Choi, Dae-sung Cho
-
Patent number: 10506177Abstract: There are provided an image processing device, image processing method, image processing program, image capture device, and image display device that prevent increase of computational complexity in image enlargement while mitigating degradation in image quality. An image input unit inputs a planar image signal containing signal values of pixels arranged on a plane and depth information including depth values corresponding to the pixels. An interpolation unit calculates a signal value for an interpolation coordinate between pixels on the plane by interpolating between the signal values of adjacent pixels which are present within a predetermined range from the interpolation coordinate. A weight decision unit determines a weighting factor for use in the interpolation based on the depth value of a reference pixel that is closest to the interpolation coordinate and the depth value of an adjacent pixel.Type: GrantFiled: January 9, 2013Date of Patent: December 10, 2019Assignee: SHARP KABUSHIKI KAISHAInventors: Keisuke Omori, Kei Tokui, Nao Shibuhisa
-
Patent number: 10489928Abstract: An image processing system for inspecting object distance and dimensions is disclosed. A calibrated hand-held camera with an integrated collimated laser is deployed in order to capture input images. The images are then processed in order to determine the object distance and related parameters such as displacements and surface dimensions.Type: GrantFiled: February 23, 2018Date of Patent: November 26, 2019Assignee: Librestream Technologies Inc.Inventors: Radeon Shamilov, Scott Brewer
-
Patent number: 10477236Abstract: An image acquisition device includes: an image acquisition unit that acquires images of a subject in time series; a hierarchical motion-detection unit that can detect a motion vector between the images acquired by the image acquisition unit, by using images at two or more levels having different resolutions; a pixel-value-change detecting unit that divides the images acquired by the image acquisition unit into a plurality of partial regions and that detects a temporal change of the pixel value at a detection pixel set in each of the partial regions; and a hierarchical-motion-detection setting unit that sets a larger number of levels used in the hierarchical motion-detection unit, for any of the partial regions that includes the detection pixel at which the temporal change detected by the pixel-value-change detecting unit is larger.Type: GrantFiled: November 10, 2017Date of Patent: November 12, 2019Assignee: OLYMPUS CORPORATIONInventor: Eiji Furukawa
-
Patent number: 10368087Abstract: A processing apparatus is provided that includes an encoder configured to encode current frames of video data using previously encoded reference frames and perform motion searches within a search window about each of a plurality of co-located portions of a reference frame. The processing apparatus also includes a processor configured to determine, prior to performing the motion searches, which locations of the reference frame to reload the search window according to a threshold number of search window reloads using predicted motions of portions of the reference frame corresponding to each of the locations. The processor is also configured to cause the encoder to reload the search window at the determined locations of the reference frame and, for each of the remaining locations of the reference frame, slide the search window in a first direction indicated by the location of the next co-located portion of the reference frame.Type: GrantFiled: September 20, 2016Date of Patent: July 30, 2019Assignees: ATI Technologies ULC, Advanced Micro Devices, Inc.Inventors: Ihab Amer, Gabor Sines, Edward Harold, Jinbo Qiu, Lei Zhang, Yang Liu, Zhen Chen, Ying Luo, Shu-Hsien Wu, Zhong Cai
-
Patent number: 10257541Abstract: Disclosed herein is a method of encoding and decoding a video signal using adaptive sampling. The method may include determining an adaptive sampling rate based on information about the properties of a decoded picture and performing interpolation filtering using samples to which the adaptive sampling rate has been applied. The adaptive sampling rate corresponds to one of a uniform sampling rate, a reduced sampling rate, and a variable sampling rate.Type: GrantFiled: December 19, 2014Date of Patent: April 9, 2019Assignee: LG ELECTRONICS INC.Inventor: Dmytro Rusanovskyy
-
Patent number: 10158861Abstract: Various embodiments are described herein for methods and systems for operating a video compression system. In one example embodiment, the method of operating a video compression system includes determining an encoding complexity limit for an encoding module within the video compression system, determining signal complexity of an input signal to the video compression system, comparing the encoding complexity limit to the signal complexity at an adaptive scaling module within the video compression system, and if the signal complexity is determined to be greater than the encoding complexity limit, manipulating the resolution of the input signal at the adaptive scaling module to generate an output signal.Type: GrantFiled: February 2, 2017Date of Patent: December 18, 2018Assignee: Evertz Microsystems Ltd.Inventors: Sunil Koteyar, Rakesh Patel, Tarek Amara, Alpesh Patel
-
Patent number: 9710922Abstract: An image processing apparatus which reduces an operation amount while maintaining accuracy in detecting a motion vector, includes a contrast value calculating circuit calculating a contrast value for each processing region including a pixel of interest at a center in a standard image which is one of input images, a bit length determining circuit determining a bit length for calculating a motion vector for the pixel of interest among the images to be smaller than a bit length when the contrast value is calculated, a quantization circuit converting a bit length of the processing region and a region corresponding to at least the processing region among the images to be the bit length determined by the bit length determining circuit, and a motion vector calculating circuit calculating a motion vector for the pixel of interest among the images in the processing region for which the bit length is converted.Type: GrantFiled: June 3, 2015Date of Patent: July 18, 2017Assignee: OLYMPUS CORPORATIONInventor: Hisumi Esaki
-
Patent number: 9445123Abstract: The present invention relates to a method and apparatus for intra prediction. The intra prediction method for a decoder, according to the present invention, comprises the steps of entropy-decoding a received bitstream, generating reference pixels to be used in the intra prediction of a prediction unit; generating a prediction block from the reference pixels on the basis of a prediction mode for the prediction unit and reconstructing an image from the prediction block and a residual block, which is obtained as a result of entropy encoding, wherein the reference pixels and/or the prediction block pixels are predicted on the basis of a base pixel, and the predicted pixel value can be the sum of the pixel value of the base pixel and the difference between the pixel values of the base pixel and the generated pixel.Type: GrantFiled: December 15, 2015Date of Patent: September 13, 2016Assignee: KT CORPORATIONInventors: Jae Cheol Kwon, Joo Young Kim
-
Patent number: 9445126Abstract: In one example, this disclosure describes a method of loop filtering of reconstructed video data during a video coding process. The method may comprising applying a one-dimensional (1D) switched filter to the video data in a first dimension that is either horizontal or vertical, and applying a 1D adaptive filter to the video data in a second dimension that is perpendicular to the first dimension.Type: GrantFiled: December 28, 2011Date of Patent: September 13, 2016Assignee: QUALCOMM IncorporatedInventors: Wei-Jung Chien, Marta Karczewicz
-
Patent number: 9432669Abstract: The present invention relates to a method and apparatus for intra prediction. The intra prediction method for a decoder, according to the present invention, comprises the steps of entropy-decoding a received bitstream, generating reference pixels to be used in the intra prediction of a prediction unit; generating a prediction block from the reference pixels on the basis of a prediction mode for the prediction unit and reconstructing an image from the prediction block and a residual block, which is obtained as a result of entropy encoding, wherein the reference pixels and/or the prediction block pixels are predicted on the basis of a base pixel, and the predicted pixel value can be the sum of the pixel value of the base pixel and the difference between the pixel values of the base pixel and the generated pixel.Type: GrantFiled: December 30, 2015Date of Patent: August 30, 2016Assignee: KT CORPORATIONInventors: Jae Cheol Kwon, Joo Young Kim
-
Patent number: 9424625Abstract: Provided are a method and apparatus for interpolating an image. The method includes: selecting a first filter, from among a plurality of different filters, for interpolating between pixel values of integer pixel units, according to an interpolation location; and generating at least one pixel value of at least one fractional pixel unit by interpolating between the pixel values of the integer pixel units by using the selected first filter.Type: GrantFiled: March 3, 2015Date of Patent: August 23, 2016Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Elena Alshina, Alexander Alshin, Nikolay Shlyakhov, Byeong-doo Choi, Yoon-mi Hong, Woo-jin Han, Tammy Lee
-
Patent number: 9390470Abstract: Provided are a method and apparatus for interpolating an image. The method includes: selecting a first filter, from among a plurality of different filters, for interpolating between pixel values of integer pixel units, according to an interpolation location; and generating at least one pixel value of at least one fractional pixel unit by interpolating between the pixel values of the integer pixel units by using the selected first filter.Type: GrantFiled: March 3, 2015Date of Patent: July 12, 2016Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Elena Alshina, Alexander Alshin, Nikolay Shlyakhov, Byeong-doo Choi, Yoon-mi Hong, Woo-jin Han, Tammy Lee
-
Patent number: 9326004Abstract: A method and system to decode a video stream are provided. The method comprises receiving macroblocks, filtering and decimating the macroblocks to create decimated macroblocks and storing the decimated macroblocks. The method further comprises creating a decimated reference block from one or more decimated macroblocks of a decimated reference picture and interpolating selected pixels of the decimated reference block to create an interpolated reference block. The method further comprises pre-processing selected columns of the interpolated reference block to create a processed reference block for motion compensation.Type: GrantFiled: June 3, 2008Date of Patent: April 26, 2016Assignee: Broadcom CorporationInventors: Bhatia Sandeep, Jason Demas, Subramanian M. K. Kuppuswamy, Bhaskar Mala Sherigar, Parijat Gupta, Darren Neuman, Ramakrishnan Lakshman
-
Patent number: 9317896Abstract: An image interpolation method and apparatus are provided. The image interpolation method includes: selecting different interpolation filters according to locations of sub pixels between integer pixels; and generating sub pixel values at the locations of the sub pixels using the selected interpolation filters.Type: GrantFiled: July 11, 2011Date of Patent: April 19, 2016Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Tammy Lee, Woo-Jin Han
-
Patent number: 9294767Abstract: The invention discloses an inter picture prediction method for video coding and decoding and a codec. The inter picture prediction method for video coding comprises: performing motion estimation over integer pixel positions of a reference picture, to determine an optimal motion vector for a current prediction unit in a current picture; and performing interpolation filtering processing for motion estimation over fractional pixel position by using the integer pixel position information to which the optimal motion vector directs in the reference picture, and spatially neighboring pixel information of the current prediction unit in the current picture.Type: GrantFiled: August 31, 2011Date of Patent: March 22, 2016Assignee: LG ELECTRONICS (CHINA) R&D CENTER CO., LTD.Inventor: Jie Jia
-
Patent number: 9288503Abstract: The present invention relates to a method and apparatus for intra prediction. The intra prediction method for a decoder, according to the present invention, comprises the steps of entropy-decoding a received bitstream, generating reference pixels to be used in the intra prediction of a prediction unit; generating a prediction block from the reference pixels on the basis of a prediction mode for the prediction unit and reconstructing an image from the prediction block and a residual block, which is obtained as a result of entropy encoding, wherein the reference pixels and/or the prediction block pixels are predicted on the basis of a base pixel, and the predicted pixel value can be the sum of the pixel value of the base pixel and the difference between the pixel values of the base pixel and the generated pixel.Type: GrantFiled: January 26, 2015Date of Patent: March 15, 2016Assignee: KT CORPORATIONInventors: Jae Cheol Kwon, Joo Young Kim
-
Patent number: 9165205Abstract: In an image processing device, an edge image generation part detects an edge in an original image and generates an edge image constituted from the detected edge. A connected pixel extraction part extracts connected pixel groups in the edge image. A binary image generation part classifies the connected pixel groups under respective colors of the connected pixel groups, and generates a character image for each color. A background image generation part generates a background image of the original image based on the character image so that a pixel value at the position of the character image in the original image is set by an average value of the pixel values in the original image with regard to at least a portion of pixels around a rectangle circumscribing the connected pixel groups. An image compression part compresses respective image data of the character image and background image by different compression manners.Type: GrantFiled: November 25, 2013Date of Patent: October 20, 2015Assignee: KYOCERA Document Solutions Inc.Inventors: Toshiaki Mutsuo, Masaki Baba
-
Patent number: 9158990Abstract: A system, computer readable medium and a method for motion detection, the method includes: receiving multiple frames; generating a set of digits for each pixel of multiple pixels of each frame of the multiple frames; wherein each set of digits represents a pixel that belongs to a patch of a frame and represents relationships between (a) first similarities between the patch and a set of patches of a next frame that are located in locations that differ from each other and differ from a location of the patch; and (b) second similarities between the patch and a set of patches of a previous frame that are located in locations that differ from each other and differ from a location of the patch; and processing the sets of digits to detect motion.Type: GrantFiled: September 21, 2010Date of Patent: October 13, 2015Assignee: RAMOT AT TEL-AVIV UNIVERSITY LTD.Inventor: Lior Wolf
-
Patent number: 9143799Abstract: A video processing system, method and computer program storage device cooperate to provide a resource and performance efficient sub-pixel motion search operation. Using on the fly calculations it is possible to provide approximations of sub-pixel positions on one image with respect to another image in an image sequence. A sub-pixel position used to set a motion vector for an encoding process may then be identified with reduced processing and memory resources relative to conventional techniques. Also, by later performing a full encoding cost analysis on the earlier identified sub-pixel position, and keeping track of differences, an interpolation accuracy may be dynamically improved by applying the differences to subsequent image frames.Type: GrantFiled: May 27, 2011Date of Patent: September 22, 2015Assignee: Cisco Technology, Inc.Inventors: Lars Petter Endresen, Steinar Midtskogen, Stian Selnes
-
Patent number: 9143796Abstract: Provided is a multi-view video coding/decoding method and apparatus which uses coded and decoded multi-view videos to code and decode depth information videos corresponding to the multi-view videos. The multi-view video coding method includes: controlling the scales of first and second depth information videos corresponding to a multi-view video such that the scales are equalized; and coding the second depth information video, of which the scale is controlled, by referring to the first depth information video of which the scale is controlled.Type: GrantFiled: December 8, 2009Date of Patent: September 22, 2015Assignee: Electronics and Telecommunications Research InstituteInventors: Gun Bang, Gi-Mun Um, Taeone Kim, Eun-Young Chang, Namho Hur, Jin-Woong Kim, Soo-In Lee
-
Patent number: 9131202Abstract: Systems and methods for encoding and playing back video at adjustable playback speeds by interpolating frames to achieve smooth playback in accordance with embodiments of the invention are described. One embodiment includes a source encoder that includes a processor, memory including an encoder application, where the encoder application directs the processor to: select a subset of frames from a first video sequence; generate motion vectors describing frames from the first video sequence that are not part of the selected subset of frames, where each motion vector describes movement between a frame in the subset of frames and a frame not included in the subset of frames; store the motion vectors; decimate frames not included in the subset of frames from the first video sequence to generate a second video sequence having a nominal frame rate less than the frame rate of the first video sequence; and encode the second video sequence at the nominal frame rate.Type: GrantFiled: September 30, 2014Date of Patent: September 8, 2015Assignee: PAOFIT HOLDINGS PTE. LTD.Inventors: Tonny Espeset, Andrei Richard Frank, Marc Scott Hardy
-
Motion vector decision apparatus, motion vector decision method and computer readable storage medium
Patent number: 9113170Abstract: A motion vector decision apparatus used in a moving image encoding apparatus for performing inter-prediction encoding of an encoding target image using a reference image and a motion vector, which decides the motion vector based on a cost calculated using a first weight coefficient as a weight coefficient when a block image included in an encoding target image includes no repetitive pattern, and decides the motion vector based on a cost calculated using a second weight coefficient larger than the first weight coefficient as the weight coefficient when the block image includes the repetitive pattern.Type: GrantFiled: March 31, 2011Date of Patent: August 18, 2015Assignee: Canon Kabushiki KaishaInventor: Hiroaki Endo -
Patent number: 9083979Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.Type: GrantFiled: December 10, 2014Date of Patent: July 14, 2015Assignee: Dolby Laboratories Licensing CorporationInventor: Gary A. Demos
-
Patent number: 9083983Abstract: This disclosure describes techniques for coding a video block based on an unclipped version of a motion vector predictor candidate. The techniques include determining a motion vector predictor candidate list including motion vector predictor candidates from neighboring video blocks without clipping the motion vector predictor candidates. More specifically, if one of the motion vector predictor candidates points to a prediction block located outside of a reference picture boundary relative to the current video block, the techniques allow an unclipped version of the motion vector predictor candidate to be included in the candidate list. The current video block is then coded based on a determined unclipped motion vector predictor candidate of the candidate list. Elimination of the motion vector predictor candidate clipping process reduces complexity at both the video encoder and the video decoder.Type: GrantFiled: June 25, 2012Date of Patent: July 14, 2015Assignee: QUALCOMM IncorporatedInventors: Muhammed Zeyd Coban, Marta Karczewicz
-
Patent number: RE47004Abstract: The present invention relates to a A moving image coding apparatus and method involving the simultaneous parallel running of respective modules, namely: a segment-unit-coding module in which an input image frame is divided into segment units and the integer pel (integer pixel) motion is estimated while at the same time the 1/n pixel images are generated with respect to the segments of the image coded in the coding module; and a macroblock-unit-coding module in which the segments of the image frame whose the integer pel motion has been estimated in the segment-unit-coding module are received as input in the form of macroblock units and are coded in macroblock units through the 1/n pixel motion estimation. By separating the coding units into different modules and employing the techniques of parallel processing and pipelining, the present invention makes it possible to effect high-speed encoding with reduced delay in the coding rate due to differences in the processing speeds of the respective modules.Type: GrantFiled: July 28, 2015Date of Patent: August 21, 2018Assignee: SK PLANET CO., LTD.Inventor: Tae Meon Bae
-
Patent number: RE48451Abstract: The present invention relates to a A moving image coding apparatus and method involving the simultaneous parallel running of respective modules, namely: a segment-unit-coding module in which an input image frame is divided into segment units and the integer pel (integer pixel) motion is estimated while at the same time the 1/n pixel images are generated with respect to the segments of the image coded in the coding module; and a macroblock-unit-coding module in which the segments of the image frame whose the integer pel motion has been estimated in the segment-unit-coding module are received as input in the form of macroblock units and are coded in macroblock units through the 1/n pixel motion estimation. By separating the coding units into different modules and employing the techniques of parallel processing and pipelining, the present invention makes it possible to effect high-speed encoding with reduced delay in the coding rate due to differences in the processing speeds of the respective modules.Type: GrantFiled: July 28, 2015Date of Patent: February 23, 2021Assignee: SK Planet Co., Ltd.Inventor: Tae Meon Bae