Pre/post Filtering Patents (Class 375/240.29)
  • Patent number: 11153594
    Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: October 19, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Yeping Su, David Singer, Hsi-Jung Wu
  • Patent number: 11128888
    Abstract: This application relates to a method and apparatus, a storage medium, and a computer device for video encoding and decoding. The video encoding method includes: acquiring a reference frame corresponding to a current frame to be encoded from a video input; determining a sub-pixel interpolation mode, the sub-pixel interpolation mode comprising one of a direct sub-pixel interpolation mode or a sampled sub-pixel interpolation mode; processing the reference frame according to resolution information of the current frame using an interpolation in the sub-pixel interpolation mode, to obtain a corresponding target reference frame; and encoding the current frame according to the target reference frame, to obtain encoded data corresponding to the current frame. By using the foregoing video encoding method, a reference frame corresponding to a current frame to be encoded can be flexibly selected, thereby effectively improving the utilization efficiency of reference frames.
    Type: Grant
    Filed: August 12, 2020
    Date of Patent: September 21, 2021
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xinwei Gao, Xunan Mao, Chenchen Gu
  • Patent number: 11115659
    Abstract: An image signal decoding method according to the present invention comprises the steps of: decoding information indicating whether a current block is encoded using a multi-mode intra prediction; when it is determined that the current block is encoded in the multi-mode intra prediction, dividing the current block into a plurality of partial blocks; and obtaining an intra prediction mode of each of the plurality of partial blocks.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: September 7, 2021
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee Moon, Sung Won Lim, Dong Jae Won
  • Patent number: 11102514
    Abstract: A system for signaling extension functions used in decoding a sequence including a plurality of pictures, each picture processed at least in part according to a picture parameter set is disclosed. An extension presence signaling flag is read and used to determine whether flags signaling the performance of extension functions are to be read. The flags are only read if indicated by the extension presence signaling flag.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: August 24, 2021
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11064210
    Abstract: A processing for a first pixel in a picture comprises obtaining a lower limit of a first color component of the first pixel in a first color space based on a distance between a color of the first pixel and a first distorted version of the color in a second color space. An upper limit of the first color component in the first color 5 space is obtained based on a distance between the color and a second distorted version of the color in the second color space. A filtered value is obtained of the first color component and which is equal to or larger than the lower limit and equal to or lower than the upper limit. The processing results in filtered values that are cheaper to encode but that are visibly undistinguishable from the original colors of the pixels.
    Type: Grant
    Filed: July 17, 2017
    Date of Patent: July 13, 2021
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Jacob Ström, Kenneth Andersson, Per Hermansson, Jonatan Samuelsson, Per Wennersten
  • Patent number: 11051043
    Abstract: The present technology relates to an image processing device and an image processing method which allow a deblocking filtering process to apply filtering appropriately. A pixel (p0i) of which the value is 255 (solid line) before a deblocking process changes greatly to 159 (dot line) after a conventional deblocking process. Therefore, a clipping process having a clipping value of 10 is performed in strong filtering, whereby the pixel (p0i) of which the value is 255 (solid line) before the deblocking process becomes 245 (bold line). Thus, a change in the pixel value occurring in the conventional technique can be suppressed as much as possible. This disclosure can be applied to an image processing device, for example.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: June 29, 2021
    Assignee: SONY CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11039172
    Abstract: The present technology relates to an image processing device and an image processing method which allow a deblocking filtering process to apply filtering appropriately. A pixel (p0i) of which the value is 255 (solid line) before a deblocking process changes greatly to 159 (dot line) after a conventional deblocking process. Therefore, a clipping process having a clipping value of 10 is performed in strong filtering, whereby the pixel (p0i) of which the value is 255 (solid line) before the deblocking process becomes 245 (bold line). Thus, a change in the pixel value occurring in the conventional technique can be suppressed as much as possible. This disclosure can be applied to an image processing device, for example.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: June 15, 2021
    Assignee: SONY CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11019251
    Abstract: The present invention is directed to implementing at least one of speed-up of detection processing and reduction of misdetection. An information processing apparatus includes an acquisition unit configured to acquire a captured image, a first setting unit configured to set a plurality of detection areas of an object for the captured image, a second setting unit configured to set a condition for detecting an object on a first detection area and a second detection area set by the first setting unit, wherein the condition includes a detection size in the captured image, and a detection unit configured to detect an object satisfying the detection size set by the second setting unit from the plurality of detection areas set by the first setting unit.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: May 25, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masayuki Kobayashi, Hisashi Kawabayashi
  • Patent number: 10992942
    Abstract: A coding method by a computer is disclosed. The computer divides a block of a coding unit into a plurality of sub-blocks. The computer determines band positions of at least two first sub-blocks among the plurality of sub-blocks. The computer calculates among the plurality of sub-blocks, band positions of second sub-blocks other than the at least two first sub-blocks based on a positional relationship of the second sub-blocks with respect to the at least two first sub-blocks and the determined band positions for the at least two first sub-blocks in the block of the coding unit. A band offset is conducted for each of the sub-blocks by using the band positions determined or calculated for the at least two first sub-blocks and the second sub-blocks.
    Type: Grant
    Filed: April 23, 2020
    Date of Patent: April 27, 2021
    Assignee: SOCIONEXT INC.
    Inventor: Eiichi Sasaki
  • Patent number: 10979623
    Abstract: The present invention is directed to implementing at least one of speed-up of detection processing and reduction of misdetection. An information processing apparatus includes an acquisition unit configured to acquire a captured image, a first setting unit configured to set a plurality of detection areas of an object for the captured image, a second setting unit configured to set a condition for detecting an object on a first detection area and a second detection area set by the first setting unit, wherein the condition includes a detection size in the captured image, and a detection unit configured to detect an object satisfying the detection size set by the second setting unit from the plurality of detection areas set by the first setting unit.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: April 13, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masayuki Kobayashi, Hisashi Kawabayashi
  • Patent number: 10956815
    Abstract: Technical solutions are described for improving efficiency of training a resistive processing unit (RPU) array using a neural network training methodology. An example method includes reducing asymmetric RPUs from the RPU array by determining an asymmetric value of an RPU from the RPU array, and burning the RPU in response to the asymmetry value being above a predetermined threshold. The RPU can be burned by causing an electric voltage across the RPU to be above a predetermined limit. The method further includes initiating the training methodology for the RPU array after the asymmetric RPUs from the RPU array are reduced.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: March 23, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Tayfun Gokmen
  • Patent number: 10951910
    Abstract: In the case where image data of a super-high definition service is transmitted without scalable coding, image data suitable to own display capability in a receiver not supporting the super-high definition service can be easily obtained. A container in a predetermined format having a video stream including encoded image data is transmitted. Auxiliary information for downscaling a spatial and/or temporal resolution of the image data is inserted into the video stream. For example, the auxiliary information indicates a limit of accuracy for a motion vector included in the encoded image data. Further, for example, the auxiliary information identifies a picture to be selected at the time of downscaling the temporal resolution at a predetermined ratio.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: March 16, 2021
    Assignee: Saturn Licensing LLC
    Inventor: Ikuo Tsukagoshi
  • Patent number: 10944997
    Abstract: Aspects of the disclosure provide a method of video coding includes receiving input data associated with a first block and a second block of an image frame. The method further includes identifying a reference size and performing a deblocking process if it is determined that the deblocking process is to be performed. The preforming the deblocking process may include processing pixels adjacent to the block boundary using a first set of deblocking filter settings if a first block size of the first block and a second block size of the second block are greater than the reference size, and processing the pixels using a second set of deblocking filter settings if the first block size or the second block size is not greater than the reference size.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: March 9, 2021
    Assignee: MEDIATEK INC.
    Inventors: Han Huang, Shan Liu, Chih-Wei Hsu
  • Patent number: 10939102
    Abstract: A post processing apparatus includes a super-resolution (SR) filtering circuit and a loop restoration (LR) filtering circuit. The SR filtering circuit applies SR filtering to a processing result of a preceding circuit. The LR filtering circuit applies LR filtering to a processing result of the SR filtering circuit. Before the SR filtering circuit finishes SR filtering of all pixels of a frame that are generated by the preceding circuit, the LR filtering circuit starts LR filtering of pixels that are derived from applying SR filtering to pixels included in the frame.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: March 2, 2021
    Assignee: MEDIATEK INC.
    Inventors: Yung-Chang Chang, Chih-Ming Wang, Chia-Yun Cheng, Chi-Hung Chen, Kai-Chun Lin, Chih-Wen Yang, Hsuan-Wen Peng
  • Patent number: 10939137
    Abstract: An image decoding device (31) includes a transform coefficient decoding unit (311) configured to decode a transform coefficient for a transform tree included in a coding unit. In the transform tree, the transform coefficient decoding unit splits a transform unit corresponding to luminance and then decodes the transform coefficient related to the luminance, and does not split the transform unit corresponding to chrominance and decodes the transform coefficient related to the chrominance.
    Type: Grant
    Filed: April 23, 2018
    Date of Patent: March 2, 2021
    Assignees: SHARP KABUSHIKI KAISHA, FG INNOVATION COMPANY LIMITED
    Inventors: Tomohiro Ikai, Tomoko Aono, Yukinobu Yasugi, Tomonori Hashimoto
  • Patent number: 10929958
    Abstract: A method and an image processing device for image enhancement are proposed. The method includes the following steps. An input image is received. A curve set is applied on the input image to generate a resultant image, where the curve set includes a plurality pairs of weight functions and process functions, where a summation of a multiplication of the weight function and the process function in each of the pairs is zero, and where the weight function in each of the pairs is associated with low-pass filtering. An output image is generated according to the resultant image and the input image.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: February 23, 2021
    Assignee: Novatek Microelectronics Corp.
    Inventors: Wan-Ching Tsai, Shu-Chun Lin
  • Patent number: 10931977
    Abstract: Systems, methods, and apparatuses are described for processing video. Video content comprising a plurality of frames may be received. A visual element of a first frame of the plurality of frames positioned in an oblique direction relative to one or more of a first axis and a second axis orthogonal to the first axis may be determined. One or more regions associated with the first frame and comprising the visual element may be determined. One or more encoded regions of the first frame may be generated based on partitioning the one or more regions comprising the visual element.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: February 23, 2021
    Assignee: Comcast Cable Communications, LLC
    Inventors: Dan Grois, Alexander Giladi
  • Patent number: 10917641
    Abstract: An encoder includes processing circuitry; and a memory coupled to the processing circuitry. Using the memory, the processing circuitry is configured to: change values of pixels in a first block and a second block to filter the boundary between the first block and the second block such that change amounts of the respective values are smaller than respective thresholds, the pixels being arranged along a line across the boundary; and encode a third block. The pixels in the first block include a first pixel located at a first position, and the pixels in the second block include a second pixel located at a second position corresponding to the first position with respect to the boundary. The thresholds include a first threshold and a second threshold corresponding to the first pixel and the second pixel, respectively. The first threshold is different from the second threshold.
    Type: Grant
    Filed: June 24, 2019
    Date of Patent: February 9, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Ryuichi Kanoh, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10915732
    Abstract: Disclosed is an image processing method capable of processing facial data and non-facial data differentially. The method is carried out by an image processing device, and includes the following steps: determining a facial region, a non-facial region and a transitional region according to a face detection result of an image, in which the transitional region is between the facial region and the non-facial region; and executing different processes for the data of the facial region, the data of the non-facial region and the data of the transitional region respectively.
    Type: Grant
    Filed: May 7, 2019
    Date of Patent: February 9, 2021
    Assignee: REALTEK SEMICONDUCTOR CORPORATION
    Inventors: Kai Liu, Zhong-Yi Qiu, Wen-Tsung Huang
  • Patent number: 10855985
    Abstract: A video coder may reconstruct a current picture of video data. A current region of the current picture is associated with a temporal index indicating a temporal layer to which the current region belongs. Furthermore, for each respective array of a plurality of arrays that correspond to different temporal layers, the video coder may store, in the respective array, sets of adaptive loop filtering (ALF) parameters used in applying ALF filters to samples of regions of pictures of the video data that are decoded prior to the current region and that are in the temporal layer corresponding to the respective array or a lower temporal layer than the temporal layer corresponding to the respective array. The video coder determines, based on a selected set of ALF parameters in the array corresponding to the temporal layer to which the current region belongs, an applicable set of ALF parameters.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: December 1, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Li Zhang, Wei-Jung Chien, Marta Karczewicz, Ye-Kui Wang
  • Patent number: 10855984
    Abstract: Provided is an image processing apparatus which includes a setting unit assigning a control block, which is a control unit of a filter process that is locally performed with respect to an image, to an initial position of the image determined based on a predetermined reference point; a movement unit moving the control block, which has been assigned to the initial position of the image by the setting unit, up to a position in which the result of the filter process is improved; and a filter processing unit performing the filter process for the respective control blocks which has been moved by the movement unit.
    Type: Grant
    Filed: August 13, 2019
    Date of Patent: December 1, 2020
    Assignee: SONY CORPORATION
    Inventor: Kenji Kondo
  • Patent number: 10834397
    Abstract: An image coding method for coding an input image per block to generate a coded image signal includes: predicting for each prediction unit which is an area obtained by partitioning a target block to generate a prediction image of the target block; comparing a transform unit which is an area obtained by partitioning the target block and is a processing unit for frequency transform with the prediction unit, to detect part of a boundary of the prediction unit, the boundary being located within the transform unit; performing boundary filtering on the detected part of the boundary in the generated prediction image; calculating a difference between a filtered prediction image and the input image to generate a difference image of the target block; and performing frequency transform on the difference image for each transform unit.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: November 10, 2020
    Assignee: SUN PATENT TRUST
    Inventors: Hisao Sasai, Takahiro Nishi, Youji Shibahara
  • Patent number: 10785503
    Abstract: Disclosed is a prediction method adopting in-loop filtering. According to the present invention, a prediction method for encoding and decoding video comprises the following steps: generating a residual block of the current block through an inverse quantization and inverse transform; generating a prediction block of the current block through an intra-prediction; performing in-loop filtering on the current block in which the residual block and the prediction block are combined; and storing the current block, on which the in-loop filtering is performed, in a frame buffer for an intra-prediction of the next block to be encoded. As described above, prediction is performed using an in-loop filter during processes for encoding and decoding video, thereby improving the accuracy of prediction and reducing errors in prediction, thus improving the efficiency of video compression and reducing the amount of data to be transmitted.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: September 22, 2020
    Assignee: INTELLECTUAL DISCOVERY CO., LTD.
    Inventors: Je Chang Jeong, Ki Baek Kim, Dong Jin Jung
  • Patent number: 10785530
    Abstract: A client device accesses a video input stream from an intermediate device for display. The client device analyzes the video input stream to determine that the video input stream matches a template corresponding to a screen portion. Based on the video input stream matching the template, a video output stream is generated and caused to be presented on a display. In some example embodiments, the analysis is performed while the client device is replacing video content received from a content source via the intermediate device. For example, commercials transmitted from a national content provider to a smart TV via a set-top box may be replaced with targeted commercials. During the replacement, menus generated by the set-top box may be detected and the replacement video altered by the smart TV to include the menus.
    Type: Grant
    Filed: December 16, 2016
    Date of Patent: September 22, 2020
    Assignee: Gracenote, Inc.
    Inventors: Markus K. Cremer, Peter Dunker, Steven D. Scherf, David Henry Pearce, Sherman Ling Fung Li, Wilson Harron, Konstantinos Antonios Dimitriou, Dewey Ho Lee
  • Patent number: 10764595
    Abstract: Provided is an image encoding method including extracting feature points from a picture; generating at least two clusters by performing feature point clustering on the extracted feature points; determining at least two split sections in the picture, the at least two split sections respectively corresponding to the at least two clusters; parallel-encoding the at least two split sections; and generating a bitstream including information about the at least two split sections. A size and a shape of each of the at least two split sections may be individually determined.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: September 1, 2020
    Assignees: SAMSUNG ELECTRONICS CO., LTD., INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
    Inventors: Sun-il Lee, Won Woo Ro, Kyungah Kim, Minsik Kim, Chan-yul Kim
  • Patent number: 10750196
    Abstract: Provided is a method for encoding parameter sets at slice level. The method includes: when there are one or more parameter sets, in which the coding tool parameters are identical to the coding tool parameters of a part of coding tools used for the current slice, in the existing parameter sets, encoding the identifiers of parameter sets into bit-stream of the current slice, wherein a parameter set contains common information of the coding tools used in the process of encoding/decoding slice(s). Correspondingly, also provided is a method for decoding parameter sets at slice level and a device for encoding and decoding parameter sets at slice level, which can make full use of the encoded parameter set information when the slice header refers to a plurality of parameter sets, implement flexible configuration of the coding tools used in the process of encoding/decoding slice(s) and reduce information redundancy.
    Type: Grant
    Filed: May 20, 2019
    Date of Patent: August 18, 2020
    Assignee: ZTE Corporation
    Inventors: Ming Li, Ping Wu
  • Patent number: 10708592
    Abstract: Deblocking is a step in video coding for removing distortions that may result from dividing a video frame into blocks, and encoding the video frame based on the blocks. Techniques described herein can include determining the activity in neighboring blocks along the boundary of the blocks, where the activity measures smoothness or complexity of pixels in the boundary area. An average of the activity can then be determined, as well a difference in the activity between the left block and the right block. The average activity and the difference in activity can then be used to determine a classification for the boundary area. The classification can further be used to select a filter to apply to the pixels in the boundary area. Once the filter have been applied, the blocks can be added to a reconstructed video frame.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: July 7, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Jie Dong, Yung-Hsuan Chao, Wei-Jung Chien, Marta Karczewicz, Li Zhang
  • Patent number: 10708622
    Abstract: A method for adaptive loop filtering of a reconstructed picture in a video encoder is provided that includes determining whether or not sample adaptive offset (SAO) filtering is applied to the reconstructed picture, and using adaptive loop filtering with no offset for the reconstructed picture when the SAO filtering is determined to be applied to the reconstructed picture.
    Type: Grant
    Filed: December 19, 2012
    Date of Patent: July 7, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Madhukar Budagavi, Minhua Zhou
  • Patent number: 10679359
    Abstract: A motion detection method is applied to a monitoring camera apparatus with motion detection function. The motion detection method includes analyzing a pixel value of each frame from a video stream changed over time, defining a first period and a second period having the pixel value greater than a triggering threshold respectively as a first event and a second event, comparing a time length of the first period with a filtering threshold to acquire time difference between an end point of the first period and a beginning point of the second period, comparing the time difference with a merging threshold, and acquiring relation between the first event and the second event according to comparison results of the filtering threshold and the merging threshold, so as to determine a detecting period of the motion detection function for actuation.
    Type: Grant
    Filed: September 2, 2018
    Date of Patent: June 9, 2020
    Assignee: VIVOTEK INC.
    Inventors: Cheng-Chieh Liu, Hsun-Shun Yu
  • Patent number: 10681371
    Abstract: The present invention provides a method for performing deblocking filtering, comprising the steps of: identifying a transform unit (TU) boundary and a prediction unit (PU) boundary in the current block; when a neighboring PU adjacent to the current PU includes a boundary, determining an additional PU boundary extended in the boundary; determining boundary strengths (BSs) for the TU boundary, the PU boundary, and the additional PU boundary; and performing a filtering on the basis of the determined BSs.
    Type: Grant
    Filed: June 7, 2016
    Date of Patent: June 9, 2020
    Assignee: LG ELECTRONICS INC.
    Inventor: Seungwook Park
  • Patent number: 10659785
    Abstract: It is provided an apparatus for encoding an image frame, wherein the image frame being partitioned into non-overlapping units (1002, 1008), the partitioned units being included in a first region, a second region and a third region of the image frame (1008, 1012), each of the first region, the second region and the third region being associated with an indicator indicating a raster scanning order; comprising means for encoding the third region of the image frame, based on the indicator of the third region, starting at a first unit from the right and the top in the third region using a raster scan technique (1002, 1008, 1012, 1016); means for encoding the second region of the image frame, based on the indicator of the second region, starting at a first unit from the right in the second region (1002, 1008, 1012, 016); and means for encoding the first region, based on the indicator of the first region, starting at a first unit from the top or the bottom in the first region (1002, 1008, 1012, 1016).
    Type: Grant
    Filed: December 16, 2016
    Date of Patent: May 19, 2020
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Franck Galpin, Fabien Racape, Tangi Poirier
  • Patent number: 10659780
    Abstract: A de-blocking method is applied to a reconstructed projection-based frame having a first projection face and a second projection face, and includes obtaining a first spherical neighboring block for a first block with a block edge to be de-blocking filtered, and selectively applying de-blocking to the block edge of the first block for at least updating a portion of pixels of the first block. There is image content discontinuity between a face boundary of the first projection face and a face boundary of the second projection face. The first block is a part of the first projection face, and the block edge of the first block is a part of the face boundary of the first projection face. A region on a sphere to which the first spherical neighboring block corresponds is adjacent to a region on the sphere from which the first projection face is obtained.
    Type: Grant
    Filed: March 8, 2019
    Date of Patent: May 19, 2020
    Assignee: MEDIATEK INC.
    Inventors: Sheng-Yen Lin, Jian-Liang Lin, Cheng-Hsuan Shih
  • Patent number: 10616583
    Abstract: Input digital frames may be down-sampled to create one or more base frames characterized by a lower resolution than the input digital frames. Enhancement information corresponding to a difference between pixel values for the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames is then created. The one base frames are encoded to form a set of base data and the enhancement information is encoded to form a set of enhancement data. The base data and enhancement data may then be transmitted over a network or stored in a memory.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: April 7, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventor: Rathish Krishnan
  • Patent number: 10602140
    Abstract: A method for filtering a reconstructed picture performed by an encoding device, according to the present invention, comprises the steps of: deriving first filter information for a target region of a reconstructed picture; selecting one among the derived first filter information and a second filter information included in the filter bank; and performing filtering on the target region in the reconstructed picture on the basis of the selected filter information, wherein, if the first filter information is selected, the filter bank is updated, and if the second filter information is selected, a filter index may be transmitted to a decoder. According to the present invention, the filtering of a reconstructed picture on the basis of the filter bank may be efficiently performed, and the amount of data allocated to the transmission/reception of filter information is reduced therethrough, consequently enabling the increase of compression and coding efficiency.
    Type: Grant
    Filed: February 2, 2016
    Date of Patent: March 24, 2020
    Assignee: LG ELECTRONICS, INC.
    Inventors: Chulkeun Kim, Junghak Nam
  • Patent number: 10567770
    Abstract: Video decoding innovations for multithreading implementations and graphics processor unit (“GPU”) implementations are described. For example, for multithreaded decoding, a decoder uses innovations in the areas of layered data structures, picture extent discovery, a picture command queue, and/or task scheduling for multithreading. Or, for a GPU implementation, a decoder uses innovations in the areas of inverse transforms, inverse quantization, fractional interpolation, intra prediction using waves, loop filtering using waves, memory usage and/or performance-adaptive loop filtering. Innovations are also described in the areas of error handling and recovery, determination of neighbor availability for operations such as context modeling and intra prediction, CABAC decoding, computation of collocated information for direct mode macroblocks in B slices, reduction of memory consumption, implementation of trick play modes, and picture dropping for quality adjustment.
    Type: Grant
    Filed: November 7, 2016
    Date of Patent: February 18, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Daniel Dinu, Juan Carlos Arevalo Baeza, Barry Friemel, William Chen
  • Patent number: 10491924
    Abstract: A method of encoding image data representing an image is provided. The method includes receiving the image data. The method includes applying a lossy encoding operation to the image data to generate encoded image data representing the image. The method includes decoding the encoded image data to generate decoded image data. The method includes reducing a compression-noise component of the decoded image data to generate reduced-noise decoded image data. The method includes processing the reduced-noise decoded image data and the image data to generate difference data representing a difference between the image data and the reduced-noise decoded image data. The method includes encoding the difference data to generate encoded difference data. A method of decoding image data derived, using a lossy encoding operation, from image data representing an image is also provided. A computing device is also provided.
    Type: Grant
    Filed: December 7, 2017
    Date of Patent: November 26, 2019
    Assignee: Apical Limited
    Inventor: Viacheslav Chesnokov
  • Patent number: 10462368
    Abstract: A method for temporal filtering based on motion detection between non-adjacent pictures. The method may compute a motion score by motion detection between a target area in a target picture and a first area in a non-adjacent one of a plurality of reference pictures; and temporal filter the target area with a second area in an adjacent one of the reference pictures based on the motion score to generate a filtered area in a filtered picture. At least one of (i) the motion score and (ii) the generation of the filtered area may be controlled by one or more gain settings in a circuit.
    Type: Grant
    Filed: June 19, 2018
    Date of Patent: October 29, 2019
    Assignee: Ambarella, Inc.
    Inventor: Elliot N. Linzer
  • Patent number: 10448013
    Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.
    Type: Grant
    Filed: December 22, 2016
    Date of Patent: October 15, 2019
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Paul Wilkins, Jingning Han, Yuxin Liu, Wei-Ting Lin
  • Patent number: 10440391
    Abstract: Aspects of the disclosure include a method of video coding. The method includes receiving input data associated with a first block and a second block of an image frame, the first block and the second block corresponding to different color space components. The method further includes identifying a reference region in the first block, identifying at least two reference unit cells among a plurality of unit cells in the reference region, identifying respective intra prediction modes for processing the identified reference unit cells, determining an intra prediction mode for processing a sub-block in the second block based on the identified intra prediction modes, and generating an intra predictor of the sub-block based on the determined intra prediction mode. The reference region and the sub-block correspond to a same region in the image frame. The method further includes encoding or decoding the sub-block based on the intra predictor of the sub-block.
    Type: Grant
    Filed: July 25, 2017
    Date of Patent: October 8, 2019
    Assignee: MEDIATEK INC.
    Inventors: Jing Ye, Shan Liu
  • Patent number: 10425640
    Abstract: A method, a device and an encoder for controlling filtering of intra-frame prediction reference pixel point are disclosed. The method includes: when various reference pixel points in a reference pixel group of an intra-frame block to be predicted are filtered, and the target reference pixel point to be filtered currently is not an edge reference pixel point in a reference pixel group (S202), acquiring a pixel difference value between the target reference pixel point and n adjacent reference pixel points thereof (S203); and selecting a filter with the filtering grade thereof corresponding to the pixel difference value to filter the target reference pixel point (S204). For various reference pixel points not located at an edge in a reference pixel group, according to the local difference characteristics of these reference pixel points, filters with corresponding filtering grades are flexibly configured, thus providing flexibility and adaptivity to the filtering, achieving better effect.
    Type: Grant
    Filed: June 16, 2016
    Date of Patent: September 24, 2019
    Assignee: Peking University Shenzhen Graduate School
    Inventors: Ronggang Wang, Kui Fan, Zhenyu Wang, Wen Gao
  • Patent number: 10419750
    Abstract: A video coding or decoding method in which luminance and chrominance samples in a 4:4:4 format or a 4:2:2 format are predicted from other respective samples according to a prediction direction associated with blocks of samples to be predicted; comprises detecting a prediction direction in respect of a current block to be predicted; generating a predicted block of chrominance samples according to other chrominance samples defined by the prediction direction; if the detected prediction direction is substantially vertical, filtering the left column of samples in the predicted block of chrominance samples, or if the detected prediction direction is substantially horizontal, filtering the top row of samples in the predicted block of chrominance samples; and encoding a difference between the filtered predicted chrominance block and the actual chrominance block or applying a decoded difference to the filtered predicted chrominance block so as to encode or decode the block respectively.
    Type: Grant
    Filed: June 26, 2017
    Date of Patent: September 17, 2019
    Assignee: Sony Corporation
    Inventors: James Alexander Gamei, Nicholas Ian Saunders, Karl James Sharman, Paul James Silcock
  • Patent number: 10419756
    Abstract: An image processing device and method capable of suppressing block noise. A ? LUT_input calculation unit and a clipping unit calculate ? LUT_input that is a value input to an existing ? generation unit and an extended ? generation unit. When the value of ? LUT_input qp from the clipping unit is equal to or less than 51, the existing ? generation unit calculates ? using the LUT defined in the HEVC method and supplies the calculated ? to a filtering determination unit. When the value of ? LUT_input qp from the clipping unit is larger than 51, the extended ? generation unit calculates extended ? and supplies the calculated ? to the filtering determination unit. The device can be applied to an image processing device, for example.
    Type: Grant
    Filed: June 15, 2017
    Date of Patent: September 17, 2019
    Assignee: Sony Corporation
    Inventors: Shuo Lu, Masaru Ikeda
  • Patent number: 10397591
    Abstract: A control processor for a video encode-decode engine is provided that includes an instruction pipeline. The instruction pipeline includes an instruction fetch stage coupled to an instruction memory to fetch instructions, an instruction decoding stage coupled to the instruction fetch stage to receive the fetched instructions, and an execution stage coupled to the instruction decoding stage to receive and execute decoded instructions. The instruction decoding stage and the instruction execution stage are configured to decode and execute a set of instructions in an instruction set of the control processor that are designed specifically for accelerating video sequence encoding and encoded video bit stream decoding.
    Type: Grant
    Filed: April 11, 2015
    Date of Patent: August 27, 2019
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Dipan Kumar Mandal, Mihir Narendra Mody, Mahesh Madhukar Mehendale, Chaitanya Satish Ghone, Piyali Goswami, Naresh Kumar Yadav, Hetul Sanghvi, Niraj Nandan
  • Patent number: 10397615
    Abstract: A deblocking filtering control comprises checking whether pixel values of four pixels (12, 22) in a line (15) of pixels (12, 22) in a block (10) of pixels (12) and in a neighboring block (20) of pixels (22) form an approximate line. If the pixel values of the four pixels (12, 22) in the line (15) of pixels (12, 20) in both the block (10) of pixels (12) and in the neighboring block (20) of pixels (22) form an approximate line the deblocking filtering control selects to apply strong deblocking filtering to pixel values in the line (15) of pixels (12, 22). The subject and objective quality of the deblocking filtering is thereby improved by applying strong deblocking filter to areas where the signal in a picture (1) not only has the form of a flat line but also form a ramp.
    Type: Grant
    Filed: June 30, 2013
    Date of Patent: August 27, 2019
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventor: Andrey Norkin
  • Patent number: 10389659
    Abstract: A data capture module includes a first port configured to receive first data transmitted from a first component to a second component of a substrate processing system, a second port configured to received second data transmitted from the second component to the first component, a first data stream forwarding module configured to duplicate the first data, forward the duplicated first data to the second port, and output the first data, and a second data stream forwarding module configured to duplicate the second data, forward the duplicated second data to the first port, and output the second data. The first port is configured to transmit the duplicated second data to the first component and the second port is configured to transmit the duplicated first data to the second component. A data compression module is configured to compress the first and second data. Data storage is configured to store the compressed data.
    Type: Grant
    Filed: September 27, 2017
    Date of Patent: August 20, 2019
    Assignee: LAM RESEARCH CORPORATION
    Inventors: Ales Janhar, Behzad Lajevardi
  • Patent number: 10334251
    Abstract: When removing a block distortion occurring in a local decoded image, a loop filtering part 11 of an image coding device carries out a filtering process on each of signal components (a luminance signal component and color difference signal components) after setting the intensity of a filter for removing the block distortion for each of the signal components according to a coding mode (an intra coding mode or an inter coding mode) selected by a coding controlling part 1.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: June 25, 2019
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Shunichi Sekiguchi, Kazuo Sugimoto, Hiroharu Sakate, Tokumichi Murakami, Akira Minezawa
  • Patent number: 10306241
    Abstract: The present invention relates to deblocking filtering, which may be advantageously applied for block-wise encoding and decoding of image or video signal. In particular, the present invention relates to performing an efficient and accurate decision on whether or not to apply deblocking filtering on an image block. The efficient and accurate decision is achieved by performing individual decisions on whether or not to apply deblocking filtering for segments of a boundary between adjacent image blocks, wherein the individual decision are based on pixels comprised in a subset of the pixel lines that the image blocks are composed of.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: May 28, 2019
    Assignee: SUN PATENT TRUST
    Inventors: Matthias Narroschke, Thomas Wedi, Semih Esenlik
  • Patent number: 10291923
    Abstract: A computing device receive a bitstream comprising a plurality of coded slice NAL units encapsulating RBSPs for respective slice segments of a slice of a picture. The slice segments including an independent slice segment and one or more dependent slice segments. The picture is partitioned into a plurality of tiles, including a first tile and a second tile. The slice segments include one or more slice segments that contain CTUs of the first tile and one or more slice segments that contain CTUs of the second tile. The computing device generates a file storing the bitstream. As part of generating the file, the computing device defines a tile region in the file. The tile region comprises an integer number of tiles forming a rectangular region encoded in one or more of the slice segments. The rectangular tile region includes the first tile and not the second tile.
    Type: Grant
    Filed: May 23, 2017
    Date of Patent: May 14, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Fnu Hendry, Ye-Kui Wang
  • Patent number: 10275861
    Abstract: An image processing part includes an edge enhancing part, an artifact detecting part and a compensating part. The edge enhancing part emphasizes an edge portion of an object in input image data. The artifact detecting part detects a corner outlier artifact at an area adjacent to the edge portion of the object. The compensating part compensates the corner outlier artifact. Accordingly, the edge portion of the object may be enhanced and the corner outlier artifact is decreased so that the display quality may be improved.
    Type: Grant
    Filed: August 16, 2017
    Date of Patent: April 30, 2019
    Assignee: Samsung Display Co., Ltd.
    Inventors: Mun-San Park, Cheol-Woo Park, Yun-Ki Baek, Kyoung-Ju Shin, Tadashi Amino
  • Patent number: 10271049
    Abstract: Control methods of sample adaptive offset (SAO) filtering applied to an image processing system with an SAO filter are provided. The method includes the steps of: receiving video signal, wherein the video signal includes at least one group of picture (GOP) and the GOP has multiple frames, each having multiple coding tree units (CTUs); determining whether current frame is an intra-picture frame (I frame); turning on the SAO filter in response to determining that the current frame is the I frame to enable the SAO filter to perform an SAO filtering on the current frame and determining a CTU ratio of the CTUs being not performed with the SAO filtering for the current frame; and selectively turning off the SAO filter based on the CTU ratio, such that the SAO filter does not perform the SAO filtering on subsequent non-I frames in the GOP including the current frame.
    Type: Grant
    Filed: November 27, 2017
    Date of Patent: April 23, 2019
    Assignee: SHANGHAI ZHAOXIN SEMICONDUCTOR CO., LTD.
    Inventors: Ao Mei, ChuanChuan Zhu