Quantization Patents (Class 375/240.03)
  • Patent number: 10839489
    Abstract: In various embodiments, a reconstruction application generates reconstructed video content that includes synthesized film grain. The reconstruction application performs scaling operation(s) on first unit noise based on a piecewise linear scaling function and the brightness component of the decoded video content to generate a brightness component of synthesized film grain. The reconstruction application then generates a brightness component of reconstructed video content based on the brightness component of the synthesized film grain and the brightness component of the decoded video content. Finally, the reconstructed application performs operation(s) related to saving the reconstructed video content to a file and/or further processing the reconstructed video content. Advantageously, the synthesized film grain reliably represents the film grain included in source video content from which the decoded video content was derived.
    Type: Grant
    Filed: August 21, 2018
    Date of Patent: November 17, 2020
    Assignee: NETFLIX, INC.
    Inventor: Andrey Norkin
  • Patent number: 10841592
    Abstract: An extension to the motion-constrained tile sets SEI message provides functionality to signal all tiles are independently decodable and to signal the ROIs that may have more than one tile per ROI. With this extension, the functionality to redefine any independently decodable region-of-interest in a CVS at a coding tree unit level based on user interactivity is enabled. The extension supports the interactivity utilized in various applications such as interactive Ultra High Definition Television (UHDTV), dynamic high-quality zoom-in application, interactive on-demand, e-learning, smart surveillance and many other applications. Additionally, the temporal MCTS SEI message is able to be used by an encoder for tiled streaming to signal explicitly to the decoder that the decoder need only to display the ROI.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: November 17, 2020
    Assignee: SONY CORPORATION
    Inventors: Cheung Auyeung, Jun Xu, Ali J Tabatabai
  • Patent number: 10834405
    Abstract: A bit rate allocation method is provided for a bit rate allocation device. The method includes obtaining an intra prediction frame (I-frame) of a to-be-encoded video, and obtaining a bit-rate characteristic parameters associated with the I-frame. The bit-rate characteristic parameters include a number of video frames in a group-of-picture (GOP) in which the I-frame is located, a pixel number of the I-frame, and a proportion of an inter prediction macroblock in a historical inter prediction frame (P-frame) before the I-frame. The method also includes determining an allocated bit rate of the I-frame according to each bit-rate characteristic parameter.
    Type: Grant
    Filed: March 22, 2019
    Date of Patent: November 10, 2020
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xunan Mao, Chenchen Gu, Yongfang Shi, Anlin Gao
  • Patent number: 10834415
    Abstract: Aspects of data compression/decompression for neural networks are described herein. The aspects may include a model data converter configured to convert neural network content values into pseudo video data. The neural network content values may refer to weight values and bias values of the neural network. The pseudo video data may include one or more pseudo frames. The aspects may further include a compression module configured to encode the pseudo video data into one or more neural network data packages.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: November 10, 2020
    Assignee: CAMBRICON TECHNOLOGIES CORPORATION LIMITED
    Inventors: Tianshi Chen, Yuzhe Luo, Qi Guo, Shaoli Liu, Yunji Chen
  • Patent number: 10834394
    Abstract: A method of adding comfort noise to a video sequence comprising setting parameters of a deblocking filter of a video encoder to change values during the video sequence, encoding frames of the video sequence using the parameters of the deblocking filter that are set to change values during the video sequence, thereby introducing comfort noise in the video sequence, and including the encoded frames in a bitstream together with an indication of which parameters of the deblocking filter were used when encoding the frames of the video sequence.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: November 10, 2020
    Assignee: AXIS AB
    Inventors: Alexander Toresson, Viktor Edpalm, Fredrik Pihl
  • Patent number: 10827196
    Abstract: Generating a compound predictor block of a current block includes generating, for the current block, predictor blocks including a first predictor block formed of first predictor pixels. Using at least a subset of the first predictor pixels, a first modulation value for modulating a first weight to be applied to a first predictor pixel of the first predictor pixels is determined. The compound predictor block is generated using the first predictor pixel, the first weight, and the first modulation value.
    Type: Grant
    Filed: November 9, 2017
    Date of Patent: November 3, 2020
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, James Bankoski, Yue Chen, Yuxin Liu, Sarah Parker
  • Patent number: 10827182
    Abstract: A video coding processing method performed by a computing device includes: obtaining a percentage of intra-prediction blocks in an inter-predicted frame in a previous group of video frame sequences; determining, according to the percentage, whether a current video scene changes, and determining a target bit rate of an intra-coded frame in a current group of video frame sequences according to the percentage when determining that the current video scene changes; and coding the intra-coded frame according to the target bit rate.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: November 3, 2020
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Xunan Mao
  • Patent number: 10827176
    Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: November 3, 2020
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Adeel Abbas, David Newman
  • Patent number: 10827188
    Abstract: A method and apparatus for parallel processing of at least two bins relating to at least one of a video and an image. The method includes determining scan type of at least a portion of the at least one of video and an image, analyzing neighboring position of a bin, removing dependencies of context selection based on the scan type and position of location being encoded in a transform, and performing parallel processing of that least two bins.
    Type: Grant
    Filed: October 9, 2018
    Date of Patent: November 3, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Vivienne Sze, Madhukar Budagavi
  • Patent number: 10819651
    Abstract: A method provides for delivering video content from a server to a plurality of media devices is disclosed that distributes accurately excess bandwidth. The method includes: determining, by the server, the bandwidth to allocate to each of the plurality of media devices using a hypertext transfer protocol-based live streaming client model or a need parameter vector and/or measured bandwidth limitations associated with each of the plurality of media devices and providing the allocated bandwidth to each of the plurality of media devices, wherein the video content is transmitted in a plurality of segments from the server, and wherein each segment is transmitted at a bitrate that may vary from segment to segment.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: October 27, 2020
    Assignee: ARRIS Enterprises LLC
    Inventors: Praveen N. Moorthy, Mark S. Schmidt, Baozhou Li, Ajay Luthra
  • Patent number: 10819987
    Abstract: An intra prediction method according to the present invention comprises the steps of: determining an intra prediction mode for a current block; determining whether to apply a coefficient induced intra prediction (CIIP) to the current block; deriving neighboring reference samples for the current block on the basis of whether the CIIP is applied; and generating prediction samples for the current block on the basis of the intra prediction mode and the neighboring samples. The present invention can generate modified or improved neighboring reference samples and thereby can improve the performance of intra prediction.
    Type: Grant
    Filed: November 11, 2016
    Date of Patent: October 27, 2020
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyeongmoon Jang, Bumshik Lee, Sehoon Yea
  • Patent number: 10819999
    Abstract: A method for decoding an intra-frame prediction mode includes determining a first mode set comprising intra-frame prediction modes of available neighborhood reconstruction units in preset positions of the current to-be-decoded unit and at least one non-directional prediction mode, and parsing the bitstream to obtain a second identifier used to indicate a candidate intra-frame prediction mode in the first mode set that is used as the intra-frame prediction mode of the current to-be-decoded unit, and a codeword length of the second identifier indicating one of the at least one non-directional prediction mode as the intra-frame prediction mode of the current to-be-decoded unit is not less than a codeword length of any second identifier indicating an intra-frame prediction mode of an available neighborhood reconstruction unit in a preset position of the current to-be-decoded unit as the intra-frame prediction mode of the current to-be-decoded unit.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: October 27, 2020
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Yu Han, Jicheng An, Jianhua Zheng
  • Patent number: 10812101
    Abstract: A method of data compression in which the total size of the compressed data is determined and based on that determination, the bit depth of the input data may be reduced before the data is compressed. The bit depth that is used may be determined by comparing the calculated total size to one or more pre-defined threshold values to generate a mapping parameter. The mapping parameter is then input to a remapping element that is arranged to perform the conversion of the input data and then output the converted data to a data compression element. The value of the mapping parameter may be encoded into the compressed data so that it can be extracted and used when subsequently decompressing the data.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: October 20, 2020
    Assignee: Imagination Technologies Limited
    Inventors: Peter Malcolm Lacey, Simon Fenney
  • Patent number: 10812798
    Abstract: Provided are systems, methods, and computer-readable medium for encoding and decoding video data. In various examples, a coding device can include multiple luma QP and chroma QP relationship tables. In performing quantization or inverse quantization one video data being encoded or decoded, respectively, the coding device can select a table. The table can be selected based on, for example, a slice type, a prediction mode, and/or a luminance value, among other factors. The coding device can then use the luma QP value to look up a chroma QP value from the table. The luma QP and chroma QP values can then be used in quantization or inverse quantization.
    Type: Grant
    Filed: October 10, 2018
    Date of Patent: October 20, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Wei-Jung Chien, Kai Zhang, Yi-Wen Chen, Marta Karczewicz
  • Patent number: 10798395
    Abstract: One or more computing devices, systems, and/or methods for video encoding are provided. For example, a video file may be segmented into at least a first portion and a second portion. The first portion may be analyzed to determine that the first portion is associated with a first level of complexity, and the second portion may be analyzed to determine that the second portion is associated with a second level of complexity. A first bitrate associated with the first level of complexity may be determined, and a second bitrate associated with the second level of complexity may be determined. The first portion may be encoded at the first bitrate to generate a first encoded portion, and the second portion may be encoded at the second bitrate to generate a second encoded portion. The first encoded portion and the second encoded portion may be assembled to generate an optimized video file.
    Type: Grant
    Filed: May 24, 2019
    Date of Patent: October 6, 2020
    Assignee: Oath Inc.
    Inventors: Jian Zhou, Congxia Dai, Heri Zhao, Zhonghua Ma, Xumin Wu, Michael Chang-Ping Chen, Sagar Dattatraya Bhandare
  • Patent number: 10796617
    Abstract: An implementation relates to a device for processing an image data stream. The device may include a first processing unit and a second processing unit for receiving the image data stream. The first processing unit may be arranged for providing a first data stream, the first data stream has a reduced bandwidth compared to the image data stream. The second processing unit may arranged for providing a second data stream, the second data stream has a reduced bandwidth compared to the image data stream.
    Type: Grant
    Filed: June 12, 2013
    Date of Patent: October 6, 2020
    Assignee: Infineon Technologies AG
    Inventors: Andre' Roger, Romain Ygnace
  • Patent number: 10798382
    Abstract: A method of and an apparatus for controlling intra and/or inter prediction for decoding of a video sequence are provided. The method includes determining whether a width or a height of a coding unit is a power of two, and based on the width or the height of the coding unit being determined to not be a power of two, splitting the coding unit into sub-blocks, each of the sub-blocks having a width or a height that is a power of two and maximized, so that a number of the sub-blocks is minimized. The method further includes applying the intra and/or inter prediction on the sub-blocks into which the coding unit is split.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: October 6, 2020
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu, Liang Zhao
  • Patent number: 10798383
    Abstract: A method for decoding a stream having first and second portions portion and representing an image divided into blocks. The method includes a sequence test having a predetermined non-zero number of bits, including two at the power of the predetermined number (2N) iterations of the following substeps, for a current block: obtaining a sequence distinct from sequences already tested; decoding and reconstructing a version of the current block from the obtained sequence and from coded data in the first portion; evaluating a likelihood measurement associated with the reconstructed block; decoding information characteristic of a first sequence including the predetermined number of binary symbols from the second portion; selecting a sequence from the sequences tested, based on the likelihood measurements and the decoded information, the selected sequence being identified as the first sequence; and decoding and reconstructing the current block from the first sequence and the first portion.
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: October 6, 2020
    Assignee: B<>COM
    Inventors: Felix Henry, Gordon Clare
  • Patent number: 10798335
    Abstract: Converting variable frame rate video to fixed frame rate video is described. A variable frame rate (VFR) video having source frames with varying frame durations is obtained. A fixed frame rate for the VFR video is determined. A mapping is generated which maps the source frames of the VFR video to a sequence of result frames of the fixed frame rate. To generate the mapping, a suitable source frame is chosen for each result frame using one or more mapping rules. After the mapping is generated, the mapping is adjusted to improve smoothness of motion of the VFR video by adding at least one skipped source frame to the mapping and removing at least one repeated source frame from the mapping. The VFR video is then converted into, or interpreted as, a fixed frame rate video having the determined fixed frame rate based on the adjusted mapping.
    Type: Grant
    Filed: May 14, 2018
    Date of Patent: October 6, 2020
    Assignee: Adobe Inc.
    Inventor: Dale Matthew Weaver
  • Patent number: 10778971
    Abstract: Aspects of the disclosure provide methods and an apparatus for video decoding. In some embodiments, the apparatus for video decoding includes processing circuitry. The processing circuitry decodes at least one syntax element from a coded video bitstream. The at least one syntax element is indicative of a block size of a non-square block under reconstruction that has a rectangular shape. The block size includes a first size in a first dimension and a second size in a second dimension. The first size is different from the second size. The processing circuitry predicts a sample of the non-square block based on a first set of intra prediction directions for the non-square block. The first set of intra prediction directions does not include at least one of a second set of intra prediction directions for a square block.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: September 15, 2020
    Assignee: Tencent America LLC
    Inventors: Shan Liu, Stephan Wenger, Xin Zhao, Xiang Li, Liang Zhao
  • Patent number: 10764590
    Abstract: Primary and secondary coefficients are identified and used for entropy coding to improve performance. When coding quantized transform coefficients of a transform block, one of those quantized transform coefficients is identified as a primary coefficient. A coefficient map indicating locations of ones of the quantized transform coefficients within the transform block is produced. Valid secondary coefficient associated with the primary coefficient are identified using the coefficient map and data indicating a location of a last non-zero coefficient within the transform block. A token class used to encode one or more neighbor coefficients of the primary coefficient and the valid secondary coefficients is then identified, and a number of bits to use to code the primary coefficient and the valid secondary coefficients is determined based on the token class. The number of bits is determined based on data retrieved from a hardware register and thus determined in a single clock cycle.
    Type: Grant
    Filed: November 15, 2017
    Date of Patent: September 1, 2020
    Assignee: GOOGLE LLC
    Inventor: Juha Pekka Maaninen
  • Patent number: 10764604
    Abstract: A spatially scalable-multiview moving picture encoding apparatus includes: a base layer encoder which encodes a base layer; an enhancement layer encoder which performs spatially scalable encoding on an enhancement layer, using a reconstructed image of the base layer generated by the base layer encoder; an enhancement view base layer encoder which performs multiview encoding on the base layer of the enhancement view, using a reconstructed image of the base layer generated by the base layer encoder; and an enhancement view enhancement layer encoder which performs multiview encoding on the enhancement layer of the enhancement view, using a reconstructed image of the enhancement layer generated by the enhancement layer encoder.
    Type: Grant
    Filed: September 20, 2012
    Date of Patent: September 1, 2020
    Assignee: SUN PATENT TRUST
    Inventors: Daisaku Komiya, Takahiro Nishi, Youji Shibahara, Hisao Sasai, Toshiyasu Sugio, Kyoko Tanikawa, Toru Matsunobu, Kengo Terada
  • Patent number: 10764582
    Abstract: Provided are systems and methods for processing 360-degree video data by obtaining a 360-degree rectangular formatted projected picture, the 360-degree rectangular formatted projected picture including a first region with a region boundary and a first region area; identifying coding tree units (CTUs) within the first region area; selectively identifying a first coding unit (CU) and a second CU from within the CTUs; determining an initial QP value for the first CU; determining an initial QP value for the second CU; identifying the first CU as a region boundary CU; identifying the second CU as a non-region boundary CU; reducing the initial QP value for the first CU to a final first QP value in response to identifying the first CU as a region boundary CU, and generating an encoded video bitstream comprising: the final QP value for the first CU, and the initial QP value for the second CU.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: September 1, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Geert Van Der Auwera, Muhammed Coban, Marta Karczewicz
  • Patent number: 10757481
    Abstract: An electronic device sends a content stream, via an unmanaged network, toward a client device and monitors the capacity of the unmanaged network. The device determines whether an aggregate bandwidth of an upcoming portion of the content stream fits the capacity. The upcoming portion of the content stream includes video content and user-interface data. In response to a determination that the aggregate bandwidth of the upcoming portion of the content stream does not fit the capacity, when the user-interface data is not the result of a user interaction: the device prioritizes a frame rate of the video content over latency for the user-interface data, and in accordance with a determination that the aggregate bandwidth of the upcoming portion of the content stream does not fit the capacity, sends ahead one or more frames of the video content in the upcoming portion, and delays the user-interface data in the upcoming portion.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: August 25, 2020
    Assignee: ACTIVEVIDEO NETWORKS, INC.
    Inventors: Ronald A. Brockmann, Maarten Hoeben
  • Patent number: 10757422
    Abstract: A video image encoding device, in a first mode, variable-length-encodes a residual coefficient to generate a coefficient code string, outputs the coefficient code string and the header information in a state in which the header information is associated with the coefficient code string, in a second mode, directly uses a differential image as a coefficient code string without variable-length-encoding the differential image, and outputs the coefficient code string and the header information in a state in which the header information is associated with the coefficient code string.
    Type: Grant
    Filed: September 9, 2013
    Date of Patent: August 25, 2020
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Hideyuki Ohgose, Kiyofumi Abe, Hiroshi Arakawa, Tatsuro Juri, Kazuhito Kimura
  • Patent number: 10757405
    Abstract: An apparatus of encoding an image in an advanced motion vector prediction (AMVP) mode can include an inter prediction module for determining motion information of a current block, and generating a prediction block of the current block using the motion information; a transform module for transforming the residual block to generate a transformed block; a quantization module for quantizing the transformed block using a quantization parameter and a quantization matrix to generate a quantized block; a scanning module for scanning quantized coefficient components of the quantized block; and an entropy coding module for entropy-coding the scanned quantized coefficient components of the quantized block; in which the motion information is encoded by performing the sub-steps of: constructing an AMVP list using available motion vector candidates of a left motion vector candidate, an above motion vector candidate and a temporal motion vector candidate; selecting a motion vector predictor among motion vector candidates of
    Type: Grant
    Filed: July 26, 2018
    Date of Patent: August 25, 2020
    Assignee: INFOBRIDGE PTE. LTD.
    Inventors: Soo Mi Oh, Moonock Yang
  • Patent number: 10750198
    Abstract: In an example, a method of processing video data includes coding at least one of data that indicates a maximum palette size of a palette of color values for coding a block of video data or data that indicates a maximum palette predictor size of a palette predictor for determining the palette of color values. The method also includes coding the block of video data in accordance with the data.
    Type: Grant
    Filed: May 21, 2015
    Date of Patent: August 18, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Rajan Laxman Joshi, Vadim Seregin, Wei Pu, Marta Karczewicz, Joel Sole Rojals, Krishnakanth Rapaka
  • Patent number: 10749599
    Abstract: An optical communication method is an optical communication method for performing optical communication with a light-emitting device serving as a communication target. The optical communication method includes: a first step of reading information relating to a distance to the light-emitting device and information relating to a size of a light-emitting region included in the light-emitting device, the information relating to the distance and the information relating to the size being stored in advance; a second step of controlling an imaging range of a camera based on the information relating to the distance and the information relating to the size, the camera capturing an image of light from the light-emitting device; and a third step of extracting a signal from light emitted from the light-emitting device based on image data that the camera has captured in the imaging range.
    Type: Grant
    Filed: October 1, 2019
    Date of Patent: August 18, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Masahiko Yamamoto, Takeshi Hatakeyama
  • Patent number: 10750192
    Abstract: An image coding apparatus includes a block dividing unit configured to divide an input image into a plurality of blocks, a prediction unit configured to perform prediction based on coded pixels to generate prediction errors, a transformation unit configured to perform orthogonal transform to the prediction errors to generate transform coefficients, a quantization matrix generation unit configured to generate quantization matrices that are used to quantize the transform coefficients, a quantization matrix coding unit configured to calculate difference values by scanning the quantization matrices and to code the difference values, a quantization unit configured to generate quantization coefficients by quantizing the generated transform coefficients using the quantization matrices, and a coefficient coding unit configured to code the quantization coefficients, wherein the quantization matrix coding unit is configured to scan coefficients of the quantization matrices in a unidirectional manner to calculate the di
    Type: Grant
    Filed: November 1, 2018
    Date of Patent: August 18, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masato Shima
  • Patent number: 10742981
    Abstract: Methods and apparatus are provided for determining quantization parameter predictors from a plurality of neighboring quantization parameters. An apparatus includes an encoder for encoding image data for at least a portion of a picture using a quantization parameter predictor for a current quantization parameter to be applied to the image data. The quantization parameter predictor is determined using multiple quantization parameters from previously coded neighboring portions. A difference between the current quantization parameter and the quantization parameter predictor is encoded for signaling to a corresponding decoder.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: August 11, 2020
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Xiaoan Lu, Joel Sole, Peng Yin, Qian Xu, Yunfei Zheng
  • Patent number: 10743039
    Abstract: A method of displaying video embedded in a user interface is performed at an electronic device such as a server system or client device. The method includes obtaining user-interface frames having a first placeholder for a first video window and obtaining source video frames having a first video stream in the first video window. The source video frames and the user-interface frames are interleaved to form an output video stream, which is provided for decoding and display.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: August 11, 2020
    Assignee: ACTIVEVIDEO NETWORKS, INC.
    Inventor: Maarten Hoeben
  • Patent number: 10742979
    Abstract: A method and system are disclosed for determining local activity of at least a portion of a coding unit using a sum and difference between a pixel and neighboring pixels being coded. In one embodiment, the method comprises determining a minimum difference between the pixel and neighboring pixels for each pixel in the at least the portion of the coding unit and determining the local activity at least in part according to a sum of the differences between each pixel of the at least a portion of the coding unit and the neighboring pixels, wherein determining a difference between the pixel of the at least a portion of the coding unit and neighboring pixels comprises determining a minimum difference between the pixel and the neighboring pixels.
    Type: Grant
    Filed: December 21, 2016
    Date of Patent: August 11, 2020
    Assignee: ARRIS Enterprises LLC
    Inventors: Krit Panusopone, Limin Wang, Yue Yu, Seungwook Hong
  • Patent number: 10742982
    Abstract: A methods and apparatus for coding and decoding a MATRIX. The coding method includes: dividing a MATRIX into layers according to a preset quantity of layers, and grouping MATRIX elements into different layers; performing, according to a determined to-be-coded layer number and in an order of layers one by one, coding processing on MATRIX elements at each layer to be coded; for a layer having a layer number less than or equal to the to-be-coded layer number, writing residual data between an original MATRIX element value corresponding to the layer and a corresponding MATRIX element predicted value into a bit stream; for a layer having a layer number greater than the to-be-coded layer number, writing no coded data of the layer into the bit stream; and coding the to-be-coded layer number and writing the coded layer number of the coded layer into the bit stream.
    Type: Grant
    Filed: October 11, 2018
    Date of Patent: August 11, 2020
    Assignees: Huawei Technologies Co., Ltd., Tsinghua Univeristy
    Inventors: Yunfei Wang, Jianhua Zheng, Xiaozhen Zheng, Yun He
  • Patent number: 10735743
    Abstract: A method for encoding a multi-view frame in a video encoder is provided that includes computing a depth quality sensitivity measure for a multi-view coding block in the multi-view frame, computing a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block, wherein the depth-based perceptual quantization scale is based on the depth quality sensitive measure and a base quantization scale for the 2D frame including the 2D coding block, and encoding the 2D coding block using the depth-based perceptual quantization scale.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: August 4, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Do-Kyoung Kwon, Madhukar Budagavi, Ming-Jun Chen
  • Patent number: 10735749
    Abstract: Techniques for coding and deriving (e.g., determining) one or more coded-block-flags associated with video content are described herein. A coded-block-flag of a last node may be determined when coded-block-flags of preceding nodes are determined to be a particular value and when a predetermined condition is satisfied. In some instances, the predetermined condition may be satisfied when log2(size of current transform unit) is less than log2(size of maximum transform unit) or log2(size of current coding unit) is less than or equal to log2(size of maximum transform unit)+1. The preceding nodes may be nodes that precede the last node on a particular level in a residual tree.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: August 4, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Bin Li, Jizheng Xu
  • Patent number: 10735774
    Abstract: Clipping may be applied during various operations at an encoder or decoder. The lower and upper bounds for clipping can be differentially encoded with respect to predictors. Fixed predictors can be used, for example, 0 and 2bitdepth for the lower and upper bounds, respectively. Adaptive predictors can also be used. Adaptive predictors can be derived from clipping bounds in previously encoded or decoded pictures, or explicitly signaled in a bitstream. Whether to encode the clipping bounds can be determined based on the number of pixels that have values close to the clipping bounds. Additionally, taking advantage of the clipping operation, the prediction residuals can be smoothed, while the distortion for the block may not necessarily increase.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: August 4, 2020
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Franck Galpin, Fabien Racape, Philippe Bordes
  • Patent number: 10735751
    Abstract: Systems, methods and computer readable mediums are presented for encoding a stream of input video frames, in which the input video frames are down sampled and the down sampled frames are encoded in a first encoding pass to generate a set of first pass coded frames forming a single first pass I frame and a plurality of first pass P frames formed into first pass sub-groups of pictures (SUB-GOPs). First pass encoding statistics are generated for individual first pass SUB-GOPs, and the statistics are used to encode the input video frames in a second encoding pass to generate a set of second pass coded frames.
    Type: Grant
    Filed: July 18, 2018
    Date of Patent: August 4, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Arun Shankar Kudana, Soyeb Nagori
  • Patent number: 10728542
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry decodes prediction information for a current block in a current coded picture that is a part of a coded video sequence. The prediction information indicates whether a planar motion vector prediction mode is used for the current block. The current block is partitioned into a plurality of sub-blocks. When it is indicated that a planar motion vector prediction mode is used for the current block, the processing circuitry determines, in response to the use of the planar motion vector prediction mode, at least one temporal motion vector predictor (TMVP) candidate for a bottom-right (BR) corner of the current block. Then the processing circuitry reconstructs the current block according to one of the at least one TMVP candidate for the BR corner.
    Type: Grant
    Filed: March 22, 2019
    Date of Patent: July 28, 2020
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 10728564
    Abstract: Systems and methods for encoding multiple video streams in accordance with embodiments of the invention are disclosed. In one embodiment, a source encoder configured to encode source video as a number of alternative video streams includes a parallel processing system configured to collect statistics on source video data and write the statistics to shared memory in a first pass through the received multimedia content, determine initial encoding information for source video data and write the initial encoding information to shared memory during the first, encode the source video data in parallel using collected statistics and initial encoding information to produce a plurality of alternative video streams during a second pass, and parallel encoding processes are configured to reuse additional encoding information that has already been determined for a portion of video and to generate additional encoding information that has not already been determined for a portion of video.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: July 28, 2020
    Assignee: Sonic IP, LLC
    Inventors: Sam Orton-Jay, Ivan Vladimirovich Naletov
  • Patent number: 10728578
    Abstract: An embedded decoder circuitry for bias minimization in successively reconstructed images from a decoded image obtained from an encoded input image, includes an on-chip memory and a bias control circuit communicatively coupled to the on-chip memory. The on-chip memory stores transform-domain compressed data that includes a plurality of transform blocks of an input image. The bias control circuit is configured to determine a set of conditions associated with each transform coefficient in a transform block of the encoded input image and modify a set of transform coefficients from the plurality of transform coefficients in the transform block based on determination of the set of conditions. The bias control circuit is further configured to generate a decoded image that exhibits a reduced error propagation in successively reconstructed images with respect to the input image, based on inverse transformation of each transform block of the encoded input image.
    Type: Grant
    Filed: March 6, 2018
    Date of Patent: July 28, 2020
    Assignee: SONY CORPORATION
    Inventors: Mohammed Golam Sarwer, Ali Tabatabai
  • Patent number: 10728561
    Abstract: An image encoding method includes acquiring a constant bit rate or a variable bit rate, determining temporal layers for a plurality of images, and setting, in a case where the constant bit rate is selected, (1) a first bit rate type of a top temporal layer to the constant bit rate, and (2) a second bit rate type of one or more other layers to the variable bit rate. The method also includes setting, in a case where the variable bit rate is selected, both the first bit rate type of the top temporal layer and the second bit rate of the one or more layers to the variable bit rate. The method further includes encoding each of the plurality of images, prohibiting reference to the images with the temporal layers higher than each of the temporal layers that each of the images belongs to, and generating the bitstream.
    Type: Grant
    Filed: November 14, 2015
    Date of Patent: July 28, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Toru Matsunobu, Toshiyasu Sugio, Takahiro Nishi
  • Patent number: 10721492
    Abstract: An intra prediction method includes: receiving intra prediction mode information through a bitstream; deriving an intra prediction mode of a current block as a first intra directional mode on the basis of the intra prediction mode information; deriving first neighboring samples of the current block; deriving a reference sample adjacent to a target sample in the current block on the basis of a prediction direction of the first intra directional mode; deriving second neighboring samples of a neighboring block to which the reference sample belongs; determining a modified prediction direction on the basis of a comparison between the reference sample and at least one of the second neighboring samples; and deriving a prediction value for the target sample on the basis of the modified prediction direction and the first neighboring samples.
    Type: Grant
    Filed: September 8, 2016
    Date of Patent: July 21, 2020
    Assignee: LG Electronics Inc.
    Inventors: Eunyong Son, Jin Heo, Seungwook Park, Sehoon Yea
  • Patent number: 10721484
    Abstract: A method for determining a luminance value used to process color samples in a decoder or encoder is provided comprising determining (33, 44) a luminance sample associated with a chroma sample position in a common space; and applying (34, 492) the determined luminance sample in a process that depends on luminance that is being applied to the chroma sample.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: July 21, 2020
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Fabrice Le Leannec, Sebastien Lasserre, Edouard Francois, Franck Galpin
  • Patent number: 10721471
    Abstract: Techniques related to quantization parameter estimation for video coding are discussed. Such techniques may include generating features using a picture of input video received for encoding and applying a neural network to a feature vector including the features, a target bitrate, and a resolution of the picture to generate an estimated quantization parameter for encoding the picture.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: July 21, 2020
    Assignee: Intel Corporation
    Inventors: Ximin Zhang, Bin Zhu, Sang-Hee Lee, Qing Li
  • Patent number: 10715772
    Abstract: One embodiment of the present invention sets forth a technique for correcting color values. The technique includes downsampling first color space values to generate downsampled color space values, upsampling the downsampled color space values to generate second color space values, and determining a first new value for at least one component value included in the downsampled color space values based on a first component value included in the first color space values, a second component value included in the second color space values, and an approximation of a nonlinear transfer function. The technique further includes determining that a first color component value associated with the first new value is outside of a color space range, and determining a second new value for the at least one component value, where the first color component associated with the second new value is within the color space range.
    Type: Grant
    Filed: October 4, 2017
    Date of Patent: July 14, 2020
    Assignee: NETFLIX, INC.
    Inventor: Andrey Norkin
  • Patent number: 10715819
    Abstract: There is provided an image encoding apparatus that divides an image in a video into blocks made up of a plurality of pixels, and encodes the blocks, the image encoding apparatus comprising: A first motion vector computation unit configured to compute a first motion vector of a block to be encoded in an image to be encoded; A motion vector modification unit configured to modify the first motion vector computed in the first motion vector computation unit to generate a second motion vector when a first condition is satisfied; Wherein the first condition is at least one of the following conditions: The absolute value of the first motion vector is greater than a first threshold The absolute value of the difference between the first motion vector and the candidate motion vector for modifying the first motion vector is greater than a second threshold.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: July 14, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kenric O. Sychingping
  • Patent number: 10708595
    Abstract: The present invention relates to a method for encoding and decoding a quantized matrix and an apparatus using same, the method for encoding a quantized matrix according to the present invention comprising the steps of: determining a quantization matrix to be used for quantization and quantizing; determining the prediction method used for the quantization of the quantization matrix; and encoding quantization matrix information on the basis of the determined prediction method, wherein the prediction method can be either a prediction method between coefficients in the quantization matrix or a duplicate of the quantization matrix.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: July 7, 2020
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Sung Chang Lim, Hui Yong Kim, Jin Ho Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 10706604
    Abstract: Embodiments provide for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; a display engine to present the one or more frames of data to the display device for display; display logic to receive a request to display the one or more frames of data and generate one or more display events for the display engine based on the request, wherein the request includes a first hint to indicate a complexity of the one or more frames of data and the one or more display events includes a second hint derived from the first hint; and a performance controller to adjust one or more performance related parameters for the display system based on the second hint.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: July 7, 2020
    Assignee: Apple Inc.
    Inventors: Arthur L. Spence, Jeremy T. Sandmel, David M. Chan, Chendi Zhang, Peter C. Tsoi
  • Patent number: 10707983
    Abstract: In some examples, an audio signal is received and divided into a plurality of frames. Frequency domain data of the audio signal may be generated for an individual frame of the plurality of frames. For example, the frequency domain data may include a plurality of sinusoidal components. Data may be embedded into a selected sinusoidal component selected from the frequency domain data of the individual frame by controlling a phase angle of the selected sinusoidal component to represent a selected bit of the data. For instance, a first range of the phase angle may represent a first type of bit and a second range of the phase angle may represent a second type of bit.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: July 7, 2020
    Assignee: ADORI LABS, INC.
    Inventors: Viswanathan Iyer, Kartik Parija, Andrew Cole
  • Patent number: 10701356
    Abstract: An image decoding method performed by a decoding apparatus according to the present invention comprises the steps of: generating a reconstruction area for a target area within a current picture; deriving a predetermined plurality of basic filters for the target area; updating at least one basic filter among the plurality of basic filters; receiving weight information for each of the basic filters; determining a merge filter for the target area on the basis of the basic filters and the weight information; and generating a modified reconstruction area by performing filtering on the target area on the basis of the filter coefficient of the determined merge filter. The present invention allows updating with filter information suitable for improving the visual quality of the target area and can thereby improve the accuracy of filtering and overall coding efficiency.
    Type: Grant
    Filed: October 13, 2016
    Date of Patent: June 30, 2020
    Assignee: LG ELECTRONIC INC.
    Inventors: Junghak Nam, Chulkeun Kim, Sehoon Yea