Predictive Patents (Class 375/240.12)
  • Patent number: 11509926
    Abstract: Provided is a video decoding method performed by a video decoding apparatus, the video decoding method including: determining prediction mode information of a current block and an index indicating a prediction candidate, from a bitstream; determining a prediction candidate list according to the prediction mode information; when the prediction mode information of the current block indicates a pre-set prediction mode, determining a motion vector indicated by the index indicating the prediction candidate from the prediction candidate list, and determining a prediction motion vector of the current block based on at least one of pieces of motion prediction information related to the motion vector; and determining a motion vector of the current block based on the prediction motion vector, wherein the pre-set prediction mode is a prediction mode different from a skip mode and a merge mode.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: November 22, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Seung-soo Jeong, Min-woo Park, Jin-Young Lee, Sun-il Lee
  • Patent number: 11503316
    Abstract: The present invention relates to an image encoding/decoding method and device. The image decoding method according to the present invention comprises the steps of: decoding a prediction mode index; determining whether the prediction mode index indicates function-based intra prediction; inducing a parameter(s) for generating a function, when the prediction mode index indicates the function-based intra prediction; generating the function on the basis of the induced parameter(s); and performing intra prediction by using the generated function.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: November 15, 2022
    Assignee: RESEARCH & BUSINESS FOUNDATION SUNGKYUNKWAN UNIVERSITY
    Inventors: Seung Hyun Cho, Jung Won Kang, Hyun Suk Ko, Sung Chang Lim, Jin Ho Mes Lee, Ha Hyun Lee, Dong San Jun, Hui Yong Kim, Byeung Woo Jeon, Nam Uk Kim, Seung Su Jeon, Jin Soo Choi
  • Patent number: 11503343
    Abstract: According to the disclosure of the present document, scaling list data delivered in an adaptation parameter set (APS) may be signaled through a hierarchical structure, and the amount of data that needs to be signaled for video/image coding may be reduced and implementation may be facilitated by placing limits on the scaling list data delivered in the APS.
    Type: Grant
    Filed: January 7, 2022
    Date of Patent: November 15, 2022
    Assignee: LG Electronics Inc.
    Inventors: Seethal Paluri, Seunghwan Kim, Jie Zhao
  • Patent number: 11503290
    Abstract: A method of and an apparatus for encoding and decoding are provided. The method comprises determining whether, as a condition for not applying binary splitting to a current block, determining whether the current block is a boundary block and whether a multi-type tree depth resulting from multi-type tree splitting of a quadtree leaf, is equal to or greater than a sum of a maximum boundary multi-type partition depth and a depth offset. Binary splitting is applied in accordance with a result of determining whether said condition is satisfied.
    Type: Grant
    Filed: May 11, 2021
    Date of Patent: November 15, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Han Gao, Semih Esenlik, Biao Wang, Anand Meher Kotra
  • Patent number: 11503282
    Abstract: Disclosed herein is an intra prediction method including: deriving neighbor prediction mode information from a left neighbor prediction mode and an upper neighbor prediction mode; deriving an intra prediction mode for a decoding target unit by using the derived neighbor prediction mode information; and performing intra prediction on the decoding target unit based on the intra prediction mode. According to exemplary embodiments of the present invention, image encoding/decoding efficiency can be improved.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: November 15, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Ha Hyun Lee, Hui Yong Kim, Sung Chang Lim, Jong Ho Kim, Jin Ho Lee, Se Yoon Jeong, Suk Hee Cho, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn
  • Patent number: 11503287
    Abstract: According to the disclosure of the present document, information regarding ALF filter coefficients may be encoded/decoded by fixed order-based exponential golomb coding. In addition, information regarding a fixed filter in ALF may be binarized by fixed-length coding. Accordingly, signaling efficiency can be increased, and coding complexity can be decreased.
    Type: Grant
    Filed: October 28, 2021
    Date of Patent: November 15, 2022
    Assignee: LG Electronics Inc.
    Inventors: Seethal Paluri, Seunghwan Kim
  • Patent number: 11503336
    Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry can decode coded information for a current block in a current picture from a coded video bitstream. The coded information can indicate a string copy mode for the current block. The current block includes a current string. The processing circuitry can determine whether a flipping operation is performed to predict the current string. Based on the flipping operation being determined as performed to predict the current string, the processing circuitry can determine an original reference string based on a string vector of the current string. The processing circuitry can generate a flipped reference string by performing the flipping operation on the original reference string, and reconstruct the current string based on the flipped reference string.
    Type: Grant
    Filed: August 27, 2021
    Date of Patent: November 15, 2022
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Shan Liu
  • Patent number: 11496751
    Abstract: A method of video processing includes deriving, for a conversion between a chroma block of a video and a bitstream representation of the video, parameters of a cross-component linear model by using downsampled luma samples that are generated from N above neighboring lines of a collocated luma block of the chroma block using a downsampling filter, where N is a positive integer; and performing the conversion using a predicted chroma block generated using the cross-component linear model.
    Type: Grant
    Filed: April 29, 2022
    Date of Patent: November 8, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Yang Wang, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11496746
    Abstract: Systems and techniques are described for data encoding using a machine learning approach to generate a distortion prediction {circumflex over (D)} and a predicted bit rate {circumflex over (R)}, and to use {circumflex over (D)} and {circumflex over (R)} to perform rate-distortion optimization (RDO). For example, a video encoder can generate the distortion prediction {circumflex over (D)} and the bit rate residual prediction based on outputs of the one or more neural networks in response to the one or more neural networks receiving a residual portion of a block of a video frame as input. The video encoder can determine bit rate metadata prediction based on metadata associated with a mode of compression, and determine {circumflex over (R)} to be the sum of and . The video encoder can determine a rate-distortion cost prediction ? as a function of {circumflex over (D)} and {circumflex over (R)}, and can determine a prediction mode for compressing the block based on ?.
    Type: Grant
    Filed: February 2, 2021
    Date of Patent: November 8, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Mahant Siddaramanna, Naveen Srinivasamurthy, Apoorva Nagarajan, Prasant Shekhar Singh, Pawan Kumar Baheti, Narendranath Malayath
  • Patent number: 11496747
    Abstract: A method of decoding video data, including receiving a first block of video data encoded using an inter-prediction mode associating a first intra-prediction mode with the first block of video data, wherein the first intra-prediction mode is associated with a second block of video data, and determining a second intra-prediction mode for a neighbor block of video data based at least in part on the first intra-prediction mode.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: November 8, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Kai Zhang, Jianle Chen, Xiang Li, Marta Karczewicz
  • Patent number: 11490086
    Abstract: Devices, systems and methods for lossless coding for visual media coding are described. An exemplary method for video processing includes determining, based on a current video block of a video satisfying a dimension constraint, that coding modes are enabled for representing the current video block in a bitstream representation, where the dimension constraint states that a same set of allowed dimensions for the current video block is disabled for the coding modes, and where, for an encoding operation, the coding modes represent the current video block in the bitstream representation without using a transform operation, or where, for a decoding operation, the coding modes are used to obtain the current video block without using an inverse transform operation; and performing a conversion between the current video block and the bitstream representation of the video based on one of the coding modes.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: November 1, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Zhipin Deng, Hongbin Liu, Na Zhang, Yue Wang
  • Patent number: 11490128
    Abstract: The present disclosure provides a deep neural network (DNN)-based reconstruction method and apparatus for compressive video sensing (CVS). The method divides a video signal into a key frame and a non-key frame. The key frame is reconstructed by using an existing image reconstruction method. The non-key frame is reconstructed by using a special DNN according to the present disclosure. The neural network includes an adaptive sampling module, a multi-hypothesis prediction module, and a residual reconstruction module. The neural network makes full use of a spatio-temporal correlation of the video signal to sample and reconstruct the video signal. This ensures low time complexity of an algorithm while improving reconstruction quality. Therefore, the method in the present disclosure is applicable to a video sensing system with limited resources on a sampling side and high requirements for reconstruction quality and real-time performance.
    Type: Grant
    Filed: August 17, 2020
    Date of Patent: November 1, 2022
    Inventors: Dengyin Zhang, Chao Zhou, Can Chen, Junjiang Li, Zijie Liu
  • Patent number: 11490116
    Abstract: Particular embodiments provide a variable, BitDepth, that may be set at a value based on a number of bits used to represent pixels in pictures of a video. The variable may be used in syntax elements in HEVC, such as the HEVC range extension, but other coding standards may be used. By using the variable, different resolutions for the video may be accommodated during the encoding and decoding process. For example, the number of pixels in the pictures may be represented by 8 bits, 10 bits, 12 bits, or another number of bits depending on the resolution. Using the BitDepth variable in the syntax provides flexibility in the motion estimation and motion compensation process. For example, syntax elements used in the weighted prediction process may take into account different numbers of bits used to represent the pictures.
    Type: Grant
    Filed: June 18, 2021
    Date of Patent: November 1, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11490124
    Abstract: Devices, systems and methods related to management of syntax flags with respect chroma formats in video processing are described. In one representative aspect, a video decoding method includes determining, based on a chroma format of a video comprising a region, whether one or more syntax flags applicable to the region of the video are absent in a syntax structure of a coded representation of the video. The one or more syntax flags are indicative of usage of a luma-dependent chroma residue scaling coding step for representing the region in the coded representation. The luma-dependent chroma residue scaling coding step comprises a scaling process in which a scaling coefficient is derived based on reconstructed luma samples and the scaling process is applied to a chroma residue. The method also includes generating one or more decoded video blocks of the video region by parsing the coded representation according to the determining.
    Type: Grant
    Filed: August 18, 2021
    Date of Patent: November 1, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11490117
    Abstract: Particular embodiments provide a variable, BitDepth, that may be set at a value based on a number of bits used to represent pixels in pictures of a video. The variable may be used in syntax elements in HEVC, such as the HEVC range extension, but other coding standards may be used. By using the variable, different resolutions for the video may be accommodated during the encoding and decoding process. For example, the number of pixels in the pictures may be represented by 8 bits, 10 bits, 12 bits, or another number of bits depending on the resolution. Using the BitDepth variable in the syntax provides flexibility in the motion estimation and motion compensation process. For example, syntax elements used in the weighted prediction process may take into account different numbers of bits used to represent the pictures.
    Type: Grant
    Filed: June 18, 2021
    Date of Patent: November 1, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11490119
    Abstract: Techniques are described related to output and removal of decoded pictures from a decoded picture buffer (DPB). The example techniques may remove a decoded picture from the DPB prior to coding a current picture. For instance, the example techniques may remove the decoded picture if that decoded picture is not identified in the reference picture set of the current picture.
    Type: Grant
    Filed: October 24, 2020
    Date of Patent: November 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Ying Chen
  • Patent number: 11490109
    Abstract: A method of video decoding is provided to include maintaining tables, wherein each table includes a set of motion candidates and each motion candidate is associated with corresponding motion information; and performing a conversion between a first video block and a bitstream representation of a video including the first video block, the performing of the conversion including using at least some of the set of motion candidates as a predictor to process motion information of the first video block.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: November 1, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11490115
    Abstract: The present disclosure provides a video picture coding method, a video picture decoding method, a coding device, and a decoding device. The method includes: determining a distance between control points for an affine picture block; determining a motion vector difference for the affine picture block, motion vectors of the control points being used to determine the motion vector difference; and performing coding processing on the affine picture block over a size that includes a horizontal length and a vertical length, wherein the horizontal length and the vertical length vary based on the distance between the control points, the motion vector difference, and a motion vector precision.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: November 1, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Hong Zhang, Haitao Yang
  • Patent number: 11483588
    Abstract: A three-dimensional data encoding method includes: dividing three-dimensional points included in point cloud data into processing units each of which includes one or more of the three-dimensional points; and encoding attribute information of a current three-dimensional point included in a current processing unit, by reference to an encoded processing unit, to generate a bitstream.
    Type: Grant
    Filed: April 6, 2021
    Date of Patent: October 25, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Toshiyasu Sugio, Noritaka Iguchi
  • Patent number: 11483587
    Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure may include parsing, from a bitstream, first information specifying whether block difference pulse code modulation (BDPCM) applies to an intra-predicted current block, determining a prediction direction of BDPCM for the current block and generating a residual block of the current block based on the determined prediction direction of BDPCM, based on the first information specifying that BDPCM applies to the current block, generating a prediction block of the current block, by performing intra prediction based on an intra prediction mode of the current block, and reconstructing the current block based on the residual block and the prediction block.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: October 25, 2022
    Assignee: LG Electronics Inc.
    Inventors: Sunmi Yoo, Jin Heo, Jangwon Choi, Jungah Choi
  • Patent number: 11483558
    Abstract: Systems and methods for coding and decoding are provided. A method includes receiving a coded video stream including a picture partitioned into a plurality of sub-pictures, and further including adaptive resolution change (ARC) information that is signaled directly within a header of a sub-picture from among the plurality of sub-pictures, or that is signaled directly within a parameter set without any of the ARC information within the parameter set being referenced in any header or other parameter set, or that is provided within the parameter set and referenced in the header; and adaptively changing resolution of the sub-picture based on the ARC information.
    Type: Grant
    Filed: June 16, 2020
    Date of Patent: October 25, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger, Iraj Sodagar
  • Patent number: 11483578
    Abstract: The present invention relates to an image information decoding method. The decoding method includes receiving a bit stream including a Network Abstraction Layer (NAL) unit that includes information related to encoded image, and parsing a NAL unit header of the NAL unit. The NAL unit header may not include 1 bit flag information that represents whether a picture is a non-reference picture or a reference picture in the entire bit stream during encoding.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: October 25, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jung Won Kang, Ha Hyun Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 11483580
    Abstract: A split architecture for encoding a video stream. A source encoder may encode a video content stream to obtain an encoded bitstream and a side information stream. The side information stream includes information characterizing rate and/or distortion estimation functions per block of the video content stream. Also, a different set of estimation functions may be included per coding mode. The encoded bitstream and side information stream may be received by a video transcoder, which transcodes the encoded bitstream to a client-requested picture resolution, according to a client-requested video format and bit rate. The side information stream allows the transcoder to efficiently and compactly perform rate control for its output bitstream, which is transmitted to the client device. This split architecture may be especially useful to operators of content delivery networks.
    Type: Grant
    Filed: June 11, 2013
    Date of Patent: October 25, 2022
    Assignee: Coherent Logix, Incorporated
    Inventors: Michael W. Bruns, Michael B. Solka, Carl S. Dobbs, Martin A. Hunt, Michael B. Doerr, Tommy K. Eng
  • Patent number: 11483573
    Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus may comprise obtaining a current block by splitting an image, determining prediction mode characteristic information based on encoding information of the current block, determining a prediction mode type of a lower-layer block split from the current block based on the prediction mode characteristic information, obtaining the lower-layer block by splitting the current block, and decoding the lower-layer block based on the determined prediction mode type of the lower-layer block. The prediction mode characteristic information may be determined based on a color format of the current block.
    Type: Grant
    Filed: February 3, 2022
    Date of Patent: October 25, 2022
    Assignee: LG ELECTRONICS INC.
    Inventor: Hyeong Moon Jang
  • Patent number: 11483552
    Abstract: A method of video processing is provided to include: performing a conversion between a current video block of a video and a coded representation of the video, wherein the coded representation includes a first parameter that indicates a motion information precision from a multiple precision set for the current video block that does not use a default motion information precision and/or a second parameter which identifies whether an alternative half-pel interpolation filter is used for the conversion, and wherein each of the first parameter and/or the second parameter is associated with one or more bins and a context-model based coding is only used for a first bin of the one or more bins in the coded representation.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: October 25, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
  • Patent number: 11477475
    Abstract: An image decoding method according to the present disclosure includes deriving a history-based motion vector prediction (HMVP) buffer for a current block, deriving motion information of the current block based on an HMVP candidate included in the HMVP buffer, generating prediction samples for the current block based on the motion information, and generating reconstructed samples based on the prediction samples, and the HMVP buffer is initialized when processing a first-ordered CTU in a CTU row in which a current CTU is located, and the current block is included in the current CTU.
    Type: Grant
    Filed: October 8, 2020
    Date of Patent: October 18, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Naeri Park, Junghak Nam, Hyeongmoon Jang
  • Patent number: 11477445
    Abstract: Methods and apparatuses for processing video data include receiving input data associated with a current video picture, dividing the current video picture into non-overlapping rectangular tiles, grouping the tiles in the current video picture into tile groups, and encoding or decoding video data in the tile groups within the current video picture. According to one embodiment, each tile group is composed of an integer number of tiles, and shapes of all the tile groups are constrained to be rectangle. According to one embodiment, a flag is used to indicate whether one or more in-loop filtering operations are performed across tile group boundaries.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: October 18, 2022
    Assignee: HFI Innovation Inc.
    Inventor: Lulin Chen
  • Patent number: 11477450
    Abstract: Methods, apparatus and systems for video bitstream generation and parsing are described. One example bitstream decoding method includes parsing a portion of a video bitstream at a video unit level for a first field indicative of whether a slice height is specified for a subpicture partitioning or for a tile partitioning at the video unit level, parsing, due to determining that the first field indicates that the slice height is specified for the subpicture partitioning, N second fields in the portion of the video bitstream to obtain heights for rectangular slices in the video unit, wherein the heights are indicated in multiple of coding tree unit (CTU) heights, and wherein each rectangular slice comprises one or more CTU rows that belong to a same subpicture, wherein N is a positive integer, and decoding, based on the first field and/or the N second fields, the video bitstream to generate a video.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: October 18, 2022
    Assignee: ZTE (UK) Limited
    Inventor: Ping Wu
  • Patent number: 11470320
    Abstract: An image decoding method according to the present document comprises the steps of: deriving a quantized transform coefficient for a current block on the basis of BDPCM; deriving a transform coefficient by performing dequantization on the quantized transform coefficient; and deriving a residual sample on the basis of the transform coefficient, wherein, when the BDPCM is applied to the current block, inverse non-separable transform is not applied to the transform coefficient.
    Type: Grant
    Filed: October 14, 2021
    Date of Patent: October 11, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Moonmo Koo, Jaehyun Lim, Junghak Nam, Seunghwan Kim
  • Patent number: 11470348
    Abstract: Exemplary video processing methods and apparatuses for encoding or decoding a current block by bi-directional prediction. Multiple weight sets are utilized for blending List 0 and List 1 predictors, and the selection among multiple weight sets may be implicitly determined based on video information. Each weight set is composed of multiple candidate weights, and one candidate weight is selected for the current block. A weight pair associated with the selected weight for the current block is used for weighted averaging List 0 and List 1 predictors of the current block to generate a final inter predictor. The video processing methods and apparatuses encode or decode the current block according to the final inter predictor of the current block.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: October 11, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Yu-Chi Su, Ching-Yeh Chen, Yu-Wen Huang, Tzu-Der Chuang
  • Patent number: 11470354
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. An apparatus for video decoding includes processing circuitry that decodes prediction information for a current block in a current picture that is a part of a coded video sequence. The prediction information indicates a specific inter prediction mode, a position dependent prediction combination (PDPC) process, and a coded residual for the current block. The processing circuitry determines at least one of (i) a partition of the current block to which a transform process is to be applied and (ii) a transform type of the transform process for the current block based on the prediction information. The processing circuitry performs the transform process on the coded residual to generate a decoded residual. The processing circuitry reconstructs the current block based on the decoded residual.
    Type: Grant
    Filed: March 11, 2020
    Date of Patent: October 11, 2022
    Assignee: Tencent America LLC
    Inventors: Liang Zhao, Xiang Li, Xin Zhao, Shan Liu
  • Patent number: 11470305
    Abstract: A video decoding method according to this document includes constructing a most probable mode (MPM) list by deriving MPM candidates for a current block based on a neighboring block adjacent to the current block, deriving an intra prediction mode for the current block based on the MPM list, generating predicted samples by performing prediction for the current block based on the intra prediction mode, and generating a reconstructed picture for the current block based on the predicted samples.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: October 11, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Ling Li, Seunghwan Kim, Jin Heo, Sunmi Yoo, Jangwon Choi, Jungah Choi
  • Patent number: 11470350
    Abstract: Particular embodiments provide a variable, BitDepth, that may be set at a value based on a number of bits used to represent pixels in pictures of a video. The variable may be used in syntax elements in HEVC, such as the HEVC range extension, but other coding standards may be used. By using the variable, different resolutions for the video may be accommodated during the encoding and decoding process. For example, the number of pixels in the pictures may be represented by 8 bits, 10 bits, 12 bits, or another number of bits depending on the resolution. Using the BitDepth variable in the syntax provides flexibility in the motion estimation and motion compensation process. For example, syntax elements used in the weighted prediction process may take into account different numbers of bits used to represent the pictures.
    Type: Grant
    Filed: June 18, 2021
    Date of Patent: October 11, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11470334
    Abstract: Embodiments are directed to systems and methods of using rice code in video coding. In one embodiment includes a method of encoding or decoding video data, e.g., on a video encoder or decoder. The method includes determining available residual coefficients neighboring a current position in a transform unit of video data and determining a sum of the available residual coefficients. The method further includes modifying the sum based on the number of available residual coefficients and determining a rice parameter based on the modified sum. The method further includes encoding or decoding a syntax element of video data based on the determined rice parameter.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: October 11, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Hongtao Wang, Yung-Hsuan Chao, Muhammed Zeyd Coban
  • Patent number: 11470349
    Abstract: Particular embodiments provide a variable, BitDepth, that may be set at a value based on a number of bits used to represent pixels in pictures of a video. The variable may be used in syntax elements in HEVC, such as the HEVC range extension, but other coding standards may be used. By using the variable, different resolutions for the video may be accommodated during the encoding and decoding process. For example, the number of pixels in the pictures may be represented by 8 bits, 10 bits, 12 bits, or another number of bits depending on the resolution. Using the BitDepth variable in the syntax provides flexibility in the motion estimation and motion compensation process. For example, syntax elements used in the weighted prediction process may take into account different numbers of bits used to represent the pictures.
    Type: Grant
    Filed: June 18, 2021
    Date of Patent: October 11, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11470310
    Abstract: A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: October 11, 2022
    Assignee: Comcast Cable Communications, LLC
    Inventors: Dan Grois, Alexander Giladi
  • Patent number: 11470351
    Abstract: Particular embodiments provide a variable, BitDepth, that may be set at a value based on a number of bits used to represent pixels in pictures of a video. The variable may be used in syntax elements in HEVC, such as the HEVC range extension, but other coding standards may be used. By using the variable, different resolutions for the video may be accommodated during the encoding and decoding process. For example, the number of pixels in the pictures may be represented by 8 bits, 10 bits, 12 bits, or another number of bits depending on the resolution. Using the BitDepth variable in the syntax provides flexibility in the motion estimation and motion compensation process. For example, syntax elements used in the weighted prediction process may take into account different numbers of bits used to represent the pictures.
    Type: Grant
    Filed: June 18, 2021
    Date of Patent: October 11, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Yue Yu, Limin Wang
  • Patent number: 11463707
    Abstract: The present disclosure describes techniques for coding and decoding video in which a plurality of coding hypotheses are developed for an input pixel block of frame content. Each coding hypothesis may include generation of prediction data for the input pixel block according to a respective prediction search. The input pixel block may be coded with reference to a prediction block formed from prediction data derived according to plurality of hypotheses. Data of the coded pixel block may be transmitted to a decoder along with data identifying a number of the hypotheses used during the coding to a channel. At a decoder, an inverse process may be performed, which may include generation of a counterpart prediction block from prediction data derived according to the hypothesis identified with the coded pixel block data, then decoding of the coded pixel block according to the prediction data.
    Type: Grant
    Filed: May 20, 2020
    Date of Patent: October 4, 2022
    Assignee: APPLE INC.
    Inventors: Alexandros Michael Tourapis, Yeping Su, David Singer, Hsi-Jung Wu
  • Patent number: 11463702
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a first determination that a luma video block of a video is coded using a matrix based intra prediction (MIP) mode in which a prediction block of the luma video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, performing, based on the first determination, a second determination about a chroma intra mode to be used for a chroma video block associated with the luma video block, and performing, based on the second determination, a conversion between the chroma video block and a bitstream representation of the chroma video block.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: October 4, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11463705
    Abstract: A method of decoding video data, including receiving a first block of video data encoded using an inter-prediction mode associating a first intra-prediction mode with the first block of video data, wherein the first intra-prediction mode is associated with a second block of video data, and determining a second intra-prediction mode for a neighbor block of video data based at least in part on the first intra-prediction mode.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: October 4, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Kai Zhang, Jianle Chen, Xiang Li, Marta Karczewicz
  • Patent number: 11463686
    Abstract: An image decoding method performed by a decoding device according to the present document comprises: a step for deriving the number of samples of upper peripheral chroma samples and left peripheral chroma samples of a current chroma block on the basis of a specific value and the width and height of the current chroma block; a step for deriving said number of upper peripheral chroma samples and said number of left peripheral chroma samples; and a step for deriving CCLM parameters on the basis of the upper peripheral chroma samples, the left peripheral chroma samples, and down-sampled peripheral luma samples, wherein, when the specific value is derived as 2 and the width and the height of the current chroma block are larger than the specific value, the number of samples is derived as the specific value.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: October 4, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Jangwon Choi, Seunghwan Kim, Jin Heo
  • Patent number: 11463688
    Abstract: A video decoder can be configured to receive, for a first chroma component of a block of the video data, information for first residual samples that correspond to a difference between a first chroma block of the first chroma component and a first prediction block of the first chroma component; determine intermediate reconstructed samples based on the first residual samples; receive, for a second chroma component of the block of video data, information for second residual samples that correspond to a difference between a second chroma block of the second chroma component and the intermediate reconstructed samples; reconstruct the first chroma block based on the first residual samples and the first prediction block; reconstruct the second chroma block based on the second residual samples and the intermediate reconstructed samples; and output decoded video data comprising the reconstructed first chroma block and the reconstructed second chroma block.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: October 4, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Bappaditya Ray, Geert Van der Auwera, Adarsh Krishnan Ramasubramonian, Marta Karczewicz
  • Patent number: 11463685
    Abstract: Devices, systems and methods for encoding and decoding digital video are described. In a representative aspect, a method for video processing includes maintaining one or more tables of intra prediction mode candidates based on one or more previous video blocks of a video and performing a conversion between a current video block of the video and a bitstream representation of the video using the one or more tables of intra prediction mode candidates.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: October 4, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11457211
    Abstract: In video coding, a transform can be selected from multiple transform sets. To efficiently implement multiple transforms, a unified architecture of implementing the Discrete Trigonometric Transforms (DTTs) or flipped DTT can be used. In the proposed unified architecture, the relationships between the transforms are utilized. In particular, all transforms can be implemented based on DCT-II, DCT-IV, a reverse order operation, and a sign changing operation for odd elements. The DCT-II can be implemented at a minimum size, and other sizes for DCT-II can be implemented recursively from the minimum size DCT-II and DCT-IV at various sizes. In one example, the multiple transforms are {DCT-II, DST-II, DCT-III, DST-III, DCT-IV, DST-IV}. The relationships between transforms can also be used to guide the design of additional transforms that can be implemented by the unified architecture.
    Type: Grant
    Filed: April 29, 2019
    Date of Patent: September 27, 2022
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Karam Naser, Tangi Poirier, Gagan Bihari Rath
  • Patent number: 11457207
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block according to a rule, where the rule specifies a relationship between samples of the current video block and matrices or offset values applied in a matrix weighted intra prediction (MIP) mode during the conversion, and where the MIP mode includes determining a prediction block of the current video block by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation.
    Type: Grant
    Filed: August 11, 2021
    Date of Patent: September 27, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11457219
    Abstract: Disclosed are an image coding/decoding method and an apparatus therefor. Specifically, a method for decoding an image by a decoding apparatus may include: deriving an intra prediction mode of a current block; configuring reference samples with samples neighboring to an upper end and samples neighboring to a left side of the current block; generating a prediction block of the current block by using the reference sample; and filtering a sample adjacent to a top boundary and/or a left boundary of the current block among the prediction samples, in which when the current block is a non-square block, whether to filter the sample adjacent to the top boundary of the current block may be determined by considering only a width of the current block and whether to filter the sample adjacent to the left boundary of the current block may be determined by considering only a height of the current block.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: September 27, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyeongmoon Jang, Jaehyun Lim
  • Patent number: 11456970
    Abstract: Some embodiments provide novel circuits for augmenting the functionality of a data plane circuit of a forwarding element with one or more field programmable circuits and external memory circuits. The external memories in some embodiments serve as deep buffers that receive through one or more FPGAs a set of data messages from the data plane (DP) circuit to store temporarily. In some of these embodiments, one or more of the FPGAs implement schedulers that specify when data messages should be retrieved from the external memories and provided back to the data plane circuit for forwarding through the network. For instance, in some embodiments, a particular FPGA can perform a scheduling operation for a first set of data messages stored in its associated external memory, and can direct another FPGA to perform the scheduling operation for a second set of data messages stored in the particular FPGA's associated external memory.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: September 27, 2022
    Assignee: Barefoot Networks, Inc.
    Inventors: Antonin Mathieu Bas, Anurag Agrawal, Changhoon Kim
  • Patent number: 11451801
    Abstract: The present disclosure provides systems and methods for performing palette coding of video data. According to certain disclosed embodiments, the methods include: classifying pixels of a coding unit into a first plurality of clusters; and determining, according to the first plurality of clusters, a palette table for the coding unit.
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: September 20, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Ru-Ling Liao, Mohammed Golam Sarwer, Jie Chen, Yan Ye, Jiancong Luo
  • Patent number: 11451826
    Abstract: An apparatus of video decoding can include circuitry configured to receive a lossless mode flag associated with a current block indicating whether a lossless coding mode is applied to the current block, determine that a lossy coding mode is not applied to the current block when the lossless mode flag indicates that the lossless coding mode is applied to the current block, and reconstruct the current block with the lossy coding mode disabled.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: September 20, 2022
    Assignee: Tencent America LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu, Cheung Auyeung, Liang Zhao, Ling Li
  • Patent number: 11451773
    Abstract: A video encoder and video decoder may determine a set of adaptive loop filters, from among a plurality of sets of adaptive loop filters, on a per-block basis. Each set of adaptive loop filters may include filters from a previous picture, filters signaled for the current picture, and/or pre-trained filter. By varying the set of adaptive loop filters on a per-block basis, the adaptive loop filters available for each block of video data may be more adapted to local statistics of the video data.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: September 20, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Akshay Gadde, Vadim Seregin, Wei-Jung Chien