Predictive Patents (Class 375/240.12)
  • Patent number: 11457219
    Abstract: Disclosed are an image coding/decoding method and an apparatus therefor. Specifically, a method for decoding an image by a decoding apparatus may include: deriving an intra prediction mode of a current block; configuring reference samples with samples neighboring to an upper end and samples neighboring to a left side of the current block; generating a prediction block of the current block by using the reference sample; and filtering a sample adjacent to a top boundary and/or a left boundary of the current block among the prediction samples, in which when the current block is a non-square block, whether to filter the sample adjacent to the top boundary of the current block may be determined by considering only a width of the current block and whether to filter the sample adjacent to the left boundary of the current block may be determined by considering only a height of the current block.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: September 27, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyeongmoon Jang, Jaehyun Lim
  • Patent number: 11456970
    Abstract: Some embodiments provide novel circuits for augmenting the functionality of a data plane circuit of a forwarding element with one or more field programmable circuits and external memory circuits. The external memories in some embodiments serve as deep buffers that receive through one or more FPGAs a set of data messages from the data plane (DP) circuit to store temporarily. In some of these embodiments, one or more of the FPGAs implement schedulers that specify when data messages should be retrieved from the external memories and provided back to the data plane circuit for forwarding through the network. For instance, in some embodiments, a particular FPGA can perform a scheduling operation for a first set of data messages stored in its associated external memory, and can direct another FPGA to perform the scheduling operation for a second set of data messages stored in the particular FPGA's associated external memory.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: September 27, 2022
    Assignee: Barefoot Networks, Inc.
    Inventors: Antonin Mathieu Bas, Anurag Agrawal, Changhoon Kim
  • Patent number: 11457207
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block according to a rule, where the rule specifies a relationship between samples of the current video block and matrices or offset values applied in a matrix weighted intra prediction (MIP) mode during the conversion, and where the MIP mode includes determining a prediction block of the current video block by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation.
    Type: Grant
    Filed: August 11, 2021
    Date of Patent: September 27, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11457211
    Abstract: In video coding, a transform can be selected from multiple transform sets. To efficiently implement multiple transforms, a unified architecture of implementing the Discrete Trigonometric Transforms (DTTs) or flipped DTT can be used. In the proposed unified architecture, the relationships between the transforms are utilized. In particular, all transforms can be implemented based on DCT-II, DCT-IV, a reverse order operation, and a sign changing operation for odd elements. The DCT-II can be implemented at a minimum size, and other sizes for DCT-II can be implemented recursively from the minimum size DCT-II and DCT-IV at various sizes. In one example, the multiple transforms are {DCT-II, DST-II, DCT-III, DST-III, DCT-IV, DST-IV}. The relationships between transforms can also be used to guide the design of additional transforms that can be implemented by the unified architecture.
    Type: Grant
    Filed: April 29, 2019
    Date of Patent: September 27, 2022
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Karam Naser, Tangi Poirier, Gagan Bihari Rath
  • Patent number: 11451829
    Abstract: An apparatus for video decoding includes processing circuitry configured to receive a split direction syntax element, a first index syntax element, and a second index syntax element that are associated with a coding block coded with a triangular prediction mode. The coding block can be partitioned into two triangular prediction units according to a split direction indicated by the split direction syntax element. The first and second index syntax elements can indicate a first merge index and a second merge index to a merge candidate list constructed for the two triangular prediction units. The coding block can be reconstructed according to the split direction, the first merge index, and second merge index.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: September 20, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Meng Xu, Xiang Li, Shan Liu
  • Patent number: 11451773
    Abstract: A video encoder and video decoder may determine a set of adaptive loop filters, from among a plurality of sets of adaptive loop filters, on a per-block basis. Each set of adaptive loop filters may include filters from a previous picture, filters signaled for the current picture, and/or pre-trained filter. By varying the set of adaptive loop filters on a per-block basis, the adaptive loop filters available for each block of video data may be more adapted to local statistics of the video data.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: September 20, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Akshay Gadde, Vadim Seregin, Wei-Jung Chien
  • Patent number: 11451781
    Abstract: A method for decoding a video according to the present invention may comprise: deriving a reference sample for a current block, determining an intra prediction mode of the current block, and obtaining a prediction sample for the current block by using the reference sample and the intra prediction mode.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: September 20, 2022
    Assignee: KT CORPORATION
    Inventor: Bae Keun Lee
  • Patent number: 11451801
    Abstract: The present disclosure provides systems and methods for performing palette coding of video data. According to certain disclosed embodiments, the methods include: classifying pixels of a coding unit into a first plurality of clusters; and determining, according to the first plurality of clusters, a palette table for the coding unit.
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: September 20, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Ru-Ling Liao, Mohammed Golam Sarwer, Jie Chen, Yan Ye, Jiancong Luo
  • Patent number: 11451783
    Abstract: An image decoding method performed by a decoding device according to the present document comprises the steps of: deriving a context model for a sign flag of a current residual coefficient of a current block; and decoding the sign flag on the basis of the context model, wherein the context model for the sign flag is derived on the basis of a sign flag of a residual coefficient decoded before the current residual coefficient in the current block.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: September 20, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunmi Yoo, Jin Heo, Jungah Choi, Seunghwan Kim
  • Patent number: 11451769
    Abstract: A method of and device for controlling multi-line intra prediction using a non-zero reference line. The method includes determining whether an intra prediction mode of a first neighboring block of a current block is an angular mode, determining whether an intra prediction mode of a second neighboring block of the current block is an angular mode, and generating a Most Probable Mode (MPM) list of the current block.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: September 20, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11451826
    Abstract: An apparatus of video decoding can include circuitry configured to receive a lossless mode flag associated with a current block indicating whether a lossless coding mode is applied to the current block, determine that a lossy coding mode is not applied to the current block when the lossless mode flag indicates that the lossless coding mode is applied to the current block, and reconstruct the current block with the lossy coding mode disabled.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: September 20, 2022
    Assignee: Tencent America LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu, Cheung Auyeung, Liang Zhao, Ling Li
  • Patent number: 11451832
    Abstract: Devices, systems and methods related to management of syntax flags with respect chroma formats in video processing are described. In one representative aspect, a video decoding method includes determining, based on a chroma format of a video comprising a region, whether one or more syntax flags applicable to the region of the video are absent in a syntax structure of a coded representation of the video. The one or more syntax flags are indicative of usage of a luma-dependent chroma residue scaling coding step for representing the region in the coded representation. The luma-dependent chroma residue scaling coding step comprises a scaling process in which a scaling coefficient is derived based on reconstructed luma samples and the scaling process is applied to a chroma residue. The method also includes generating one or more decoded video blocks of the video region by parsing the coded representation according to the determining.
    Type: Grant
    Filed: August 18, 2021
    Date of Patent: September 20, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11451831
    Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry is configured to decode coding information for a current block of a current picture. The coding information can indicate a coding mode for the current block being one of: an intra block copy (IBC) mode and a string copy mode. The processing circuitry is configured to determine current vector information for a current unit of samples in the current block based on the coding mode for the current block and a history buffer. The history buffer can be configured to store vector information of at least a block previously decoded in the IBC mode and a string previously decoded in the string copy mode. The processing circuitry is configured to reconstruct the current unit of samples based on the current vector information.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: September 20, 2022
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Shan Liu
  • Patent number: 11451837
    Abstract: The present invention enables efficient decoding by using DR mapping information between a base layer and an enhancement layer in various manners in an HDR decoder considering backward compatibility.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: September 20, 2022
    Assignee: KWANGWON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
    Inventors: Donggyu Sim, Seanae Park, Yongjo Ahn, Jonghyun Ma, Jeongyun Lim
  • Patent number: 11445203
    Abstract: A video coder is configured to determine a split type of a block of video data from an intra prediction mode associated with a neighboring block. The video coder may determine an intra prediction mode associated with a neighboring block of the current block of video data, determine a split type of the current block of video data based on the intra prediction mode associated with the neighboring block, split the current block of video data into a plurality of sub-partitions based on the determined split type, and code the plurality of sub-partitions.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: September 13, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Luong Pham Van, Geert Van der Auwera, Adarsh Krishnan Ramasubramonian, Marta Karczewicz
  • Patent number: 11445230
    Abstract: In one example, a method performed by a processing system including at least one processor includes obtaining a first stream of audio and video data, wherein the first stream of audio and video data comprises a lower-resolution version of a second stream of audio and video data that is transmitted to a first user device over a content distribution network and encrypted using a high-bandwidth digital content protection protocol, performing an analysis technique on the first stream of audio and video data in order to extract audio and video artifacts which from which content of the first stream of audio and video data is inferred, deriving a signature marker from the audio and video artifacts, and sending the signature marker to the first user device.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: September 13, 2022
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: James Gordon Beattie, Jr., Haywood S. Peitzer
  • Patent number: 11445224
    Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques, and in particular, sub-block shapes in extended quadtree partitioning, are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block, where a size of the current visual media block is M×N, and the size of the at least one sub-block is based on a minimum value between M and N, or a maximum value between M and N; decoding, based on a bitstream representation, the four sub-blocks; and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: September 13, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Hsiao Chiang Chuang, Yue Wang
  • Patent number: 11445189
    Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure may include determining whether a prediction mode of a current block is an intra prediction mode based on information on the prediction mode of the current block, determining whether intra sub-partitions (ISP) is available for the current block, when the prediction mode of the current block is an intra prediction mode, decoding an ISP application indicator indicating whether to apply ISP to the current block, when ISP is available for the current block, and generating a prediction block for the current block by applying ISP to the current block, upon determining that ISP applies to the current block based on the ISP application indicator.
    Type: Grant
    Filed: September 10, 2021
    Date of Patent: September 13, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Ling Li, Jin Heo, Moonmo Koo, Jung Hak Nam
  • Patent number: 11445216
    Abstract: An image decoding method according to the present document may comprise the steps of: deriving an intra prediction mode for a current block; deriving reference samples located around the current block; generating a prediction sample for the current block on the basis of the intra prediction mode and the reference samples; and generating residual samples for the current block on the basis of the prediction sample, wherein the step of generating the prediction sample for the current block may comprise the steps of: deriving an interpolation filter, which is to be applied to the reference sample, on the basis of the prediction mode of the current block or the size of the current block; and generating the prediction sample by applying the derived interpolation filter to the reference sample.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: September 13, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunmi Yoo, Jin Heo
  • Patent number: 11445207
    Abstract: A video hardware engine which support dynamic frame padding is disclosed. The video hardware engine includes an external memory. The external memory stores a reference frame. The reference frame includes a plurality of reference pixels. A motion estimation (ME) engine receives a current LCU (largest coding unit), and defines a search area around the current LCU for motion estimation. The ME engine receives a set of reference pixels corresponding to the current LCU. The set of reference pixels of the plurality of reference pixels are received from the external memory. The ME engine pads a set of duplicate pixels along an edge of the reference frame when a part area of the search area is outside the reference frame.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: September 13, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Hetul Sanghvi, Mihir Narendra Mody, Niraj Nandan, Mahesh Madhukar Mehendale, Subrangshu Das, Dipan Kumar Mandal, Nainala Vyagrheswarudu, Vijayavardhan Baireddy, Pavan Venkata Shastry
  • Patent number: 11438579
    Abstract: Embodiments of the present disclosure provide a method and an apparatus for processing a video signal through intra prediction.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: September 6, 2022
    Assignee: LG Electronics Inc.
    Inventors: Jin Heo, Seunghwan Kim, Junghak Nam, Sunmi Yoo, Ling Li, Jaehyun Lim, Jangwon Choi, Jungah Choi
  • Patent number: 11438613
    Abstract: A method of visual media processing includes determining a size of a buffer to store reference samples for prediction in an intra block copy mode; and performing a conversion between a current video block of visual media data and a bitstream representation of the current video block, using the reference samples stored in the buffer, wherein the conversion is performed in the intra block copy mode which is based on motion information related to a reconstructed block located in same video region with the current video block without referring to a reference picture.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: September 6, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11438611
    Abstract: Method and apparatus of coding a video sequence, are disclosed. According to the method, a bitstream corresponding to encoded data of the video sequence is generated at an encoder side or received at a decoder side, where the bitstream complies with a bitstream conformance that one or more constraints are satisfied. The constraints are related to a set of RPR (Reference Picture Resampling) parameters including scaling window width or height of a current picture, scaling window width or height of a reference picture, current picture width or height, and maximum picture width or height specified for the video sequence. Scaling information for the RPR mode is derived using the set of RPR parameters. A target picture of the video sequence is then encoded at the encoder side or decoded at the decoder side by utilizing the scaling information when the RPR mode is enabled for the target picture.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: September 6, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Chih-Wei Hsu, Ching-Yeh Chen, Chia-Ming Tsai, Chun-Chia Chen, Olena Chubach, Yu-Wen Huang
  • Patent number: 11438573
    Abstract: An image sensor may include an array of imaging pixels and verification circuitry. Row control circuitry including row drivers may provide control signals to the pixels in the array of imaging pixels. The verification circuitry may test proper operation of the row drivers. The verification circuitry be configured to pre-charge the first and second storage capacitors to a first bias voltage, intentionally discharge the first and second storage capacitors to a second bias voltage, reset only the first storage capacitor back to the first bias voltage, and use a first sample from the first storage capacitor and a second sample from the second storage capacitor to test operation of the row driver. If the row driver is operating correctly, a voltage swing will be detected between the two samples. If the row driver is stuck high or stuck low, the first and second samples may be the same.
    Type: Grant
    Filed: December 2, 2019
    Date of Patent: September 6, 2022
    Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
    Inventors: Anirudh Oberoi, Gurvinder Singh
  • Patent number: 11438609
    Abstract: In one implementation, an apparatus is provided for encoding or decoding video information. The apparatus comprises a memory configured to store inter-layer reference pictures associated with a current picture that is being coded. The apparatus further comprises a processor operationally coupled to the memory. In one embodiment, the processor is configured to indicate a number of inter-layer reference pictures to use to predict the current picture using inter-layer prediction. The processor is also configured to indicate which of the inter-layer reference pictures to use to predict the current picture using inter-layer prediction. The processor is also configured to determine an inter-layer reference picture set associated with the current picture using the indication of the number of inter-layer reference pictures and the indication of which of the inter-layer reference pictures to use to predict the current picture using inter-layer prediction.
    Type: Grant
    Filed: April 1, 2014
    Date of Patent: September 6, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Jianle Chen, Krishnakanth Rapaka, Ying Chen
  • Patent number: 11438582
    Abstract: A method for decoding a video according to the present invention may comprise: deriving a plurality of reference sample lines for a current block, selecting at least two among the plurality of reference sample lines, and performing intra prediction for the current block based on the selected reference sample lines.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: September 6, 2022
    Assignee: KT CORPORATION
    Inventor: Bae Keun Lee
  • Patent number: 11438619
    Abstract: A moving picture coding method includes (i) transforming, for each of one or more second processing units included in the first processing unit, a moving picture signal in a spatial domain into a frequency domain coefficient and quantizing the frequency domain coefficient, and (ii) performing arithmetic coding on a luminance CBF flag indicating whether or not a quantized coefficient is included in the second processing unit in which transform and quantization are performed, wherein, in the arithmetic coding, a probability table for use in arithmetic coding is determined according to whether or not the size of the first processing unit is identical to the size of the second processing unit and whether or not the second processing unit has a predetermined maximum size.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: September 6, 2022
    Assignee: SUN PATENT TRUST
    Inventors: Hisao Sasai, Takahiro Nishi, Youji Shibahara, Toshiyasu Sugio, Kyoko Tanikawa, Toru Matsunobu
  • Patent number: 11431964
    Abstract: Devices, systems and methods for digital video coding, which include sub-block based inter prediction methods, are described. An exemplary method for video processing includes determining, for a conversion between a current block of video and a bitstream representation of the video, a maximum number of candidates in a sub-block based merge candidate list and/or whether to add sub-block based temporal motion vector prediction (SbTMVP) candidates to the sub-block based merge candidate list based on whether temporal motion vector prediction (TMVP) is enabled for use during the conversion or whether a current picture referencing (CPR) coding mode is used for the conversion, and performing, based on the determining, the conversion.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: August 30, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11431996
    Abstract: A method of decoding a bistream by an electronic device is provided. A block unit is determined from an image frame according to the bitstream. A line index determined in the bitstream is compared with a first predefined value to determine whether a mode flag is included in the bitstream. A mode index is determined for directly selecting a prediction mode of the block unit from a most probable mode (MPM) list of the block unit when the mode flag is not included in the bitstream. The mode flag is compared to a second predefined value when the mode flag is included in the bitstream to determine whether the prediction mode is selected from the MPM list. One of a plurality of reference lines is selected based on the line index. The block unit is reconstructed based on the selected reference line and the prediction mode.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: August 30, 2022
    Assignee: FG Innovation Company Limited
    Inventors: Hui-Yu Jiang, Yao-Jen Chang
  • Patent number: 11432012
    Abstract: A method for encoding digital images or video streams, includes a receiving phase, wherein a portion of an image is received; a graph weights prediction phase, wherein the elements of a weights matrix associated to the graph related to the blocks of the image (predicted blocks) are predicted on the basis of reconstructed, de-quantized and inverse-transformed pixel values of at least one previously coded block (predictor block) of the image, the weights matrix being a matrix comprising elements denoting the level of similarity between a pair of pixels composing said image, a graph transform computation phase, wherein the graph Fourier transform of the blocks of the image is performed, obtaining for the blocks a set of coefficients determined on the basis of the predicted weights; a coefficients quantization phase, wherein the coefficients are quantized an output phase wherein a bitstream comprising the transformed and quantized coefficients is transmitted and/or stored.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: August 30, 2022
    Assignee: Sisvel Technology S.R.L.
    Inventors: Marco Grangetto, Francesco Verdoja
  • Patent number: 11431991
    Abstract: The present disclosure provides a chroma block prediction method and a device. The method includes: parsing a bitstream to obtain first indication information; downsampling a first luma block by a first filter when a value of the first indication information is a first value or by using a second filter when a value of the first indication information is a second value, to obtain a second luma block; obtaining a plurality of chroma samples and a plurality of luma samples; obtaining linear model coefficients based on the plurality of chroma samples and the plurality of luma samples; and obtaining a prediction value of the current chroma block based on the second luma block and the linear model coefficients.
    Type: Grant
    Filed: February 3, 2021
    Date of Patent: August 30, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Xiang Ma, Haitao Yang, Jianle Chen
  • Patent number: 11431999
    Abstract: The present disclosure relates to a method for embedding key information in an image, the method comprising reserving a range of DMZ values, in a predetermined range of 2N values used for storing useful data in the image, the reserved range being used for storing a key information associated with at least one coordinates in the image, with N>0 and DMZ<<2N.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: August 30, 2022
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Julien Fleureau, Renaud Dore, Thierry Tapie
  • Patent number: 11431971
    Abstract: A method and an image processing apparatus for video coding are provided. The method is adapted to the image processing apparatus and includes following steps. A current coding unit is received, and filter selection is performed according to a size of the current coding unit. At least one selected filter is used to perform a filtering operation on a plurality of reference boundaries of the current coding unit to generate a plurality of filtering reference values. An interpolation operation is performed on the current coding unit according to the filtering reference values to generate a plurality of interpolated prediction values.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: August 30, 2022
    Assignee: Industrial Technology Research Institute
    Inventors: Chang-Hao Yau, Bing-Jung Fuh, Ching-Chieh Lin
  • Patent number: 11431983
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a first determination that a luma video block of a video is coded using a matrix based intra prediction (MIP) mode in which a prediction block of the luma video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, performing, based on the first determination, a second determination about a chroma intra mode to be used for a chroma video block associated with the luma video block, and performing, based on the second determination, a conversion between the chroma video block and a bitstream representation of the chroma video block.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: August 30, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11431972
    Abstract: An image coding apparatus includes a coded data generating unit configured to generate coded data including image data for a subpicture acquired by dividing a picture, where the coded data generating unit generates, on a per subpicture basis, a subpicture header including subpicture identification information used for identifying the subpicture, and causes the generated subpicture header to be included in the coded data.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: August 30, 2022
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventors: Tomoko Aono, Takeshi Chujoh, Tomohiro Ikai, Yukinobu Yasugi
  • Patent number: 11431966
    Abstract: Video coding and decoding methods are described. In example method includes performing a conversion between a current video block of a video and a bitstream representation of the current video block by determining a first intra coding mode to be stored which is associated with the current video block using a differential coding mode, where the first intra coding mode associated with the current video block is determined according to a second prediction mode used by the differential coding mode, and where, in the differential coding mode, a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual is represented in the bitstream representation for the current video block using a differential pulse coding modulation (DPCM) representation.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: August 30, 2022
    Assignee: BYTEDANCE INC.
    Inventors: Weijia Zhu, Li Zhang, Jizheng Xu, Hsiao Chiang Chuang
  • Patent number: 11431975
    Abstract: A video decoding method includes obtaining information indicating a first difference between a maximum size of a coding unit having a 1:4 ratio and a size of a largest coding unit, determining the maximum size of the coding unit of having the 1:4 ratio by using the size of the largest coding unit and the first difference, determining a minimum size of the coding unit having the 1:4 ratio based on a minimum size of a coding unit, determining whether a coding having the 1:4 ratio may be generated by splitting a first coding unit based on the maximum size and the minimum size of the coding unit having the 1:4 ratio, and determining a second coding unit including the coding unit having the 1:4 ratio, from the first coding unit, and decoding the second coding unit.
    Type: Grant
    Filed: September 21, 2021
    Date of Patent: August 30, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Minsoo Park, Minwoo Park, Kiho Choi, Yinji Piao, Seungsoo Jeong, Narae Choi, Woongil Choi, Anish Tamse
  • Patent number: 11431968
    Abstract: A video coder determines a first block of the video data is intra mode coded; based on a first height and the first width of the first block, identifies a group of N available intra prediction modes for the first block of video data; selects from the group of N available intra prediction modes, a first intra prediction mode used to code the first block of the video data; and codes the first block using the first intra prediction mode. A video coder generates a first most probable mode (MPM) candidate list for the block; codes a first flag indicating an actual intra prediction mode used to code the block is not included in the first MPM candidate list; generates a second MPM candidate list by deriving at least one candidate intra prediction mode based on an intra prediction mode in the first MPM candidate list.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: August 30, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Vadim Seregin, Nan Hu, Wei-Jung Chien, Marta Karczewicz, Xin Zhao, Vijayaraghavan Thirumalai
  • Patent number: 11432006
    Abstract: A method, computer program, and computer system is provided for encoding or decoding video data. Video data including a chroma component having a first nominal angle and first delta angles and a luma component having a second nominal angle and second delta angles is received, whereby the first delta angles are dependent on the second delta angles. First delta angle values are signaled or parsed for the first delta angles based on at least an intra prediction mode associated with the luma component. The video data is encoded or decoded based on the first delta angle values corresponding to the first delta angles.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: August 30, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Shan Liu
  • Patent number: 11425393
    Abstract: A system for calculating token rates for video encoding includes a plurality of different probability lookup tables implemented in hardware, wherein each of the probability lookup tables specifically corresponds to a different prediction mode of a video codec. The system includes an application-specific integrated circuit compute unit. For each candidate prediction mode among the different prediction modes, the application-specific integrated circuit is configured to determine a rate distortion cost (RD Cost) for a video. The application-specific integrated circuit is configured to select one of the plurality of different probability lookup tables that corresponds to the candidate prediction mode and use the selected one of the plurality of different probability lookup tables to calculate a corresponding token rate for the candidate prediction mode.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: August 23, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Zhao Wang, Srikanth Alaparthi, Yunqing Chen, Baheerathan Anandharengan, Gaurang Chaudhari, Junqiang Lan, Harikrishna Madadi Reddy, Prahlad Rao Venkatapuram
  • Patent number: 11425392
    Abstract: A video encoding apparatus includes: an inter prediction unit to determine a motion parameter of a current block and generate a predicted block of the current block, by performing a motion estimation on the current block; and an optimal mode determining unit to set a prediction mode of the current block as a SKIP mode when (i) the motion parameter of the current block is identical to a motion parameter of a candidate block among a plurality of candidate blocks and (ii) all-zero coefficients result from a transform and a quantization performed on a residual data block representing the difference between the current block and the predicted block.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: August 23, 2022
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jeongyeon Lim, Joong Gunn Park, Byeungwoo Jeon, Haekwang Kim, Joohee Moon, Yunglyul Lee, Jongki Han, Jungyoup Yang, Jaehwan Kim, Kwanghyun Won, Hoyoung Lee
  • Patent number: 11425367
    Abstract: Wedgelet separation lines of neighboring blocks are predicted from each other by aligning the wedgelet separation lines of such neighboring blocks to each other, thereby reducing the side information coding rate that may be used.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: August 23, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Patent number: 11425378
    Abstract: A method and apparatus of prediction for video coding are disclosed. According to the method, when the Intra Sub-Partition (ISP) mode is applied to a block, the block is partitioned into multiple sub-blocks horizontally or vertically. A target horizontal transform and a target vertical transform are determined from a candidate transform set for each of the multiple sub-blocks according to a target setting belonging to a setting group comprising unified setting and block setting. The target horizontal transform and the target vertical transform selected are then applied to each of the multiple sub-blocks. According to another method, a target horizontal and vertical transform are determined from a candidate transform set without a transform index for the current block according to unified setting, wherein the unified setting comprises two or more Intra modes or Intra-related modes.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: August 23, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Man-Shu Chiang, Chih-Wei Hsu
  • Patent number: 11425397
    Abstract: Video encoding and decoding techniques for bi-prediction with weighted averaging are disclosed. According to certain embodiments, a computer-implemented video signaling method includes signaling, by a processor to a video decoder, a bitstream including weight information used for prediction of a coding unit (CU). The weight information indicates: if weighted prediction is enabled for a bi-prediction mode of the CU, disabling weighted averaging for the bi-prediction mode.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: August 23, 2022
    Assignee: Alibaba Group Holding Limited
    Inventor: Yan Ye
  • Patent number: 11425402
    Abstract: A method for sharing the motion estimation and mode decision results and decisions of one codec with another codec is disclosed. A video is received to be transcoded into a plurality of different output encodings of a plurality of different codecs. Each codec has a different video encoding format. A shared motion estimation and a shared mode decision processing of the video are performed. One or more results of the shared mode decision processing shared across the plurality of different codecs are used to encode the video into the plurality of different output encodings of the plurality of different codecs.
    Type: Grant
    Filed: April 22, 2021
    Date of Patent: August 23, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Gaurang Chaudhari, Hariharan G. Lalgudi, Harikrishna Madadi Reddy
  • Patent number: 11425330
    Abstract: A projector includes an image converting module, a processing module and an imaging module. The image converting module receives an original image sequence with a first frame rate. The image converting module inserts a plurality of supplement images into the original image sequence per second to output a supplement image sequence with a second frame rate, wherein the second frame rate is larger than the first frame rate. The processing module is coupled to the image converting module. The processing module receives the supplement image sequence from the image converting module. The processing module ignores the supplement images and processes and outputs the original image sequence. The imaging module is coupled to the processing module. The imaging module receives the original image sequence from the processing module and outputs the original image sequence by the first frame rate.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: August 23, 2022
    Assignee: Qisda Corporation
    Inventors: Tsai-Hsu Cheng, Chih-Wei Cho
  • Patent number: 11418813
    Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform parsing at least one video parameter set comprising at least one syntax element indicating whether at least one layer in the scalable bitstream is one of a dependent layer of the scalable bitstream and an independent layer of the scalable bitstream, determining a number of dependent layers, including the dependent layer, of the scalable bitstream based on a plurality of flags included in the VPS, decoding a picture in the dependent layer by parsing and interpreting an inter-layer reference picture list, and decoding a picture in an independent layer without parsing and interpreting the inter-layer reference picture list.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: August 16, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
  • Patent number: 11418778
    Abstract: A method of and an apparatus for controlling intra prediction for decoding of a video sequence are provided. The method includes, based on a reference line index signaling, to a decoder, a first reference line nearest to a coding unit, among a plurality of reference lines adjacent to the coding unit, applying intra smoothing on only the first reference line, based on the intra smoothing being applied only on the first reference line, applying intra prediction on the coding unit, and based on the intra prediction being applied on the coding unit, applying a position-dependent intra prediction combination (PDPC) on only the first reference line.
    Type: Grant
    Filed: February 10, 2021
    Date of Patent: August 16, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11412253
    Abstract: The present disclosure provides systems and methods for processing video data. A method includes: performing a decoder side motion vector refinement (DMVR) process to generate a bi-predicted signal, wherein performing the DMVR process comprises: determining a refined motion vector for a target coding unit, without using wrap-around motion compensation; determining whether the wrap-around motion compensation is enabled; and in response to a determination that the wrap-around motion compensation is enabled, generating, based on the refined motion vector, a bi-predicted signal using the wrap-around motion compensation.
    Type: Grant
    Filed: February 22, 2021
    Date of Patent: August 9, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Jiancong Luo, Yan Ye
  • Patent number: 11412236
    Abstract: A video decoding method performed by a decoding apparatus according to the present disclosure includes deriving one of a plurality of cross-component linear model (CCLM) prediction mode as a CCLM prediction mode of the current chroma block, deriving a sample number of neighboring chroma samples of the current chroma block based on the CCLM prediction mode of the current chroma block, a size of the current chroma block, and a specific value; deriving the neighboring chroma samples of the sample number, calculating CCLM parameters based on the neighboring chroma samples and the down sampled neighboring luma samples, deriving prediction samples for the current chroma block based on the CCLM parameters and the down sampled luma samples and generating reconstructed samples for the current chroma block based on the prediction samples, wherein the specific value is derived as 2.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: August 9, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Jangwon Choi, Jin Heo, Seunghwan Kim, Sunmi Yoo, Ling Li, Jungah Choi