Patents by Inventor Shan Liu
Shan Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250150638Abstract: An example method of video coding includes receiving a video bitstream for a plurality of encoded pictures. The method also includes deriving, using a first type of frame interpolation, a reconstruction picture for an encoded picture of the plurality of encoded pictures, and determining, based on a signaled indicator in the video bitstream, whether to apply loop filtering to the reconstruction picture. When the signaled indicator has a first value, a decoded picture for the encoded picture is derived by applying one or more loop filters to the reconstruction picture. When the signaled indicator has a second value, the decoded picture is derived without applying the one or more loop filters to the reconstruction picture.Type: ApplicationFiled: March 28, 2024Publication date: May 8, 2025Inventors: Xin Zhao, Liang Zhao, Jing Ye, Han Gao, Yushin Cho, Madhu Peringassery Krishnan, Shan Liu
-
Publication number: 20250150597Abstract: Aspects of the disclosure provide a method and an apparatus for video coding. In some examples, the apparatus includes processing circuitry for video encoding. The processing circuitry selects a resolution from a set of resolutions that includes a 1-integer-pel resolution and a 4-integer-pel resolution. A current block is encoded with an intra block copy mode based on the selected resolution. The processing circuitry determines a block vector of the current block. The processing circuitry determines a block vector difference of the current block based on the block vector and a block vector predictor of the current block. The block vector difference is in the selected resolution. The processing circuitry encodes prediction information indicating the selected resolution and the block vector difference.Type: ApplicationFiled: January 13, 2025Publication date: May 8, 2025Applicant: Tencent America LLCInventors: Xiaozhong XU, Xiang LI, Shan LIU
-
Publication number: 20250150631Abstract: An example method of video coding includes receiving a video bitstream for a plurality of encoded pictures. The method also includes deriving, using frame interpolation, a reconstruction picture for an encoded picture of the plurality of encoded pictures. The method further includes determining, based on a signaled indicator in the video bitstream, whether one or more quantization parameters for the encoded picture are signaled in the video bitstream. When the signaled indicator indicates that the one or more quantization parameters are signaled in the video bitstream, the one or more quantization parameters are parsed from the video bitstream. When the signaled indicator indicates that the one or more quantization parameters are not signaled in the video bitstream, the one or more quantization parameters are derived at the decoder.Type: ApplicationFiled: March 28, 2024Publication date: May 8, 2025Inventors: Xin Zhao, Shan Liu
-
Publication number: 20250150586Abstract: A video bitstream including coded information of a current block in a current picture is received. The current block is divided into a plurality of subblocks based on a region division shape of a plurality of region division shapes that is associated with an intra prediction mode of the current block. A weight set is determined for each of the plurality of subblocks, where the weight set includes a first weight for an intra prediction of the respective subblock and a second weight for an inter prediction of the respective subblock. Each of the plurality of subblocks is reconstructed based on the weight set, the intra prediction, and the inter prediction that are associated with the respective subblock.Type: ApplicationFiled: October 22, 2024Publication date: May 8, 2025Applicant: Tencent America LLCInventors: Yonguk YOON, Shan LIU, Roman CHERNYAK, Biao WANG, Lien-Fei CHEN, Motong XU, Xin ZHAO, Ziyue XIANG
-
Publication number: 20250150621Abstract: An example method of video decoding includes decoding prediction information for a current block, the prediction information indicating a plurality of combinations of processed reconstructed samples and corresponding output values of a filtering process. The method also includes performing the filtering process on processed reconstructed samples of a first color component of the current block, the processed reconstructed samples of the first color not being included in the plurality of combinations of the processed reconstructed samples indicated in the prediction information. The method further includes determining an output value of the filter process based on one of: a default value, a predicted output value, and one of the output values indicated in the prediction information; and reconstructing the current block based on the output value being applied to reconstructed samples of a second color component of the current block, the second color component being different from the first color component.Type: ApplicationFiled: January 10, 2025Publication date: May 8, 2025Inventors: Yixin DU, Xun Zhao, Shan Liu
-
Publication number: 20250150592Abstract: The various implementations described herein include methods and systems for coding video. In one aspect, a video bitstream includes a current coding block of an image frame and signals a first syntax element for a multi-hypothesis cross-component prediction (MH-CCP) mode. A computing system determines that the MH-CCP mode is enabled to reconstruct each of a plurality of chroma samples of the current coding block using a respective luma sample and one or more neighboring luma samples. The computing device determines a number (N) of model parameters used in the MH-CCP mode for at least the current coding block, and identifies one or more neighboring luma samples of a first luma sample based on the number (N) of model parameters. A first chroma sample that is collocated with the first luma sample is determined based on the first luma sample and the one or more neighboring luma samples.Type: ApplicationFiled: March 29, 2024Publication date: May 8, 2025Inventors: Jing YE, Xin ZHAO, Liang ZHAO, Han GAO, Shan LIU
-
Publication number: 20250150578Abstract: A method includes receiving a current picture, a first reference picture, and a second reference picture. The method includes obtaining a plurality of predefined weighting patterns, each weighting pattern being signaled as an index value and selecting a weighting pattern based on a predetermined condition. The method includes deriving a first weight to be applied to a first sub-block in the first reference picture and a second weight to be applied to a second sub-block in the second reference picture based on the index value corresponding to the selected weighting pattern. The method includes assigning the first weight to the first sub-block and the second weight to the second sub-block based on the selected weighting pattern. The method includes decoding the current block by a weighted bi-prediction based at least on the first sub-block weighted by the first weight and the second sub-block weighted by the second weight.Type: ApplicationFiled: January 10, 2025Publication date: May 8, 2025Applicant: TENCENT AMERICA LLCInventors: Madhu Peringassery KRISHNAN, Xin ZHAO, Liang ZHAO, Han GAO, Xiaozhong XU, Shan LIU
-
Patent number: 12294720Abstract: Neural network based substitutional end-to-end (E2E) image compression (NIC) being performed by at least one processor and includes receiving an input image to an E2E NIC framework, determining a step size of the input image indicating a learning rate of a training model, determining a substitute image based on the training model, encoding the substitute image in lieu of the input image to generate a bitstream, and mapping the substitute image to the bitstream to generate a compressed representation. Further, step size may be determined by a scheduler and change throughout the training of the training model. The image may also be split into patches for which a scheduler is assigned for each patch and each patch is encoded instead of the entire input image.Type: GrantFiled: October 13, 2021Date of Patent: May 6, 2025Assignee: TENCENT AMERICA LLCInventors: Sheng Lin, Ding Ding, Wei Jiang, Wei Wang, Xiaozhong Xu, Shan Liu
-
Patent number: 12294730Abstract: A pruning method of neural network based video coding of a current block of a picture of a video sequence is performed by at least one processor and includes categorizing parameters of a neural network into groups, setting a first index to indicate that a first group of the groups is to be pruned, and a second index to indicate that a second group of the groups is not to be pruned, and transmitting, to a decoder, the set first index and the set second index. Based on the transmitted first index and the transmitted second index, the current block is processed using the parameters of which the first group of the groups is pruned.Type: GrantFiled: June 20, 2023Date of Patent: May 6, 2025Assignee: TENCENT AMERICA LLCInventors: Xiaozhong Xu, Wei Jiang, Shan Liu, Wei Wang
-
Patent number: 12294693Abstract: A method of video processing in a decoder includes determining, by a processor, an initial block vector for predicting a current block in a current coding tree unit (CTU) in response to the current block being predicted in an intra block copy (IBC) mode. The initial block vector is determined based on a merge index included in a coded video bitstream. The method further includes performing, by the processor, template matching based on the initial block vector indicated by the merge index in the video bitstream to determine a refined block vector that points to a reference block in a picture as the current block, and reconstructing, by the processor, the current block based on the reference block.Type: GrantFiled: August 29, 2022Date of Patent: May 6, 2025Assignee: Tencent America LLCInventors: Ling Li, Xiang Li, Shan Liu
-
Patent number: 12293274Abstract: A method of unification based coding for neural network model compression is performed by at least one processor and includes receiving a layer uniform flag indicating whether a quantized weight of an input neural network is encoded using a uniform coding method, and determining whether the quantized weight is encoded using the uniform coding method, based on the received layer uniform flag. The method further includes, based on the quantized weight being determined to be encoded using the uniform coding method, encoding the quantized weight, using the uniform coding method, and based on the quantized weight being determined to not be encoded using the uniform coding method, encoding the quantized weight, using a non-uniform coding method.Type: GrantFiled: July 1, 2021Date of Patent: May 6, 2025Assignee: TENCENT AMERICA LLCInventors: Wei Wang, Wei Jiang, Shan Liu
-
Signaling of reference picture resampling with resampling picture size indication in video bitstream
Patent number: 12294710Abstract: A method, device, and computer-readable medium for decoding an encoded video bitstream using at least one processor, including obtaining a first flag indicating that a conformance window is present in a current picture; based on the first flag indicating that the conformance window is present, obtaining a second flag indicating whether the conformance window is used for reference picture resampling; based on the second flag indicating that the conformance window is used for the reference picture resampling, determining a resampling ratio between the current picture and a reference picture based on a conformance window size of the conformance window; based on the second flag indicating that the conformance window is not used for the reference picture resampling, determining the resampling ratio based on a resampling picture size; and performing the reference picture resampling on the current picture using the resampling ratio.Type: GrantFiled: September 15, 2023Date of Patent: May 6, 2025Assignee: TENCENT AMERICA LLCInventors: Byeongdoo Choi, Stephan Wenger, Shan Liu -
Patent number: 12294722Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. An apparatus for video decoding includes processing circuitry. The processing circuitry checks an inferable condition for a flag of a specific prediction mode for a current block before parsing the flag of the specific prediction mode for the current block from a coded video bitstream. The specific prediction mode is one of a plurality of inter picture prediction modes. When the inferable condition indicates that the flag is inferable, the processing circuitry infers the flag without parsing the flag from the coded video bitstream. When the inferable condition indicates uncertainty for inferring the flag, the processing circuitry parses the flag from the coded video bitstream. Then, the processing circuitry reconstructs the current block according to the specific prediction mode when the flag is indicative of an application of the specific prediction mode on the current block.Type: GrantFiled: July 28, 2021Date of Patent: May 6, 2025Assignee: Tencent America LLCInventors: Jing Ye, Xiang Li, Shan Liu
-
Patent number: 12294390Abstract: Systems and methods for encoding and decoding neural network data is provided. A method includes: obtaining an independent neural network with a topology; encoding the independent neural network with the topology such as to obtain a neural network representation (NNR) bitstream; and sending the NNR bitstream to a decoder, wherein the NNR bitstream includes a group of NNR units (GON) that represents the independent neural network with the topology, and the GON includes an NNR model parameter set unit, an NNR layer parameter set unit, an NNR topology unit, an NNR quantization unit, and an NNR compressed data unit.Type: GrantFiled: January 13, 2023Date of Patent: May 6, 2025Assignee: TENCENT AMERICA LLCInventors: Byeongdoo Choi, Wei Wang, Wei Jiang, Stephan Wenger, Shan Liu
-
Patent number: 12294694Abstract: Methods, apparatus, and computer readable storage medium for intra bi-prediction and multiple reference line intra prediction in video decoding. The method includes receiving, by a device, a coded video bitstream for a block. The method also includes determining, by the device, whether a single directional intra prediction or an intra bi-prediction applies to the block, based on mode information of the block, the mode information of the block comprising at least one of: a reference line index of the block, an intra prediction mode of the block, and a size of the block; in response to determining that the single directional intra prediction applies to the block, performing, by the device, the single directional intra prediction to the block; and in response to determining that the intra bi-prediction applies to the block, performing, by the device, the intra bi-prediction to the block.Type: GrantFiled: October 26, 2023Date of Patent: May 6, 2025Assignee: Tencent America LLCInventors: Liang Zhao, Xin Zhao, Shan Liu
-
Publication number: 20250142048Abstract: The various implementations described herein include methods and systems for coding video. In one aspect, a method includes receiving a video bitstream comprising a set of encoded video information and a first indicator associated with a plurality of probability models. The method includes determining a value of the first indicator by parsing the video bitstream. The method includes, when the first indicator has a first value, selecting a first probability model from the plurality of probability models and when the first indicator has a second value, selecting a second probability model from the plurality of probability models, the second probability model being different from the first probability model. The method also includes entropy decoding the set of encoded video information using the selected probability model.Type: ApplicationFiled: May 29, 2024Publication date: May 1, 2025Inventors: Yushin CHO, Xin ZHAO, Madhu PERINGASSERY KRISHNAN, Liang ZHAO, Jing YE, Han GAO, Shan LIU
-
Publication number: 20250142071Abstract: An example method of video coding includes receiving a video bitstream that includes a plurality of blocks. The method also includes determining a scanning order for a motion vector list for a first block of the plurality of blocks based on one or more of: a number of neighboring blocks of the current block with corresponding temporal motion vectors, a number of neighboring blocks of the current block encoded in an inter prediction mode, a mode of the current block, and a reference frame index for the current block. The method further includes generating the motion vector list according to the scanning order and identifying, from the motion vector list, a motion vector predictor for the current block. The method also includes decoding the current block using the identified motion vector predictor.Type: ApplicationFiled: May 20, 2024Publication date: May 1, 2025Inventors: Liang ZHAO, Xin ZHAO, Han GAO, Jing YE, Shan LIU
-
Publication number: 20250142055Abstract: A feature value is determined based on at least one of (i) neighboring reconstructed chroma samples of a current chroma block and (ii) neighboring reconstructed luma samples of a luma block that is collocated with the current chroma block. Chroma samples of the current chroma block and luma samples of the luma block that is collocated with the current chroma block are grouped into a plurality of groups based on a threshold of the feature value. Each of the plurality of groups includes a respective chroma sample and a respective luma sample. A respective cross-component prediction mode is determined for each of the plurality of groups by comparing the respective chroma sample and the respective luma sample of each respective group to the determined feature value. The current chroma block is reconstructed based on the determined cross-component prediction modes of the plurality of groups.Type: ApplicationFiled: January 6, 2025Publication date: May 1, 2025Applicant: Tencent America LLCInventors: Xin ZHAO, Guichun LI, Lien-Fei CHEN, Shan LIU
-
Publication number: 20250142061Abstract: Various implementations described herein include methods and systems for coding video. In one aspect, a video bitstream includes a current image frame and a first syntax element for a cross-component sample offset (CCSO) mode. The first syntax element indicates whether to generate a first sample offset of a first color sample of the current image frame based on one or more luma samples. An electronic device identifies a first luma sample that is collocated with the first color sample and neighboring luma sample(s) s of the first luma sample. The first luma sample and the one neighboring luma sample(s) are downsampled to generate downsampled luma sample(s) for the CCSO mode. The electronic device determines the first sample offset of the first color sample based on the downsampled luma sample(s), and reconstructs the current image frame at least by adjusting the first color sample based on the first sample offset.Type: ApplicationFiled: May 9, 2024Publication date: May 1, 2025Inventors: Han Gao, Xin Zhao, Liang Zhao, Shan Liu, Jing Ye
-
Publication number: 20250142060Abstract: An example method of video coding includes receiving a video bitstream for a plurality of encoded pictures. The method also includes obtaining a reconstructed picture that corresponds to an encoded picture of the plurality of encoded pictures and deriving a set of quantization parameters for the reconstructed picture, the set of quantization parameters derived from a set of reference quantization parameters for the encoded picture. The method further includes performing loop filtering on the reconstructed picture using the set of quantization parameters.Type: ApplicationFiled: March 28, 2024Publication date: May 1, 2025Inventors: Xin ZHAO, Han GAO, Liang ZHAO, Jing YE, Shan LIU