Patents by Inventor Shan Liu

Shan Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11949894
    Abstract: An apparatus for video decoding includes processing circuitry. The processing circuitry determines a string vector for a current string in a current coding tree unit (CTU). The string vector points to a reference string for the current string. The processing circuitry determines that the string vector satisfies a requirement for an allowance of a partial overlapping of the current string and the reference string, and then reconstructs the current string based on the reference string.
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiaozhong Xu, Shan Liu
  • Patent number: 11949892
    Abstract: A method and apparatus for neural network based cross component prediction with low-bit precision during encoding or decoding of an image frame or a video sequence, which may include reconstructing a chroma component based on a received luma component using a pre-trained deep neural network (DNN) cross component prediction (CCP) model for chroma prediction, and updating a set of parameters of the pre-trained DNN CCP model with low-bit precision. The method may also include generating an updated DNN CCP model for chroma prediction with low-bit precision based on at least one video sequence, and using the updated DNN CCP model for cross component prediction of the at least one video sequence at reduced processing time.
    Type: Grant
    Filed: May 26, 2022
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Sheng Lin, Wei Jiang, Wei Wang, Shan Liu, Xiaozhong Xu
  • Patent number: 11949850
    Abstract: A method of selecting a reference sample used to encode a current block in an encoded video bitstream using at least one processor includes determining that a constrained intra prediction (CIP) mode is enabled; determining that a neighboring sample of the current block belongs to a coding block that is coded using intra block copy (IBC) coding; based on the determining that the neighboring sample belongs to the coding block that is coded using the IBC coding, selecting the neighboring sample as the reference sample; and encoding the current block using intra prediction coding based on the reference sample.
    Type: Grant
    Filed: August 19, 2021
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Xiang Li, Liang Zhao, Shan Liu
  • Patent number: 11949896
    Abstract: Aspects of the disclosure provide a method and an apparatus for video encoding. Whether a block size cbSize of a chroma block in luma samples is less than or equal to a minimum allowed chroma quaternary tree (QT) leaf node size MinQtSizeC in luma samples such that cbSize <=MinQtSizeC is determined. In response to the block size cbSize of the chroma block in luma samples being less than or equal to the minimum allowed chroma QT leaf node size MinQtSizeC in luma samples, a QT split is determined as disallowed for the chroma block. Partition information indicating that a chroma coding tree structure in a dual tree is applied to the chroma block is generated, the partition information further indicating the block size cbSize of the chroma block in luma samples and the minimum allowed chroma QT leaf node size MinQtSizeC in luma samples.
    Type: Grant
    Filed: August 1, 2022
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Guichun Li, Xiang Li, Shan Liu, Xiaozhong Xu
  • Patent number: 11949902
    Abstract: A method for video decoding in a decoder is provided. Coding information of a current block (CB) from a coded video bitstream is decoded. The coding information includes weighted prediction information that indicates a weighted prediction for the CB. A determination is made as to whether to apply a prediction refinement with optical flow (PROF) on the CB based on the weighted prediction information. The CB is reconstructed based on the weighted prediction and whether the PROF is determined to be applied on the CB.
    Type: Grant
    Filed: March 30, 2022
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Guichun Li, Xiang Li, Xiaozhong Xu, Shan Liu
  • Patent number: 11948336
    Abstract: Aspects of the disclosure provide methods and apparatuses for point cloud compression and decompression. In some examples, an apparatus for point cloud compression/decompression includes processing circuitry. In some examples, the processing circuitry receives a bitstream carrying compressed data for a point cloud. The processing circuitry determines that a current node in an octree structure is eligible for an isolated mode. The octree structure corresponds to three dimensional (3D) partitions of a space of the point cloud. Then the processing circuitry determines, based on information of one or more other nodes, a single isolated point flag for the current node that indicates whether the current node is coded with a single isolated point.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Zhang, Wen Gao, Shan Liu
  • Patent number: 11949849
    Abstract: A method for video decoding is provided. For a current block, whether an angular intra prediction mode for the current block is a wide angle mode that is in a direction outside of a range of directions that spans a bottom left diagonal direction and a top right diagonal direction of the current block is determined. Based on the angular intra prediction mode being determined as the wide angle mode, an intra smooth filter is enabled, the enabled intra smooth filter is applied to blocks neighboring the current block to generate filtered blocks, and intra prediction is performed based on the filtered blocks to decode the current block.
    Type: Grant
    Filed: November 28, 2022
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Xiang Li, Shan Liu
  • Publication number: 20240107075
    Abstract: A method of video coding includes receiving video data comprising one or more subpictures, signaling, in a sequence parameter set, whether to use a network abstraction unit (NAL) layer identifier as a subpicture identifier, signaling the subpicture identifier in a NAL unit header when the sequence parameter set indicates to use the NAL layer identifier and signaling the subpicture identifier in a slice header when the sequence parameter set indicates not to use the NAL layer identifier, signaling a length of the subpicture identifier, and encoding the video data based on the subpicture identifier.
    Type: Application
    Filed: December 12, 2023
    Publication date: March 28, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Byeongdoo CHOI, Stephan WENGER, Shan LIU
  • Publication number: 20240107045
    Abstract: A method and system for decoding a coded video sequence may include obtaining the coded video sequence, and decoding the coded video sequence. A a value of a temporal sublayer identifier of a video coding layer (VCL) network abstraction layer (NAL) unit in the coded video sequence is constrained to be less than or equal to a value of vps_max_sublayers_minus1, that specifies a maximum number of temporal sublayers that may be present in a layer in each coded video sequence referring to the video parameter set (VPS), in the VPS referred to by the VCL NAL unit.
    Type: Application
    Filed: November 30, 2023
    Publication date: March 28, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Byeongdoo CHOI, Shan Liu, Stephan Wenger
  • Publication number: 20240104783
    Abstract: Method, apparatus, and system for merging multiple attribute maps for mesh compression may be provided. The process may include obtaining multiple attribute maps associated with a mesh including one or more texture maps. The multiple attribute maps may be concatenated into a single concatenated map and concatenated UV coordinates for each of the multiple attribute maps may be generated based on re-computing original UV coordinates of each of the multiple attribute maps within the single concatenated map.
    Type: Application
    Filed: May 9, 2023
    Publication date: March 28, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Fang-yi CHAO, Thuong Nguyen Canh, Xiang Zhang, Xiaozhong Xu, Shan Liu
  • Publication number: 20240107043
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding and decoding. The apparatuses include an apparatus for video decoding. Processing circuitry of the apparatus for video decoding can decode coded information for a current block from a coded video bitstream. The coded information indicates a bi-prediction motion compensation mode for the current block. The processing circuitry determines, based on current neighboring reconstructed samples of the current block, first neighboring reconstructed samples of a first prediction block, and second neighboring reconstructed samples of a second prediction block, a weight used in the bi-prediction motion compensation mode. The processing circuitry reconstructs samples in the current block based on a weighted average of corresponding samples in the first prediction block and the second prediction block using the determined weight.
    Type: Application
    Filed: November 15, 2023
    Publication date: March 28, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Xin ZHAO, Liang Zhao, Shan Liu
  • Patent number: 11943462
    Abstract: A method of video encoding includes determining whether a plurality of constraint flags of a constraint information group are to be signaled for a subset of coding blocks, and signaling a gate flag indicating whether the plurality of constraint flags of the constraint information group are signaled. The gate flag is signaled in constraint information in a syntax structure of a coded video bitstream. In accordance with the signaled gate flag indicating that the plurality of constraint flags of the constraint information group are signaled, the method further includes signaling the plurality of constraint flags of the constraint information group in the constraint information in the syntax structure of the coded video bitstream. In accordance with the plurality of constraint flags being signaled in the constraint information, the method further includes encoding the subset of coding blocks based on the plurality of constraint flags.
    Type: Grant
    Filed: August 15, 2022
    Date of Patent: March 26, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 11943448
    Abstract: This disclosure relates generally to video coding and particularly to methods and systems for providing signaling schemes for jointly coding of motion vector difference. An example method for decoding a current video block of a video bitstream is disclosed. The method includes receiving a coded video bitstream; determining, from the coded video bitstream, a flag for a current video block, wherein the flag indicates whether joint motion vector difference (MVD) coding is applied to the current video block; and in response to the flag indicating that the joint MVD coding is applied to the current video block: obtaining, by the device from the coded video bitstream, a joint MVD for the current video block, deriving, by the device based on the joint MVD, an MVD for the current video block, and decoding, by the device based on the joint MVD and the derived MVD, the current video block.
    Type: Grant
    Filed: September 1, 2022
    Date of Patent: March 26, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Shan Liu
  • Patent number: 11943432
    Abstract: In a method of video decoding, coded information of a current block is received. First information associated with the current block in the coded information is obtained. The first information indicates whether the current block is intra predicted based on decoder side intra mode derivation (DIMD). Second information associated with the current block in the coded information is obtained. The second information indicates whether the current block is partitioned based on an intra sub-partition (ISP) mode. A context model index is determined in response to one of (i) the first information indicating that the current block is intra predicted based on the DIMD, and (ii) the second information indicating that an above adjacent block or a left adjacent block of the current block is partitioned based on the ISP mode. The current block is decoded from the coded video stream based at least on the context model index.
    Type: Grant
    Filed: April 22, 2022
    Date of Patent: March 26, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Ling Li, Xiang Li, Shan Liu
  • Patent number: 11943446
    Abstract: A method, device, and computer-readable medium for decoding an encoded video bitstream using at least one processor, including obtaining a flag indicating that a conformance window is not used for reference picture resampling; based on the flag indicating that the conformance window is not used for the reference picture resampling, determining whether a resampling picture size is signaled; based on determining that the resampling picture size is signaled, determining a resampling ratio based on the resampling picture size; based on determining that the resampling picture size is not signaled, determining the resampling ratio based on an output picture size; and performing the reference picture resampling on a current picture using the resampling ratio.
    Type: Grant
    Filed: March 16, 2023
    Date of Patent: March 26, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
  • Patent number: 11943435
    Abstract: Aspects of the disclosure provide method and apparatus for video coding. In some examples, an apparatus includes receiving circuitry and processing circuitry. The processing circuitry selects a reference line from a plurality of potential reference lines and selects an intra prediction mode from a set of potential intra prediction modes that is associated with the reference line. The processing circuitry encodes a block according to the intra prediction mode and at least one reference sample in the reference line. The processing circuitry further generates prediction information of the block. Inclusion of an indication of a reference line index of the reference line in the prediction information is based on the intra prediction mode.
    Type: Grant
    Filed: May 10, 2022
    Date of Patent: March 26, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu, Liang Zhao
  • Patent number: 11941856
    Abstract: A method, computer program, and computer system is provided for decoding point cloud data. Data corresponding to a point cloud is received. A number of contexts associated with the received data is reduced based on reducing a size of an array corresponding to syntax elements for predictive tree-based coding of the point cloud. The data corresponding to the point cloud is decoded based on the reduced number of contexts.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: March 26, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Wen Gao, Xiang Zhang, Shan Liu
  • Publication number: 20240098269
    Abstract: Methods and systems are provided for decoding at least one video stream. A method includes receiving a first network abstraction layer (NAL) unit of a first slice of a coded picture and a second VCL NAL unit of a second slice of the coded picture, the first VCL NAL unit having a first VCL NAL unit type and the second VCL NAL unit having a second VCL NAL unit type that is different from the first VCL NAL unit type, and decoding the coded picture, the decoding including determining a picture type of the coded picture based on the first VCL NAL unit type of the first VCL NAL unit and the second VCL NAL unit type of the second VCL NAL unit, or based on an indicator, received by the at least one processor, indicating that the coded picture includes mixed VCL NAL unit types.
    Type: Application
    Filed: November 15, 2023
    Publication date: March 21, 2024
    Applicant: TENCENT AMERICA LC
    Inventors: Byeongdoo CHOI, Stephan Wenger, Shan Liu
  • Publication number: 20240095965
    Abstract: In a method, a base mesh is generated from a down-sampled input mesh in a current frame, where the base mesh includes a plurality of vertices. A prediction mode to be applied to the base mesh is determined. The prediction mode is an inter prediction mode or an intra prediction mode. Based on the prediction mode being determined as the intra prediction mode, duplicate vertices among the plurality of vertices in the base mesh are merged to generate a subset of the plurality of vertices. At least the subset of the plurality of vertices is encoded based on the determined intra prediction mode to generate prediction information of at least the subset of the plurality of vertices.
    Type: Application
    Filed: June 9, 2023
    Publication date: March 21, 2024
    Applicant: Tencent America LLC
    Inventors: Jun TIAN, Xiang ZHANG, Xiaozhong XU, Chao HUANG, Shan LIU
  • Publication number: 20240098279
    Abstract: In a method, coded information of a current block in a current picture of a video is received from a coded video bitstream. The coded information indicates that the current block is partitioned into at least a first partition and a second partition based on a geometric partition mode (GPM). The first partition is associated with an intra block copy (IBC) prediction mode, and the second partition is associated with an intra prediction mode. Prediction mode information for a first subblock of a plurality of subblocks of the current block is stored. The prediction mode information includes one of a DC mode, a Planar mode, and an intra prediction mode based on whether the first subblock is associated with one of the IBC prediction mode, the intra prediction mode, and both the IBC prediction mode and the intra prediction mode.
    Type: Application
    Filed: December 1, 2023
    Publication date: March 21, 2024
    Applicant: Tencent America LLC
    Inventors: Lien-Fei CHEN, Xiang LI, Shan LIU