Patents by Inventor Shan Liu

Shan Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240064287
    Abstract: Methods, apparatus, and computer readable storage medium for intra bi-prediction and multiple reference line intra prediction in video decoding. The method includes receiving, by a device, a coded video bitstream for a block. The method also includes determining, by the device, whether a single directional intra prediction or an intra bi-prediction applies to the block, based on mode information of the block, the mode information of the block comprising at least one of: a reference line index of the block, an intra prediction mode of the block, and a size of the block; in response to determining that the single directional intra prediction applies to the block, performing, by the device, the single directional intra prediction to the block; and in response to determining that the intra bi-prediction applies to the block, performing, by the device, the intra bi-prediction to the block.
    Type: Application
    Filed: October 26, 2023
    Publication date: February 22, 2024
    Applicant: Tencent America LLC
    Inventors: Liang ZHAO, Xin Zhao, Shan Liu
  • Patent number: 11908103
    Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining an input low resolution (LR) image comprising a height, a width, and a number of channels, implementing a feature learning deep neural network (DNN) configured to compute a feature tensor based on the input LR image, generating, by an upscaling DNN, a high resolution (HR) image, having a higher resolution than the input LR image, based on the feature tensor computed by the feature learning DNN, wherein a networking structure of the upscaling DNN differs depending on different scale factors, and wherein a networking structure of the feature learning DNN is a same structure for each of the different scale factors.
    Type: Grant
    Filed: June 30, 2021
    Date of Patent: February 20, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Wei Jiang, Wei Wang, Shan Liu
  • Patent number: 11909780
    Abstract: A method, computer program, and computer system for enabling peer-to-peer media streaming using service enabler architecture layer (SEAL). The method may be executed by one or more processors, and the method may include receiving, by a vertical application layer (VAL) server, a request for a media session negotiation between one or more client devices, and retrieving, by the vertical application layer (VAL) server, transport layer information associated with each of the one or more client devices using network address translation traversal. The method may further include transmitting, by the vertical application layer (VAL) server, agreed session description protocol (SDP) parameters based on the transport layer information, wherein the agreed session description protocol (SDP) parameters are used to establish a peer-to-peer media streaming session.
    Type: Grant
    Filed: July 6, 2022
    Date of Patent: February 20, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Shuai Zhao, Stephan Wenger, Shan Liu
  • Patent number: 11909987
    Abstract: A method for controlling block intra prediction is provided for a decoder. The method includes: obtaining a coded video bitstream; decoding, prediction information of a current coding unit (CU) in a segment of a current picture from the coded video bitstream; determining, according to the prediction information, a prediction type of a chroma coding block (CB) of the current CU, the prediction type being intra prediction or inter prediction; and reconstructing the chroma CB according to the prediction information, where a width of any reconstructed chroma CB intra-predicted from the coded video bitstream is greater than 2.
    Type: Grant
    Filed: March 12, 2023
    Date of Patent: February 20, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xiang Li, Xin Zhao, Shan Liu, Guichun Li, Xiaozhong Xu
  • Patent number: 11909956
    Abstract: Systems and methods for deep neural network (DNN)-based cross component prediction are provided. A method includes inputting a reconstructed luma block of an image or video into a DNN; and predicting, by the DNN, a reconstructed chroma block of the image or video based on the reconstructed luma block that is input. Luma and chroma reference information and side information may also be input into the DNN to predict the reconstructed chroma block. The various inputs may also be generated using processes such as downsampling and transformation.
    Type: Grant
    Filed: May 20, 2022
    Date of Patent: February 20, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Sheng Lin, Wei Jiang, Wei Wang, Liqiang Wang, Shan Liu, Xiaozhong Xu
  • Patent number: 11909976
    Abstract: A method of controlling intra-inter prediction for decoding or encoding of a video sequence, is performed by at least one processor. The method may include setting a prediction mode flag associated with a current block to indicate whether the current block is coded in inter prediction mode, intra prediction mode, or inter-intra prediction mode; deriving a context value associated with a coded block flag associated with the current block based on the prediction mode flag associated with the current block. Deriving the context value may include based on the current block being determined to be coded in the intra prediction mode, setting the context value of the coded block flag to a first value, and based on the current block being determined to be coded in the inter prediction mode, setting the context value of the coded block flag to a second value.
    Type: Grant
    Filed: June 10, 2022
    Date of Patent: February 20, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11909991
    Abstract: A method, computer program, and computer system is provided for coding a video sequence. Video data comprising one or more luma samples is received. A YUV format associated with the received video data is determined. A height setting value and a width setting value corresponding to the one or more luma samples are restricted based on the determined YUV format. The YUV format may include a YUV4:4:4 format, a YUV4:2:2 format, a YUV4:2:0 format, and a YUV4:0:0 format.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: February 20, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Xiang Li, Byeongdoo Choi, Shan Liu
  • Patent number: 11902585
    Abstract: A method includes receiving video data including one or more subpicture. The video data includes a flag, signaled in a sequence parameter set, indicating whether to use a network abstraction unit (NAL) layer identifier as a subpicture identifier, where the subpicture identifier is signaled in a NAL unit header based on the flag indicating to use the NAL layer identifier, and the subpicture identifier is signaled in a slice header based on the flag indicating not to use the NAL layer identifier. The video data is decoded based on the subpicture identifier.
    Type: Grant
    Filed: February 15, 2022
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
  • Patent number: 11902584
    Abstract: A method, computer program, and computer system for encoding or decoding video data, and indicating, with a syntax element, types of slices for all slices of a coded picture, the syntax element being coded using an unsigned integer.
    Type: Grant
    Filed: September 21, 2020
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Ling Li, Xiaozhong Xu, Byeongdoo Choi, Xiang Li, Stephan Wenger, Shan Liu
  • Patent number: 11902514
    Abstract: A method of and an apparatus for controlling intra prediction for decoding of a video sequence are provided. The method may include based on a reference line index signaling a first reference line nearest to a coding unit, among a plurality of reference lines adjacent to the coding unit, applying intra smoothing on one or more first reference lines comprising the first reference line, among the plurality of reference lines, and based on the intra smoothing being applied on the one or more first reference lines, applying a position-dependent intra prediction combination (PDPC) on one or more third reference lines comprising the first reference line, among the plurality of reference lines, while preventing application of the PDPC on one or more fourth reference lines other than the one or more third reference lines, among the plurality of reference lines.
    Type: Grant
    Filed: June 10, 2022
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11902554
    Abstract: A method of video encoding includes determining whether a plurality of constraint flags of a constraint information group are to be signaled for a subset of coding blocks, and signaling a gate flag indicating whether the plurality of constraint flags of the constraint information group are signaled. The gate flag is signaled in constraint information in a syntax structure of a coded video bitstream. In accordance with the signaled gate flag indicating that the plurality of constraint flags of the constraint information group are signaled, the method further includes signaling the plurality of constraint flags of the constraint information group in the constraint information in the syntax structure of the coded video bitstream. In accordance with the plurality of constraint flags being signaled in the constraint information, the method further includes encoding the subset of coding blocks based on the plurality of constraint flags.
    Type: Grant
    Filed: August 15, 2022
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 11900640
    Abstract: A method of substitutional neural residual compression is performed by at least one processor and includes estimating motion vectors, based on a current image frame and a previous reconstructed image frame, obtaining a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame, and subtracting the obtained predicted image frame from the current image frame to obtain a substitutional residual. The method further includes encoding the obtained substitutional residual, using a first neural network, to obtain an encoded representation, and compressing the encoded representation.
    Type: Grant
    Filed: April 21, 2021
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Wei Jiang, Wei Wang, Shan Liu
  • Patent number: 11902545
    Abstract: A method of video decoding performed in a video decoder is disclosed. A syntax element can be received from a bitstream of a coded video indicating that residual blocks of a current coding unit (CU) are processed with a color space conversion. The residual blocks of the current CU can include a luma residual block, a first chroma residual block, and a second chroma residual block. In response to receiving the syntax element indicating that the residual blocks of the current CU are processed with the color space conversion, one of two options of color space conversion equations can be selected based on a transform skip flag and a quantization parameter (QP) corresponding to each of the residual blocks of the current CU. An inverse color space conversion can be applied using the selected option of color space conversion equations to the residual blocks of the current CU.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Ling Li, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11902517
    Abstract: An image processing method includes obtaining statistics information of a block of an image frame, determining whether the statistics information satisfies a condition, and disabling cross-component filtering (CCF) for the block in response to the statistics information satisfying the condition.
    Type: Grant
    Filed: March 1, 2022
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Yixin Du, Xin Zhao, Liang Zhao, Xiang Li, Shan Liu
  • Publication number: 20240048763
    Abstract: Whether each of a plurality of duplicate vertices is skippable in a mesh is determined. One or more skippable duplicate vertices of the plurality of duplicate vertices in the mesh are excluded to generate an updated mesh. Vertices of the updated mesh are divided into a plurality of vertex groups, where the plurality of vertex groups includes a first vertex group. A prediction mode of the first vertex group is determined at least based on estimation errors of vertices in the first vertex group of the updated mesh. Each of the estimation errors indicates a difference between a respective vertex in the first vertex group and a corresponding reference vertex in the reference frame. Prediction information of the vertices in the first vertex group is generated based on the determined prediction mode.
    Type: Application
    Filed: June 8, 2023
    Publication date: February 8, 2024
    Applicant: Tencent America LLC
    Inventors: Jun TIAN, Chao HUANG, Xiaozhong XU, Xiang ZHANG, Shan LIU
  • Publication number: 20240048773
    Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that receives metadata associated with a coded video bitstream. The metadata includes labeling information of one or more objects detected in a first picture that is coded in the coded video bitstream. The processing circuitry decodes the labeling information of the one or more objects in the first picture that is coded in the coded video bitstream. The processing circuitry applies the labeling information to the one or more objects in the first picture.
    Type: Application
    Filed: October 23, 2023
    Publication date: February 8, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Shan Liu, Xiaozhong Xu, Wen Gao
  • Publication number: 20240048730
    Abstract: Systems and methods for encoding and decoding using warp motion modes are provided. A method includes receiving a bitstream that includes a coded picture; obtaining warp information that is signaled in the bitstream, the warp information including a warp type indicating a number of parameters to be corrected by delta values, the number of parameters defining warp motion for predicting a current block of the coded picture; obtaining at least one delta value from the bitstream that is a delta of at least one parameter that defines the warp motion for predicting the current block; obtaining a warp model based on the warp information and the at least one delta value; and predicting the current block by performing warped motion compensation using the warp model.
    Type: Application
    Filed: November 7, 2022
    Publication date: February 8, 2024
    Applicant: Tencent America LLC
    Inventors: Han GAO, Liang ZHAO, Xin ZHAO, Shan LIU
  • Publication number: 20240048745
    Abstract: In a method of video encoding for an encoder, a determination is made to determin whether (i) an implicit transform scheme is enabled, and (ii) at least one of a low-frequency non-separable transform (LFNST) and a matrix-based intra predication mode (MIP) is invalid for a coding unit (CU). In response to the determination that the implicit transform scheme is enabled, and at least one of the LFNST and MIP is invalid, a primary transform type is determined based on a size of the CU. A primary transform is performed for a transform block that is partitioned from the CU in accordance with the determined primary transform type. A coded bitstream that indicates the primary transform type of the CU is subsequently ouput.
    Type: Application
    Filed: October 13, 2023
    Publication date: February 8, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Xin ZHAO, Xiang LI, Shan LIU
  • Publication number: 20240048728
    Abstract: A method of and an apparatus for controlling intra prediction for encoding of a video sequence are provided. The method includes determining a ratio of a width to a height of a coding unit, and based on the determined ratio being different than one, adding, to a table including intra prediction modes corresponding to intra prediction angles, first wide angles toward a bottom-left edge of the coding unit, second wide angles toward a top-right edge of the coding unit, and additional intra prediction modes respectively corresponding to the first wide angles and the second wide angles. The method further includes signaling, for encoding the video sequence, one of the intra prediction modes and the additional intra prediction modes added to the table.
    Type: Application
    Filed: October 5, 2023
    Publication date: February 8, 2024
    Applicant: TENCENT AMERICA LLC
    Inventors: Liang ZHAO, Xin ZHAO, Xiang LI, Shan LIU
  • Publication number: 20240048743
    Abstract: A method of decoding an encoded video bitstream using at least one processor, including: obtaining from the encoded video bitstream a coded video sequence including a picture unit corresponding to a coded picture; obtaining a picture header (PH) network abstraction layer (NAL) unit included in the picture unit; obtaining at least one video coding layer (VCL) network abstraction layer (NAL) unit included in the picture unit; decoding the coded picture based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the APS NAL unit is available to the at least one processor before the at least one VCL NAL unit.
    Type: Application
    Filed: June 29, 2023
    Publication date: February 8, 2024
    Applicant: Tencent America LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger