Patents by Inventor Ruoyang Yu

Ruoyang Yu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250254297
    Abstract: There is provided a method for encoding or decoding a video, the video comprising a sequence of pictures which includes a first picture and a second picture. The method comprises obtaining a first group of values of samples included in a first block, wherein the first block is included in the first picture. The method further comprises selecting, from a set of filters, a filter to use for generating a second group of values included in a second block, wherein the second block is included in the first picture or the second picture. The method comprises, using the selected filter and the first group of values, generating the second group of values, wherein the filter comprises a set of 6, 8, 10, or 12 coefficient values, and the set of coefficient values is selected from given groups of coefficient values.
    Type: Application
    Filed: March 30, 2023
    Publication date: August 7, 2025
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Kenneth ANDERSSON, Ruoyang YU
  • Publication number: 20250254298
    Abstract: A method for generating an encoded video or a decoded video is provided. The method comprises obtaining values of reconstructed samples, and obtaining input information comprising any one or a combination of: i) information about filtered samples, ii) information about predicted samples, or iii) information about skipped samples. The method further comprises providing the values of reconstructed samples and the input information to a machine learning, ML, model, thereby generating at least one ML output data, and based at least on said at least one ML output data, generating the encoded video or the decoded video.
    Type: Application
    Filed: April 12, 2023
    Publication date: August 7, 2025
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Du LIU, Jacob STRÖM, Kenneth ANDERSSON, Yun LI, Mitra DAMGHANIAN, Ruoyang YU, Per WENNERSTEN
  • Patent number: 12382091
    Abstract: A method of performing bi-directional optical flow, BDOF, processing for a video sequence of images, with each image including a plurality of blocks with bidirectional-predicted inter coding blocks, BPICBs. The method includes obtaining a shifted pair of refinement parameters per a subblock of a bidirectional-predicted inter coding block, wherein the shifted pair of refinement parameters includes a shifted first refinement parameter and a shifted second refinement parameter.
    Type: Grant
    Filed: February 16, 2024
    Date of Patent: August 5, 2025
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Du Liu, Ruoyang Yu
  • Patent number: 12368858
    Abstract: A prediction unit for an encoder or decoder implements matrix based intra prediction. Input boundary samples for a current block are downsampled to obtain reduced boundary samples for matrix multiplication and/or linear interpolation, or both. In one embodiment, downsampling is performed in a manner that aligns the reduced boundary samples with an output of a matrix multiplication unit of the prediction unit. In other embodiments, downsampling is performed without averaging. The embodiments reduce the complexity of the prediction unit and the latency of the encoder or decoder.
    Type: Grant
    Filed: April 29, 2024
    Date of Patent: July 22, 2025
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Zhi Zhang, Ruoyang Yu, Kenneth Andersson, Per Wennersten, Jacob Ström, Rickard Sjöberg
  • Patent number: 12363305
    Abstract: There is provided a method for processing a bitstream. The method comprises determining a value, N, wherein N identifies a number of ordered layer representations, wherein N is greater than or equal to 3 such that the N ordered layer representations comprises a highest layer representation, a second highest layer representation, and a third highest layer representation. The method further comprises determining a value for the highest layer representation. The method comprises, after determining the value for the highest layer representation and before determining a value for the third highest layer representation, determining a value for the second highest layer representation. The method comprises, after determining the value for the second highest layer representation, determining a value for the third highest layer representation.
    Type: Grant
    Filed: January 27, 2021
    Date of Patent: July 15, 2025
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Rickard Sjöberg, Martin Pettersson, Mitra Damghanian, Jacob Ström, Zhi Zhang, Jack Enhorn, Ruoyang Yu, Du Liu
  • Publication number: 20250211791
    Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.
    Type: Application
    Filed: March 11, 2025
    Publication date: June 26, 2025
    Inventors: Zhi ZHANG, Kenneth ANDERSSON, Davood SAFFAR, Rickard SJÖBERG, Jacob STRÖM, Ruoyang YU
  • Publication number: 20250159153
    Abstract: A deblocking method for deblocking a boundary between a first block of samples, block P, and a second block of samples, block Q. The method includes determining whether at least one of the P block or the Q block is a combined intra-inter prediction block; and, as a result of determining that at least one of the P block or the Q block is a combined intra-inter prediction block, deblocking the boundary between the P block and the Q block.
    Type: Application
    Filed: September 19, 2024
    Publication date: May 15, 2025
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Kenneth ANDERSSON, Jack ENHORN, Ruoyang YU, Zhi ZHANG
  • Patent number: 12301878
    Abstract: A method for decoding a picture comprising a virtual boundary from a coded video bitstream. The method includes determining one or more of a maximum picture width or a maximum picture height from one or more syntax elements S1 in the coded video bitstream and determining one or more of a current picture width or a current picture height from one or more syntax elements S2 in the coded video bitstream. The method also includes determining that a virtual boundary syntax element in the coded video bitstream is encoded with a bit length derived from (i) one or more of the maximum picture width or the maximum picture height or (ii) one or more of the current picture width or the current picture height.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: May 13, 2025
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Mitra Damghanian, Martin Pettersson, Rickard Sjöberg, Zhi Zhang, Jack Enhorn, Ruoyang Yu, Jacob Ström
  • Patent number: 12294741
    Abstract: A methods and apparatuses for encoding or decoding a segment in a coded picture. The decoding may include obtaining from a bitstream a value of a first codeword that indicates whether the coded picture may contain bi-directional inter coded segments or not. The decoding may include, based on the value of the first codeword, deriving one or more parameter values by either (a) decoding one or more parameters from the bitstream to obtain the one or more parameter values or (b) inferring the one or more parameter values. The decoding may include decoding the segment in the coded picture based on the one or more parameter values. The encoding may include encoding the first codeword to the bitstream and determining whether to encode one or more parameter values in the bitstream based on a determination of whether the coded picture will contain bi-directional inter coded segments or not.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: May 6, 2025
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Martin Pettersson, Ruoyang Yu, Rickard Sjöberg, Mitra Damghanian, Zhi Zhang, Jack Enhorn
  • Publication number: 20250142108
    Abstract: Methods and apparatuses for processing (e.g., decoding) a current block within a current picture. The processing may include decoding partial motion vector difference (MVD) information from a coded video bitstream. The processing may include determining first and second motion vector predictors (MVPs). The processing may include determining complete MVD information using the partial MVD information and one or more of the first and second MVPs. Determining the complete MVD information may include using the partial MVD information to generate a set of MVD hypothesis pairs, and each of the MVD hypothesis pairs may include a possible first MVD and a possible second MVD. The processing may include determining first and second final prediction blocks of the current block using the complete MVD information and the first and second MVPs.
    Type: Application
    Filed: December 22, 2022
    Publication date: May 1, 2025
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang YU, Kenneth ANDERSSON, Jacob STRÖM
  • Patent number: 12278993
    Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.
    Type: Grant
    Filed: March 8, 2024
    Date of Patent: April 15, 2025
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Zhi Zhang, Kenneth Andersson, Davood Saffar, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
  • Publication number: 20250119570
    Abstract: A method for determining a prediction block for decoding or encoding a current block in a current picture of a video stream. The method includes obtaining a pair of initial motion vectors comprising a first and a second initial motion vector. The method also includes determining whether to refine the initial motion vectors. The step of determining whether or not to refine the initial motion vectors comprises: i) determining whether a first prediction scheme and/or a second prediction scheme is enabled and ii) determining to refrain from refining the initial motion vectors as a result of determining that either the first prediction scheme or second prediction scheme is enabled or determining to refine the initial motion vectors as a result of determining neither the first prediction scheme nor second prediction scheme is enabled.
    Type: Application
    Filed: October 14, 2024
    Publication date: April 10, 2025
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang YU, Du LIU
  • Patent number: 12238316
    Abstract: A method and decoder for determining that a decoder conforming to a first profile is capable of decoding a first picture of a video bitstream conforming to a second profile is provided. The method includes obtaining an indicator value, the indicator value indicating conformance to a profile. The method includes determining whether the first picture in the video bitstream is a still picture. The method includes responsive to the indicator value indicating conformance to the second profile and the first picture is determined to be a still picture, determining that the decoder conforming to the first profile is capable of decoding the first picture of the video bitstream.
    Type: Grant
    Filed: June 7, 2021
    Date of Patent: February 25, 2025
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Martin Pettersson, Rickard Sjöberg, Mitra Damghanian, Ruoyang Yu, Jacob Ström, Jack Enhorn, Du Liu
  • Patent number: 12219133
    Abstract: Methods, decoders, and programs are provided. All blocks of an image that has been encoded are decoded. At least one sample of at least one block of the image is filtered by, for each block being filtered: for each sample being filtered: selecting a plurality of neighboring samples. For at least one neighboring sample, a difference is calculated between the neighboring sample and the sample. A modifier value is obtained. A modifier sum is derived based on a sum of the modifier values for the neighboring samples. A correction value is determined based on a conditional addition of at least one shifted version of the modifier sum, each shift having a same number of shift steps in each correction value determination. A filtered sample is derived based on the sample and correction value. The filtered sample is stored. The block and filtered sample is output towards a decoder output.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: February 4, 2025
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Jacob Ström, Per Wennersten, Jack Enhorn, Ruoyang Yu, Lukasz Litwic
  • Publication number: 20240414331
    Abstract: Methods, decoders, and programs are provided. All blocks of an image that has been encoded are decoded. At least one sample of at least one block of the image is filtered by, for each block being filtered: for each sample being filtered: selecting a plurality of neighboring samples. For at least one neighboring sample, a difference is calculated between the neighboring sample and the sample. A modifier value is obtained. A modifier sum is derived based on a sum of the modifier values for the neighboring samples. A correction value is determined based on a conditional addition of at least one shifted version of the modifier sum, each shift having a same number of shift steps in each correction value determination. A filtered sample is derived based on the sample and correction value. The filtered sample is stored. The block and filtered sample is output towards a decoder output.
    Type: Application
    Filed: March 10, 2020
    Publication date: December 12, 2024
    Inventors: Jacob Ström, Per Wennersten, Jack Enhorn, Ruoyang Yu, Lukasz Litwic
  • Patent number: 12149730
    Abstract: A method for determining a prediction block for decoding or encoding a current block in a current picture of a video stream. The method includes obtaining a pair of initial motion vectors, the pair of initial motion vectors comprising a first initial motion vector and a second initial motion vector. The method also includes determining whether or not to refine the initial motion vectors. The method further includes refining the initial motion vectors as a result of determining to refine the initial motion vectors.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: November 19, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Ruoyang Yu, Du Liu
  • Publication number: 20240340454
    Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.
    Type: Application
    Filed: March 8, 2024
    Publication date: October 10, 2024
    Inventors: Zhi ZHANG, Kenneth ANDERSSON, Davood SAFFAR, Rickard SJÖBERG, Jacob STRÖM, Ruoyang YU
  • Publication number: 20240340446
    Abstract: Methods and devices for determining video picture resolution. A first source picture is obtained and a first reduced resolution picture is generated based on the first source picture. A first similarity metric is determined for the first reduced resolution picture and the first source picture. A picture resolution is selected based at least in part on the first similarity metric.
    Type: Application
    Filed: June 30, 2022
    Publication date: October 10, 2024
    Applicant: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth ANDERSSON, Jacob STRÖM, Ruoyang YU
  • Patent number: 12113970
    Abstract: A deblocking method for deblocking a boundary between a first block of samples, block P, and a second block of samples, block Q. The method includes determining whether at least one of the P block or the Q block is a combined intra-inter prediction block; and, as a result of determining that at least one of the P block or the Q block is a combined intra-inter prediction block, deblocking the boundary between the P block and the Q block.
    Type: Grant
    Filed: January 18, 2022
    Date of Patent: October 8, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Jack Enhorn, Ruoyang Yu, Zhi Zhang
  • Publication number: 20240333968
    Abstract: There is provided a method of encoding a picture. The method comprises selecting a motion vector. MV, for a current block within the picture. The method comprises determining whether a condition is satisfied, wherein determining whether the condition is satisfied comprises: (i) determining if a subblock-based motion refinement is applicable for the current block and (ii) determining if a first subblock within the current block satisfies a criteria. The method comprises, as a result of determining that the condition is satisfied, not using the selected MV for encoding the current block.
    Type: Application
    Filed: June 2, 2022
    Publication date: October 3, 2024
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang YU, Kenneth ANDERSSON, Jacob STRÖM