Patents by Inventor Ruoyang Yu

Ruoyang Yu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11395000
    Abstract: The present embodiments introduce a new type of random access point in video bitstreams that can be used for random access operations but can be represented in encoded form at a lower bit-cost as compared to IRAP pictures. The random access point is a dependent random access point (DRAP) picture that is encoded and decoded using an IRAP picture and/or a previous, according to a decoding order, DRAP picture as sole reference picture(s) for the DRAP picture. The DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in a video bitstream.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: July 19, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Martin Pettersson, Jonatan Samuelsson, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
  • Patent number: 11381807
    Abstract: There are provided mechanisms for temporal motion vector prediction of a current picture in a series of pictures of a video sequence. The method comprises determining, for a current block of the current picture, whether any one of: left, top, top-right and left-bottom spatial neighboring blocks of the current block in the current picture uses a collocated picture as a reference picture. The method further comprises, when the determination is that one of the left, top, top-right and left-bottom spatial neighboring block uses a collocated picture as a reference picture, using a motion vector of the one of the spatial neighboring blocks as a temporal vector of the current block.
    Type: Grant
    Filed: November 20, 2019
    Date of Patent: July 5, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang Yu, Kenneth Andersson, Du Liu
  • Publication number: 20220182632
    Abstract: A MIP method (700) for predicting samples of a current block. The method includes storing (s702) a set of MIP weight matrices. The method also includes determining (s704) the width, W, and the height, H, of the current block. The method further includes setting (s706) a mipSizeId variable to 1 as a result of: i) determining that W=4 storing a set of MIP weight matrices and H=16 or ii) determining that W=16 and H=4. The method further includes storing (s708) a value, predModeIntra, that specifies a MIP prediction mode for the current block. The method further includes determining (s710), based on predModeIntra and the value of the mipSizeId variable, a modeId value. And the method further includes selecting (s712), from the set of MIP weight matrices, a MIP weight matrix to be used for the current block, wherein the selection is based on modeId and the value of the mipSizeId variable.
    Type: Application
    Filed: July 22, 2020
    Publication date: June 9, 2022
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Zhi ZHANG, Ruoyang YU, Rickard SJÖBERG, Kenneth ANDERSSON, Jacob STRÖM, Davood SAFFAR
  • Publication number: 20220150532
    Abstract: A method for determining a prediction block for decoding or encoding a current block in a current picture of a video stream. The method includes obtaining a pair of initial motion vectors, the pair of initial motion vectors comprising a first initial motion vector and a second initial motion vector. The method also includes determining whether or not to refine the initial motion vectors. The method further includes refining the initial motion vectors as a result of determining to refine the initial motion vectors.
    Type: Application
    Filed: March 5, 2020
    Publication date: May 12, 2022
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang YU, Du LIU
  • Publication number: 20220141464
    Abstract: A deblocking method for deblocking a boundary between a first block of samples, block P, and a second block of samples, block Q. The method includes determining whether at least one of the P block or the Q block is a combined intra-inter prediction block; and, as a result of determining that at least one of the P block or the Q block is a combined intra-inter prediction block, deblocking the boundary between the P block and the Q block.
    Type: Application
    Filed: January 18, 2022
    Publication date: May 5, 2022
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Kenneth ANDERSSON, Jack ENHORN, Ruoyang YU, Zhi ZHANG
  • Publication number: 20220141457
    Abstract: A method for deblocking at least one boundary of a coding unit, wherein the boundary forms a first side and a second side of the coding unit, wherein a video picture comprises the coding unit, and wherein the first and second sides use a same reference picture. The method includes obtaining a first motion vector component in the first side; obtaining a second motion vector component in the second side; determining whether an absolute difference between the first motion vector component and the second motion vector component is equal to or larger than a predetermined threshold that is less than 1 sample; and as a result of determining that the absolute difference between the first motion vector component and the second motion vector component is equal to or larger than the predetermined threshold, applying deblocking to the vertical or horizontal boundary between the first side and the second side.
    Type: Application
    Filed: February 19, 2020
    Publication date: May 5, 2022
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Kenneth ANDERSSON, Jack ENHORN, Ruoyang YU
  • Publication number: 20220124362
    Abstract: A method for decoding a current block in a current picture of a video bitstream includes decoding, from the video bitstream, a first motion vector for the current block relative to a first reference block of a first reference picture having a first picture order count, and decoding, from the video bitstream, a second motion vector for the current block relative to a second reference block of a second reference picture having a second picture order count. A similarity metric is generated based on a comparison of the first motion vector and the second motion vector. The method further includes determining whether to refine the first motion vector based on the similarity metric, generating a first refined motion vector from the first motion vector, and performing motion compensation to derive a first reference block from the first reference picture using the first refined motion vector.
    Type: Application
    Filed: January 3, 2022
    Publication date: April 21, 2022
    Inventors: Du LIU, Rickard SJÖBERG, Jacob STRÖM, Ruoyang YU
  • Patent number: 11310535
    Abstract: A deblocking filtering control involves deciding whether to apply deblocking filtering to sample values in a sample block in a picture and in a neighboring sample block in the picture based on i) whether illumination compensation is enabled for sample prediction values in a first prediction block in a reference picture for said sample block and/or ii) whether illumination compensation is enabled for sample prediction values in a second prediction block in said reference picture or another reference picture for said neighboring sample block. The sample block and the neighboring sample block are separated in the picture by a block boundary. This decision to apply deblocking filtering based on whether illumination compensation is enabled reduces blocking artefacts that may otherwise arise in certain pictures of a video sequence.
    Type: Grant
    Filed: June 21, 2018
    Date of Patent: April 19, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Kenneth Andersson, Per Wennersten, Rickard Sjöberg, Ruoyang Yu
  • Publication number: 20220078459
    Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.
    Type: Application
    Filed: November 19, 2021
    Publication date: March 10, 2022
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang YU, Rickard SJÖBERG, Zhi ZHANG
  • Publication number: 20220060739
    Abstract: A decoder can be configured to obtain a current inter block and a plurality of previously decoded inter blocks. Each inter block of the plurality of inter blocks can include a motion vector having a resolution. The decoder generates a list of motion vector predictor candidates that is used to predict the motion vector that is associated with the current inter block. Generating the list of motion vector predictor candidates can include defining a set of inter blocks that includes a number of previously decoded inter blocks; scanning the inter blocks in the set of inter blocks in a scanning order; and for each of the inter blocks in the set of inter blocks: deriving a motion vector prediction candidate using the motion vector of the inter block; and determining whether a criterion is satisfied.
    Type: Application
    Filed: December 19, 2019
    Publication date: February 24, 2022
    Inventors: Ruoyang YU, Du LIU, Per WENNERSTEN, Kenneth ANDERSSON, Rickard SJÖBERG
  • Patent number: 11252431
    Abstract: A method for decoding a current block in a current picture of a video bitstream includes decoding, from the video bitstream, a first motion vector for the current block relative to a first reference block of a first reference picture having a first picture order count, and decoding, from the video bitstream, a second motion vector for the current block relative to a second reference block of a second reference picture having a second picture order count. A similarity metric is generated based on a comparison of the first motion vector and the second motion vector. The method further includes determining whether to refine the first motion vector based on the similarity metric, generating a first refined motion vector from the first motion vector, and performing motion compensation to derive a first reference block from the first reference picture using the first refined motion vector.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: February 15, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Du Liu, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
  • Patent number: 11240497
    Abstract: A deblocking method for deblocking a boundary between a first block of samples, block P, and a second block of samples, block Q. The method includes determining whether at least one of the P block or the Q block is a combined intra-inter prediction block; and, as a result of determining that at least one of the P block or the Q block is a combined intra-inter prediction block, deblocking the boundary between the P block and the Q block.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: February 1, 2022
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Jack Enhorn, Ruoyang Yu, Zhi Zhang
  • Patent number: 11218716
    Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: January 4, 2022
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Ruoyang Yu, Rickard Sjöberg, Zhi Zhang
  • Publication number: 20210385457
    Abstract: A method of processing a video sequence including images, wherein each image includes blocks of sample values, is provided. The method includes determining input and output lengths for deblocking filtering of the sample values for a first and second side of a potential blocking boundary. The input and output lengths are a number of consecutive sample values, from a sample value closest to the potential blocking boundary to one or more other sample values spaced from the potential blocking boundary. The input and output lengths are determined based on determining whether the potential blocking boundary is identified as an internal sub-block boundary. The method includes deblocking filtering of the sample values on the at least one of the first and second side of the potential blocking boundary, using the input and output lengths, to generate deblocked sample values.
    Type: Application
    Filed: December 18, 2018
    Publication date: December 9, 2021
    Inventors: Kenneth ANDERSSON, Jack ENHORN, Rickard SJÖBERG, Per WENNERSTEN, Ruoyang YU
  • Publication number: 20210352291
    Abstract: A method of processing a video sequence including images, wherein each image includes blocks of sample values, is provided. The method includes determining input and output lengths for deblocking filtering of sample values for a first and second side of a potential blocking boundary. The input and output lengths are consecutive sample values, from a sample value closest to the potential blocking boundary to one or more other sample values spaced from the potential blocking boundary. The input and output lengths are determined based on a number of consecutive sample values from the sample value closest to the potential blocking boundary to another sample value closest to a neighboring potential blocking boundary. The method includes deblocking filtering of the sample values on the at least one of the first and second side of the potential blocking boundary, using the input and output lengths, to generate deblocked sample values.
    Type: Application
    Filed: December 18, 2018
    Publication date: November 11, 2021
    Inventors: Kenneth ANDERSSON, Jack ENHORN, Rickard SJÖBERG, Per WENNERSTEN, Ruoyang YU
  • Publication number: 20210329266
    Abstract: A method of processing a video sequence including images, wherein each image includes blocks of sample values, is provided. The method includes determining input and output lengths for deblocking filtering of the sample values for a first and second side of a potential blocking boundary. The input and output lengths are a number of consecutive sample values, from a sample value closest to the potential blocking boundary to one or more other sample values spaced from the potential blocking boundary. The input and output lengths are determined based on a number of consecutive smooth sample values perpendicular to the potential blocking boundary on respectively the first and/or second side of the potential blocking boundary. The method includes deblocking filtering of the sample values on the at least one of the first and second side of the potential blocking boundary, using the input and output lengths, to generate deblocked sample values.
    Type: Application
    Filed: December 18, 2018
    Publication date: October 21, 2021
    Inventors: Kenneth ANDERSSON, Jack ENHORN, Rickard SJÖBERG, Per WENNERSTEN, Ruoyang YU
  • Patent number: 11082688
    Abstract: A method of encoding/decoding a picture of a video signal includes selecting a block of the picture for decoding, comparing a motion vector associated with the selected block to a motion vector associated with a neighbouring block that is adjacent the block, and determining whether to use motion vectors associated with the neighbouring block in encoding/decoding of the block based on the comparison of the motion vector associated with the selected block and the motion vector associated with the neighbouring block.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: August 3, 2021
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang Yu, Kenneth Andersson, Per Wennersten
  • Publication number: 20210218961
    Abstract: A deblocking method for deblocking a boundary between a first block of samples, block P, and a second block of samples, block Q. The method includes determining whether at least one of the P block or the Q block is a combined intra-inter prediction block; and, as a result of determining that at least one of the P block or the Q block is a combined intra-inter prediction block, deblocking the boundary between the P block and the Q block.
    Type: Application
    Filed: November 12, 2019
    Publication date: July 15, 2021
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Kenneth ANDERSSON, Jack ENHORN, Ruoyang YU, Zhi ZHANG
  • Publication number: 20210203920
    Abstract: There are provided mechanisms for temporal motion vector prediction of a current picture in a series of pictures of a video sequence. The method comprises determining, for a current block of the current picture, whether any one of: left, top, top-right and left-bottom spatial neighboring blocks of the current block in the current picture uses a collocated picture as a reference picture. The method further comprises, when the determination is that one of the left, top, top-right and left-bottom spatial neighboring block uses a collocated picture as a reference picture, using a motion vector of the one of the spatial neighboring blocks as a temporal vector of the current block.
    Type: Application
    Filed: November 20, 2019
    Publication date: July 1, 2021
    Inventors: Ruoyang YU, Kenneth ANDERSSON, Du LIU
  • Patent number: 11032575
    Abstract: The present embodiments introduce a new type of random access point in video bitstreams that can be used for random access operations but can be represented in encoded form at a lower bit-cost as compared to IRAP pictures. The random access point is a dependent random access point (DRAP) picture that is encoded and decoded using an IRAP picture as sole reference picture for the DRAP picture. The DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in a video bitstream.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: June 8, 2021
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Martin Pettersson, Jonatan Samuelsson, Rickard Sjöberg, Jacob Ström, Ruoyang Yu