Patents by Inventor Ruoyang Yu

Ruoyang Yu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11973952
    Abstract: A prediction unit (60) for an encoder (24) or decoder (44) implements matrix based intra prediction Input boundary samples for a current block are downsampled to obtain reduced boundary samples for matrix multiplication and/or linear interpolation, or both. In one embodiment, downsampling is performed in a manner that aligns the reduced boundary samples with an output of a matrix multiplication unit of the prediction unit. In other embodiments, downsampling is performed without averaging. The embodiments reduce the complexity of the prediction unit and the latency of the encoder (24) or decoder (44).
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: April 30, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Zhi Zhang, Ruoyang Yu, Kenneth Andersson, Per Wennersten, Jacob Ström, Rickard Sjöberg
  • Patent number: 11943478
    Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.
    Type: Grant
    Filed: September 17, 2020
    Date of Patent: March 26, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Zhi Zhang, Kenneth Andersson, Davood Saffar, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
  • Patent number: 11936904
    Abstract: A method of performing bi-directional optical flow, BDOF, processing for a video sequence of images, with each image including a plurality of blocks with bidirectional-predicted inter coding blocks, BPICBs. The method includes obtaining a shifted pair of refinement parameters per a subblock of a bidirectional-predicted inter coding block, wherein the shifted pair of refinement parameters includes a shifted first refinement parameter and a shifted second refinement parameter.
    Type: Grant
    Filed: September 17, 2020
    Date of Patent: March 19, 2024
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Du Liu, Ruoyang Yu
  • Patent number: 11930205
    Abstract: A method for decoding a current block in a current picture of a video bitstream includes decoding, from the video bitstream, a first motion vector for the current block relative to a first reference block of a first reference picture having a first picture order count, and decoding, from the video bitstream, a second motion vector for the current block relative to a second reference block of a second reference picture having a second picture order count. A similarity metric is generated based on a comparison of the first motion vector and the second motion vector. The method further includes determining whether to refine the first motion vector based on the similarity metric, generating a first refined motion vector from the first motion vector, and performing motion compensation to derive a first reference block from the first reference picture using the first refined motion vector.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: March 12, 2024
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Du Liu, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
  • Patent number: 11902516
    Abstract: A method for deblocking at least one boundary of a coding unit, wherein the boundary forms a first side and a second side of the coding unit, wherein a video picture comprises the coding unit, and wherein the first and second sides use a same reference picture. The method includes obtaining a first motion vector component in the first side; obtaining a second motion vector component in the second side; determining whether an absolute difference between the first motion vector component and the second motion vector component is equal to or larger than a predetermined threshold that is less than 1 sample; and as a result of determining that the absolute difference between the first motion vector component and the second motion vector component is equal to or larger than the predetermined threshold, applying deblocking to the vertical or horizontal boundary between the first side and the second side.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: February 13, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Jack Enhorn, Ruoyang Yu
  • Patent number: 11902566
    Abstract: A decoder can be configured to obtain a current inter block and a plurality of previously decoded inter blocks. Each inter block of the plurality of inter blocks can include a motion vector having a resolution. The decoder generates a list of motion vector predictor candidates that is used to predict the motion vector that is associated with the current inter block. Generating the list of motion vector predictor candidates can include defining a set of inter blocks that includes a number of previously decoded inter blocks; scanning the inter blocks in the set of inter blocks in a scanning order; and for each of the inter blocks in the set of inter blocks: deriving a motion vector prediction candidate using the motion vector of the inter block; and determining whether a criterion is satisfied.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: February 13, 2024
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang Yu, Du Liu, Per Wennersten, Kenneth Andersson, Rickard Sjöberg
  • Patent number: 11882302
    Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.
    Type: Grant
    Filed: March 28, 2023
    Date of Patent: January 23, 2024
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Ruoyang Yu, Rickard Sjöberg, Zhi Zhang
  • Publication number: 20230308668
    Abstract: A method and decoder for determining that a decoder conforming to a first profile is capable of decoding a first picture of a video bitstream conforming to a second profile is provided. The method includes obtaining an indicator value, the indicator value indicating conformance to a profile. The method includes determining whether the first picture in the video bitstream is a still picture. The method includes responsive to the indicator value indicating conformance to the second profile and the first picture is determined to be a still picture, determining that the decoder conforming to the first profile is capable of decoding the first picture of the video bitstream.
    Type: Application
    Filed: June 7, 2021
    Publication date: September 28, 2023
    Inventors: Martin PETTERSSON, Rickard SJÖBERG, Mitra DAMGHANIAN, Ruoyang YU, Jacob STRÖM, Jack ENHORN, Du LIU
  • Publication number: 20230239486
    Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.
    Type: Application
    Filed: March 28, 2023
    Publication date: July 27, 2023
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang YU, Rickard SJÖBERG, Zhi ZHANG
  • Publication number: 20230232011
    Abstract: There is provided a method for processing a bitstream. The method comprises determining a value, N, wherein N identifies a number of ordered layer representations, wherein N is greater than or equal to 3 such that the N ordered layer representations comprises a highest layer representation, a second highest layer representation, and a third highest layer representation. The method further comprises determining a value for the highest layer representation. The method comprises, after determining the value for the highest layer representation and before determining a value for the third highest layer representation, determining a value for the second highest layer representation. The method comprises, after determining the value for the second highest layer representation, determining a value for the third highest layer representation.
    Type: Application
    Filed: January 27, 2021
    Publication date: July 20, 2023
    Applicant: Talefonaktiebolaget LM Ericsson (publ)
    Inventors: Rickard SJÖBERG, Martin PETTERSSON, Mitra DAMIGHANIAN, Jacob STROM, Zhi ZHANG, Jack ENHORN, Ruoyang YU, Du LIU
  • Publication number: 20230179803
    Abstract: A method for decoding a picture comprising a virtual boundary from a coded video bitstream. The method includes determining one or more of a maximum picture width or a maximum picture height from one or more syntax elements S1 in the coded video bitstream and determining one or more of a current picture width or a current picture height from one or more syntax elements S2 in the coded video bitstream. The method also includes determining that a virtual boundary syntax element in the coded video bitstream is encoded with a bit length derived from (i) one or more of the maximum picture width or the maximum picture height or (ii) one or more of the current picture width or the current picture height.
    Type: Application
    Filed: March 30, 2021
    Publication date: June 8, 2023
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Mitra DAMGHANIAN, Martin PETTERSSON, Rickard SJÖBERG, Zhi ZHANG, Jack ENHORN, Ruoyang YU, Jacob STRÕM
  • Publication number: 20230137221
    Abstract: A methods and apparatuses for encoding or decoding a segment in a coded picture. The decoding may include obtaining from a bitstream a value of a first codeword that indicates whether the coded picture may contain bi-directional inter coded segments or not. The decoding may include, based on the value of the first codeword, deriving one or more parameter values by either (a) decoding one or more parameters from the bitstream to obtain the one or more parameter values or (b) inferring the one or more parameter values. The decoding may include decoding the segment in the coded picture based on the one or more parameter values. The encoding may include encoding the first codeword to the bitstream and determining whether to encode one or more parameter values in the bitstream based on a determination of whether the coded picture will contain bi-directional inter coded segments or not.
    Type: Application
    Filed: March 30, 2021
    Publication date: May 4, 2023
    Applicant: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Martin PETTERSSON, Ruoyang YU, Rickard SJÖBERG, Mitra DAMGHANIAN, Zhi ZHANG, Jack ENHORN
  • Patent number: 11627329
    Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.
    Type: Grant
    Filed: November 19, 2021
    Date of Patent: April 11, 2023
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Ruoyang Yu, Rickard Sjöberg, Zhi Zhang
  • Publication number: 20220377371
    Abstract: A method of performing bi-directional optical flow, BDOF, processing for a video sequence of images, with each image including a plurality of blocks with bidirectional-predicted inter coding blocks, BPICBs. The method includes obtaining a shifted pair of refinement parameters per a subblock of a bidirectional-predicted inter coding block, wherein the shifted pair of refinement parameters includes a shifted first refinement parameter and a shifted second refinement parameter.
    Type: Application
    Filed: September 17, 2020
    Publication date: November 24, 2022
    Inventors: Du LIU, Ruoyang YU
  • Publication number: 20220377378
    Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.
    Type: Application
    Filed: September 17, 2020
    Publication date: November 24, 2022
    Inventors: Zhi ZHANG, Kenneth ANDERSSON, Davood SAFFAR, Rickard SJÖBERG, Jacob STRÖM, Ruoyang YU
  • Publication number: 20220321878
    Abstract: There are provided mechanisms for temporal motion vector prediction of a current picture in a series of pictures of a video sequence. The method comprises determining, for a current block of the current picture, whether any one of: left, top, top-right and left-bottom spatial neighboring blocks of the current block in the current picture uses a collocated picture as a reference picture. The method further comprises, when the determination is that one of the left, top, top-right and left-bottom spatial neighboring block uses a collocated picture as a reference picture, using a motion vector of the one of the spatial neighboring blocks as a temporal vector of the current block.
    Type: Application
    Filed: June 22, 2022
    Publication date: October 6, 2022
    Inventors: Ruoyang YU, Kenneth ANDERSSON, Du LIU
  • Publication number: 20220303574
    Abstract: The present embodiments introduce a new type of random access point in video bitstreams that can be used for random access operations but can be represented in encoded form at a lower bit-cost as compared to IRAP pictures. The random access point is a dependent random access point (DRAP) picture that is encoded and decoded using an IRAP picture and/or a previous, according to a decoding order, DRAP picture as sole reference picture(s) for the DRAP picture. The DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in a video bitstream.
    Type: Application
    Filed: June 6, 2022
    Publication date: September 22, 2022
    Inventors: Martin PETTERSSON, Jonatan SAMUELSSON, Rickard SJÖBERG, Jacob STRÖM, Ruoyang YU
  • Publication number: 20220264148
    Abstract: Intra-prediction with modified clipping is presented herein for encoding and/or decoding video and/or still images. Input boundary samples for a current block are used to generate a reduced prediction matrix of prediction samples. Clipping is performed on each of the prediction samples in the reduced prediction matrix that are out of range to generate a clipped reduced prediction matrix. The clipped reduced prediction matrix is then used to generate the complete prediction block corresponding to the current block. The prediction block is then used to obtain a residual block. By clipping the prediction sample(s) in the reduced prediction matrix, the solution presented herein reduces latency and complexity.
    Type: Application
    Filed: June 12, 2020
    Publication date: August 18, 2022
    Inventors: Zhi Zhang, Ruoyang Yu, Kenneth Andersson, Per Wennersten, Jacob Ström, Rickard Sjöberg
  • Publication number: 20220239919
    Abstract: A prediction unit (60) for an encoder (24) or decoder (44) implements matrix based intra prediction Input boundary samples for a current block are downsampled to obtain reduced boundary samples for matrix multiplication and/or linear interpolation, or both. In one embodiment, downsampling is performed in a manner that aligns the reduced boundary samples with an output of a matrix multiplication unit of the prediction unit. In other embodiments, downsampling is performed without averaging. The embodiments reduce the complexity of the prediction unit and the latency of the encoder (24) or decoder (44).
    Type: Application
    Filed: June 12, 2020
    Publication date: July 28, 2022
    Inventors: Zhi Zhang, Ruoyang Yu, Kenneth Andersson, Per Wennersten, Jacob Ström, Rickard Sjöberg
  • Patent number: 11395000
    Abstract: The present embodiments introduce a new type of random access point in video bitstreams that can be used for random access operations but can be represented in encoded form at a lower bit-cost as compared to IRAP pictures. The random access point is a dependent random access point (DRAP) picture that is encoded and decoded using an IRAP picture and/or a previous, according to a decoding order, DRAP picture as sole reference picture(s) for the DRAP picture. The DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in a video bitstream.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: July 19, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Martin Pettersson, Jonatan Samuelsson, Rickard Sjöberg, Jacob Ström, Ruoyang Yu