Patents by Inventor Ruoyang Yu
Ruoyang Yu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11973952Abstract: A prediction unit (60) for an encoder (24) or decoder (44) implements matrix based intra prediction Input boundary samples for a current block are downsampled to obtain reduced boundary samples for matrix multiplication and/or linear interpolation, or both. In one embodiment, downsampling is performed in a manner that aligns the reduced boundary samples with an output of a matrix multiplication unit of the prediction unit. In other embodiments, downsampling is performed without averaging. The embodiments reduce the complexity of the prediction unit and the latency of the encoder (24) or decoder (44).Type: GrantFiled: June 12, 2020Date of Patent: April 30, 2024Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)Inventors: Zhi Zhang, Ruoyang Yu, Kenneth Andersson, Per Wennersten, Jacob Ström, Rickard Sjöberg
-
Patent number: 11943478Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.Type: GrantFiled: September 17, 2020Date of Patent: March 26, 2024Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)Inventors: Zhi Zhang, Kenneth Andersson, Davood Saffar, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
-
Patent number: 11936904Abstract: A method of performing bi-directional optical flow, BDOF, processing for a video sequence of images, with each image including a plurality of blocks with bidirectional-predicted inter coding blocks, BPICBs. The method includes obtaining a shifted pair of refinement parameters per a subblock of a bidirectional-predicted inter coding block, wherein the shifted pair of refinement parameters includes a shifted first refinement parameter and a shifted second refinement parameter.Type: GrantFiled: September 17, 2020Date of Patent: March 19, 2024Assignee: Telefonaktiebolaget LM Ericsson (publ)Inventors: Du Liu, Ruoyang Yu
-
Patent number: 11930205Abstract: A method for decoding a current block in a current picture of a video bitstream includes decoding, from the video bitstream, a first motion vector for the current block relative to a first reference block of a first reference picture having a first picture order count, and decoding, from the video bitstream, a second motion vector for the current block relative to a second reference block of a second reference picture having a second picture order count. A similarity metric is generated based on a comparison of the first motion vector and the second motion vector. The method further includes determining whether to refine the first motion vector based on the similarity metric, generating a first refined motion vector from the first motion vector, and performing motion compensation to derive a first reference block from the first reference picture using the first refined motion vector.Type: GrantFiled: January 3, 2022Date of Patent: March 12, 2024Assignee: Telefonaktiebolaget LM Ericsson (publ)Inventors: Du Liu, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
-
Patent number: 11902516Abstract: A method for deblocking at least one boundary of a coding unit, wherein the boundary forms a first side and a second side of the coding unit, wherein a video picture comprises the coding unit, and wherein the first and second sides use a same reference picture. The method includes obtaining a first motion vector component in the first side; obtaining a second motion vector component in the second side; determining whether an absolute difference between the first motion vector component and the second motion vector component is equal to or larger than a predetermined threshold that is less than 1 sample; and as a result of determining that the absolute difference between the first motion vector component and the second motion vector component is equal to or larger than the predetermined threshold, applying deblocking to the vertical or horizontal boundary between the first side and the second side.Type: GrantFiled: February 19, 2020Date of Patent: February 13, 2024Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)Inventors: Kenneth Andersson, Jack Enhorn, Ruoyang Yu
-
Patent number: 11902566Abstract: A decoder can be configured to obtain a current inter block and a plurality of previously decoded inter blocks. Each inter block of the plurality of inter blocks can include a motion vector having a resolution. The decoder generates a list of motion vector predictor candidates that is used to predict the motion vector that is associated with the current inter block. Generating the list of motion vector predictor candidates can include defining a set of inter blocks that includes a number of previously decoded inter blocks; scanning the inter blocks in the set of inter blocks in a scanning order; and for each of the inter blocks in the set of inter blocks: deriving a motion vector prediction candidate using the motion vector of the inter block; and determining whether a criterion is satisfied.Type: GrantFiled: December 19, 2019Date of Patent: February 13, 2024Assignee: Telefonaktiebolaget LM Ericsson (publ)Inventors: Ruoyang Yu, Du Liu, Per Wennersten, Kenneth Andersson, Rickard Sjöberg
-
Patent number: 11882302Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.Type: GrantFiled: March 28, 2023Date of Patent: January 23, 2024Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)Inventors: Ruoyang Yu, Rickard Sjöberg, Zhi Zhang
-
Publication number: 20230308668Abstract: A method and decoder for determining that a decoder conforming to a first profile is capable of decoding a first picture of a video bitstream conforming to a second profile is provided. The method includes obtaining an indicator value, the indicator value indicating conformance to a profile. The method includes determining whether the first picture in the video bitstream is a still picture. The method includes responsive to the indicator value indicating conformance to the second profile and the first picture is determined to be a still picture, determining that the decoder conforming to the first profile is capable of decoding the first picture of the video bitstream.Type: ApplicationFiled: June 7, 2021Publication date: September 28, 2023Inventors: Martin PETTERSSON, Rickard SJÖBERG, Mitra DAMGHANIAN, Ruoyang YU, Jacob STRÖM, Jack ENHORN, Du LIU
-
Publication number: 20230239486Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.Type: ApplicationFiled: March 28, 2023Publication date: July 27, 2023Applicant: Telefonaktiebolaget LM Ericsson (publ)Inventors: Ruoyang YU, Rickard SJÖBERG, Zhi ZHANG
-
Publication number: 20230232011Abstract: There is provided a method for processing a bitstream. The method comprises determining a value, N, wherein N identifies a number of ordered layer representations, wherein N is greater than or equal to 3 such that the N ordered layer representations comprises a highest layer representation, a second highest layer representation, and a third highest layer representation. The method further comprises determining a value for the highest layer representation. The method comprises, after determining the value for the highest layer representation and before determining a value for the third highest layer representation, determining a value for the second highest layer representation. The method comprises, after determining the value for the second highest layer representation, determining a value for the third highest layer representation.Type: ApplicationFiled: January 27, 2021Publication date: July 20, 2023Applicant: Talefonaktiebolaget LM Ericsson (publ)Inventors: Rickard SJÖBERG, Martin PETTERSSON, Mitra DAMIGHANIAN, Jacob STROM, Zhi ZHANG, Jack ENHORN, Ruoyang YU, Du LIU
-
Publication number: 20230179803Abstract: A method for decoding a picture comprising a virtual boundary from a coded video bitstream. The method includes determining one or more of a maximum picture width or a maximum picture height from one or more syntax elements S1 in the coded video bitstream and determining one or more of a current picture width or a current picture height from one or more syntax elements S2 in the coded video bitstream. The method also includes determining that a virtual boundary syntax element in the coded video bitstream is encoded with a bit length derived from (i) one or more of the maximum picture width or the maximum picture height or (ii) one or more of the current picture width or the current picture height.Type: ApplicationFiled: March 30, 2021Publication date: June 8, 2023Applicant: Telefonaktiebolaget LM Ericsson (publ)Inventors: Mitra DAMGHANIAN, Martin PETTERSSON, Rickard SJÖBERG, Zhi ZHANG, Jack ENHORN, Ruoyang YU, Jacob STRÕM
-
Publication number: 20230137221Abstract: A methods and apparatuses for encoding or decoding a segment in a coded picture. The decoding may include obtaining from a bitstream a value of a first codeword that indicates whether the coded picture may contain bi-directional inter coded segments or not. The decoding may include, based on the value of the first codeword, deriving one or more parameter values by either (a) decoding one or more parameters from the bitstream to obtain the one or more parameter values or (b) inferring the one or more parameter values. The decoding may include decoding the segment in the coded picture based on the one or more parameter values. The encoding may include encoding the first codeword to the bitstream and determining whether to encode one or more parameter values in the bitstream based on a determination of whether the coded picture will contain bi-directional inter coded segments or not.Type: ApplicationFiled: March 30, 2021Publication date: May 4, 2023Applicant: Telefonaktiebolaget LM Ericsson (publ)Inventors: Martin PETTERSSON, Ruoyang YU, Rickard SJÖBERG, Mitra DAMGHANIAN, Zhi ZHANG, Jack ENHORN
-
Patent number: 11627329Abstract: A process for selecting a transform set for a prediction block. The process can be used in both an encoder and a decoder. For example, the process can be used in both an encoder and a decoder for a prediction block that has been predicted from a reference block. In some embodiments, both the prediction block and the reference block are intra blocks.Type: GrantFiled: November 19, 2021Date of Patent: April 11, 2023Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)Inventors: Ruoyang Yu, Rickard Sjöberg, Zhi Zhang
-
Publication number: 20220377371Abstract: A method of performing bi-directional optical flow, BDOF, processing for a video sequence of images, with each image including a plurality of blocks with bidirectional-predicted inter coding blocks, BPICBs. The method includes obtaining a shifted pair of refinement parameters per a subblock of a bidirectional-predicted inter coding block, wherein the shifted pair of refinement parameters includes a shifted first refinement parameter and a shifted second refinement parameter.Type: ApplicationFiled: September 17, 2020Publication date: November 24, 2022Inventors: Du LIU, Ruoyang YU
-
Publication number: 20220377378Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.Type: ApplicationFiled: September 17, 2020Publication date: November 24, 2022Inventors: Zhi ZHANG, Kenneth ANDERSSON, Davood SAFFAR, Rickard SJÖBERG, Jacob STRÖM, Ruoyang YU
-
Publication number: 20220321878Abstract: There are provided mechanisms for temporal motion vector prediction of a current picture in a series of pictures of a video sequence. The method comprises determining, for a current block of the current picture, whether any one of: left, top, top-right and left-bottom spatial neighboring blocks of the current block in the current picture uses a collocated picture as a reference picture. The method further comprises, when the determination is that one of the left, top, top-right and left-bottom spatial neighboring block uses a collocated picture as a reference picture, using a motion vector of the one of the spatial neighboring blocks as a temporal vector of the current block.Type: ApplicationFiled: June 22, 2022Publication date: October 6, 2022Inventors: Ruoyang YU, Kenneth ANDERSSON, Du LIU
-
Publication number: 20220303574Abstract: The present embodiments introduce a new type of random access point in video bitstreams that can be used for random access operations but can be represented in encoded form at a lower bit-cost as compared to IRAP pictures. The random access point is a dependent random access point (DRAP) picture that is encoded and decoded using an IRAP picture and/or a previous, according to a decoding order, DRAP picture as sole reference picture(s) for the DRAP picture. The DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in a video bitstream.Type: ApplicationFiled: June 6, 2022Publication date: September 22, 2022Inventors: Martin PETTERSSON, Jonatan SAMUELSSON, Rickard SJÖBERG, Jacob STRÖM, Ruoyang YU
-
Publication number: 20220264148Abstract: Intra-prediction with modified clipping is presented herein for encoding and/or decoding video and/or still images. Input boundary samples for a current block are used to generate a reduced prediction matrix of prediction samples. Clipping is performed on each of the prediction samples in the reduced prediction matrix that are out of range to generate a clipped reduced prediction matrix. The clipped reduced prediction matrix is then used to generate the complete prediction block corresponding to the current block. The prediction block is then used to obtain a residual block. By clipping the prediction sample(s) in the reduced prediction matrix, the solution presented herein reduces latency and complexity.Type: ApplicationFiled: June 12, 2020Publication date: August 18, 2022Inventors: Zhi Zhang, Ruoyang Yu, Kenneth Andersson, Per Wennersten, Jacob Ström, Rickard Sjöberg
-
Publication number: 20220239919Abstract: A prediction unit (60) for an encoder (24) or decoder (44) implements matrix based intra prediction Input boundary samples for a current block are downsampled to obtain reduced boundary samples for matrix multiplication and/or linear interpolation, or both. In one embodiment, downsampling is performed in a manner that aligns the reduced boundary samples with an output of a matrix multiplication unit of the prediction unit. In other embodiments, downsampling is performed without averaging. The embodiments reduce the complexity of the prediction unit and the latency of the encoder (24) or decoder (44).Type: ApplicationFiled: June 12, 2020Publication date: July 28, 2022Inventors: Zhi Zhang, Ruoyang Yu, Kenneth Andersson, Per Wennersten, Jacob Ström, Rickard Sjöberg
-
Patent number: 11395000Abstract: The present embodiments introduce a new type of random access point in video bitstreams that can be used for random access operations but can be represented in encoded form at a lower bit-cost as compared to IRAP pictures. The random access point is a dependent random access point (DRAP) picture that is encoded and decoded using an IRAP picture and/or a previous, according to a decoding order, DRAP picture as sole reference picture(s) for the DRAP picture. The DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in a video bitstream.Type: GrantFiled: December 22, 2020Date of Patent: July 19, 2022Assignee: Telefonaktiebolaget LM Ericsson (publ)Inventors: Martin Pettersson, Jonatan Samuelsson, Rickard Sjöberg, Jacob Ström, Ruoyang Yu