Patents by Inventor Sriram Sethuraman

Sriram Sethuraman has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11985320
    Abstract: It is provided a method of video coding implemented in a decoding device or an encoding device, the method comprising: obtaining initial motion vectors for a current block; obtaining first predictions for a sample value in the current block based on the initial motion vectors; calculating a first matching cost according to the first predictions; determining whether an optical flow refinement process should be performed or not, according to at least one preset condition, the at least one preset condition comprising a condition of whether the calculated first matching cost is equal to or larger than a threshold value; and performing an optical flow refinement process for obtaining a final inter prediction for the sample value in the current block, when it is determined that the optical flow refinement process should be performed.
    Type: Grant
    Filed: August 20, 2021
    Date of Patent: May 14, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Semih Esenlik, Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Patent number: 11968387
    Abstract: A bidirectional optical flowing prediction method includes obtaining an initial motion vector pair for a current block, obtaining a forward and a backward prediction block according to the forward motion vector and a backward prediction block according to the initial motion vector pair, and calculating gradient parameters for a current sample in the current block. The method further includes obtaining at least two sample optical flow parameters, including a first parameter and a second parameter, for the current sample based on the gradient parameters, obtaining block optical flow parameters based on sample optical flow parameters of samples in the current block, and obtaining a prediction value of the current block. One of the block optical flow parameters is obtained by multiplying the first parameter and a sign function of the second parameter, and the sign function is a piecewise function with at least three subintervals.
    Type: Grant
    Filed: September 7, 2021
    Date of Patent: April 23, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Sagar Kotecha, Jeeva Raj A
  • Patent number: 11902508
    Abstract: A method for inter prediction of a block of a picture and corresponding apparatus are provided. The method comprises: determining a first prediction block based on an initial first motion vector of a current block in a first reference picture, so as to obtain a first extension block; obtaining from the first reference picture, one or more first reference blocks each of which is associated with a combination of the initial first motion vector and one of motion vector offsets; obtaining a target motion vector offset with a smallest cost among the motion vector offsets; determining for the current block, a refined first motion vector which is a combination of the initial first motion vector and the target motion vector offset; and obtaining a refined prediction block of the current block based on the refined first motion vector, thereby improving coherence of refined motion vectors to achieve higher coding efficiencies.
    Type: Grant
    Filed: September 3, 2021
    Date of Patent: February 13, 2024
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Sriram Sethuraman, Sagar Kotecha, Jeeva Raj A
  • Patent number: 11889109
    Abstract: In some embodiments, a video encoder or a video decoder obtains a pair of motion vectors for a current coding block of a video signal with respect to two reference frames. Predictions of the current block are generated using the pair of motion vectors from respective reference frames. The video encoder or video decoder further determine an optical flow for the current coding block based on samples values in the predictions. One component of the optical flow is determined based on the other component of the optical flow. Bi-predictive optical flow (BPOF) can be performed on the current coding block using the determined optical flow.
    Type: Grant
    Filed: September 17, 2021
    Date of Patent: January 30, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Publication number: 20240007666
    Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.
    Type: Application
    Filed: July 4, 2023
    Publication date: January 4, 2024
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Jeeva Raj A
  • Patent number: 11778224
    Abstract: Techniques are described for pre-processing frames to apply a temporal filter. A P-frame may be temporally filtered based on neighboring reference frames. The temporal filter may be applied to blocks of the P-frame to improve alignment with dependent frames that are encoded based on blocks of the P-frame.
    Type: Grant
    Filed: November 29, 2021
    Date of Patent: October 3, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Rahul Vanam, Sriram Sethuraman
  • Patent number: 11729438
    Abstract: Techniques are described for optimizing streaming video encoding profiles.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: August 15, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Vishal Jain, Deepthi Nandakumar, Sriram Sethuraman, Sandesh Ghanta
  • Patent number: 11722691
    Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.
    Type: Grant
    Filed: August 5, 2021
    Date of Patent: August 8, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Jeeva Raj A
  • Patent number: 11700376
    Abstract: Techniques are described for optimizing and assigning video encoding ladders.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: July 11, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Deepthi Nandakumar, Vishal Jain, Sriram Sethuraman, Sandesh Ghanta
  • Publication number: 20230188722
    Abstract: A method for inter-prediction of a current image block in a current picture of a video is provided. The method includes determining whether a first temporal distance (such as TD0) is equal to a second temporal distance (such as TD1), wherein the first temporal distance is represented in terms of a difference between a picture order count value of the current picture and a picture order count value of a first reference picture; and the second temporal distance is represented in terms of a difference between a picture order count value of a second reference picture and the picture order count value of the current picture; and performing no motion vector refinement (DMVR) procedure when it is determined that the first temporal distance (TD0) is not equal to the second temporal distance (TD1). Thus the DMVR procedure is restricted to only the image block with equal-distance references.
    Type: Application
    Filed: December 16, 2022
    Publication date: June 15, 2023
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Patent number: 11563948
    Abstract: A method for inter-prediction of a current image block in a current picture of a video is provided. The method includes determining whether a first temporal distance (such as TD0) is equal to a second temporal distance (such as TD1), wherein the first temporal distance is represented in terms of a difference between a picture order count value of the current picture and a picture order count value of a first reference picture; and the second temporal distance is represented in terms of a difference between a picture order count value of a second reference picture and the picture order count value of the current picture; and performing no motion vector refinement (DMVR) procedure when it is determined that the first temporal distance (TD0) is not equal to the second temporal distance (TD1). Thus the DMVR procedure is restricted to only the image block with equal-distance references.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: January 24, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Publication number: 20220368888
    Abstract: The present disclosure provides an inter prediction method, comprising the steps of obtaining an initial motion vector and a reference picture for bi-prediction; obtaining sets of candidate sample positions in the reference picture according to the initial motion vector and candidate motion vectors, wherein each candidate motion vector is derived by the initial motion vector and a respective motion vector offset, and wherein each set of candidate sample positions corresponds to each candidate motion vector; obtaining a respective set of sample positions from each set of candidate sample positions; computing a matching cost for each candidate motion vector within each set of sample positions; obtaining a refined motion vector based on the computed matching cost of each candidate motion vector; and obtaining prediction values for a current block based on the refined motion vector.
    Type: Application
    Filed: September 3, 2021
    Publication date: November 17, 2022
    Inventors: Sriram SETHURAMAN, Semih ESENLIK, Jeeva Raj A, Sagar KOTECHA
  • Publication number: 20220368921
    Abstract: A method for inter-prediction of a current image block in a current picture of a video is provided. The method includes determining whether a first temporal distance (such as TD0) is equal to a second temporal distance (such as TD1), wherein the first temporal distance is represented in terms of a difference between a picture order count value of the current picture and a picture order count value of a first reference image; and the second temporal distance is represented in terms of a difference between a picture order count value of a second reference image and the picture order count value of the current picture; and performing no motion vector refinement (DMVR) procedure when it is determined that the first temporal distance (TD0) is not equal to the second temporal distance (TD1). Thus the DMVR procedure is restricted to only the image block with equal-distance references.
    Type: Application
    Filed: March 12, 2021
    Publication date: November 17, 2022
    Inventors: Sriram SETHURAMAN, Jeeva Raj A, Sagar KOTECHA
  • Patent number: 11490096
    Abstract: Methods and system, including decoders and encoders, for interprediction.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: November 1, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Patent number: 11336935
    Abstract: Techniques are described for detecting desynchronization between an audio stream and a video stream.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: May 17, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Yongjun Wu, Joshua Peter Ebenezer, Sriram Sethuraman, Hai Wei, Zongyi Liu
  • Publication number: 20220132158
    Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.
    Type: Application
    Filed: January 11, 2022
    Publication date: April 28, 2022
    Applicant: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Patent number: 11310521
    Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.
    Type: Grant
    Filed: November 22, 2020
    Date of Patent: April 19, 2022
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Publication number: 20220116648
    Abstract: It is provided a method of decoding a video bitstream implemented by a decoding device, the video bitstream including coded data for a plurality of pictures. The decoding method comprises: parsing an enabling flag for decoder motion vector refinement (DMVR) from a sequence parameter set of the video bitstream; parsing a disabling flag for DMVR from a syntax structure of a lower hierarchic syntax structure level than the sequence parameter set (SPS) level of the video bitstream; and performing DMVR based inter bi-prediction for a current block within at least one region of the current picture to obtain predicted sample values of the current block when at least one pre-defined condition is fulfilled, and wherein the at least one pre-defined condition comprises that the parsed value of the disabling flag specifies that DMVR based inter bi-prediction is enabled for at least one region of the current picture.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Sriram SETHURAMAN, Sagar KOTECHA, Jeeva Raj A, Semih ESENLIK
  • Publication number: 20220116624
    Abstract: A method for bi-directional optical flow prediction based on reference sample values from sample positions belonging to an extended region of a predicted block used in the bi-directional optical flow prediction of a current block is provided, wherein sub-pixel positions in the extended region of the predicted block in the reference picture are rounded to obtain integer pixel sample positions in the reference picture, wherein the reference sample values at the obtained integer pixel sample positions in the reference picture are used in the computation of boundary sample gradients corresponding to the boundaries of the predicted block in the reference picture.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Sriram SETHURAMAN, Jeeva Raj A, Sagar KOTECHA
  • Patent number: 11272205
    Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.
    Type: Grant
    Filed: November 22, 2020
    Date of Patent: March 8, 2022
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha