Patents by Inventor Vadim Seregin

Vadim Seregin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220201315
    Abstract: Example devices and techniques for multi-pass decoder-side motion vector refinement (DMVR) are disclosed. An example device includes memory configured to store video data and one or more processors coupled to the memory. The one or more processors are configured to apply a multi-pass DMVR to a motion vector for a block of the video data to determine at least one refined motion vector and decode the block based on the at least one refined motion vector. The multi-pass DMVR includes a block-based first pass, a sub-block-based second pass, and a sub-block-based third pass.
    Type: Application
    Filed: December 20, 2021
    Publication date: June 23, 2022
    Inventors: Zhi Zhang, Han Huang, Chun-Chi Chen, Yan Zhang, Vadim Seregin, Marta Karczewicz
  • Publication number: 20220201313
    Abstract: A method of decoding video data includes determining that bi-directional optical flow (BDOF) is enabled for a block of the video data; dividing the block into a plurality of sub-blocks based on the determination that BDOF is enabled for the block, determining, for each sub-block of one or more sub-blocks of the plurality of sub-blocks, respective distortion values, determining that one of per-pixel BDOF is performed or BDOF is bypassed for each sub-block of the one or more sub-blocks of the plurality of sub-blocks based on the respective distortion values, determining prediction samples for each sub-block of the one or more sub-blocks based on the determination of per-pixel BDOF being performed or BDOF being bypassed, and reconstructing the block based on the prediction samples.
    Type: Application
    Filed: December 20, 2021
    Publication date: June 23, 2022
    Inventors: Zhi Zhang, Han Huang, Chun-Chi Chen, Yan Zhang, Vadim Seregin, Marta Karczewicz
  • Publication number: 20220201329
    Abstract: Techniques are described herein for processing video data using enhanced interpolation filters for intra-prediction. For instance, a device can determine an intra-prediction mode for predicting a block of video data. The device can determine a type of smoothing filter to use for the block of video data, wherein the type of the smoothing filter is determined based at least in part on comparing at least one of a width of the block of video data and a height of the block of video data to a first threshold. The device can further perform intra-prediction for the block of video data using the determined type of smoothing filter and the intra-prediction mode.
    Type: Application
    Filed: December 17, 2021
    Publication date: June 23, 2022
    Inventors: Bappaditya RAY, Vadim SEREGIN, Marta KARCZEWICZ
  • Publication number: 20220201281
    Abstract: An method of decoding video data includes deriving, for a current block of video data and using decoder side intra mode derivation (DIMD), a list of intra modes using reconstructed samples of neighboring blocks; constructing, for the current block, a most probable mode (MPM) list, wherein constructing the MPM list comprises inserting, into the MPM list, at least one intra mode from the derived list of intra modes; and predicting, using a candidate selected from the constructed MPM list, the current block.
    Type: Application
    Filed: October 15, 2021
    Publication date: June 23, 2022
    Inventors: Jingya Li, Vadim Seregin, Marta Karczewicz
  • Publication number: 20220201282
    Abstract: Systems and techniques are provided for overlapped block motion compensation (OBMC). A method can include determining an OBMC mode is enabled for a current subblock of video data; for a neighboring subblock(s) adjacent to the current subblock, determining whether a first, second and third condition are met, the first condition comprising that all reference picture lists for predicting the current subblock are used to predict the neighboring subblock; the second condition comprising that identical reference pictures are used to determine motion vectors associated with the current subblock and the neighboring subblock, and the third condition comprising that a difference between motion vectors of the current subblock and the neighboring subblock do not exceed a threshold; and based on determining that the OBMC mode is enabled and the first, second, and third conditions are met, determining not to use motion information of the neighboring subblock for motion compensation of the current subblock.
    Type: Application
    Filed: November 23, 2021
    Publication date: June 23, 2022
    Inventors: Yao-Jen CHANG, Jingya LI, Vadim SEREGIN, Marta KARCZEWICZ
  • Publication number: 20220201322
    Abstract: An example device for decoding video data includes one or more processors configured to: determine that a first weight and a second weight are specified for a bi-prediction mode predicted current block of video data; determine whether the current block is to be predicted using multi-hypothesis prediction (MHP) mode with the bi-prediction mode as a base mode; in response to determining that the current block is to be predicted using the MHP mode with the bi-prediction mode as the base mode, determine an additional inter-prediction mode of the MHP mode; generate a first prediction block according to the bi-prediction mode; generate a second prediction block according to the additional inter-prediction mode; generate a final prediction block for the current block according to the MHP mode using the first prediction block and the second prediction block; and decode the current block using the final prediction block.
    Type: Application
    Filed: December 15, 2021
    Publication date: June 23, 2022
    Inventors: Han Huang, Kevin Pascal Andre Reuze, Vadim Seregin, Marta Karczewicz
  • Patent number: 11368684
    Abstract: Techniques are described for adaptation parameter sets (APS) for adaptive loop filter (ALF) parameters. One example involves obtaining an APS ID value and an APS type value associated with a NAL unit from a bitstream. A first APS associated with at least a portion of at least one picture is identified, with the first APS being uniquely identified by a combination of the APS type value and the APS identifier value, and the APS identifier value of the first APS is in a range based on the APS type value. The portion of the at least one picture is then reconstructed using an adaptive loop filter with parameters defined by the first APS uniquely identified by the APS type value and the APS identifier value.
    Type: Grant
    Filed: April 7, 2020
    Date of Patent: June 21, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Vadim Seregin, Nan Hu, Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: 11356685
    Abstract: A video decoder can be configured to decode a first syntax element indicating a size of a coding tree unit (CTU); after decoding the first syntax element indicating the size of the CTU, decode a second syntax element indicating a width of elements of a subpicture identifier grid; after decoding the first syntax element indicating the size of the CTU, decode a third syntax element indicating a height of the elements of the subpicture identifier grid; and determine a location of a subpicture within a picture based on the first syntax element, the second syntax element, and the third syntax element.
    Type: Grant
    Filed: September 21, 2020
    Date of Patent: June 7, 2022
    Assignee: Qualcomm Incorproated
    Inventors: Yao-Jen Chang, Muhammed Zeyd Coban, Vadim Seregin, Marta Karczewicz
  • Patent number: 11356707
    Abstract: Systems, methods, and computer-readable storage media for signaling filters for reference picture resampling are described. One example involves obtaining an encoded video bitstream associated with the video data, identifying a current picture and at least one reference picture from the encoded video bitstream, and identifying signaling data from the encoded video bitstream for the video data, the signaling data including a partial set of coefficient data for at least one filter. A complete set of coefficients (e.g., filter coefficients) is derived for the at least one filter from the partial set of coefficient data and characteristics of the at least one filter, and the current picture is processed using the complete set of coefficients for the at least one filter.
    Type: Grant
    Filed: September 17, 2020
    Date of Patent: June 7, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Vadim Seregin, Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: 11356705
    Abstract: A method of processing video data comprises obtaining a bitstream and locating intra random access pictures (IRAP) or Gradual Decoder Refresh (GDR) pictures among the encoded pictures in the bitstream. Locating the IRAP or GDR pictures may comprise obtaining, from a picture header Network Abstraction Layer (NAL) unit in the bitstream, a syntax element that indicates that a picture associated with the picture header NAL unit must be either an Intra Random Access Picture (IRAP) or a Gradual Decoder Refresh (GDR) picture. The picture header NAL unit contains syntax elements that apply to all slices of the picture associated with the picture header NAL unit.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: June 7, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Muhammed Zeyd Coban, Vadim Seregin, Adarsh Krishnan Ramasubramonian, Marta Karczewicz
  • Patent number: 11356662
    Abstract: Systems, methods, and computer-readable media are provided for simplification of clipping value calculations for adaptive loop filtering. An example method can include obtaining video data including one or more pictures; obtaining a block of a picture from the one or more pictures; determining clipping values for a filter, the clipping values corresponding to a luma component in the picture and/or a chroma component in the picture, wherein each clipping value is determined by left shifting a first integer by a second integer, the second integer including a result of a bit depth value for a sample from the picture minus an offset value associated with a clipping index value; and applying the filter to the block.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: June 7, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Nan Hu, Vadim Seregin, Marta Karczewicz
  • Publication number: 20220167001
    Abstract: A method of decoding video data may comprise decoding data from an encoded bitstream to generate motion vectors and performing a decoder-side motion vector refinement (DMVR) process on one or more of the motion vectors. Performing the DMVR process may include determining one or more characteristics of current video block being decoded and determining a search area for the DMVR process for the current video block based on the determined one or more characteristics of the current video block.
    Type: Application
    Filed: November 23, 2020
    Publication date: May 26, 2022
    Inventors: Zhi Zhang, Chun-Chi Chen, Han Huang, Vadim Seregin, Marta Karczewicz
  • Patent number: 11343493
    Abstract: An example method includes decoding a plurality of filter coefficients of a cross-component adaptive loop filter, wherein decoding a particular filter coefficient of the plurality of filter coefficients comprises: decoding, from an encoded video bitstream, a syntax element specifying an exponent value that represents a log base 2 of an absolute value of the particular filter coefficient as two raised to the power of the exponent value; and determining a value of the particular filter coefficient based on the exponent value; reconstructing samples of a block of video data; and cross-component adaptive loop filtering, based on the plurality of filter coefficients, the block of video data.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: May 24, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Nan Hu, Jie Dong, Vadim Seregin, Marta Karczewicz
  • Publication number: 20220150545
    Abstract: A video decoder configured to set a context index variable to a first value, wherein the first value for the context index variable is associated with a first context; context decode a first bin for a syntax element indicating a transform using the first context; determine a new value for the context index variable based on a value of the first bin; context decode a second bin for the syntax element indicating the transform using a context associated with the new value; determine an inverse transform from a set of inverse transform candidates based on the first bin and the second bin; and apply the inverse transform to a set of coefficients to determine a block of residual data.
    Type: Application
    Filed: June 9, 2021
    Publication date: May 12, 2022
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Marta Karczewicz
  • Patent number: 11330297
    Abstract: Methods incorporating extensions to copy-above mode for palette mode coding are disclosed. In one aspect, the method includes coding a current pixel of a current block of video data in copy-previous mode via coding a previous line index. The coding of the current pixel in copy-previous mode further including identifying a number of candidate values for the previous line index, identifying a number of escape pixels in a column of pixels above the current pixel in the current block, and reducing a number of candidate values of the previous line index by the number of identified escape pixels.
    Type: Grant
    Filed: August 4, 2015
    Date of Patent: May 10, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Wei Pu, Feng Zou, Marta Karczewicz, Rajan Laxman Joshi, Joel Sole Rojals, Vadim Seregin
  • Patent number: 11330305
    Abstract: An example device includes memory configured to store video data and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine whether a picture of the video data is an intra random access picture (IRAP) and determine whether all layers of the picture are independent. Based on the picture being an IRAP and all layers of the picture being independent, the one or more processors are configured to determine a value of a first syntax element to be indicative of an inter slice not being allowed in the picture and code the picture without using inter slice prediction.
    Type: Grant
    Filed: February 23, 2021
    Date of Patent: May 10, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Vadim Seregin, Muhammed Zeyd Coban
  • Patent number: 11323733
    Abstract: In an example a method of processing video data includes determining a first palette for a first block of video data that is located in a first row of blocks, generating a predictor palette for constructing at least one second palette of at least one second block of video data in the first row of blocks coded, reinitializing the predictor palette for determining a third palette of a third block of video data that is located in a second row of blocks, wherein re-initializing the predictor palette comprises re-initializing the predictor palette based on the one or more palette entries of the first palette or an initial predictor palette generated after coding the first block, determining the third palette of the third block based on the re-initialized predictor palette, and coding the third block using the third palette.
    Type: Grant
    Filed: May 21, 2015
    Date of Patent: May 3, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Vadim Seregin, Rajan Laxman Joshi, Marta Karczewicz, Wei Pu, Joel Sole Rojals
  • Patent number: 11323748
    Abstract: A video decoder may receive, in a bitstream that comprises an encoded representation of video data, information indicating whether a residual block is partitioned and information indicating a partition tree type for the residual block based on the residual block being partitioned, wherein the residual block is indicative of a difference between a current block and a prediction block. The video decoder may determine, based on the received information that the residual block is partitioned and the partition tree type for the residual block, a plurality of residual sub-blocks into which the residual block is partitioned according to the partition tree type. The video decoder may produce the residual data for the current block based at least in part on the residual block being partitioned according to the partition tree type into the plurality of residual sub-blocks and may decode the current block using the residual data.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: May 3, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Amir Said, Marta Karczewicz
  • Patent number: 11310497
    Abstract: An example device for decoding video data includes a memory configured to store the video data and one or more processors implemented in circuitry and coupled to the memory. The one or more processors are configured to determine a first distance index associated with a first geometric partition mode (GEO) angle for a first prediction unit (PU) of the video data to be 4. The one or more processors are configured to determine a first displacement value based on the first distance index, the first displacement value being indicative of a distance from a center of the first PU to a GEO split. The one or more processors are configured to decode the first PU based on the first GEO angle and the first displacement value. The first displacement value is half of a displacement value associated with a distance index of 2.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: April 19, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Kevin Pascal Andre Reuze, Han Huang, Chun-Chi Chen, Po-Han Lin, Wei-Jung Chien, Vadim Seregin, Marta Karczewicz
  • Patent number: 11303892
    Abstract: Systems, methods, and media are provided for video coding, including loop filtering. One example includes obtaining the video data comprising one or more pictures and determining a sample of the one or more pictures to be filtered using a loop filter. A shift variable associated with the sample is determined, and a rounding value is selected based on the shift variable. A modified sample is generated, the modified sample being generated at least in part by modifying a value of the sample using one or more filter coefficients, one or more clipping values of the loop filter, the rounding value, and the shift variable. The modified sample is then output.
    Type: Grant
    Filed: January 20, 2021
    Date of Patent: April 12, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Nan Hu, Vadim Seregin, Marta Karczewicz