Patents by Inventor Hilmi Enes EGILMEZ

Hilmi Enes EGILMEZ has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11973983
    Abstract: An example method of decoding video data that includes receiving one or more syntax elements of the video data indicative of whether a first type of coding scheme or a second type of coding scheme is applied to residual values of a block of video data coded with transform skip, wherein the residual values are indicative of a difference between the block and a prediction block, and wherein, in transform skip, the residual values are not transformed from a sample domain to a frequency domain. The method includes determining a type of coding scheme to apply to the residual values based on the one or more syntax elements, determining the residual values based on the determined type of coding scheme, and reconstructing the block based on the determined residual values and the prediction block.
    Type: Grant
    Filed: October 8, 2020
    Date of Patent: April 30, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Marta Karczewicz, Muhammed Zeyd Coban, Alican Nalci, Hilmi Enes Egilmez
  • Publication number: 20240129472
    Abstract: Improved lossless entropy coding techniques for coding of image data include selecting a context for entropy coding based on an ordered scan path of possible context locations. A symbol for a current location within a source image may be entropy coded based on a context of prior encoded symbols of other locations within source images, where the context is selected based on an ordered scan path enumerating a series of potential context locations within one or more source images. To select a context, a predetermined number of prior symbols may be selected by qualifying or disqualifying locations in the scan path, and then the current symbol may be encoded with a context based on prior symbols corresponding to the first qualifying context locations in the order of the scan path.
    Type: Application
    Filed: September 18, 2023
    Publication date: April 18, 2024
    Inventors: Yeqing WU, Yunfei ZHENG, Alican NALCI, Yixin DU, Hilmi Enes EGILMEZ, Guoxin JIN, Alexandros TOURAPIS, Jun XIN, Hsi-Jung WU
  • Publication number: 20240114152
    Abstract: A video decoder can be configured to determine a number of allowed non-zero coefficients for a block of video data based on a size of the block; obtain a set of dequantized coefficients for the block, wherein the set of dequantized coefficients comprises a first subset of dequantized coefficients that includes non-zero dequantized coefficients and a second subset of dequantized coefficients that includes all zero coefficients, wherein a number of coefficients in the first subset of dequantized coefficients is equal to the number of allowed non-zero coefficients for the block of video data; apply an inverse low-frequency non-separable transform (LFNST) to the first subset of dequantized coefficients to determine a first intermediate subset of coefficients; and apply an inverse separable transform to the first intermediate subset of coefficients and at least a portion of the second subset of coefficients to determine a block of reconstructed residual values.
    Type: Application
    Filed: December 7, 2023
    Publication date: April 4, 2024
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Marta Karczewicz
  • Patent number: 11949870
    Abstract: An example method includes determining a color component of a unit of video data; determining, based at least on the color component, a context for context-adaptive binary arithmetic coding (CABAC) a syntax element that specifies a value of a low-frequency non-separable transform (LFNST) index for the unit of video data; CABAC decoding, based on the determined context and via a syntax structure for the unit of video data, the syntax element that specifies the value of the LFNST index for the unit of video data; and inverse-transforming, based on a transform indicated by the value of the LFNST index, transform coefficients of the unit of video data.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: April 2, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Alican Nalci, Hilmi Enes Egilmez, Vadim Seregin, Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: 11924471
    Abstract: A video decoder configured to set a context index variable to a first value, wherein the first value for the context index variable is associated with a first context; context decode a first bin for a syntax element indicating a transform using the first context; determine a new value for the context index variable based on a value of the first bin; context decode a second bin for the syntax element indicating the transform using a context associated with the new value; determine an inverse transform from a set of inverse transform candidates based on the first bin and the second bin; and apply the inverse transform to a set of coefficients to determine a block of residual data.
    Type: Grant
    Filed: June 9, 2021
    Date of Patent: March 5, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Marta Karczewicz
  • Publication number: 20240073438
    Abstract: Techniques are disclosed for improved video coding with virtual reference frames. A motion vector for prediction of a pixel block from a reference may be constrained based on the reference. In as aspect, if the reference is a temporally interpolated virtual reference frame with corresponding time close to the time of the current pixel block, the motion vector for prediction may be constrained magnitude and/or precision. In another aspect, a bitstream syntax for encoding the constrained motion vector may also be constrained. In this manner, the techniques proposed herein contribute to improved coding efficiencies.
    Type: Application
    Filed: August 18, 2023
    Publication date: February 29, 2024
    Inventors: Yeqing WU, Yunfei ZHENG, Guoxin JIN, Yixin DU, Alican NALCI, Hilmi Enes EGILMEZ, Jun XIN, Hsi-Jung WU
  • Patent number: 11902531
    Abstract: A method of decoding video data includes determining an intra prediction mode from a plurality of intra prediction modes for a current block of the video data, determining a low frequency non-separable transform (LFNST) kernel from a plurality of LFNST kernels for the current block based on the determined intra prediction mode, wherein at least one LFNST kernel of the plurality of LFNST kernels is associated with at least two different intra prediction modes of the plurality of intra prediction modes, applying an inverse of the determined LFNST kernel to coefficient values generated from a transform unit (TU) of the current block to generate intermediate values, applying an inverse primary transform on the intermediate values to generate residual data, and reconstructing the current block based on the residual data.
    Type: Grant
    Filed: April 7, 2022
    Date of Patent: February 13, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Louis Joseph Kerofsky, Muhammed Zeyd Coban, Bappaditya Ray, Hilmi Enes Egilmez, Marta Karczewicz
  • Publication number: 20240048776
    Abstract: Disclosed is a method that includes receiving an image frame having a plurality of coded blocks, determining a prediction unit (PU) from the plurality of coded blocks, determining one or more motion compensation units arranged in an array within the PU, and applying a filter to one or more boundaries of the one or more motion compensation units. Also disclosed is a method that includes receiving a reference frame that includes a reference block, determining a timing for deblocking a current block, performing motion compensation on the reference frame to obtain a predicted frame that includes a predicted block, performing reconstruction on the predicted frame to obtain a reconstructed frame that includes a reconstructed PU, and applying, at the timing for deblocking the current block, a deblocking filter based on one or more parameters to the reference block, the predicted block, or the reconstructed PU.
    Type: Application
    Filed: September 29, 2022
    Publication date: February 8, 2024
    Inventors: Yixin Du, Alexandros Tourapis, Alican Nalci, Guoxin Jin, Hilmi Enes Egilmez, Hsi-Jung Wu, Jun Xin, Yeqing Wu, Yunfei Zheng
  • Publication number: 20240040120
    Abstract: Video coders and decoders perform transform coding and decoding on blocks of video content according to an adaptively selected transform type. The transform types are organized into a hierarchy of transform sets where each transform set includes a respective number of transforms and each higher-level transform set includes the transforms of each lower-level transform set within the hierarchy. The video coders and video decoders may exchange signaling that establishes a transform set context from which a transform set that was selected for coding given block(s) may be identified. The video coders and video decoders may exchange signaling that establishes a transform decoding context from which a transform that was selected from the identified transform set to be used for decoding the transform unit. The block(s) may be coded and decoded by the selected transform.
    Type: Application
    Filed: July 25, 2023
    Publication date: February 1, 2024
    Inventors: Hilmi Enes EGILMEZ, Yunfei ZHENG, Alican NALCI, Yeqing WU, Yixin DU, Guoxin JIN, Alexandros TOURAPIS, Jun XIN, Hsi-Jung WU
  • Publication number: 20240040124
    Abstract: A flexible coefficient coding (FCC) approach is presented. In the first aspect, spatial sub-regions are defined over a transform unit (TU) or a prediction unit (PU). These sub-regions organize the coefficient samples residing inside a TU or a PU into variable coefficient groups (VCGs). Each VCG corresponds to a sub-region inside a larger TU or PU. The shape of VCGs or the boundaries between different VCGs may be irregular, determined based on the relative distance of coefficient samples with respect to each other. Alternatively, the VCG regions may be defined according to scan ordering within a TU. Each VCG can encode a 1) different number of symbols for a given syntax element, or a 2) different number of syntax elements within the same TU or PU. Whether to code more symbols or more syntax elements may depend on the type of arithmetic coding engine used in a particular coding specification. For multi-symbol arithmetic coding (MS-AC), a VCG may encode a different number of symbols for a syntax element.
    Type: Application
    Filed: July 25, 2023
    Publication date: February 1, 2024
    Inventors: Alican NALCI, Yunfei ZHENG, Hilmi Enes EGILMEZ, Yeqing WU, Yixin DU, Alexandros TOURAPIS, Jun XIN, Hsi-Jung WU, Arash VOSOUGHI, Dzung T. HOANG
  • Patent number: 11871010
    Abstract: A video decoder can be configured to determine a number of allowed non-zero coefficients for a block of video data based on a size of the block; obtain a set of dequantized coefficients for the block, wherein the set of dequantized coefficients comprises a first subset of dequantized coefficients that includes non-zero dequantized coefficients and a second subset of dequantized coefficients that includes all zero coefficients, wherein a number of coefficients in the first subset of dequantized coefficients is equal to the number of allowed non-zero coefficients for the block of video data; apply an inverse low-frequency non-separable transform (LFNST) to the first subset of dequantized coefficients to determine a first intermediate subset of coefficients; and apply an inverse separable transform to the first intermediate subset of coefficients and at least a portion of the second subset of coefficients to determine a block of reconstructed residual values.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: January 9, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Marta Karczewicz
  • Publication number: 20230412844
    Abstract: A video decoder determines, based on a block size of a current block and a low-frequency non-separable transform (LFNST) syntax element, a zero-out pattern of normatively defined zero-coefficients. The LFNST syntax element is signaled at a transform unit (TU) level. Additionally, the video decoder determines transform coefficients of the current block. The transform coefficients of the current block include transform coefficients in an LFNST region of the current block and transform coefficients outside the LFNST region of the current block. As part of determining the transform coefficients of the current block, the video decoder applies an inverse LFNST to determine values of one or more transform coefficients in the LFNST region of the current block. The video decoder also determines that transform coefficients of the current block in a region of the current block defined by the zero-out pattern are equal to 0.
    Type: Application
    Filed: May 22, 2023
    Publication date: December 21, 2023
    Inventors: Alican Nalci, Hilmi Enes Egilmez, Vadim Seregin, Muhammed Zeyd Coban, Marta Karczewicz
  • Publication number: 20230300341
    Abstract: Techniques are disclosed for generating virtual reference frames that may be used for prediction of input video frames. The virtual reference frames may be derived from already-coded reference frames and thereby incur reduced signaling overhead. Moreover, signaling of virtual reference frames may be avoided until an encoder selects the virtual reference frame as a prediction reference for a current frame. In this manner, the techniques proposed herein contribute to improved coding efficiencies.
    Type: Application
    Filed: January 20, 2023
    Publication date: September 21, 2023
    Inventors: Yeqing WU, Yunfei ZHENG, Alexandros TOURAPIS, Alican NALCI, Yixin DU, Hilmi Enes EGILMEZ, Albert E. KEINATH, Jun XIN, Hsi-Jung WU
  • Patent number: 11736688
    Abstract: Example techniques are described for coding video data by obtaining a block of video data, obtaining an adaptive parameter set, determining a set of adaptive loop filter parameters for a plurality of filters for the block of video data based on the adaptive parameter set, wherein a plurality of adaptive loop parameters of the set of adaptive loop filter parameters are signaled using the same signaling parameter for each of the plurality of filters of the adaptive parameter set, and coding the block of video data using the set of adaptive loop filter parameters. The example techniques can be performed as part of an encoding or decoding process and/or by an encoder or a decoder.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: August 22, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Nan Hu, Hilmi Enes Egilmez, Vadim Seregin, Marta Karczewicz
  • Patent number: 11706425
    Abstract: A video decoder may be configured to receive a block of video data, and determine a value of a multiple transform set index for the block of video data based on a presence of non-zero transform coefficients in the block of video data other than a DC coefficient. The video decoder may then apply a transform to the block of video data based on the determined value of the multiple transform set index.
    Type: Grant
    Filed: January 6, 2021
    Date of Patent: July 18, 2023
    Assignee: Qualcomm Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: 11695960
    Abstract: A video decoder determines, based on a block size of a current block and a low-frequency non-separable transform (LFNST) syntax element, a zero-out pattern of normatively defined zero-coefficients. The LFNST syntax element is signaled at a transform unit (TU) level. Additionally, the video decoder determines transform coefficients of the current block. The transform coefficients of the current block include transform coefficients in an LFNST region of the current block and transform coefficients outside the LFNST region of the current block. As part of determining the transform coefficients of the current block, the video decoder applies an inverse LFNST to determine values of one or more transform coefficients in the LFNST region of the current block. The video decoder also determines that transform coefficients of the current block in a region of the current block defined by the zero-out pattern are equal to 0.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: July 4, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Alican Nalci, Hilmi Enes Egilmez, Vadim Seregin, Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: 11683527
    Abstract: An example device for coding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: code a first codeword representing a selected transform scheme of a set of transform candidates of a multiple transform selection (MTS) scheme for a current block of video data, the selected transform scheme being a secondary transform of a set of available secondary transforms to be applied in addition to a primary transform; code a second codeword representing the secondary transform from the set of available secondary transforms; and apply the primary transform and the secondary transform during coding of residual data for the current block. The second codeword may be a value for a low-frequency non-separable transform (LFNST) syntax element.
    Type: Grant
    Filed: October 11, 2021
    Date of Patent: June 20, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Amir Said, Marta Karczewicz
  • Publication number: 20230188738
    Abstract: In an example method, a decoder obtains a data stream representing video content. The video content is partitioned into one or more logical units, and each of the logical units is partitioned into one or more respective logical sub-units. The decoder determines that the data stream includes first data indicating that a first logical unit has been encoded according to a flexible skip coding scheme. In response, the decoder determines a first set of decoding parameters based on the first data, and decodes each of the logical sub-units of the first logical unit according to the first set of decoding parameters.
    Type: Application
    Filed: December 6, 2022
    Publication date: June 15, 2023
    Inventors: Alican Nalci, Alexandros Tourapis, Hilmi Enes Egilmez, Hsi-Jung Wu, Jun Xin, Yeqing Wu, Yixin Du, Yunfei Zheng
  • Patent number: 11677984
    Abstract: A method of decoding video data includes receiving encoded data for a current block and decoding N bins for a low-frequency non-separable transform (LFNST) index from the encoded data. The N bins comprises a first bin and a second bin. Decoding the N bins comprises context decoding each bin of the N bins. The method further includes determining the LFNST index using the N bins and decoding the encoded data to generate transform coefficients. The method further includes applying an inverse LFNST to the transform coefficients using the LFNST index to produce a residual block for the current block and reconstructing the current block of the video data using the residual block and a prediction block for the current block.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: June 13, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Marta Karczewicz
  • Publication number: 20230179776
    Abstract: An example device applies a primary transform to a current block of video data to create primary transform coefficients. The device determines whether intra sub-partitioning is applied to the current block of video data. The device applies a primary transform to the current block. The device also determines whether a primary transform size for the current block of video data is at least a predetermined size. Based on intra sub-partitioning being applied and the primary transform size being at least the predetermined size, the device applies a secondary transform to primary transform coefficients and codes the current block of video data based on the secondary transform.
    Type: Application
    Filed: February 1, 2023
    Publication date: June 8, 2023
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Amir Said, Marta Karczewicz