Patents Assigned to GE Video Compression, LLC
  • Patent number: 11689738
    Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: June 27, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Sebastian Bosse, Heiko Schwarz, Thomas Wiegand, Heribert Brust
  • Patent number: 11677966
    Abstract: Scalable coding concepts are described. One aspect improves parallel decoding of inter-dependent layers of a multi-layer video data stream by introducing a long-term syntax element structure for guaranteeing that during a predetermined time period the pictures of the dependent layer are subdivided so that borders of the spatial segments of the pictures of the second layer and the spatial segments of the first layer overlay. Another aspect concerns upsampling from base layer to enhancement layer. Another aspect introduces a long-term syntax element structure allowing the decoder to determine the inter-layer offset for a predetermined time period. Another aspect introduces a type indicator field changing a way a layer indicator field within the NAL unit headers is to be interpreted. Another aspect allows different codecs/standards to be used for the different layers. Another aspect concerns a syntax element structure which indicates the inter-layer offset in units of the base layer blocks.
    Type: Grant
    Filed: April 27, 2021
    Date of Patent: June 13, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Valeri George, Detlev Marpe, Robert Skupin
  • Patent number: 11653033
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: May 16, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11647209
    Abstract: A signaling of at least one characteristic for layers of a multi-layered video signal such as, for example, for each layer the indication of dependent layers to which the respective layer directly relates via inter-layer prediction, or the signaling of the afore-mentioned second inter-dependency syntax structure, is described. A maximum syntax element is signaled within the multi-layered video signal to indicate a maximally used value of an extension layer-ID field of the packets of the multi-layered video signal, the scope of the maximum syntax element being, for example, a predetermined portion of the multi-layered video signal extending, for example, across several portions of the multi-layered video signal. Accordingly, it is feasible for devices such as decoders or network elements receiving the multi-layered video signal to gain, for a relatively large predetermined portion of the multi-layered video signal, knowledge about the actually consumed portion of the possible domain of possible values.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: May 9, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez de la Fuente, Gerhard Tech
  • Patent number: 11625750
    Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: April 11, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Simon Oudin, Martin Winken, Detlev Marpe, Thomas Wiegand
  • Patent number: 11616982
    Abstract: An idea used herein is to use the same function for the dependency of the context and the dependency of the symbolization parameter on previously coded/decoded transform coefficients. Using the same function—with varying function parameter—may even be used with respect to different transform block sizes and/or frequency portions of the transform blocks in case of the transform coefficients being spatially arranged in transform blocks. A further variant of this idea is to use the same function for the dependency of a symbolization parameter on previously coded/decoded transform coefficients for different sizes of the current transform coefficient's transform block, different information component types of the current transform coefficient's transform block and/or different frequency portions the current transform coefficient is located within the transform block.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: March 28, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tung Nguyen, Heiner Kirchhoffer, Detlev Marpe
  • Patent number: 11616964
    Abstract: A signaling of the layer ID is described which each of the packets of a multi-layered video signal is associated with. In particular, an efficient way of signaling this layer association is achieved, with nevertheless maintaining the backward compatibility with codecs according to which a certain value of the base layer-ID field is restricted to be non-extendable such as base layer-ID value 0 in the base layer-ID field. Instead of circumventing this restriction specifically with respect to this non-extendable base layer-ID value, the layer-ID of portions of the multi-layer data stream is signaled in an extendable manner by sub-dividing the base layer-ID field into a first sub-field and a second sub-field: whenever the first sub-field of the base layer-ID field fulfills a predetermined criterion, an extension layer-ID field is provided, and if the first sub-field of the base layer-ID field does not fulfill the predetermined criterion, the extension layer-ID field is omitted.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: March 28, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez De La Fuente, Gerhard Tech
  • Publication number: 20230092331
    Abstract: An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.
    Type: Application
    Filed: November 7, 2022
    Publication date: March 23, 2023
    Applicant: GE Video Compression, LLC
    Inventors: Yago SANCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Patent number: 11611761
    Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: March 21, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Martin Winken, Heiner Kirchhoffer, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230065580
    Abstract: An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.
    Type: Application
    Filed: November 7, 2022
    Publication date: March 2, 2023
    Applicant: GE Video Compression, LLC
    Inventors: Yago SANCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Patent number: 11595675
    Abstract: The entropy coding of a current part of a predetermined entropy slice is based on, not only, the respective probability estimations of the predetermined entropy slice as adapted using the previously coded part of the predetermined entropy slice, but also probability estimations as used in the entropy coding of a spatially neighboring, in entropy slice order preceding entropy slice at a neighboring part thereof. Thereby, the probability estimations used in entropy coding are adapted to the actual symbol statistics more closely, thereby lowering the coding efficiency decrease normally caused by lower-delay concepts. Temporal interrelationships are exploited additionally or alternatively.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: February 28, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Anastasia Henkel, Heiner Kirchhoffer, Detlev Marpe, Thomas Schierl
  • Patent number: 11595674
    Abstract: Reconstructing a second component signal relating to a second component of a multi-component picture from a spatially corresponding portion of a reconstructed first component signal and a correction signal derived from a data stream for the second component promises increased coding efficiency over a broader range of multi-component picture content. By including the spatially corresponding portion of the reconstructed first component signal into the reconstruction of the second component signal, any remaining inter-component redundancies/correlations present such as still present despite a possibly a priori performed component space transformation, or present because of having been introduced by such a priori performed component space transformation, for example, may readily be removed by way of the inter-component redundancy/correlation reduction of the second component signal.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: February 28, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tung Nguyen, Ali Atef Ibrahim Khairat Abdelhamid, Detlev Marpe
  • Patent number: 11589062
    Abstract: A subblock-based coding of transform coefficient blocks of the enhancement layer is rendered more efficient. To this end, the subblock subdivision of the respective transform coefficient block is controlled on the basis of the base layer residual signal or the base layer signal. In particular, by exploiting the respective base layer hint, the subblocks may be made longer along a spatial frequency axis transverse to edge extensions observable from the base layer residual signal or the base layer signal.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: February 21, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Patent number: 11582473
    Abstract: Various concepts which further improve multi-view/layer coding concepts, are described.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: February 14, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Robert Skupin, Karsten Suehring, Yago Sanchez De La Fuente, Gerhard Tech, Valeri George, Thomas Schierl, Detlev Marpe
  • Patent number: 11575921
    Abstract: The coding efficiency of scalable video coding is increased by substituting missing spatial intra prediction parameter candidates in a spatial neighborhood of a current block of the enhancement layer by use of intra prediction parameters of a co-located block of the base layer signal. By this measure, the coding efficiency for coding the spatial intra prediction parameters is increased due to the improved prediction quality of the set of intra prediction parameters of the enhancement layer, or, more precisely stated, the increased likelihood, that appropriate predictors for the intra prediction parameters for an intra predicted block of the enhancement layer are available thereby increasing the likelihood that the signaling of the intra prediction parameter of the respective enhancement layer block may be performed, on average, with less bits.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: February 7, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Patent number: 11553212
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: January 10, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 11546641
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 11546618
    Abstract: The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with.
    Type: Grant
    Filed: April 23, 2021
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez De La Fuente, Gerhard Tech
  • Patent number: 11546642
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11533485
    Abstract: An entropy decoder is configured to, for horizontal and vertical components of motion vector differences, derive a truncated unary code from the data stream using context-adaptive binary entropy decoding with exactly one context per bin position of the truncated unary code, which is common for horizontal and vertical components of the motion vector differences, and an Exp-Golomb code using a constant equi-probability bypass mode to obtain the binarizations of the motion vector differences. A desymbolizer is configured to debinarize the binarizations of the motion vector difference syntax elements to obtain integer values of the horizontal and vertical components of the motion vector differences. A reconstructor is configured to reconstruct a video based on the integer values of the horizontal and vertical components of the motion vector differences.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: December 20, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand