Patents by Inventor Heiko Schwarz

Heiko Schwarz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11785229
    Abstract: A further coding efficiency increase may be achieved if for a current block of a picture, for which the bit stream signals one of supported partitioning patterns, a reversal of the partitioning by block merging is avoided. In particular, if the signaled one of the supported partitioning patterns specifies a subdivision of the block into two or more further blocks, a removal of certain coding parameter candidates for all further blocks, except a first further block of the further blocks in a coding order, is performed. Particularly, those coding parameter candidates are removed from the set of coding parameter candidates for the respective further block, the coding parameters of which are the same as coding parameters associated with any of the further blocks which, when being merged with the respective further block, would result in one of the supported partitioning pattern. This avoids redundancy between partitioning coding and merging coding.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: October 10, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Simon Oudin, Benjamin Bross
  • Patent number: 11785246
    Abstract: A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.
    Type: Grant
    Filed: September 21, 2020
    Date of Patent: October 10, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiko Schwarz, Heiner Kirchhoffer, Philipp Helle, Simon Oudin, Jan Stegemann, Benjamin Bross, Detlev Marpe, Thomas Wiegand
  • Patent number: 11778241
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: October 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11770527
    Abstract: An apparatus for decoding a picture is configured to partition the picture into coding blocks, using recursive multi-tree splitting. Splitting schemes for the multi-tree splitting are described. According to an embodiment, the decoder decodes a split direction flag from a data stream by context adaptive entropy decoding using a context which depends on whether, and discriminates be-tween, a first number of criteria which would be fulfilled in case of a split direction indicated by the split direction flag being horizontal equals a second number of criteria which would be fulfilled in case of the split direction indicated by the split direction flag being vertical, the first number being greater than the second number, and the first number being smaller than the second number.
    Type: Grant
    Filed: July 2, 2021
    Date of Patent: September 26, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Adam Wieckowski, Phan Hoang Tung Nguyen, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11770528
    Abstract: A video decoder for decoding an encoded video signal including encoded picture data and indication data of a picture of a video to reconstruct the picture of the video is provided. The video decoder includes an interface configured for receiving the encoded video signal, and a data decoder configured for reconstructing the picture of the video by decoding the encoded picture data using the indication data. The picture is partitioned into a plurality of coding areas. One or more coding areas of the plurality of coding areas include two or more coding tree units of the plurality of coding tree units, wherein each coding area of the one or more coding areas which includes two or more coding tree units exhibits a coding order for the two or more coding tree units of the coding area.
    Type: Grant
    Filed: April 12, 2022
    Date of Patent: September 26, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Valeri George, Tobias Hinz, Jackie Ma, Yago Sánchez De La Fuente, Robert Skupin, Thomas Schierl, Jens Brandenburg, Christian Lehmann, Adam Wieckowski, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11765362
    Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.
    Type: Grant
    Filed: October 8, 2020
    Date of Patent: September 19, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Martin Winken, Heiner Kirchhoffer, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11765363
    Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: September 19, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Martin Winken, Heiner Kirchhoffer, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230276047
    Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.
    Type: Application
    Filed: May 9, 2023
    Publication date: August 31, 2023
    Inventors: Jens BRADENBURG, Tobias HINZ, Adam WIECKOWSKI, Jackie MA, Valeri GEORGE, Christian LEHMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Thomas SCHIERL
  • Publication number: 20230276048
    Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points.
    Type: Application
    Filed: May 4, 2023
    Publication date: August 31, 2023
    Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11736738
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: November 4, 2022
    Date of Patent: August 22, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20230262241
    Abstract: The coding efficiency of scalable video coding is increased by substituting missing spatial intra prediction parameter candidates in a spatial neighborhood of a current block of the enhancement layer by use of intra prediction parameters of a co-located block of the base layer signal. By this measure, the coding efficiency for coding the spatial intra prediction parameters is increased due to the improved prediction quality of the set of intra prediction parameters of the enhancement layer, or, more precisely stated, the increased likelihood, that appropriate predictors for the intra prediction parameters for an intra predicted block of the enhancement layer are available thereby increasing the likelihood that the signaling of the intra prediction parameter of the respective enhancement layer block may be performed, on average, with less bits.
    Type: Application
    Filed: February 3, 2023
    Publication date: August 17, 2023
    Inventors: Tobias HINZ, Haricharan LAKSHMAN, Jan STEGEMANN, Philipp HELLE, Mischa SIEKMANN, Karsten SUEHRING, Detlev MARPE, Heiko SCHWARZ, Christian BARTNIK, Ali Atef Ibrahim KHAIRAT ABDELHAMID, Heiner KIRCHHOFFER, Thomas WIEGAND
  • Publication number: 20230262242
    Abstract: A subblock-based coding of transform coefficient blocks of the enhancement layer is rendered more efficient. To this end, the subblock subdivision of the respective transform coefficient block is controlled on the basis of the base layer residual signal or the base layer signal. In particular, by exploiting the respective base layer hint, the subblocks may be made longer along a spatial frequency axis transverse to edge extensions observable from the base layer residual signal or the base layer signal.
    Type: Application
    Filed: February 6, 2023
    Publication date: August 17, 2023
    Inventors: Tobias HINZ, Haricharan LAKSHMAN, Jan STEGEMANN, Philipp HELLE, Mischa SIEKMANN, Karsten SUEHRING, Detlev MARPE, Heiko SCHWARZ, Christian BARTNIK, Ali Atef Ibrahim KHAIRAT ABDELHAMID, Heiner KIRCHHOFFER, Thomas WIEGAND
  • Patent number: 11729426
    Abstract: A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.
    Type: Grant
    Filed: September 2, 2021
    Date of Patent: August 15, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Jonathan Pfaff, Martin Winken, Christian Rudat, Heiko Schwarz, Thomas Wiegand, Detlev Marpe
  • Publication number: 20230254508
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template ; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Application
    Filed: January 9, 2023
    Publication date: August 10, 2023
    Applicant: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230238982
    Abstract: The invention describes an encoding scheme for arithmetically encoding a sequence of information values into an arithmetic coded bitstream using providing the bitstream with entry point information allowing for resuming arithmetic decoding the bitstream from a predetermined entry point onward. A respective decoding scheme is also provided. These encoding and decoding schemes provide more efficient encoding concept in view of the decoding speed.
    Type: Application
    Filed: April 5, 2023
    Publication date: July 27, 2023
    Inventors: Paul HAASE, Heiner KIRCHHOFFER, Karsten MUELLER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11706413
    Abstract: A picture in a data stream is subdivided into different size transform blocks. For a transform block, a transformation is selected by checking whether the block's size exceeds a threshold. If it does, a default technique is used to select the transformation. If it does not, a transformation is used from a list of transformations as identified by an index, the list including an identity transformation and non-identity transformations. A coefficients block in the data stream is decoded, and if the selected transformation is the identity transformation, then the coefficients block is used as a residual sample array, and if the selected transformation is not the identity transformation, the coefficients block is subjected to an inverse transformation corresponding to the selected transformation to obtain a residual sample array used to correct a prediction for the transform block.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: July 18, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Benjamin Bross, Phan Hoang Tung Nguyen, Paul Keydel, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Christian Helmrich
  • Patent number: 11695937
    Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.
    Type: Grant
    Filed: October 8, 2020
    Date of Patent: July 4, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Martin Winken, Heiner Kirchhoffer, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11695966
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: July 4, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11695969
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: November 4, 2022
    Date of Patent: July 4, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11689738
    Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: June 27, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Sebastian Bosse, Heiko Schwarz, Thomas Wiegand, Heribert Brust