Patents by Inventor Heiko Schwarz

Heiko Schwarz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220248010
    Abstract: A video decoder for decoding an encoded video signal including encoded picture data and indication data of a picture of a video to reconstruct the picture of the video is provided. The video decoder includes an interface configured for receiving the encoded video signal, and a data decoder configured for reconstructing the picture of the video by decoding the encoded picture data using the indication data. The picture is partitioned into a plurality of coding areas. One or more coding areas of the plurality of coding areas include two or more coding tree units of the plurality of coding tree units, wherein each coding area of the one or more coding areas which includes two or more coding tree units exhibits a coding order for the two or more coding tree units of the coding area.
    Type: Application
    Filed: April 12, 2022
    Publication date: August 4, 2022
    Inventors: Valeri George, Tobias Hinz, Jackie Ma, Yago Sánchez De La Fuente, Robert Skupin, Thomas Schierl, Jens Brandenburg, Christian Lehmann, Adam Wieckowski, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11405635
    Abstract: A proposed intermediate way of handling the renderable portion of the first view results in more efficient coding. Instead of omitting the coding of the renderable portion completely, even more efficient coding of multi-view signals entails merely suppressing the coding of the residual signal within the renderable portion, whereas the prediction parameter coding still takes place from the non-renderable portion of the multi-view signal across the renderable portion so that prediction parameters for the renderable portion may be exploited for predicting parameters for the non-renderable portion. The additional coding rate for transmitting the prediction parameters for the renderable portion may be kept low as this merely aims at forming a continuation of the parameter history across the renderable portion to serve as a basis for prediction parameters of other portions of the multi-view signal.
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: August 2, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Sebastian Bosse, Heiko Schwarz, Thomas Wiegand, Tobias Hinz
  • Patent number: 11405050
    Abstract: Decomposing a value range of the respective syntax elements into a sequence of n partitions with coding the components of z laying within the respective partitions separately with at least one by VLC coding and with at least one by PIPE or entropy coding is used to greatly increase the compression efficiency at a moderate coding overhead since the coding scheme used may be better adapted to the syntax element statistics. Accordingly, syntax elements are decomposed into a respective number n of source symbols si with i=1 . . . n, the respective number n of source symbols depending on as to which of a sequence of n partitions into which a value range of the respective syntax elements is sub-divided, a value z of the respective syntax elements falls into, so that a sum of values of the respective number of source symbols si yields z, and, if n>1, for all i=1 . . . n?1, the value of si corresponds to a range of the ith partition.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: August 2, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Detlev Marpe, Tung Nguyen, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20220239924
    Abstract: Arithmetic encoder for encoding a plurality of symbols is configured to derive an interval size information for an arithmetic encoding of one or more symbol values to be encoded on the basis of one or more state variable value, in a first mode of operation, and to update the one or more state variable values and/or the interval size information for an encoding of one or more subsequent symbol values to be encoded in the first mode; in a second mode, the arithmetic encoder is configured to disable an update of the one or more state variable values and/or of the interval size information. Additionally, further embodiments of arithmetic encoders and decoders and video encoders and decoders are described.
    Type: Application
    Filed: March 24, 2022
    Publication date: July 28, 2022
    Inventors: Heiner KIRCHHOFFER, Detlev MARPE, Benjamin BROSS, Phan Hoang Tung NGUYEN, Christian RUDAT, Heiko SCHWARZ, Thomas WIEGAND
  • Patent number: 11395013
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: July 19, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20220217418
    Abstract: A more effective coding/decoding of a sequence of information values and, for instance, one which enables implementations of increased processing speed, is achieved by rendering the binarization of the information values dependent on previously coded/decoded information values.
    Type: Application
    Filed: March 22, 2022
    Publication date: July 7, 2022
    Inventors: Heiko SCHWARZ, Anastasia HENKEL, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220217316
    Abstract: The usual coding order according to which the reference view is coded prior to the dependent view, and within each view, a depth map is coded subsequent to the respective picture, may be maintained and does lead to a sacrifice of efficiency in performing inter-view redundancy removal by, for example, predicting motion data of the current picture of the dependent view from motion data of the current picture of the reference view. Rather, a depth map estimate of the current picture of the dependent view is obtained by warping the depth map of the current picture of the reference view into the dependent view, thereby enabling various methods of inter-view redundancy reduction more efficiently by bridging the gap between the views.
    Type: Application
    Filed: January 14, 2022
    Publication date: July 7, 2022
    Inventors: Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20220210418
    Abstract: Decoder for decoding a residual signal from a data stream, configured to decode, from the data stream, a quantized prediction residual and at least one quantization error compensation signal; scale the quantized prediction residual to determine a scaled prediction residual; determine a reconstructed prediction residual based on the scaled prediction residual and the at least one quantization error compensation signal.
    Type: Application
    Filed: March 18, 2022
    Publication date: June 30, 2022
    Inventors: Benjamin BROSS, Phan Hoang Tung NGUYEN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11363268
    Abstract: Coding quantization parameter variation or adaptation is made more effective by basing the determination of a coding quantization parameter for a predetermined block of the picture on a dispersion of a statistical sample value distribution of a high-pass filtered version of the predetermined block. The usage of the high-pass filtered version of the predetermined block as a basis for the determination of the dispersion instead of using, for instance, the un-filtered or original version of the predetermined block assists in a better adaptation of the resulting coding quantization parameter variation across the picture to the human visual system. Alternatively or additionally, coding quantization parameter variation or adaptation across a picture is made more efficient by a control of coding quantization parameter variation/adaptation across a picture in a manner dependent on a prediction of the actual dispersion.
    Type: Grant
    Filed: March 20, 2020
    Date of Patent: June 14, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Christian Helmrich, Thomas Wiegand, Adam Wieckowski, Heiko Schwarz, Detlev Marpe, Sebastian Bosse, Benjamin Bross
  • Patent number: 11363308
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: June 14, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11363259
    Abstract: In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: June 14, 2022
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., München
    Inventors: Jonathan Pfaff, Philipp Helle, Dominique Maniry, Thomas Wiegand, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Mischa Siekmann, Martin Winken
  • Publication number: 20220159228
    Abstract: A gain in multi-view coding is achieved as follows: the residual signal involved with coding a dependent view of the multi-view signal is predicted from a reference residual signal of the current picture of the reference view using block-granular disparity-compensated prediction, i.e. using disparity compensated prediction with a disparity defined at, and varying with, block granularity so that each block of the current picture of the dependent view has its own disparity displacement such as its own disparity vector, associated therewith. In other words, a remaining similarity between the residual signal involved with predictively coding the reference view is used in order to predict the residual signal involved with predictively coding the dependent view.
    Type: Application
    Filed: November 19, 2021
    Publication date: May 19, 2022
    Inventors: Heiko SCHWARZ, Thomas WIEGAND, Martin WINKEN
  • Patent number: 11336890
    Abstract: A video decoder for decoding an encoded video signal including encoded picture data and indication data of a picture of a video to reconstruct the picture of the video is provided. The video decoder includes an interface configured for receiving the encoded video signal, and a data decoder configured for reconstructing the picture of the video by decoding the encoded picture data using the indication data. The picture is partitioned into a plurality of coding areas. One or more coding areas of the plurality of coding areas include two or more coding tree units of the plurality of coding tree units, wherein each coding area of the one or more coding areas which includes two or more coding tree units exhibits a coding order for the two or more coding tree units of the coding area.
    Type: Grant
    Filed: January 4, 2021
    Date of Patent: May 17, 2022
    Assignee: Fraunhofer-Gesellschaft zur Forderung der angewandten Forschung e.V.
    Inventors: Valeri George, Tobias Hinz, Jackie Ma, Yago Sánchez De La Fuente, Robert Skupin, Thomas Schierl, Jens Brandenburg, Christian Lehmann, Adam Wieckowski, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11330242
    Abstract: Embodiments are described which exploit a finding, according to which a higher compression rate or better rate/distortion ratio may be achieved by adopting or predicting second coding parameters used for encoding a second view of the multi-view signal from first coding parameters used in encoding a first view of the multi-view signal. In other words, the inventors found out that the redundancies between views of a multi-view signal are not restricted to the views themselves, such as the video information thereof, but that the coding parameters in parallely encoding these views show similarities which may be exploited in order to further improve the coding rate.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: May 10, 2022
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Wiegand, Detlev Marpe, Karsten Mueller, Philipp Merkle, Gerhard Tech, Hunn Rhee, Heiko Schwarz
  • Publication number: 20220132169
    Abstract: Decoder for decoding a picture from a data stream, configured to check whether a plurality of coding parameters, which are contained in the data stream, relate to a predetermined portion of the picture and control a prediction residual transform mode and a quantization accuracy with respect to the predetermined portion, are indicative of a coding parameter setting corresponding to a lossless prediction residual coding. Responsive to the plurality of coding parameters being indicative of the coding parameter setting corresponding to the lossless prediction residual coding, the decoder is configured to set one or more predetermined coding options relating to one or more tools of the decoder for processing a prediction residual corrected predictive reconstruction with respect to the predetermined portion so that the one or more tools are disabled with respect to the predetermined portion.
    Type: Application
    Filed: January 4, 2022
    Publication date: April 28, 2022
    Inventors: Christian HELMRICH, Benjamin BROSS, Tung Hoang NGUYEN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220132167
    Abstract: A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.
    Type: Application
    Filed: September 2, 2021
    Publication date: April 28, 2022
    Inventors: Jonathan PFAFF, Martin WINKEN, Christian RUDAT, Heiko SCHWARZ, Thomas WIEGAND, Detlev MARPE
  • Publication number: 20220132108
    Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.
    Type: Application
    Filed: January 5, 2022
    Publication date: April 28, 2022
    Inventors: Jens BRANDENBURG, Tobias HINZ, Adam WIECKOWSKI, Jackie MA, Valeri GEORGE, Christian LEHMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Thomas SCHIERL
  • Publication number: 20220124372
    Abstract: Decoder for decoding a picture, wherein blocks into which the picture is subdivided are assigned to a set of prediction types, which include intra prediction and inter prediction. For each of predetermined intra-predicted blocks, the decoder is configured to derive, from the data stream, an information on a partitioning of the respective predetermined intra-predicted block into partitions. The decoder is configured to derive, from the data stream, for each partition of the respective predetermined intra-predicted block, a partition-specific prediction residual signal related to a spatial domain prediction residual signal of the respective partition of the respective predetermined intra-predicted block via a predetermined transform. The predetermined transform can be identified out of a set of transforms including a first transform and a second transform, which equals a concatenation of a primary transform and a secondary transform applied onto a subset of coefficients of the primary transform.
    Type: Application
    Filed: December 17, 2021
    Publication date: April 21, 2022
    Inventors: Santiago DE LUXÁN HERNÁNDEZ, Valeri GEORGE, Gayathri VENUGOPAL, Jens BRANDENBURG, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220116618
    Abstract: A video decoder and a video encoder include a noise reduction operation including at least two denoising operations and adapting the second denoising operation in dependence of the difference before and after the first denoising operation, thus correcting the quality reduction occurred due to the application of the first denoising operation. Corresponding methods serve to encode and decode video signals.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Wang-Q LIM, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220116606
    Abstract: An apparatus configured to select a predetermined intra prediction mode out of a plurality of intra-prediction modes which includes a first set of intra-prediction modes and a second set of matrix-based intra-prediction modes. The apparatus is configured to select a subset of one or more secondary transforms dependent on the predetermined intra prediction mode so that the subset is nonempty in case of the predetermined intra prediction mode being contained in the first set of intra-prediction modes or in the second set of matrix-based intra-prediction modes. The apparatus is configured to derive a transformed version of a prediction residual for a predetermined block, which is related to a spatial domain version of the prediction residual of the predetermined block via a transform defined by a concatenation of a primary transform and a predetermined secondary transform out of the subset of secondary transforms.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND