Patents by Inventor Heiko Schwarz

Heiko Schwarz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250106401
    Abstract: A method for sequentially decoding, from a data stream, a sequence of samples corresponding to a picture, including entropy decoding a quantization index corresponding to a sample, indicating, based on the quantization index, a reconstruction level set of two reconstruction levels sets, the two reconstruction level sets including: a first reconstruction level set that includes reconstruction levels that are even multiples of a quantization step size, wherein the first reconstruction level set excludes reconstruction levels that are odd multiples of the quantization set size; a second reconstruction level set that includes reconstruction levels that are odd multiples of the quantization step size, and dequantizing the sample using the indicated reconstruction level set. The second reconstruction level set excludes reconstruction levels that are even multiples of the quantization step size.
    Type: Application
    Filed: December 9, 2024
    Publication date: March 27, 2025
    Inventors: Heiko SCHWARZ, Thomas WIEGAND, Phan Hoang Tung NGUYEN, Detlev MARPE
  • Publication number: 20250106397
    Abstract: The present invention concerns an apparatus configured to partition a picture into leaf blocks using recursive multi-tree partitioning, block-based encode the picture into a data stream using the partitioning of the picture into the leaf blocks, wherein the apparatus is configured to, in partitioning the picture into the leaf blocks, for a predetermined block which extends beyond a boundary of the picture, reduce an available set of split modes depending on a position at which the boundary of the picture crosses the predetermined block in order to obtain a reduced set of one or more split modes, wherein the apparatus is configured to signal a selected split mode in the data stream.
    Type: Application
    Filed: December 9, 2024
    Publication date: March 27, 2025
    Inventors: Adam WIECKOWSKI, Valeri GEORGE, Tobias HINZ, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Jackie MA, Jens BRANDENBURG
  • Publication number: 20250097453
    Abstract: A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.
    Type: Application
    Filed: September 25, 2024
    Publication date: March 20, 2025
    Inventors: Heiko SCHWARZ, Heiner KIRCHHOFFER, Philipp HELLE, Simon OUDIN, Jan STEGEMANN, Benjamin BROSS, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20250080735
    Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).
    Type: Application
    Filed: November 18, 2024
    Publication date: March 6, 2025
    Inventors: Paul HAASE, Christian RUDAT, Heiner KIRCHHOFFER, Phan Hoang Tung NGUYEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12244851
    Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.
    Type: Grant
    Filed: June 8, 2023
    Date of Patent: March 4, 2025
    Assignee: Dolby Video Compression, LLC
    Inventors: Sebastian Bosse, Heiko Schwarz, Thomas Wiegand, Heribert Brust
  • Patent number: 12244864
    Abstract: A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)—and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal.
    Type: Grant
    Filed: May 12, 2024
    Date of Patent: March 4, 2025
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Björn Stallenberger, Michael Schafer, Philipp Merkle, Tobias Hinz, Philipp Helle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Benjamin Bross, Martin Winken, Mischa Siekmann
  • Publication number: 20250071292
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Application
    Filed: November 8, 2024
    Publication date: February 27, 2025
    Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20250071291
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Application
    Filed: November 8, 2024
    Publication date: February 27, 2025
    Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20250063165
    Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.
    Type: Application
    Filed: November 1, 2024
    Publication date: February 20, 2025
    Inventors: Benjamin BROSS, Philipp MERKLE, Simone WALTER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Paul KEYDEL
  • Patent number: 12231608
    Abstract: A gain in multi-view coding is achieved as follows: the residual signal involved with coding a dependent view of the multi-view signal is predicted from a reference residual signal of the current picture of the reference view using block-granular disparity-compensated prediction, i.e. using disparity compensated prediction with a disparity defined at, and varying with, block granularity so that each block of the current picture of the dependent view has its own disparity displacement such as its own disparity vector, associated therewith. In other words, a remaining similarity between the residual signal involved with predictively coding the reference view is used in order to predict the residual signal involved with predictively coding the dependent view.
    Type: Grant
    Filed: November 19, 2021
    Date of Patent: February 18, 2025
    Assignee: Dolby Video Compression, LLC
    Inventors: Heiko Schwarz, Thomas Wiegand, Martin Winken
  • Publication number: 20250056040
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Application
    Filed: October 23, 2024
    Publication date: February 13, 2025
    Inventors: Jonathan PFAFF, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Mischa SIEKMANN, Martin WINKEN, Adam WIECKOWSKI, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12225198
    Abstract: A block-based decoder is configured to partition a picture of more than one color component and of a color sampling format, according to which each color component is equally sampled, into blocks using a partitioning scheme in which the picture is equally partitioned with respect to each color component. A first color component is decoded in units of the blocks with selecting, for each of intra-predicted first color component blocks, one out of a first set of intra-prediction modes. The first set comprises matrix-based intra prediction modes according to each of which a block inner is predicted by deriving a sample value vector out of neighboring reference samples, computing a matrix-vector product between the sample value vector and a prediction matrix associated with the respective matrix-based intra prediction mode to obtain a prediction vector, and predicting samples in the block inner on the basis of the prediction vector.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: February 11, 2025
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Tobias Hinz, Philipp Helle, Philipp Merkle, Björn Stallenberger, Michael Schäfer, Benjamin Bross, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12225238
    Abstract: Decoder for decoding a picture from a data stream, configured to check whether a plurality of coding parameters, which are contained in the data stream, relate to a predetermined portion of the picture and control a prediction residual transform mode and a quantization accuracy with respect to the predetermined portion, are indicative of a coding parameter setting corresponding to a lossless prediction residual coding. Responsive to the plurality of coding parameters being indicative of the coding parameter setting corresponding to the lossless prediction residual coding, the decoder is configured to set one or more predetermined coding options relating to one or more tools of the decoder for processing a prediction residual corrected predictive reconstruction with respect to the predetermined portion so that the one or more tools are disabled with respect to the predetermined portion.
    Type: Grant
    Filed: February 14, 2024
    Date of Patent: February 11, 2025
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Christian Helmrich, Benjamin Bross, Tung Hoang Nguyen, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20250047843
    Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.
    Type: Application
    Filed: October 22, 2024
    Publication date: February 6, 2025
    Inventors: Jens BRANDENBURG, Tobias HINZ, Adam WIECKOWSKI, Jackie MA, Valeri GEORGE, Christian LEHMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Thomas SCHIERL
  • Publication number: 20250045973
    Abstract: Embodiments according to the invention relate to a decoder for providing decoded parameters of a neural network on the basis of an encoded representation, wherein the decoder is configured to obtain a first multi-dimensional array comprising a plurality of neural network parameter values using a decoding of neural network parameters and wherein the decoder is configured to obtain a re-ordered multidimensional array using a reordering, in which a first dimension of the first multi-dimensional array is rearranged to a different dimension in the re-ordered multidimensional array. Furthermore, encoders, methods and computer programs using a reordering are disclosed.
    Type: Application
    Filed: October 11, 2024
    Publication date: February 6, 2025
    Inventors: Paul HAASE, Heiner KIRCHHOFFER, Daniel BECKING, Karsten MÜLLER, Wojciech SAMEK, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Gerhard TECH
  • Publication number: 20250047821
    Abstract: This disclosure is directed to coding a multi-view signal, which includes processing a list of plurality of motion vector candidates associated with a coding block of a current picture in a dependent view of the multi-view signal. Such processing includes estimating a first motion vector based on a second motion vector associated with a reference block in a current picture of a reference view of the multi-view signal, the reference block corresponding to the coding block of the current picture in the dependent view. The first motion vector is added into the list, and an index is used that specifies at least one candidate from the list to be used for motion-compensated prediction. The coding block in the current picture is coded by performing the motion-compensated prediction based on the at least one candidate indicated by the index.
    Type: Application
    Filed: August 14, 2024
    Publication date: February 6, 2025
    Inventors: Heiko SCHWARZ, Thomas WIEGAND
  • Publication number: 20250039404
    Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.
    Type: Application
    Filed: September 23, 2024
    Publication date: January 30, 2025
    Inventors: Martin WINKEN, Heiner KIRCHHOFFER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12212754
    Abstract: The coding of a media signal is rendered more efficient by describing the media signal using a sequence of samples and sequentially encoding this sequence by selecting, for a current sample, a set of quantization levels out of a plurality of quantization level sets depending on indices encoded into the data stream for previous samples of the sequence of samples, quantizing the current sample onto one level of the set of quantization levels, and encoding a quantization index to the one level for the current sample into the data stream. In other words, scalar quantization of the individual samples of the sequence of samples is used, but it is rendered dependent on quantization indices encoded into the data stream for previous samples of the sequence of samples.
    Type: Grant
    Filed: November 15, 2022
    Date of Patent: January 28, 2025
    Assignee: Fraunhofer-Gesellschaft zur Förderung derangewandten Forschung e.V.
    Inventors: Heiko Schwarz, Thomas Wiegand, Phan Hoang Tung Nguyen, Detlev Marpe
  • Publication number: 20250030853
    Abstract: A video decoder for decoding an encoded video signal including encoded picture data and indication data of a picture of a video to reconstruct the picture of the video is provided. The video decoder includes an interface configured for receiving the encoded video signal, and a data decoder configured for reconstructing the picture of the video by decoding the encoded picture data using the indication data. The picture is partitioned into a plurality of coding areas. One or more coding areas of the plurality of coding areas include two or more coding tree units of the plurality of coding tree units, wherein each coding area of the one or more coding areas which includes two or more coding tree units exhibits a coding order for the two or more coding tree units of the coding area.
    Type: Application
    Filed: October 4, 2024
    Publication date: January 23, 2025
    Inventors: Valeri GEORGE, Tobias HINZ, Jackie MA, Yago SÁNCHEZ DE LA FUENTE, Robert SKUPIN, Thomas SCHIERL, Jens BRANDENBURG, Christian LEHMANN, Adam WIECKOWSKI, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20250030852
    Abstract: In an encoder and a decoder for Region Based Intra Block Copy, the encoder may be configured for block-based encoding a picture into a data stream, and the decoder may be configured for block-based decoding a picture from a data stream. The encoder and decoder may further be configured to determine for a current block of the picture a difference between a first predetermined block and a second predetermined block inside a block search area. The encoder may encode the difference into the data stream and the decoder may derive the difference from the data stream. According to the innovative principle, the encoder and the decoder may be configured to partition the block search area into multiple block search regions.
    Type: Application
    Filed: August 9, 2024
    Publication date: January 23, 2025
    Inventors: Gayathri VENUGOPAL, Santiago DE LUXÁN HERNÁNDEZ, Karsten MÜLLER, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND