Patents by Inventor Heiko Schwarz
Heiko Schwarz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250106401Abstract: A method for sequentially decoding, from a data stream, a sequence of samples corresponding to a picture, including entropy decoding a quantization index corresponding to a sample, indicating, based on the quantization index, a reconstruction level set of two reconstruction levels sets, the two reconstruction level sets including: a first reconstruction level set that includes reconstruction levels that are even multiples of a quantization step size, wherein the first reconstruction level set excludes reconstruction levels that are odd multiples of the quantization set size; a second reconstruction level set that includes reconstruction levels that are odd multiples of the quantization step size, and dequantizing the sample using the indicated reconstruction level set. The second reconstruction level set excludes reconstruction levels that are even multiples of the quantization step size.Type: ApplicationFiled: December 9, 2024Publication date: March 27, 2025Inventors: Heiko SCHWARZ, Thomas WIEGAND, Phan Hoang Tung NGUYEN, Detlev MARPE
-
Publication number: 20250106397Abstract: The present invention concerns an apparatus configured to partition a picture into leaf blocks using recursive multi-tree partitioning, block-based encode the picture into a data stream using the partitioning of the picture into the leaf blocks, wherein the apparatus is configured to, in partitioning the picture into the leaf blocks, for a predetermined block which extends beyond a boundary of the picture, reduce an available set of split modes depending on a position at which the boundary of the picture crosses the predetermined block in order to obtain a reduced set of one or more split modes, wherein the apparatus is configured to signal a selected split mode in the data stream.Type: ApplicationFiled: December 9, 2024Publication date: March 27, 2025Inventors: Adam WIECKOWSKI, Valeri GEORGE, Tobias HINZ, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Jackie MA, Jens BRANDENBURG
-
Publication number: 20250097453Abstract: A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.Type: ApplicationFiled: September 25, 2024Publication date: March 20, 2025Inventors: Heiko SCHWARZ, Heiner KIRCHHOFFER, Philipp HELLE, Simon OUDIN, Jan STEGEMANN, Benjamin BROSS, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20250080735Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).Type: ApplicationFiled: November 18, 2024Publication date: March 6, 2025Inventors: Paul HAASE, Christian RUDAT, Heiner KIRCHHOFFER, Phan Hoang Tung NGUYEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Patent number: 12244851Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.Type: GrantFiled: June 8, 2023Date of Patent: March 4, 2025Assignee: Dolby Video Compression, LLCInventors: Sebastian Bosse, Heiko Schwarz, Thomas Wiegand, Heribert Brust
-
Patent number: 12244864Abstract: A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)—and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal.Type: GrantFiled: May 12, 2024Date of Patent: March 4, 2025Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Björn Stallenberger, Michael Schafer, Philipp Merkle, Tobias Hinz, Philipp Helle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Benjamin Bross, Martin Winken, Mischa Siekmann
-
Publication number: 20250071292Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.Type: ApplicationFiled: November 8, 2024Publication date: February 27, 2025Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
-
Publication number: 20250071291Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.Type: ApplicationFiled: November 8, 2024Publication date: February 27, 2025Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
-
Publication number: 20250063165Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.Type: ApplicationFiled: November 1, 2024Publication date: February 20, 2025Inventors: Benjamin BROSS, Philipp MERKLE, Simone WALTER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Paul KEYDEL
-
Patent number: 12231608Abstract: A gain in multi-view coding is achieved as follows: the residual signal involved with coding a dependent view of the multi-view signal is predicted from a reference residual signal of the current picture of the reference view using block-granular disparity-compensated prediction, i.e. using disparity compensated prediction with a disparity defined at, and varying with, block granularity so that each block of the current picture of the dependent view has its own disparity displacement such as its own disparity vector, associated therewith. In other words, a remaining similarity between the residual signal involved with predictively coding the reference view is used in order to predict the residual signal involved with predictively coding the dependent view.Type: GrantFiled: November 19, 2021Date of Patent: February 18, 2025Assignee: Dolby Video Compression, LLCInventors: Heiko Schwarz, Thomas Wiegand, Martin Winken
-
Publication number: 20250056040Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.Type: ApplicationFiled: October 23, 2024Publication date: February 13, 2025Inventors: Jonathan PFAFF, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Mischa SIEKMANN, Martin WINKEN, Adam WIECKOWSKI, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Patent number: 12225198Abstract: A block-based decoder is configured to partition a picture of more than one color component and of a color sampling format, according to which each color component is equally sampled, into blocks using a partitioning scheme in which the picture is equally partitioned with respect to each color component. A first color component is decoded in units of the blocks with selecting, for each of intra-predicted first color component blocks, one out of a first set of intra-prediction modes. The first set comprises matrix-based intra prediction modes according to each of which a block inner is predicted by deriving a sample value vector out of neighboring reference samples, computing a matrix-vector product between the sample value vector and a prediction matrix associated with the respective matrix-based intra prediction mode to obtain a prediction vector, and predicting samples in the block inner on the basis of the prediction vector.Type: GrantFiled: April 1, 2021Date of Patent: February 11, 2025Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Tobias Hinz, Philipp Helle, Philipp Merkle, Björn Stallenberger, Michael Schäfer, Benjamin Bross, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Patent number: 12225238Abstract: Decoder for decoding a picture from a data stream, configured to check whether a plurality of coding parameters, which are contained in the data stream, relate to a predetermined portion of the picture and control a prediction residual transform mode and a quantization accuracy with respect to the predetermined portion, are indicative of a coding parameter setting corresponding to a lossless prediction residual coding. Responsive to the plurality of coding parameters being indicative of the coding parameter setting corresponding to the lossless prediction residual coding, the decoder is configured to set one or more predetermined coding options relating to one or more tools of the decoder for processing a prediction residual corrected predictive reconstruction with respect to the predetermined portion so that the one or more tools are disabled with respect to the predetermined portion.Type: GrantFiled: February 14, 2024Date of Patent: February 11, 2025Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Christian Helmrich, Benjamin Bross, Tung Hoang Nguyen, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Publication number: 20250047843Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.Type: ApplicationFiled: October 22, 2024Publication date: February 6, 2025Inventors: Jens BRANDENBURG, Tobias HINZ, Adam WIECKOWSKI, Jackie MA, Valeri GEORGE, Christian LEHMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Thomas SCHIERL
-
Publication number: 20250045973Abstract: Embodiments according to the invention relate to a decoder for providing decoded parameters of a neural network on the basis of an encoded representation, wherein the decoder is configured to obtain a first multi-dimensional array comprising a plurality of neural network parameter values using a decoding of neural network parameters and wherein the decoder is configured to obtain a re-ordered multidimensional array using a reordering, in which a first dimension of the first multi-dimensional array is rearranged to a different dimension in the re-ordered multidimensional array. Furthermore, encoders, methods and computer programs using a reordering are disclosed.Type: ApplicationFiled: October 11, 2024Publication date: February 6, 2025Inventors: Paul HAASE, Heiner KIRCHHOFFER, Daniel BECKING, Karsten MÜLLER, Wojciech SAMEK, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Gerhard TECH
-
Publication number: 20250047821Abstract: This disclosure is directed to coding a multi-view signal, which includes processing a list of plurality of motion vector candidates associated with a coding block of a current picture in a dependent view of the multi-view signal. Such processing includes estimating a first motion vector based on a second motion vector associated with a reference block in a current picture of a reference view of the multi-view signal, the reference block corresponding to the coding block of the current picture in the dependent view. The first motion vector is added into the list, and an index is used that specifies at least one candidate from the list to be used for motion-compensated prediction. The coding block in the current picture is coded by performing the motion-compensated prediction based on the at least one candidate indicated by the index.Type: ApplicationFiled: August 14, 2024Publication date: February 6, 2025Inventors: Heiko SCHWARZ, Thomas WIEGAND
-
Publication number: 20250039404Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.Type: ApplicationFiled: September 23, 2024Publication date: January 30, 2025Inventors: Martin WINKEN, Heiner KIRCHHOFFER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Patent number: 12212754Abstract: The coding of a media signal is rendered more efficient by describing the media signal using a sequence of samples and sequentially encoding this sequence by selecting, for a current sample, a set of quantization levels out of a plurality of quantization level sets depending on indices encoded into the data stream for previous samples of the sequence of samples, quantizing the current sample onto one level of the set of quantization levels, and encoding a quantization index to the one level for the current sample into the data stream. In other words, scalar quantization of the individual samples of the sequence of samples is used, but it is rendered dependent on quantization indices encoded into the data stream for previous samples of the sequence of samples.Type: GrantFiled: November 15, 2022Date of Patent: January 28, 2025Assignee: Fraunhofer-Gesellschaft zur Förderung derangewandten Forschung e.V.Inventors: Heiko Schwarz, Thomas Wiegand, Phan Hoang Tung Nguyen, Detlev Marpe
-
Publication number: 20250030853Abstract: A video decoder for decoding an encoded video signal including encoded picture data and indication data of a picture of a video to reconstruct the picture of the video is provided. The video decoder includes an interface configured for receiving the encoded video signal, and a data decoder configured for reconstructing the picture of the video by decoding the encoded picture data using the indication data. The picture is partitioned into a plurality of coding areas. One or more coding areas of the plurality of coding areas include two or more coding tree units of the plurality of coding tree units, wherein each coding area of the one or more coding areas which includes two or more coding tree units exhibits a coding order for the two or more coding tree units of the coding area.Type: ApplicationFiled: October 4, 2024Publication date: January 23, 2025Inventors: Valeri GEORGE, Tobias HINZ, Jackie MA, Yago SÁNCHEZ DE LA FUENTE, Robert SKUPIN, Thomas SCHIERL, Jens BRANDENBURG, Christian LEHMANN, Adam WIECKOWSKI, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20250030852Abstract: In an encoder and a decoder for Region Based Intra Block Copy, the encoder may be configured for block-based encoding a picture into a data stream, and the decoder may be configured for block-based decoding a picture from a data stream. The encoder and decoder may further be configured to determine for a current block of the picture a difference between a first predetermined block and a second predetermined block inside a block search area. The encoder may encode the difference into the data stream and the decoder may derive the difference from the data stream. According to the innovative principle, the encoder and the decoder may be configured to partition the block search area into multiple block search regions.Type: ApplicationFiled: August 9, 2024Publication date: January 23, 2025Inventors: Gayathri VENUGOPAL, Santiago DE LUXÁN HERNÁNDEZ, Karsten MÜLLER, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND