Patents by Inventor Mischa SIEKMANN
Mischa SIEKMANN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250080735Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).Type: ApplicationFiled: November 18, 2024Publication date: March 6, 2025Inventors: Paul HAASE, Christian RUDAT, Heiner KIRCHHOFFER, Phan Hoang Tung NGUYEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Patent number: 12244864Abstract: A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)—and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal.Type: GrantFiled: May 12, 2024Date of Patent: March 4, 2025Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Björn Stallenberger, Michael Schafer, Philipp Merkle, Tobias Hinz, Philipp Helle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Benjamin Bross, Martin Winken, Mischa Siekmann
-
Publication number: 20250071292Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.Type: ApplicationFiled: November 8, 2024Publication date: February 27, 2025Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
-
Publication number: 20250071291Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.Type: ApplicationFiled: November 8, 2024Publication date: February 27, 2025Inventors: Martin WINKEN, Christian BARTNIK, Philipp HELLE, Mischa SIEKMANN, Jonathan PFAFF, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
-
Publication number: 20250056040Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.Type: ApplicationFiled: October 23, 2024Publication date: February 13, 2025Inventors: Jonathan PFAFF, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Mischa SIEKMANN, Martin WINKEN, Adam WIECKOWSKI, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20250030847Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding and include assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder or encoder, if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.Type: ApplicationFiled: October 2, 2024Publication date: January 23, 2025Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
-
Patent number: 12200216Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).Type: GrantFiled: October 17, 2023Date of Patent: January 14, 2025Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.Inventors: Paul Haase, Christian Rudat, Heiner Kirchhoffer, Phan Hoang Tung Nguyen, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Patent number: 12160606Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.Type: GrantFiled: January 9, 2023Date of Patent: December 3, 2024Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung, e.V.Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Patent number: 12160571Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points.Type: GrantFiled: May 4, 2023Date of Patent: December 3, 2024Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Heiko Schwarz, Philipp Helle, Michael Schäfer, Roman Rischke, Tobias Hinz, Philipp Merkle, Björn Stallenberger, Martin Winken, Mischa Siekmann, Detlev Marpe, Thomas Wiegand
-
Patent number: 12155867Abstract: A scalable video decoder is described which is configured to reconstruct a base layer signal from a coded data stream to obtain a reconstructed base layer signal; and reconstruct an enhancement layer signal including spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components; and predictively reconstructing the enhancement layer signal using the enhancement layer prediction signal.Type: GrantFiled: August 25, 2021Date of Patent: November 26, 2024Assignee: GE Video Compression, LLCInventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
-
Patent number: 12143591Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.Type: GrantFiled: July 26, 2022Date of Patent: November 12, 2024Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Martin Winken, Christian Bartnik, Philipp Helle, Mischa Siekmann, Jonathan Pfaff, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
-
Publication number: 20240373064Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.Type: ApplicationFiled: July 17, 2024Publication date: November 7, 2024Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Tobias Hinz, Philipp Merkle, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Publication number: 20240373066Abstract: Information available from coding/decoding the base layer. i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.Type: ApplicationFiled: May 9, 2024Publication date: November 7, 2024Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
-
Publication number: 20240364891Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initialType: ApplicationFiled: July 8, 2024Publication date: October 31, 2024Inventors: Valeri GEORGE, Benjamin BROSS, Heiner KIRCHHOFFER, Detlev MARPE, Tung NGUYEN, Matthias PREISS, Mischa SIEKMANN, Jan STEGEMANN, Thomas WIEGAND
-
Patent number: 12126812Abstract: An apparatus for determining visual activity information for a predetermined picture block of a video sequence including a plurality of video frames, the plurality of video frames including a current video frame and one or more timely-preceding video frames, wherein the one or more timely-preceding video frames precede the current video frame in time, is provided. The apparatus is configured to receive the predetermined picture block of each of the one or more timely-preceding video frames and the predetermined picture block of the current video frame. Moreover, the apparatus is configured to determine the visual activity information depending on the predetermined picture block of the current video frame and depending on the predetermined picture block of each of the one or more timely-preceding video frames and depending on a temporal high-pass filter.Type: GrantFiled: April 18, 2022Date of Patent: October 22, 2024Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Christian Helmrich, Sebastian Bosse, Mischa Siekmann, Soeren Becker, Johannes Erfurt, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Publication number: 20240323360Abstract: An apparatus includes at least one processor for decoding a block of a picture using intra-prediction that is configured to: decode, from a data stream, a mode index, the mode index indicating a matrix-based intra-prediction mode out of a plurality of matrix-based intra-prediction modes based on a size of the block, derive an input vector based on downsampling reference samples neighboring the block, determine a matrix based on the size of the block and the mode index, compute a respective output for each component of a matrix-vector product between the the input vector and the determined matrix, the respective output computed by performing, a right shift by a number of bits which is independent of the matrix-based intra-prediction mode indicated by the mode index, and for each component of the matrix-vector product, use the respective output to predict a respective sample of the block.Type: ApplicationFiled: June 7, 2024Publication date: September 26, 2024Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20240314305Abstract: Apparatus configured to derive a set-selective syntax element indicating whether the predetermined block is to be predicted using one of a first set of intra-prediction modes comprising a DC intra prediction mode and angular prediction modes. If the set-selective syntax element indicates that the predetermined block is to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a list of most probable intra-prediction modes. If the set-selective syntax element indicates that the predetermined block is not to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a matrix-based intra-prediction mode. The list of most probable intra-prediction modes is formed such that the list of most probable intra-prediction modes is free of the DC intra prediction mode in case of the neighbouring blocks being predicted by any of the angular intra prediction modes.Type: ApplicationFiled: May 23, 2024Publication date: September 19, 2024Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Bjoern STALLENBERGER, Michael SCHAEFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20240298033Abstract: A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)-and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal.Type: ApplicationFiled: May 12, 2024Publication date: September 5, 2024Inventors: Jonathan PFAFF, Björn STALLENBERGER, Michael SCHAFER, Philipp MERKLE, Tobias HINZ, Philipp HELLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN
-
Patent number: 12075091Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.Type: GrantFiled: October 7, 2022Date of Patent: August 27, 2024Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Tobias Hinz, Philipp Merkle, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Patent number: 12069267Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initialType: GrantFiled: September 9, 2022Date of Patent: August 20, 2024Assignee: GE Video Compression, LLCInventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand