Patents by Inventor Mischa SIEKMANN
Mischa SIEKMANN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240137500Abstract: In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.Type: ApplicationFiled: December 19, 2023Publication date: April 25, 2024Inventors: Jonathan PFAFF, Philipp HELLE, Dominique MANIRY, Thomas WIEGARD, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Mischa SIEKMANN, Martin WINKEN
-
Publication number: 20240114138Abstract: In transform coefficient coding, predetermined sets of transforms may be used. Embodiments of the present invention provide an encoder and a decoder for encoding a picture into/from a data stream using block-based prediction and block-based residual coding, the encoder and decoder supporting a set of transforms for the block-based residual coding. The encoder and decoder are configured to determine a transform candidate list of transforms for a current residual block out of the set of transforms based on a height and a width of the current residual block, and to encode/decode a prediction residual within the residual block using one selected transform out of the selectable list of transforms and selectively signal/derive the selected transform in/from the data stream.Type: ApplicationFiled: December 6, 2023Publication date: April 4, 2024Inventors: Mischa SIEKMANN, Bjoern STALLENBERGER, Christian BARTNIK, Sebastian BOSSE, Jonathan PFAFF, Philipp HELLE, Jackie MA, Martin WINKEN, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
-
Publication number: 20240048705Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).Type: ApplicationFiled: October 17, 2023Publication date: February 8, 2024Inventors: Paul HAASE, Christian RUDAT, Heiner KIRCHHOFFER, Phan Hoang Tung NGUYEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20240048708Abstract: A decoder for decoding a data stream into which media data is coded has a mode switch configured to activate a low-complexity mode or a high-efficiency mode depending on the data stream, an entropy decoding engine configured to retrieve each symbol of a sequence of symbols by entropy decoding using a selected one of a plurality of entropy decoding schemes, a desymbolizer configured to desymbolize the sequence of symbols to obtain a sequence of syntax elements, a reconstructor configured to reconstruct the media data based on the sequence of syntax elements, selection depending on the activated low-complexity mode or the high-efficiency mode.Type: ApplicationFiled: October 6, 2023Publication date: February 8, 2024Inventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand, Christian Bartnik
-
Patent number: 11895290Abstract: A video coding method and apparatus for codes a video in a data stream using block-based predictive coding by deriving a collection of one or more primitive predictions for a block using a set of primitive prediction modes adapted for predicting blocks of a picture of the video. Each primitive prediction in the collection of primitive predictions is derived using a respective primitive prediction mode from the set of primitive prediction modes. A composite prediction signal for the block is composed by combining primitive predictions from the collection of one or more primitive predictions, and the block is predicted using the composite prediction signal.Type: GrantFiled: March 21, 2022Date of Patent: February 6, 2024Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Thomas Wiegand, Detlev Marpe, Heiko Schwarz, Martin Winken, Christian Bartnik, Jonathan Pfaff, Philipp Helle, Mischa Siekmann
-
Patent number: 11889066Abstract: In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.Type: GrantFiled: June 13, 2022Date of Patent: January 30, 2024Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Philipp Helle, Dominique Maniry, Thomas Wiegard, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Mischa Siekmann, Martin Winken
-
Patent number: 11882284Abstract: In transform coefficient coding, predetermined sets of transforms may be used. Embodiments of the present invention provide an encoder and a decoder for encoding a picture into/from a data stream using block-based prediction and block-based residual coding, the encoder and decoder supporting a set of transforms for the block-based residual coding. The encoder and decoder are configured to determine a transform candidate list of transforms for a current residual block out of the set of transforms based on a height and a width of the current residual block, and to encode/decode a prediction residual within the residual block using one selected transform out of the selectable list of transforms and selectively signal/derive the selected transform in/from the data stream.Type: GrantFiled: September 28, 2020Date of Patent: January 23, 2024Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Mischa Siekmann, Bjoern Stallenberger, Christian Bartnik, Sebastian Bosse, Jonathan Pfaff, Philipp Helle, Jackie Ma, Martin Winken, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
-
Patent number: 11838511Abstract: A decoder for decoding a data stream into which media data is coded has a mode switch configured to activate a low-complexity mode or a high-efficiency mode depending on the data stream, an entropy decoding engine configured to retrieve each symbol of a sequence of symbols by entropy decoding using a selected one of a plurality of entropy decoding schemes, a desymbolizer configured to desymbolize the sequence of symbols to obtain a sequence of syntax elements, a reconstructor configured to reconstruct the media data based on the sequence of syntax elements, selection depending on the activated low-complexity mode or the high-efficiency mode.Type: GrantFiled: February 1, 2022Date of Patent: December 5, 2023Assignee: GE Video Compression, LLCInventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand, Christian Bartnik
-
Patent number: 11825091Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).Type: GrantFiled: February 1, 2023Date of Patent: November 21, 2023Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.Inventors: Paul Haase, Christian Rudat, Heiner Kirchhoffer, Phan Hoang Tung Nguyen, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Publication number: 20230328287Abstract: Apparatus (54) for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from a data stream (12), a mode index (200) using a binarization code (202). The mode index (200) points to one out of a list (204) of matrix-based intra-prediction modes. The apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighbourhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix-vector product (206) onto sample positions (104) of the predetermined block. The list (204) of matrix-based intra-prediction modes consists of an even number of matrix-based intra-prediction modes.Type: ApplicationFiled: September 24, 2020Publication date: October 12, 2023Inventors: Jonathan PFAFF, Björn STALLENBERGER, Michael SCHAEFER, Philipp MERKLE, Tobias HINZ, Philipp HELLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN
-
Publication number: 20230276048Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points.Type: ApplicationFiled: May 4, 2023Publication date: August 31, 2023Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20230262242Abstract: A subblock-based coding of transform coefficient blocks of the enhancement layer is rendered more efficient. To this end, the subblock subdivision of the respective transform coefficient block is controlled on the basis of the base layer residual signal or the base layer signal. In particular, by exploiting the respective base layer hint, the subblocks may be made longer along a spatial frequency axis transverse to edge extensions observable from the base layer residual signal or the base layer signal.Type: ApplicationFiled: February 6, 2023Publication date: August 17, 2023Inventors: Tobias HINZ, Haricharan LAKSHMAN, Jan STEGEMANN, Philipp HELLE, Mischa SIEKMANN, Karsten SUEHRING, Detlev MARPE, Heiko SCHWARZ, Christian BARTNIK, Ali Atef Ibrahim KHAIRAT ABDELHAMID, Heiner KIRCHHOFFER, Thomas WIEGAND
-
Publication number: 20230262241Abstract: The coding efficiency of scalable video coding is increased by substituting missing spatial intra prediction parameter candidates in a spatial neighborhood of a current block of the enhancement layer by use of intra prediction parameters of a co-located block of the base layer signal. By this measure, the coding efficiency for coding the spatial intra prediction parameters is increased due to the improved prediction quality of the set of intra prediction parameters of the enhancement layer, or, more precisely stated, the increased likelihood, that appropriate predictors for the intra prediction parameters for an intra predicted block of the enhancement layer are available thereby increasing the likelihood that the signaling of the intra prediction parameter of the respective enhancement layer block may be performed, on average, with less bits.Type: ApplicationFiled: February 3, 2023Publication date: August 17, 2023Inventors: Tobias HINZ, Haricharan LAKSHMAN, Jan STEGEMANN, Philipp HELLE, Mischa SIEKMANN, Karsten SUEHRING, Detlev MARPE, Heiko SCHWARZ, Christian BARTNIK, Ali Atef Ibrahim KHAIRAT ABDELHAMID, Heiner KIRCHHOFFER, Thomas WIEGAND
-
Publication number: 20230254508Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template ; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.Type: ApplicationFiled: January 9, 2023Publication date: August 10, 2023Applicant: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Publication number: 20230188719Abstract: An entropy decoder is configured to, for horizontal and vertical components of motion vector differences, derive a truncated unary code from the data stream using context-adaptive binary entropy decoding with exactly one context per bin position of the truncated unary code, which is common for horizontal and vertical components of the motion vector differences, and an Exp-Golomb code using a constant equi-probability bypass mode to obtain the binarizations of the motion vector differences. A desymbolizer is configured to debinarize the binarizations of the motion vector difference syntax elements to obtain integer values of the horizontal and vertical components of the motion vector differences. A reconstructor is configured to reconstruct a video based on the integer values of the horizontal and vertical components of the motion vector differences.Type: ApplicationFiled: November 7, 2022Publication date: June 15, 2023Inventors: Valeri GEORGE, Benjamin BROSS, Heiner KIRCHHODDER, Detlev MARPE, Tung NGUYEN, Matthias PRIESS, Mischa SIEKMANN, Jan STEGEMANN, Thomas WIEGAND
-
Publication number: 20230188718Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).Type: ApplicationFiled: February 1, 2023Publication date: June 15, 2023Inventors: Paul HAASE, Christian RUDAT, Heiner KIRCHHOFFER, Phan Hoang Tung NGUYEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Patent number: 11659169Abstract: There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding. In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder (resp.Type: GrantFiled: March 11, 2021Date of Patent: May 23, 2023Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Jonathan Pfaff, Heiko Schwarz, Philipp Helle, Michael Schäfer, Roman Rischke, Tobias Hinz, Philipp Merkle, Björn Stallenberger, Martin Winken, Mischa Siekmann, Detlev Marpe, Thomas Wiegand
-
Patent number: 11641473Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.Type: GrantFiled: January 8, 2021Date of Patent: May 2, 2023Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Martin Winken, Christian Bartnik, Philipp Helle, Mischa Siekmann, Jonathan Pfaff, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
-
Patent number: 11611748Abstract: An encoder encodes transform coefficients of a transform coefficient block representing a block of a picture using a scan pattern which sequentially traverses the transform coefficients of the transform block by encoding absolute values of quantization levels of the transform coefficients. The absolute values are binarized with a binarization comprising a first part of the binarization below a cutoff value and a second part of the binarization, prefixed by a codeword of the first part of the binarization for the cutoff value, above the cutoff value. The encoder adaptively, based on previously encoded transform coefficients, decreases the cutoff value to zero monotonically during encoding of the transform coefficients so that the binarization comprises the second part of the binarization and not the first part of the binarization.Type: GrantFiled: September 25, 2020Date of Patent: March 21, 2023Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.Inventors: Paul Haase, Christian Rudat, Heiner Kirchhoffer, Phan Hoang Tung Nguyen, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Publication number: 20230078680Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initialType: ApplicationFiled: September 9, 2022Publication date: March 16, 2023Inventors: Valeri GEORGE, Benjamin BROSS, Heiner KIRCHHOFFER, Detlev MARPE, Tung NGUYEN, Matthias PREISS, Mischa SIEKMANN, Jan STEGEMANN, Thomas WIEGAND