Patents by Inventor Heiner Kirchhoffer
Heiner Kirchhoffer has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240373066Abstract: Information available from coding/decoding the base layer. i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.Type: ApplicationFiled: May 9, 2024Publication date: November 7, 2024Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
-
Publication number: 20240373071Abstract: A raw byte sequence payload describing a picture in slices, WPP substreams or tiles and coded using context-adaptive binary arithmetic coding is subdivided into tranches with continuing the context-adaptive binary arithmetic coding probability adaptation across tranche boundaries. Thereby, tranche boundaries additionally introduced within slices, WPP substreams or tiles do not lead to a reduction in the entropy coding efficiency of these entities. However, the tranches are smaller than the original slices, WPP substreams or tiles and accordingly they may be transmitted earlier, i.e. with lower delay, than the un-chopped original entities. According to another aspect combinable with the first aspect, substream marker NAL units are used within a sequence of NAL units of a video bitstream to enable a transport demultiplexer to assign data of slices within NAL units to the corresponding substreams or tiles so as to be able to, in parallel, serve a multi-threaded decoder with the corresponding substreams or tiles.Type: ApplicationFiled: May 10, 2024Publication date: November 7, 2024Inventors: Thomas SCHIERL, Valeri GEORGE, Karsten GRUENEBERG, Heiner KIRCHHOFFER, Anastasia HENKEL, Detlev MARPE
-
Patent number: 12137242Abstract: A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.Type: GrantFiled: August 1, 2023Date of Patent: November 5, 2024Assignee: GE Video Compression, LLCInventors: Heiko Schwarz, Heiner Kirchhoffer, Philipp Helle, Simon Oudin, Jan Stegemann, Benjamin Bross, Detlev Marpe, Thomas Wiegand
-
Publication number: 20240364362Abstract: Some embodiments relate to a method, a decoder and/or an encoder for entropy coding of parameters of neural networks and their incremental updates, and in particular to reduced value set coding and history depended significance coding.Type: ApplicationFiled: July 9, 2024Publication date: October 31, 2024Applicant: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Gerhard TECH, Paul HAASE, Daniel BECKING, Heiner KIRCHHOFFER, Jonathan PFAFF, Karsten MÜLLER, Wojciech SAMEK, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
-
Publication number: 20240364891Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initialType: ApplicationFiled: July 8, 2024Publication date: October 31, 2024Inventors: Valeri GEORGE, Benjamin BROSS, Heiner KIRCHHOFFER, Detlev MARPE, Tung NGUYEN, Matthias PREISS, Mischa SIEKMANN, Jan STEGEMANN, Thomas WIEGAND
-
Publication number: 20240348805Abstract: A video decoder is configured to decode a plurality of video frames which are subdivided into a set of one or more slices. The decoder evaluates slice type information indicating whether a slice is encoded using an independent coding mode having no prediction of video content of a current frame on the basis of a video content of a previous frame, or using a single-predictive mode having a prediction of a block of pixels on the basis of one block of pixels of a previous frame, or using a bi-predictive mode having a prediction of a block of pixels on the basis of two or more blocks of pixels of one or more previous frames, to select a mode of operation for decoding a slice.Type: ApplicationFiled: June 25, 2024Publication date: October 17, 2024Inventors: Jan STEGEMANN, Heiner KIRCHHOFFER, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
-
Patent number: 12120316Abstract: A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.Type: GrantFiled: June 30, 2023Date of Patent: October 15, 2024Assignee: GE Video Compression, LLCInventors: Martin Winken, Heiner Kirchhoffer, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
-
Patent number: 12095486Abstract: An arithmetic encoder for encoding a plurality of symbols having symbol values is configured to derive an interval size information for an arithmetic encoding of one or more symbol values to be encoded based on a plurality of state variable values representing statistics of a plurality of previously encoded symbol values with different adaptation time constants. The arithmetic encoder is configured to map a first state variable value, or a scaled and/or rounded version thereof, using a lookup-table and to map a second state variable value, or a scaled and/or rounded version thereof using the lookup-table, in order to obtain the interval size information describing an interval size for the arithmetic encoding of one or more symbols to be encoded. Further arithmetic encoders, arithmetic decoders, video encoders, video decoder, methods for encoding, methods for decoding and computer programs are also disclosed which are based on the same concept and on other concepts.Type: GrantFiled: July 26, 2022Date of Patent: September 17, 2024Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Heiner Kirchhoffer, Jan Stegemann, Detlev Marpe, Paul Haase, Stefan Matlage, Christian Bartnik, Heiko Schwarz, Thomas Wiegand
-
Publication number: 20240305822Abstract: An idea used herein is to use the same function for the dependency of the context and the dependency of the symbolization parameter on previously coded/decoded transform coefficients. Using the same function—with varying function parameter—may even be used with respect to different transform block sizes and/or frequency portions of the transform blocks in case of the transform coefficients being spatially arranged in transform blocks. A further variant of this idea is to use the same function for the dependency of a symbolization parameter on previously coded/decoded transform coefficients for different sizes of the current transform coefficient's transform block, different information component types of the current transform coefficient's transform block and/or different frequency portions the current transform coefficient is located within the transform block.Type: ApplicationFiled: March 19, 2024Publication date: September 12, 2024Inventors: Tung NGUYEN, Heiner KIRCHHOFFER, Detlev MARPE
-
Publication number: 20240292010Abstract: The entropy coding of a current part of a predetermined entropy slice is based on, not only, the respective probability estimations of the predetermined entropy slice as adapted using the previously coded part of the predetermined entropy slice, but also probability estimations as used in the entropy coding of a spatially neighboring, in entropy slice order preceding entropy slice at a neighboring part thereof. Thereby, the probability estimations used in entropy coding are adapted to the actual symbol statistics more closely, thereby lowering the coding efficiency decrease normally caused by lower-delay concepts. Temporal interrelationships are exploited additionally or alternatively.Type: ApplicationFiled: March 6, 2024Publication date: August 29, 2024Inventors: Valeri GEORGE, Anastasia HENKEL, Heiner KIRCHHOFFER, Detlev MARPE, Thomas SCHIERL
-
Patent number: 12069267Abstract: A decoder includes an entropy decoder configured to derive a number of bins of the binarizations from the data stream using binary entropy decoding by selecting a context among different contexts and updating probability states associated with the different contexts, dependent on previously decoded portions of the data stream; a desymbolizer configured to debinarize the binarizations of the syntax elements to obtain integer values of the syntax elements; a reconstructor configured to reconstruct the video based on the integer values of the syntax elements using a quantization parameter, wherein the entropy decoder is configured to distinguish between 126 probability states and to initialize the probability states associated with the different contexts according to a linear equation of the quantization parameter, wherein the entropy decoder is configured to, for each of the different contexts, derive a slope and an offset of the linear equation from first and second four bit parts of a respective 8 bit initialType: GrantFiled: September 9, 2022Date of Patent: August 20, 2024Assignee: GE Video Compression, LLCInventors: Valeri George, Benjamin Bross, Heiner Kirchhoffer, Detlev Marpe, Tung Nguyen, Matthias Preiss, Mischa Siekmann, Jan Stegemann, Thomas Wiegand
-
Publication number: 20240267569Abstract: Coding schemes for coding a spatially sampled information signal using subdivision and coding scheme for coding a sub-division or a multi tree structure are described, wherein representative embodiments relate to picture and/or video coding applications.Type: ApplicationFiled: January 29, 2024Publication date: August 8, 2024Inventors: Heiner KIRCHHOFFER, Martin WINKEN, Philipp HELLE, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND
-
Patent number: 12058352Abstract: A video decoder is configured to decode a plurality of video frames which are subdivided into a set of one or more slices. The decoder evaluates slice type information indicating whether a slice is encoded using an independent coding mode having no prediction of video content of a current frame on the basis of a video content of a previous frame, or using a single-predictive mode having a prediction of a block of pixels on the basis of one block of pixels of a previous frame, or using a bi-predictive mode having a prediction of a block of pixels on the basis of two or more blocks of pixels of one or more previous frames, to select a mode of operation for decoding a slice. The video decoder includes an arithmetic decoder for providing a decoded binary sequence on the basis of an encoded representation of the binary sequence.Type: GrantFiled: August 31, 2022Date of Patent: August 6, 2024Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.Inventors: Jan Stegemann, Heiner Kirchhoffer, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
-
Patent number: 12010334Abstract: Information available from coding/decoding the base layer, i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.Type: GrantFiled: April 16, 2020Date of Patent: June 11, 2024Assignee: GE Video Compression, LLCInventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
-
Patent number: 11997319Abstract: A raw byte sequence payload describing a picture in slices, WPP substreams or tiles and coded using context-adaptive binary arithmetic coding is subdivided into tranches with continuing the context-adaptive binary arithmetic coding probability adaptation across tranche boundaries. Thereby, tranche boundaries additionally introduced within slices, WPP substreams or tiles do not lead to a reduction in the entropy coding efficiency of these entities. However, the tranches are smaller than the original slices, WPP substreams or tiles and accordingly they may be transmitted earlier, i.e. with lower delay, than the un-chopped original entities. According to another aspect combinable with the first aspect, substream marker NAL units are used within a sequence of NAL units of a video bitstream to enable a transport demultiplexer to assign data of slices within NAL units to the corresponding substreams or tiles so as to be able to, in parallel, serve a multi-threaded decoder with the corresponding substreams or tiles.Type: GrantFiled: October 28, 2020Date of Patent: May 28, 2024Assignee: GE Video Compression, LLCInventors: Thomas Schierl, Valeri George, Karsten Grueneberg, Heiner Kirchhoffer, Anastasia Henkel, Detlev Marpe
-
Patent number: 11979584Abstract: Arithmetic encoder for encoding a plurality of symbols is configured to derive an interval size information for an arithmetic encoding of one or more symbol values to be encoded on the basis of one or more state variable value, in a first mode of operation, and to update the one or more state variable values and/or the interval size information for an encoding of one or more subsequent symbol values to be encoded in the first mode; in a second mode, the arithmetic encoder is configured to disable an update of the one or more state variable values and/or of the interval size information. Additionally, further embodiments of arithmetic encoders and decoders and video encoders and decoders are described.Type: GrantFiled: March 24, 2022Date of Patent: May 7, 2024Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Inventors: Heiner Kirchhoffer, Detlev Marpe, Benjamin Bross, Phan Hoang Tung Nguyen, Christian Rudat, Heiko Schwarz, Thomas Wiegand
-
Publication number: 20240146954Abstract: A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.Type: ApplicationFiled: August 1, 2023Publication date: May 2, 2024Inventors: Heiko SCHWARZ, Heiner KIRCHHOFFER, Philipp HELLE, Simon OUDIN, Jan STEGEMANN, Benjamin BROSS, Detlev MARPE, Thomas WIEGAND
-
Patent number: 11968395Abstract: An idea used herein is to use the same function for the dependency of the context and the dependency of the symbolization parameter on previously coded/decoded transform coefficients. Using the same function—with varying function parameter—may even be used with respect to different transform block sizes and/or frequency portions of the transform blocks in case of the transform coefficients being spatially arranged in transform blocks. A further variant of this idea is to use the same function for the dependency of a symbolization parameter on previously coded/decoded transform coefficients for different sizes of the current transform coefficient's transform block, different information component types of the current transform coefficient's transform block and/or different frequency portions the current transform coefficient is located within the transform block.Type: GrantFiled: March 23, 2023Date of Patent: April 23, 2024Assignee: GE Video Compression, LLCInventors: Tung Nguyen, Heiner Kirchhoffer, Detlev Marpe
-
Patent number: 11949897Abstract: The entropy coding of a current part of a predetermined entropy slice is based on, not only, the respective probability estimations of the predetermined entropy slice as adapted using the previously coded part of the predetermined entropy slice, but also probability estimations as used in the entropy coding of a spatially neighboring, in entropy slice order preceding entropy slice at a neighboring part thereof. Thereby, the probability estimations used in entropy coding are adapted to the actual symbol statistics more closely, thereby lowering the coding efficiency decrease normally caused by lower-delay concepts. Temporal interrelationships are exploited additionally or alternatively.Type: GrantFiled: January 27, 2023Date of Patent: April 2, 2024Assignee: GE Video Compression, LLCInventors: Valeri George, Anastasia Henkel, Heiner Kirchhoffer, Detlev Marpe, Thomas Schierl
-
Patent number: 11910029Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.Type: GrantFiled: July 26, 2023Date of Patent: February 20, 2024Assignee: GE Video Compression, LLCInventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand