Patents by Inventor Heiko Schwarz

Heiko Schwarz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230276047
    Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.
    Type: Application
    Filed: May 9, 2023
    Publication date: August 31, 2023
    Inventors: Jens BRADENBURG, Tobias HINZ, Adam WIECKOWSKI, Jackie MA, Valeri GEORGE, Christian LEHMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Robert SKUPIN, Yago SÁNCHEZ DE LA FUENTE, Thomas SCHIERL
  • Publication number: 20230276048
    Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points.
    Type: Application
    Filed: May 4, 2023
    Publication date: August 31, 2023
    Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230262242
    Abstract: A subblock-based coding of transform coefficient blocks of the enhancement layer is rendered more efficient. To this end, the subblock subdivision of the respective transform coefficient block is controlled on the basis of the base layer residual signal or the base layer signal. In particular, by exploiting the respective base layer hint, the subblocks may be made longer along a spatial frequency axis transverse to edge extensions observable from the base layer residual signal or the base layer signal.
    Type: Application
    Filed: February 6, 2023
    Publication date: August 17, 2023
    Inventors: Tobias HINZ, Haricharan LAKSHMAN, Jan STEGEMANN, Philipp HELLE, Mischa SIEKMANN, Karsten SUEHRING, Detlev MARPE, Heiko SCHWARZ, Christian BARTNIK, Ali Atef Ibrahim KHAIRAT ABDELHAMID, Heiner KIRCHHOFFER, Thomas WIEGAND
  • Publication number: 20230262241
    Abstract: The coding efficiency of scalable video coding is increased by substituting missing spatial intra prediction parameter candidates in a spatial neighborhood of a current block of the enhancement layer by use of intra prediction parameters of a co-located block of the base layer signal. By this measure, the coding efficiency for coding the spatial intra prediction parameters is increased due to the improved prediction quality of the set of intra prediction parameters of the enhancement layer, or, more precisely stated, the increased likelihood, that appropriate predictors for the intra prediction parameters for an intra predicted block of the enhancement layer are available thereby increasing the likelihood that the signaling of the intra prediction parameter of the respective enhancement layer block may be performed, on average, with less bits.
    Type: Application
    Filed: February 3, 2023
    Publication date: August 17, 2023
    Inventors: Tobias HINZ, Haricharan LAKSHMAN, Jan STEGEMANN, Philipp HELLE, Mischa SIEKMANN, Karsten SUEHRING, Detlev MARPE, Heiko SCHWARZ, Christian BARTNIK, Ali Atef Ibrahim KHAIRAT ABDELHAMID, Heiner KIRCHHOFFER, Thomas WIEGAND
  • Publication number: 20230254508
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template ; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Application
    Filed: January 9, 2023
    Publication date: August 10, 2023
    Applicant: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230238982
    Abstract: The invention describes an encoding scheme for arithmetically encoding a sequence of information values into an arithmetic coded bitstream using providing the bitstream with entry point information allowing for resuming arithmetic decoding the bitstream from a predetermined entry point onward. A respective decoding scheme is also provided. These encoding and decoding schemes provide more efficient encoding concept in view of the decoding speed.
    Type: Application
    Filed: April 5, 2023
    Publication date: July 27, 2023
    Inventors: Paul HAASE, Heiner KIRCHHOFFER, Karsten MUELLER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11689738
    Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: June 27, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Sebastian Bosse, Heiko Schwarz, Thomas Wiegand, Heribert Brust
  • Publication number: 20230199188
    Abstract: Concepts for transform coefficient block coding are described which enable coding of coefficients of a transform block in a manner suitable for dependent quantization and effectively implementable by entropy coding in terms of coding efficiency.
    Type: Application
    Filed: February 16, 2023
    Publication date: June 22, 2023
    Inventors: Heiko SCHWARZ, Phan Hoang Tung NGUYEN, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11683485
    Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.
    Type: Grant
    Filed: January 5, 2022
    Date of Patent: June 20, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jens Brandenburg, Tobias Hinz, Adam Wieckowski, Jackie Ma, Valeri George, Christian Lehmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Robert Skupin, Yago Sánchez De La Fuente, Thomas Schierl
  • Publication number: 20230188715
    Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.
    Type: Application
    Filed: January 31, 2023
    Publication date: June 15, 2023
    Inventors: Benjamin Bross, Philipp Merkle, Simone Walter, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Paul Keydel
  • Publication number: 20230188718
    Abstract: A video encoder is configured to entropy encode an absolute value of a quantization level of a current transform coefficient at position (xC, yC), wherein the absolute value is encoded using context adaptive binary arithmetic encoding of bins of a first binarization. The video coder is further configured, for the current transform coefficient, to encode a bin of the first binarization by using a context which is determined based on a sum of minimum absolute values of transform coefficient quantization levels, based on encoded bins of the first binarization, at one or more transform coefficient positions among (xC+1, yC), (xC+2, yC), (xC+1, yC+1), (xC, yC+1), and (xC, yC+2).
    Type: Application
    Filed: February 1, 2023
    Publication date: June 15, 2023
    Inventors: Paul HAASE, Christian RUDAT, Heiner KIRCHHOFFER, Phan Hoang Tung NGUYEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230188720
    Abstract: Block based decoder configured to partition a picture (10) of more than one color component (101, 102) and of a color sampling format, according to which each color component (101, 102) is equally sampled, into blocks using a partitioning scheme according to which the picture (10) is equally partitioned with respect to each color component (101, 102). Additionally, the block based decoder is configured to decode a first color component (101) of the picture (10) in units of the blocks with selecting, for each of intra-predicted first color component blocks (18?11-18?1n) of the picture (10), one out of a first set (508) of intra-prediction modes.
    Type: Application
    Filed: April 1, 2021
    Publication date: June 15, 2023
    Inventors: Jonathan Pfaff, Tobias Hinz, Philipp Helle, Philipp Merkle, Björn Stallenberger, Michael Schäfer, Benjamin Bross, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230188694
    Abstract: This disclosure is directed to a multi-view signal, which includes processing a list of plurality of motion vector candidates-associated with coding block of a current picture in a dependent view of the multi-view signal Such processing includes estimating a first motion vector based on asecond motion vector associated with a reference block in a current picture of a reference view of the multi-view signal, the reference block corresponding to the coding block of the current picture in the dependent view. The first motion vector is added into the list, and an index is used that specifies at least one candidate from the list to be used for motion- compensated prediction. The coding block in the current picture is coded by performing the motion-compensated prediction based on the at least one candidate indicated by the index.
    Type: Application
    Filed: November 7, 2022
    Publication date: June 15, 2023
    Inventors: Heiko SCHWARZ, Thomas WIEGAND
  • Patent number: 11677950
    Abstract: Concepts are presented which achieve a more efficient coding of coefficients of a transform block by use of dependent quantization and context adaptive entropy coding or achieve a coding of coefficients of a transform block in a manner which allows a more efficient coding even if a usage of dependent quantization is combined with the usage of context adaptive entropy coding.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: June 13, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Heiko Schwarz, Thomas Wiegand, Phan Hoang Tung Nguyen, Detlev Marpe
  • Patent number: 11659169
    Abstract: There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding. In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder (resp.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: May 23, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Heiko Schwarz, Philipp Helle, Michael Schäfer, Roman Rischke, Tobias Hinz, Philipp Merkle, Björn Stallenberger, Martin Winken, Mischa Siekmann, Detlev Marpe, Thomas Wiegand
  • Patent number: 11653033
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: May 16, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20230141029
    Abstract: A decoder for decoding weight parameters of a neural network, wherein the decoder is configured to obtain a plurality of neural network parameters of the neural network on the basis of an encoded bitstream. Furthermore, the decoder is configured to decode the neural network parameters of the neural network using a context-dependent arithmetic decoding Moreover, the decoder is configured to obtain a probability estimate for a decoding of a bin of a number representation of a neural network parameter using one or more probability estimation parameters. In addition, the decoder is configured to use different probability estimation parameter values for a decoding of different neural network parameters and/or to use different probability estimation parameter values for a decoding of bins associated with different context models. Some embodiments are configured to use different probability estimation parameter values for a decoding of neural network parameters of different layers of the neural network.
    Type: Application
    Filed: October 13, 2022
    Publication date: May 11, 2023
    Inventors: Paul HAASE, Karsten MÜLLER, Heiner KIRCHHOFFER, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230134365
    Abstract: An arithmetic encoder for encoding a plurality of symbols having symbol values is configured to derive an interval size information for an arithmetic encoding of one or more symbol values to be encoded based on a plurality of state variable values representing statistics of a plurality of previously encoded symbol values with different adaptation time constants. The arithmetic encoder is configured to map a first state variable value, or a scaled and/or rounded version thereof, using a lookup-table and to map a second state variable value, or a scaled and/or rounded version thereof using the lookup-table, in order to obtain the interval size information describing an interval size for the arithmetic encoding of one or more symbols to be encoded. Further arithmetic encoders, arithmetic decoders, video encoders, video decoder, methods for encoding, methods for decoding and computer programs are also disclosed which are based on the same concept and on other concepts.
    Type: Application
    Filed: July 26, 2022
    Publication date: May 4, 2023
    Inventors: Heiner KIRCHHOFFER, Jan STEGEMANN, Detlev MARPE, Paul HAASE, Stefan MATLAGE, Christian BARTNIK, Heiko SCHWARZ, Thomas WIEGAND
  • Patent number: 11641473
    Abstract: A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: May 2, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Martin Winken, Christian Bartnik, Philipp Helle, Mischa Siekmann, Jonathan Pfaff, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20230117869
    Abstract: The invention describes an encoding scheme for encoding a sequence of integer values, particularly by first using encoding a value at a predetermined position and then consecutively calculating and encoding differences between neighboring values. A respective decoding scheme is also provided. These encoding and decoding schemes provide a more efficient encoding concept.
    Type: Application
    Filed: December 21, 2022
    Publication date: April 20, 2023
    Inventors: Paul HAASE, Karsten MÜLLER, Heiner KIRCHHOFFER, Detlev MARPE, Heiko SCHWARZ, Thomas WIEGAND