Patents by Inventor Detlev Marpe

Detlev Marpe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12010353
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: August 14, 2023
    Date of Patent: June 11, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 12010337
    Abstract: An encoder for hybrid video coding, the encoder for providing an encoded representation of a video sequence on the basis of an input video content, and the encoder configured to: determine one or more syntax elements related to a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based a property described by on the one or more syntax elements, the processing scheme for acquiring a sample for a motion-compensated prediction at an integer and/or fractional location within the portion of the video sequence; encode an index indicating the selected processing scheme such that a given encoded index value represents different processing schemes depending on the property described by the one or more syntax elements; and provide, as the encoded representation of the video sequence, a bit stream including the one or more syntax elements and the encoded index.
    Type: Grant
    Filed: September 8, 2021
    Date of Patent: June 11, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Benjamin Bross, Martin Winken, Anastasia Henkel, Paul Keydel, Ivan Zupancic, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 12010334
    Abstract: Information available from coding/decoding the base layer, i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: June 11, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Publication number: 20240187612
    Abstract: A decoder for block-based decoding of picture data of a picture is configured to decode a current block of the picture by determining first and second sets of luma in a neighborhood of the current block, the first set of luma samples having smaller luma values than the second set of luma samples, fitting a straight-line having a linear function through first and second pairs of luma-chroma samples, wherein the first and second pairs of luma-chroma samples are determined based on the first and second sets of luma samples, respectively, and on first and second corresponding chroma samples, respectively, in said neighborhood of the current block, and predicting chroma samples of the current block using luma samples of the current block and said linear function. The present invention further concerns a respective encoder and corresponding methods for encoding and decoding.
    Type: Application
    Filed: February 13, 2024
    Publication date: June 6, 2024
    Inventors: Christian HELMRICH, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20240187653
    Abstract: Decoder for decoding a picture from a data stream, configured to check whether a plurality of coding parameters, which are contained in the data stream, relate to a predetermined portion of the picture and control a prediction residual transform mode and a quantization accuracy with respect to the predetermined portion, are indicative of a coding parameter setting corresponding to a lossless prediction residual coding. Responsive to the plurality of coding parameters being indicative of the coding parameter setting corresponding to the lossless prediction residual coding, the decoder is configured to set one or more predetermined coding options relating to one or more tools of the decoder for processing a prediction residual corrected predictive reconstruction with respect to the predetermined portion so that the one or more tools are disabled with respect to the predetermined portion.
    Type: Application
    Filed: February 14, 2024
    Publication date: June 6, 2024
    Inventors: Christian HELMRICH, Benjamin BROSS, Tung Hoang NGUYEN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 12003723
    Abstract: A picture in a data stream is subdivided into different size transform bocks. For a transform block, a transformation is selected by checking whether the block's size exceeds a threshold. If it does, a default technique is used to select the transformation. If it does not, a transformation is used from a list of transformations as identified by an index, the list including an identity transformation and non-identity transformations. A coefficients block in the data stream is decoded, and if the selected transformation is the identity transformation, then the coefficients block is used as a residual sample array, and if the selected transformation is not the identity transformation, the coefficients block is subjected to an inverse transformation corresponding to the selected transformation to obtain a residual sample array used to correct a prediction for the transform block.
    Type: Grant
    Filed: June 13, 2023
    Date of Patent: June 4, 2024
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Benjamin Bross, Phan Hoang Tung Nguyen, Paul Keydel, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Christian Helmrich
  • Patent number: 11997280
    Abstract: An apparatus includes an encoder, which receives image or video data, encodes the data and provides a bitstream representing the data. The encoder includes a CABAC encoder, which receives a binary valued syntax element associated with a block of the data to be encoded, and encodes, using a selected context model, the syntax element into coded bits for the bitstream. The syntax element includes a tool flag indicating whether or not certain coding tool, like linear weighted intra prediction, is employed when encoding a block of the data. For a block of the data which exhibits an aspect ratio larger than 2 and for a block of the data which exhibits an aspect ratio less than or equal to 2, and to which blocks the certain coding tool is applicable, first and second context models for encoding the tool flag are selected from a group of one or more first and second context models, respectively.
    Type: Grant
    Filed: August 30, 2021
    Date of Patent: May 28, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schäfer, Tobias Hinz, Björn Stallenberger, Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11997319
    Abstract: A raw byte sequence payload describing a picture in slices, WPP substreams or tiles and coded using context-adaptive binary arithmetic coding is subdivided into tranches with continuing the context-adaptive binary arithmetic coding probability adaptation across tranche boundaries. Thereby, tranche boundaries additionally introduced within slices, WPP substreams or tiles do not lead to a reduction in the entropy coding efficiency of these entities. However, the tranches are smaller than the original slices, WPP substreams or tiles and accordingly they may be transmitted earlier, i.e. with lower delay, than the un-chopped original entities. According to another aspect combinable with the first aspect, substream marker NAL units are used within a sequence of NAL units of a video bitstream to enable a transport demultiplexer to assign data of slices within NAL units to the corresponding substreams or tiles so as to be able to, in parallel, serve a multi-threaded decoder with the corresponding substreams or tiles.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: May 28, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Schierl, Valeri George, Karsten Grueneberg, Heiner Kirchhoffer, Anastasia Henkel, Detlev Marpe
  • Patent number: 11991355
    Abstract: Concepts are described, including encoding of a video into data stream and decoding of a data stream having a video encoded thereinto, using motion compensation prediction between pictures of equal resolution and pictures of different resolution, based on motion vectors at a half-sample resolution and on motion vectors at a different resolution using interpolation filters to obtain sub-sample values within a reference sample array. The interpolation filter is selected from two interpolation filter versions different in a higher edge preserving property, and the selection is depending on whether a current picture is equal in picture resolution to the reference sample array in horizontal and/or vertical dimension, and/or a constraint information in the data stream.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: May 21, 2024
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Benjamin Bross, Yago Sánchez De La Fuente, Robert Skupin, Martin Winken, Heiko Schwarz, Detlev Marpe, Thomas Schierl, Thomas Wiegand
  • Patent number: 11983737
    Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.
    Type: Grant
    Filed: November 3, 2022
    Date of Patent: May 14, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Simon Oudin, Martin Winken, Detlev Marpe, Thomas Wiegand
  • Publication number: 20240155114
    Abstract: A video decoder for decoding a video from a data stream is configured to decode an indication from the data stream which is valid for a sequence of pictures of the video, and indicates that RASL pictures within the sequence of pictures are coded in a manner excluding a predetermined set of one or more coding tools.
    Type: Application
    Filed: February 26, 2022
    Publication date: May 9, 2024
    Inventors: Robert SKUPIN, Christian BARTNIK, Adam WIECKOWSKI, Yago SÁNCHEZ DE LA FUENTE, Cornelius HELLGE, Benjamin BROSS, Thomas SCHIERL, Thomas WIEGAND, Detlev MARPE
  • Publication number: 20240155126
    Abstract: Block-based coding of a picture is rendered more effective by providing an intra-prediction coding concept according to which a certain block of the picture is intra-prediction coded using a certain intra-coding mode by partitioning the predetermined block into partitions along a certain dimension with the number of partitions being greater than two and/or the partitions being one sample wide along the certain dimension with the partitions being, for reconstruction purposes, sequentially subject to spatial prediction using the intra-prediction coding mode signaled for the certain block followed by correcting the thus obtained predictor using a prediction residual so that for preceding partitions a reconstruction of the samples is available to the decoder at the time of processing the next, then current, partition. Signaling overhead with respect to the partitioning may be left off or may be kept low.
    Type: Application
    Filed: November 30, 2023
    Publication date: May 9, 2024
    Inventors: Santiago DE LUXÁN HERNÁNDEZ, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20240155141
    Abstract: The handling of scalable data streams by network entities is rendered less complex by, in the data stream, accompanying packets which actually carry data by packets of a different packet type which have a scalability axes descriptor defining the number of scalability axes and a semantic meaning thereof. In another aspect, the handling of scalable data streams by network entities is rendered more efficient by conveying level and/or profile descriptors using packets other than the data carrying packets, with profile and/or level descriptors being divided up into a first set explicitly signaling the definition of the available coding option set and/or available syntax element value range for a respective operation point, and a second set of profile and/or level descriptors which signal the definition of the available coding option set and/or available syntax element value range for their respective operation points by reference another profile and/or level descriptor.
    Type: Application
    Filed: January 12, 2024
    Publication date: May 9, 2024
    Inventors: Thomas SCHIERL, Valeri GEORGE, Anastasia HENKEL, Detlev MARPE, Karsten GRÜNEBERG, Robert SKUPIN
  • Patent number: 11979584
    Abstract: Arithmetic encoder for encoding a plurality of symbols is configured to derive an interval size information for an arithmetic encoding of one or more symbol values to be encoded on the basis of one or more state variable value, in a first mode of operation, and to update the one or more state variable values and/or the interval size information for an encoding of one or more subsequent symbol values to be encoded in the first mode; in a second mode, the arithmetic encoder is configured to disable an update of the one or more state variable values and/or of the interval size information. Additionally, further embodiments of arithmetic encoders and decoders and video encoders and decoders are described.
    Type: Grant
    Filed: March 24, 2022
    Date of Patent: May 7, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Heiner Kirchhoffer, Detlev Marpe, Benjamin Bross, Phan Hoang Tung Nguyen, Christian Rudat, Heiko Schwarz, Thomas Wiegand
  • Publication number: 20240146954
    Abstract: A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.
    Type: Application
    Filed: August 1, 2023
    Publication date: May 2, 2024
    Inventors: Heiko SCHWARZ, Heiner KIRCHHOFFER, Philipp HELLE, Simon OUDIN, Jan STEGEMANN, Benjamin BROSS, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11973961
    Abstract: A decoder for block-based decoding of picture data of a picture is configured to decode a current block of the picture by determining first and second sets of luma in a neighborhood of the current block, the first set of luma samples having smaller luma values than the second set of luma samples, fitting a straight-line having a linear function through first and second pairs of luma-chroma samples, wherein the first and second pairs of luma-chroma samples are determined based on the first and second sets of luma samples, respectively, and on first and second corresponding chroma samples, respectively, in said neighborhood of the current block, and predicting chroma samples of the current block using luma samples of the current block and said linear function. The present proposal further concerns a respective encoder and corresponding methods for encoding and decoding.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: April 30, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e. V.
    Inventors: Christian Helmrich, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11973978
    Abstract: Decoder for block-based decoding of a picture from a data stream, configured to decode an intra-coding mode for a predetermined block of the picture from the data stream, configured to decode a partition dimension flag for the predetermined block of the picture from the data stream and set a partition dimension depending on the partition dimension flag to be horizontal or vertical and the decoder is configured to partition, along the predetermined dimension, the predetermined block into transform partitions which are as wide as the predetermined block perpendicular to predetermined dimension, furthermore configured to decode, for each transform partition, a transform of a prediction residual from the data stream; intra-predicting the predetermined block depending on one or more already reconstructed samples neighboring the predetermined block in a manner depending on the intra-coding mode to obtain a predictor for the predetermined block; and reconstructing the predetermined block by correcting the predictor
    Type: Grant
    Filed: September 10, 2021
    Date of Patent: April 30, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Santiago De Luxán Hernández, Benjamin Bross, Phan Hoang Tung Nguyen, Valeri George, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11973988
    Abstract: Decoder for decoding a picture from a data stream, configured to check whether a plurality of coding parameters, which are contained in the data stream, relate to a predetermined portion of the picture and control a prediction residual transform mode and a quantization accuracy with respect to the predetermined portion, are indicative of a coding parameter setting corresponding to a lossless prediction residual coding. Responsive to the plurality of coding parameters being indicative of the coding parameter setting corresponding to the lossless prediction residual coding, the decoder is configured to set one or more predetermined coding options relating to one or more tools of the decoder for processing a prediction residual corrected predictive reconstruction with respect to the predetermined portion so that the one or more tools are disabled with respect to the predetermined portion.
    Type: Grant
    Filed: January 4, 2022
    Date of Patent: April 30, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Christian Helmrich, Benjamin Bross, Tung Hoang Nguyen, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20240137500
    Abstract: In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.
    Type: Application
    Filed: December 19, 2023
    Publication date: April 25, 2024
    Inventors: Jonathan PFAFF, Philipp HELLE, Dominique MANIRY, Thomas WIEGARD, Wojciech SAMEK, Stephan KALTENSTADLER, Heiko SCHWARZ, Detlev MARPE, Mischa SIEKMANN, Martin WINKEN
  • Publication number: 20240137531
    Abstract: Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.
    Type: Application
    Filed: December 28, 2023
    Publication date: April 25, 2024
    Inventors: Philipp MERKLE, Christian BARTNIK, Haricharan LAKSHMAN, Detlev MARPE, Karsten MUELLER, Thomas WIEGAND, Gerhard TECH