Patents by Inventor Philipp Merkle

Philipp Merkle has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240137531
    Abstract: Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.
    Type: Application
    Filed: December 28, 2023
    Publication date: April 25, 2024
    Inventors: Philipp MERKLE, Christian BARTNIK, Haricharan LAKSHMAN, Detlev MARPE, Karsten MUELLER, Thomas WIEGAND, Gerhard TECH
  • Publication number: 20240114135
    Abstract: Block-based coding of a picture is done by providing an intra-prediction coding concept according to which a certain block of the picture is intra-prediction coded using a certain intra-coding mode by partitioning the predetermined block into partitions which are, for reconstruction purposes, sequentially subject to spatial prediction using the intra-prediction coding mode signaled for the certain block followed by correcting the thus obtained predictor using a prediction residual so that for preceding partitions a reconstruction of the samples is available to the decoder at the time of processing the next, then current, partition.
    Type: Application
    Filed: December 6, 2023
    Publication date: April 4, 2024
    Inventors: Santiago DE LUXÁN HERNÁNDEZ, Philipp MERKLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20240106997
    Abstract: Embodiments are described which exploit a finding, according to which a higher compression rate or better rate/distortion ratio may be achieved by adopting or predicting second coding parameters used for encoding a second view of the multi-view signal from first coding parameters used in encoding a first view of the multi-view signal. In other words, the inventors found out that the redundancies between views of a multi-view signal are not restricted to the views themselves, such as the video information thereof, but that the coding parameters in parallelly encoding these views show similarities which may be exploited in order to further improve the coding rate.
    Type: Application
    Filed: December 11, 2023
    Publication date: March 28, 2024
    Inventors: Thomas WIEGAND, Detlev MARPE, Karsten MUELLER, Philipp MERKLE, Gerhard TECH, Hunn RHEE, Heiko SCHWARZ
  • Patent number: 11917200
    Abstract: Hybrid video decoder supporting intermediate view synthesis of an intermediate view video from a first- and a second-view video which are predictively coded into a multi-view data signal with frames of the second-view video being spatially subdivided into sub-regions and the multi-view data signal having a prediction mode is provided, having: an extractor configured to respectively extract, from the multi-view data signal, for sub-regions of the frames of the second-view video, a disparity vector and a prediction residual; a predictive reconstructor configured to reconstruct the sub-regions of the frames of the second-view video, by generating a prediction from a reconstructed version of a portion of frames of the first-view video using the disparity vectors and a prediction residual for the respective sub-regions; and an intermediate view synthesizer configured to reconstruct first portions of the intermediate view video.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: February 27, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Wiegand, Karsten Mueller, Philipp Merkle
  • Patent number: 11876964
    Abstract: Block-based coding of a picture is done by providing an intra-prediction coding concept according to which a certain block of the picture is intra-prediction coded using a certain intra-coding mode by partitioning the predetermined block into partitions which are, for reconstruction purposes, sequentially subject to spatial prediction using the intra-prediction coding mode signaled for the certain block followed by correcting the thus obtained predictor using a prediction residual so that for preceding partitions a reconstruction of the samples is available to the decoder at the time of processing the next, then current, partition.
    Type: Grant
    Filed: October 3, 2022
    Date of Patent: January 16, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Santiago De Luxán Hernández, Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11863763
    Abstract: Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: January 2, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Publication number: 20230412822
    Abstract: The way of predicting a current block by assigning constant partition values to the partitions of a bi-partitioning of a block is quite effective, especially in case of coding sample arrays such as depth/disparity maps where the content of these sample arrays is mostly composed of plateaus or simple connected regions of similar value separated from each other by steep edges. The transmission of such constant partition values would, however, still need a considerable amount of side information which should be avoided. This side information rate may be further reduced if mean values of values of neighboring samples associated or adjoining the respective partitions are used as predictors for the constant partition values.
    Type: Application
    Filed: June 12, 2023
    Publication date: December 21, 2023
    Inventors: Philipp MERKLE, Christian BARTNIK, Haricharan LAKSHMAN, Detlev MARPE, Karsten MUELLER, Thomas WIEGAND, Gerhard TECH
  • Patent number: 11843757
    Abstract: Embodiments are described which exploit a finding, according to which a higher compression rate or better rate/distortion ratio may be achieved by adopting or predicting second coding parameters used for encoding a second view of the multi-view signal from first coding parameters used in encoding a first view of the multi-view signal. In other words, the inventors found out that the redundancies between views of a multi-view signal are not restricted to the views themselves, such as the video information thereof, but that the coding parameters in parallelly encoding these views show similarities which may be exploited in order to further improve the coding rate.
    Type: Grant
    Filed: April 7, 2022
    Date of Patent: December 12, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Wiegand, Detlev Marpe, Karsten Mueller, Philipp Merkle, Gerhard Tech, Hunn Rhee, Heiko Schwarz
  • Publication number: 20230353726
    Abstract: Wedgelet separation lines of neighboring blocks are predicted from each other by aligning the wedgelet separation lines of such neighboring blocks to each other, thereby reducing the side information coding rate that may be used.
    Type: Application
    Filed: April 7, 2023
    Publication date: November 2, 2023
    Inventors: Philipp MERKLE, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Publication number: 20230328287
    Abstract: Apparatus (54) for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from a data stream (12), a mode index (200) using a binarization code (202). The mode index (200) points to one out of a list (204) of matrix-based intra-prediction modes. The apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighbourhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix-vector product (206) onto sample positions (104) of the predetermined block. The list (204) of matrix-based intra-prediction modes consists of an even number of matrix-based intra-prediction modes.
    Type: Application
    Filed: September 24, 2020
    Publication date: October 12, 2023
    Inventors: Jonathan PFAFF, Björn STALLENBERGER, Michael SCHAEFER, Philipp MERKLE, Tobias HINZ, Philipp HELLE, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN
  • Publication number: 20230276048
    Abstract: Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points.
    Type: Application
    Filed: May 4, 2023
    Publication date: August 31, 2023
    Inventors: Jonathan PFAFF, Heiko SCHWARZ, Philipp HELLE, Michael SCHÄFER, Roman RISCHKE, Tobias HINZ, Philipp MERKLE, Björn STALLENBERGER, Martin WINKEN, Mischa SIEKMANN, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230254508
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template ; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Application
    Filed: January 9, 2023
    Publication date: August 10, 2023
    Applicant: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11722657
    Abstract: Wedgelet separation lines of neighboring blocks are predicted from each other by aligning the wedgelet separation lines of such neighboring blocks to each other, thereby reducing the side information coding rate that may be used.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: August 8, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Publication number: 20230188715
    Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.
    Type: Application
    Filed: January 31, 2023
    Publication date: June 15, 2023
    Inventors: Benjamin Bross, Philipp Merkle, Simone Walter, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Paul Keydel
  • Publication number: 20230188720
    Abstract: Block based decoder configured to partition a picture (10) of more than one color component (101, 102) and of a color sampling format, according to which each color component (101, 102) is equally sampled, into blocks using a partitioning scheme according to which the picture (10) is equally partitioned with respect to each color component (101, 102). Additionally, the block based decoder is configured to decode a first color component (101) of the picture (10) in units of the blocks with selecting, for each of intra-predicted first color component blocks (18?11-18?1n) of the picture (10), one out of a first set (508) of intra-prediction modes.
    Type: Application
    Filed: April 1, 2021
    Publication date: June 15, 2023
    Inventors: Jonathan Pfaff, Tobias Hinz, Philipp Helle, Philipp Merkle, Björn Stallenberger, Michael Schäfer, Benjamin Bross, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11659169
    Abstract: There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding. In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder (resp.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: May 23, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Heiko Schwarz, Philipp Helle, Michael Schäfer, Roman Rischke, Tobias Hinz, Philipp Merkle, Björn Stallenberger, Martin Winken, Mischa Siekmann, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230088154
    Abstract: In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.
    Type: Application
    Filed: November 21, 2022
    Publication date: March 23, 2023
    Inventors: Philipp MERKLE, Christian BARTINK, Haricharan LAKSHMAN, Detlev MARPE, Karsten MUELLER, Thomas WEIGAND, Gerhard TECH
  • Patent number: 11606554
    Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: March 14, 2023
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
    Inventors: Benjamin Bross, Philipp Merkle, Simone Walter, Heiko Schwarz, Detlev Marpe, Thomas Wiegand, Paul Keydel
  • Patent number: 11601672
    Abstract: An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: March 7, 2023
    Assignee: Fraunhofer-Gesellschaft zur Forderung der angewandten Forschung e.V.
    Inventors: Jonathan Pfaff, Philipp Helle, Philipp Merkle, Björn Stallenberger, Mischa Siekmann, Martin Winken, Adam Wieckowski, Wojciech Samek, Stephan Kaltenstadler, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230039672
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Application
    Filed: October 7, 2022
    Publication date: February 9, 2023
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Philipp Merkle, Tobias Hinz, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand