Patents by Inventor Thomas Wiegand

Thomas Wiegand has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230059366
    Abstract: Concepts are described, including encoding of a video into data stream and decoding of a data stream having a video encoded thereinto, using motion compensation prediction between pictures of equal resolution and pictures of different resolution, based on motion vectors at a half-sample resolution and on motion vectors at a different resolution using interpolation filters to obtain sub-sample values within a reference sample array. The interpolation filter is selected from two interpolation filter versions different in a higher edge preserving property, and the selection is depending on whether a current picture is equal in picture resolution to the reference sample array in horizontal and/or vertical dimension, and/or a constraint information in the data stream.
    Type: Application
    Filed: December 21, 2020
    Publication date: February 23, 2023
    Inventors: Benjamin BROSS, Yago SÁNCHEZ DE LA FUENTE, Robert SKUPIN, Martin WINKEN, Heiko SCHWARZ, Detlev MARPE, Thomas SCHIERL, Thomas WIEGAND
  • Patent number: 11589062
    Abstract: A subblock-based coding of transform coefficient blocks of the enhancement layer is rendered more efficient. To this end, the subblock subdivision of the respective transform coefficient block is controlled on the basis of the base layer residual signal or the base layer signal. In particular, by exploiting the respective base layer hint, the subblocks may be made longer along a spatial frequency axis transverse to edge extensions observable from the base layer residual signal or the base layer signal.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: February 21, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Publication number: 20230039672
    Abstract: Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.
    Type: Application
    Filed: October 7, 2022
    Publication date: February 9, 2023
    Inventors: Jonathan Pfaff, Philipp Helle, Michael Schaefer, Roman Rischke, Philipp Merkle, Tobias Hinz, Bjoern Stallenberger, Martin Winken, Mischa Siekmann, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230037902
    Abstract: A video data stream having a video encoded thereinto is provided. The video data stream comprises an indication that indicates whether or not one or more scalable nesting supplemental enhancement information messages comprising timing information for each of one or more output layer sets are present within the video data stream.
    Type: Application
    Filed: December 18, 2020
    Publication date: February 9, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230043130
    Abstract: An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.
    Type: Application
    Filed: September 21, 2022
    Publication date: February 9, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Comelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230044030
    Abstract: A video decoder employs context-adaptive binary arithmetic coding for decoding a video from a data stream. The video decoder determines a parametrization for the context-adaptive binary arithmetic coding.
    Type: Application
    Filed: December 29, 2020
    Publication date: February 9, 2023
    Inventors: Phan Hoang Tung NGUYEN, Benjamin BROSS, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Patent number: 11575921
    Abstract: The coding efficiency of scalable video coding is increased by substituting missing spatial intra prediction parameter candidates in a spatial neighborhood of a current block of the enhancement layer by use of intra prediction parameters of a co-located block of the base layer signal. By this measure, the coding efficiency for coding the spatial intra prediction parameters is increased due to the improved prediction quality of the set of intra prediction parameters of the enhancement layer, or, more precisely stated, the increased likelihood, that appropriate predictors for the intra prediction parameters for an intra predicted block of the enhancement layer are available thereby increasing the likelihood that the signaling of the intra prediction parameter of the respective enhancement layer block may be performed, on average, with less bits.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: February 7, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Tobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
  • Publication number: 20230036509
    Abstract: Apparatus for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from the data stream (12), a mode index (200), the mode index pointing to one out of a list (204) of matrix-based intra-prediction modes. Additionally, the apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighborhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix vector product (206) onto sample positions (104) of the predetermined block.
    Type: Application
    Filed: December 4, 2020
    Publication date: February 2, 2023
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20230027374
    Abstract: The present invention is concerned with decoders, encoders and corresponding methods for handling video data streams (11) comprising a first sub-bitstream (11-1) and a second sub-bitstream (11-2). The herein described concept provides solutions for mixing, within an access unit (30, 31, 32), different NAL units (301, 302, 3030, 304) of different NAL unit types. For example, RAP NAL unit types may be mixed with different IRAP NAL unit types or non-IRAP NAL unit types, and non-IRAP NAL unit types may be mixed with different non-IRAP NAL unit types.
    Type: Application
    Filed: December 16, 2020
    Publication date: January 26, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230025784
    Abstract: Block-based coding of a picture is done by providing an intra-prediction coding concept according to which a certain block of the picture is intra-prediction coded using a certain intra-coding mode by partitioning the predetermined block into partitions which are, for reconstruction purposes, sequentially subject to spatial prediction using the intra-prediction coding mode signaled for the certain block followed by correcting the thus obtained predictor using a prediction residual so that for preceding partitions a reconstruction of the samples is available to the decoder at the time of processing the next, then current, partition.
    Type: Application
    Filed: October 3, 2022
    Publication date: January 26, 2023
    Inventors: Santiago De Luxán Hernández, Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230027719
    Abstract: A proposed intermediate way of handling the renderable portion of the first view results in more efficient coding. Instead of omitting the coding of the renderable portion completely, even more efficient coding of multi-view signals entails merely suppressing the coding of the residual signal within the renderable portion, whereas the prediction parameter coding still takes place from the non-renderable portion of the multi-view signal across the renderable portion so that prediction parameters for the renderable portion may be exploited for predicting parameters for the non-renderable portion. The additional coding rate for transmitting the prediction parameters for the renderable portion may be kept low as this merely aims at forming a continuation of the parameter history across the renderable portion to serve as a basis for prediction parameters of other portions of the multi-view signal.
    Type: Application
    Filed: July 12, 2022
    Publication date: January 26, 2023
    Inventors: Sebastian BOSSE, Heiko SCHWARZ, Thomas WIEGAND, Tobias HINZ
  • Publication number: 20230015840
    Abstract: File format concepts for video files are described. It is proposed to that descriptive data of a file indicates whether a parameter set for a track of a file is forwarded when jointly decoding a sub-stream of the track and a further track, and/or that a file includes, for a sub-stream of a video stream signaled in the file, an alternative parameter set to a parameter set for fully decoding the track, the alternative parameter set being for decoding the sub-stream, so as to allow for switching between multiple tracks of a file, and/or that step-wise stream access pictures of a track of a file are marked as stream access point pictures for accessing the track, and/or that a temporal length within which a decoder refresh in case of a joint decoding of sub-streams distributed over multiple tracks is indicated in a file, and/or that a file provides information from which it is derivable whether a pixel aspect ratio varies.
    Type: Application
    Filed: September 29, 2022
    Publication date: January 19, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Dimitri PODBORSKI, Karsten GRUENEBERG, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Patent number: 11553207
    Abstract: A video decoder and method for supporting a prediction mode for predicting blocks of a video is configured to predict each of the blocks by extrapolating a neighborhood of the respective block into the block along a direction which varies across the respective block.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: January 10, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Philipp Merkle, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11553212
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: January 10, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Publication number: 20230007252
    Abstract: Decoder for decoding a transformed representation of a sample block from a data stream. If a first coded coefficient is located inside a predetermined subarea of the transform coefficient block and if the underlying transform is within a first set of available transforms, the decoder decodes coefficients along a first coefficient scan order. If the transform is within a second set of In available transforms, the decoder decodes coefficients located within the predetermined subarea along a second coefficient scan order, and infers that coefficients located outside the predetermined subarea are zero. The first coefficient scan order is so that coefficients outside the predetermined subarea are scanned between two transform coefficients located inside the predetermined subarea. The second coefficient scan order does not scan any coefficient outside the predetermined subarea between scanning the coefficients within the predetermined subarea.
    Type: Application
    Filed: November 25, 2020
    Publication date: January 5, 2023
    Inventors: Benjamin Bross, Santiago De Luxán Hernández, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Publication number: 20230006799
    Abstract: Communication system including a data transmission controller, at least a transmitter and at least a receiver wherein the transmitter is configured to transmit a first data portion to the receiver by use of a resource portion having a bandwidth and a plurality of time frames in a manner to further increase a redundancy of the first data portion to be transmitted from time frame to time frame of the plurality of time frames, wherein the receiver is configured to analyze the received first data portion and its redundancy to determine a correctly and/or completely and/or sufficiently received first data portion or incorrectly and/or incompletely and/or insufficiently received first data portion and to transmit an ACK signal to the transmitter using the resource portion, when determining the correctly and/or completely and/or sufficiently received first data portion.
    Type: Application
    Filed: June 17, 2022
    Publication date: January 5, 2023
    Inventors: Baris GOEKTEPE, Cornelius HELLGE, Nithin SRINIVASAN, Thomas FEHRENBACH, Thomas SCHIERL, Thomas WIEGAND
  • Patent number: 11546641
    Abstract: A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Helle, Detlev Marpe, Simon Oudin, Thomas Wiegand
  • Patent number: 11546642
    Abstract: Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: January 3, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Heiner Kirchhoffer, Martin Winken, Philipp Helle, Detlev Marpe, Heiko Schwarz, Thomas Wiegand
  • Patent number: 11546404
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: January 3, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Thomas Schierl, Yago Sánchez De La Fuente, Thomas Wiegand, Dimitri Podborski
  • Patent number: 11546630
    Abstract: Video decoder and/or video encoder, configured to determine a set of search area location candidates in a reference picture of a video; match the set of search area location candidates with a current template area adjacent to a current block of a current picture to obtain a best matching search area location candidate; select, out of a search area positioned in the reference picture at the best matching search area location candidate, a set of one or more predictor blocks by matching the current template area against the search area; and predictively decode/encode the current block from/into a data stream based on the set of one or more predictor blocks.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: January 3, 2023
    Inventors: Gayathri Venugopal, Detlev Marpe, Thomas Wiegand