Patents by Inventor Robert SKUPIN

Robert SKUPIN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11677966
    Abstract: Scalable coding concepts are described. One aspect improves parallel decoding of inter-dependent layers of a multi-layer video data stream by introducing a long-term syntax element structure for guaranteeing that during a predetermined time period the pictures of the dependent layer are subdivided so that borders of the spatial segments of the pictures of the second layer and the spatial segments of the first layer overlay. Another aspect concerns upsampling from base layer to enhancement layer. Another aspect introduces a long-term syntax element structure allowing the decoder to determine the inter-layer offset for a predetermined time period. Another aspect introduces a type indicator field changing a way a layer indicator field within the NAL unit headers is to be interpreted. Another aspect allows different codecs/standards to be used for the different layers. Another aspect concerns a syntax element structure which indicates the inter-layer offset in units of the base layer blocks.
    Type: Grant
    Filed: April 27, 2021
    Date of Patent: June 13, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Valeri George, Detlev Marpe, Robert Skupin
  • Publication number: 20230171425
    Abstract: Video/picture coding of improved coding efficiency with supporting varying resolution and/or efficiently handling region-wise packing.
    Type: Application
    Filed: December 28, 2022
    Publication date: June 1, 2023
    Inventors: Robert SKUPIN, Cornelius HELLGE, Valeri GEORGE, Thomas SCHIERL, Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Thomas WIEGAND
  • Publication number: 20230156203
    Abstract: The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with.
    Type: Application
    Filed: November 8, 2022
    Publication date: May 18, 2023
    Inventors: Karsten SUEHRING, Thomas SCHIERL, Detlev MARPE, Robert SKUPIN, Yago SANCHEZ DE LA FUENTE, Gerhard TECH
  • Patent number: 11647209
    Abstract: A signaling of at least one characteristic for layers of a multi-layered video signal such as, for example, for each layer the indication of dependent layers to which the respective layer directly relates via inter-layer prediction, or the signaling of the afore-mentioned second inter-dependency syntax structure, is described. A maximum syntax element is signaled within the multi-layered video signal to indicate a maximally used value of an extension layer-ID field of the packets of the multi-layered video signal, the scope of the maximum syntax element being, for example, a predetermined portion of the multi-layered video signal extending, for example, across several portions of the multi-layered video signal. Accordingly, it is feasible for devices such as decoders or network elements receiving the multi-layered video signal to gain, for a relatively large predetermined portion of the multi-layered video signal, knowledge about the actually consumed portion of the possible domain of possible values.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: May 9, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez de la Fuente, Gerhard Tech
  • Publication number: 20230108814
    Abstract: Various concepts which further improve multi-viewilayer coding concepts, are described.
    Type: Application
    Filed: November 7, 2022
    Publication date: April 6, 2023
    Inventors: Robert SKUPIN, Karsten Suehring, Yago Sanchez De La Fuente, Gerhard Tech, Valeri George, Thomas Schierl, Detlev Marpe
  • Publication number: 20230095686
    Abstract: An apparatus for receiving a video data stream as an input bitstream is provided. The video data stream has a video encoded thereinto, wherein, for a playback speed modification factor (Nx), the apparatus is to determine a decoding capability requirement depending on a decoding capability requirement limit, wherein the playback speed modification factor (Nx) is a forward playback speed modification factor or is a backward playback speed modification factor.
    Type: Application
    Filed: December 18, 2020
    Publication date: March 30, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Patent number: 11616964
    Abstract: A signaling of the layer ID is described which each of the packets of a multi-layered video signal is associated with. In particular, an efficient way of signaling this layer association is achieved, with nevertheless maintaining the backward compatibility with codecs according to which a certain value of the base layer-ID field is restricted to be non-extendable such as base layer-ID value 0 in the base layer-ID field. Instead of circumventing this restriction specifically with respect to this non-extendable base layer-ID value, the layer-ID of portions of the multi-layer data stream is signaled in an extendable manner by sub-dividing the base layer-ID field into a first sub-field and a second sub-field: whenever the first sub-field of the base layer-ID field fulfills a predetermined criterion, an extension layer-ID field is provided, and if the first sub-field of the base layer-ID field does not fulfill the predetermined criterion, the extension layer-ID field is omitted.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: March 28, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez De La Fuente, Gerhard Tech
  • Patent number: 11616979
    Abstract: Video/picture coding of improved coding efficiency with supporting varying resolution and/or efficiently handling region-wise packing.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: March 28, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Valeri George, Thomas Schierl, Yago Sánchez De La Fuente, Karsten Sühring, Thomas Wiegand
  • Publication number: 20230089495
    Abstract: File format concepts for video coding are described. Embodiments allow for an efficient extraction of sub-streams from a video file. Further embodiments allow for a flexible switching between sub-streams of a video file. Further embodiments allow for a flexible handling of decoder initializations.
    Type: Application
    Filed: September 30, 2022
    Publication date: March 23, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Dimitri PODBORSKI, Karsten GRUENEBERG, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230093377
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Application
    Filed: September 27, 2022
    Publication date: March 23, 2023
    Inventors: Robert SKUPIN, Cornelius HELLGE, Thomas SCHIERL, Yago SÁNCHEZ DE LA FUENTE, Thomas WIEGAND, Dimitri PODBORSKI
  • Publication number: 20230092331
    Abstract: An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.
    Type: Application
    Filed: November 7, 2022
    Publication date: March 23, 2023
    Applicant: GE Video Compression, LLC
    Inventors: Yago SANCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230065580
    Abstract: An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.
    Type: Application
    Filed: November 7, 2022
    Publication date: March 2, 2023
    Applicant: GE Video Compression, LLC
    Inventors: Yago SANCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230054567
    Abstract: Concepts are described, including encoding, processing and decoding of a data stream having a video encoded thereinto, wherein the video comprises a plurality of pictures, wherein the data stream comprises a plurality of pictures in at least two layers, wherein the pictures of at least one layer are split into a predetermined layer-specific number of subpictures, one or more of the pictures or subpictures of one layer corresponds to one picture or subpictures in one or more other layer, and at least one of the subpictures comprises boundaries for boundary extension for motion compensation, and an indication that at least one of the boundaries of corresponding subpictures or corresponding pictures in different layers are aligned with each other.
    Type: Application
    Filed: December 18, 2020
    Publication date: February 23, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230059366
    Abstract: Concepts are described, including encoding of a video into data stream and decoding of a data stream having a video encoded thereinto, using motion compensation prediction between pictures of equal resolution and pictures of different resolution, based on motion vectors at a half-sample resolution and on motion vectors at a different resolution using interpolation filters to obtain sub-sample values within a reference sample array. The interpolation filter is selected from two interpolation filter versions different in a higher edge preserving property, and the selection is depending on whether a current picture is equal in picture resolution to the reference sample array in horizontal and/or vertical dimension, and/or a constraint information in the data stream.
    Type: Application
    Filed: December 21, 2020
    Publication date: February 23, 2023
    Inventors: Benjamin BROSS, Yago SÁNCHEZ DE LA FUENTE, Robert SKUPIN, Martin WINKEN, Heiko SCHWARZ, Detlev MARPE, Thomas SCHIERL, Thomas WIEGAND
  • Patent number: 11582473
    Abstract: Various concepts which further improve multi-view/layer coding concepts, are described.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: February 14, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Robert Skupin, Karsten Suehring, Yago Sanchez De La Fuente, Gerhard Tech, Valeri George, Thomas Schierl, Detlev Marpe
  • Publication number: 20230037902
    Abstract: A video data stream having a video encoded thereinto is provided. The video data stream comprises an indication that indicates whether or not one or more scalable nesting supplemental enhancement information messages comprising timing information for each of one or more output layer sets are present within the video data stream.
    Type: Application
    Filed: December 18, 2020
    Publication date: February 9, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230043130
    Abstract: An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.
    Type: Application
    Filed: September 21, 2022
    Publication date: February 9, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Comelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230027374
    Abstract: The present invention is concerned with decoders, encoders and corresponding methods for handling video data streams (11) comprising a first sub-bitstream (11-1) and a second sub-bitstream (11-2). The herein described concept provides solutions for mixing, within an access unit (30, 31, 32), different NAL units (301, 302, 3030, 304) of different NAL unit types. For example, RAP NAL unit types may be mixed with different IRAP NAL unit types or non-IRAP NAL unit types, and non-IRAP NAL unit types may be mixed with different non-IRAP NAL unit types.
    Type: Application
    Filed: December 16, 2020
    Publication date: January 26, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Karsten SÜHRING, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230015840
    Abstract: File format concepts for video files are described. It is proposed to that descriptive data of a file indicates whether a parameter set for a track of a file is forwarded when jointly decoding a sub-stream of the track and a further track, and/or that a file includes, for a sub-stream of a video stream signaled in the file, an alternative parameter set to a parameter set for fully decoding the track, the alternative parameter set being for decoding the sub-stream, so as to allow for switching between multiple tracks of a file, and/or that step-wise stream access pictures of a track of a file are marked as stream access point pictures for accessing the track, and/or that a temporal length within which a decoder refresh in case of a joint decoding of sub-streams distributed over multiple tracks is indicated in a file, and/or that a file provides information from which it is derivable whether a pixel aspect ratio varies.
    Type: Application
    Filed: September 29, 2022
    Publication date: January 19, 2023
    Inventors: Yago SÁNCHEZ DE LA FUENTE, Dimitri PODBORSKI, Karsten GRUENEBERG, Cornelius HELLGE, Thomas SCHIERL, Robert SKUPIN, Thomas WIEGAND
  • Publication number: 20230008125
    Abstract: The A method of augmenting a view of a real-world environment with a view of a volumetric video object on a user device is disclosed . The method includes determining a current pose information (CPI) indicating a current pose of the view of the real-world environment and a desired pose of the volumetric video object in the real-world environment. The method further includes sending the CPI to a remote server. The method further includes receiving a rendered view of the volumetric video object that has been rendered in accordance with the CPI from the remote server. The method also includes augmenting the view of the real-world environment by at least mapping the rendered view of the volumetric video object onto a planar mapping surface arranged according to the desired position of the volumetric video object.
    Type: Application
    Filed: December 15, 2020
    Publication date: January 12, 2023
    Applicant: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Cornelius Hellge, Thomas Schierl, Peter Eisert, Anna Hilsmann, Robert Skupin, Yago Sanchez, Jangwoo Son, Gurdeep Singh Bhullar, Serhan Gül, Dimitri Podborski