Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to process multi-view multimedia data. The multi-view multimedia data includes a hierarchical track structure with at least a first track, wherein the first track is at a first level in the hierarchical track structure, and includes data for both a first view and a second view of the multi-view multimedia data. Metadata contained within the first track can be determined and used to perform an extraction operation on the first track to generate first media data of a second track, wherein the first media data is for the first view, and second media data of a third track, wherein the second media data is for the second view, wherein the second track and the third track are at a second level in the hierarchical track structure above the first level of the first track.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode and decode multimedia data. A hierarchical track structure for the multimedia data is encoded with at least a first track and a second track, wherein the second track is above the first track. Overlay composition metadata is associated with the second track, wherein the overlay composition metadata comprises offset metadata, layer metadata, source metadata, or some combination thereof. The overlay composition metadata specifies at least part of an overlay composition for media data associated with the first track, wherein the overlay composition can be performed as part of a track derivation operation on media data associated with the first track to generate media data of the second track, such that the second track is a derived track of the first track.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode and/or decode video data. The video data can include a region of interest. The video data can include a region structure associated with the video data that specifies one or more aspects of the region of interest based on a sphere, such as a coordinate aspect, a size aspect, a range aspect, or some combination thereof, the region structure comprising data indicative of whether the region structure comprises data indicative of one or more global aspects of the region of interest that applies to each of a set of samples associated with the region structure. The region of interest in the video data can be determined based on the data indicative of whether the region structure comprises data indicative of the one or more global aspects of the region of interest.

Abstract: A method and system of AL-FEC using MMT protocol performed are disclosed. For an MMT receiving entity, a bounded FEC configuration setting is received from an MMT sending entity. The bounded FEC configuration setting belongs to an FEC configuration group consisting of at least one FEC configuration setting having a bounded-number of stages or layers of FEC coding structure, where the bounded-number is a positive integer greater than 1. If the bounded FEC configuration setting corresponds to one FEC configuration setting having the bounded-number of stages or layers of FEC coding structure, one or more FEC source packets and FEC repair packets are received from the MMT sending entity are FEC decoded into one recovered MMT packet using a range of FEC schemes having a target number of stages or layers of FEC coding structure from 1 to the bounded-number. The process for an MMT sending entity is also disclosed.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to process multimedia data. The multimedia data includes a hierarchical track structure with at least a first track and a second track, such that the first track is at a first level in the hierarchical track structure and the second track is at a second level in the hierarchical track structure above the first level of the first track. First metadata is contained within the first track and second metadata is contained within the second track. The multimedia data can be decoded by performing, based on the first metadata and the second metadata, a track derivation operation on the media data associated with the first track to generate the media data of the second track such that the second track is a derived track of the first track.

Abstract: A method and system of message exchange for controlling flow associated with multimedia streaming services from a server to a client using DASH are disclosed. In one method, one or more Push Directives are sent from a client to a server to indicate information related to media data requested. At least one selected Push Directive uses one URLTemplate that comprises a list of media parameter values, and where each media parameter value corresponds to one media parameter associated with one media segment requested. The server then pushes one or more groups of data for the media data requested to the client according to the list of media parameter values. In another method, at least one selected Push Directive uses one URLTemplate that includes a first number to represent a number of repeating difference of media parameter values associated with requested media segments.

Abstract: A method and system of AL-FEC using MMT protocol performed are disclosed. For an MMT receiving entity, a bounded FEC configuration setting is received from an MMT sending entity. The bounded FEC configuration setting belongs to an FEC configuration group consisting of at least one FEC configuration setting having a bounded-number of stages or layers of FEC coding structure, where the bounded-number is a positive integer greater than 1. If the bounded FEC configuration setting corresponds to one FEC configuration setting having the bounded-number of stages or layers of FEC coding structure, one or more FEC source packets and FEC repair packets are received from the MMT sending entity are FEC decoded into one recovered MMT packet using a range of FEC schemes having a target number of stages or layers of FEC coding structure from 1 to the bounded-number. The process for an MMT sending entity is also disclosed.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to process (e.g., encode and/or decode) multimedia data that includes a representation of a multimedia experience associated with at least one spherical region. At least one video portion of the multimedia data and at least one additional multimedia portion of the multimedia data are associated with the spherical region. The multimedia data, at least one video portion, and at least one additional multimedia portion present the multimedia experience associated with the spherical region.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to process (including encoding and decoding) composition layouts. The video data includes a plurality of encoded two-dimensional sub-picture tracks associated with a viewport and a composition operation to compose the tracks. The composition operation comprises data indicative of a composition to perform on the plurality of two-dimensional sub-picture tracks to compose the tracks into a canvas associated with the viewport, and a composition layout operation to adjust the composition if the canvas comprises a composition layout created by two or more of the plurality of two-dimensional sub-picture tracks composed on the canvas.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to derive a composite track. Three-dimensional video data includes a plurality of two-dimensional sub-picture tracks associated with a viewport. A composite track derivation for composing the plurality of two-dimensional sub-picture tracks for the viewport includes data indicative of the plurality of two-dimensional sub-picture tracks belonging to a same group, placement information to compose sample images from the plurality of two-dimensional tracks into a canvas associated with the viewport, and a composition layout operation to adjust the composition if the canvas comprises a composition layout created by two or more of the plurality of two-dimensional sub-picture tracks composed on the canvas. The composite track derivation can be encoded and/or used to decode the three-dimensional video data.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to process asset change point locations. A processor or encoder is configured to operate according to a set of constraints that constrain the encoding process for asset changes, wherein the set of constraints configures a set of allowable asset change point locations from a set of possible asset change point locations, wherein the set of allowable asset change point locations is a subset of the set of possible asset change point locations, and configures a set of allowable data access types from a set of possible data access types, wherein the set of allowable data access types is a subset of the set of possible data access types. Video data is encoded based on the set of constraints to generate encoded first video data, such that the encoded first video data comprises a set of asset change point locations and associated data access types in compliance with the set of constraints.

Abstract: Aspects of the disclosure provide an apparatus that includes interface circuitry and processing circuitry. The interface circuitry is configured to receive signals carrying metadata for visual track composition from multiple visual tracks. The visual track composition includes alpha compositing, and can include spatial compositing and background compositing. The processing circuitry is configured to parse the metadata to extract configuration information for the visual track composition. Further, the processing circuitry receives a first sample from a first visual track and a second sample from a second visual track, and combines the first sample with the second sample to generate a composite sample based on the configuration information for the visual track composition.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to perform an asset change for video data. First video data comprises a sequence of data units separated by data unit boundaries, and a sequence of error correction data units, wherein each error correction data unit is associated with one or more data units from the sequence of data units. Based on the received first video data, it can be determined whether an error correction data unit from the sequence of error correction data units associated with an asset change point of the first video data crosses one or more data unit boundaries of the first video data. Based on the determination, an asset change operation for the first video data and second video data is performed, wherein the second video data is different than the first video data.

Abstract: Aspects of the disclosure provide an apparatus that includes interface circuitry and processing circuitry. The interface circuitry is configured to receive signals carrying metadata that associates a region of interest in a first visual view provided by a first visual track with the first visual track and a second visual track that provides a second visual view that is a part of the first visual view. The processing circuitry is configured to parse the metadata, determine, when the region of interest is selected, the second visual track to provide visual data, and generate images for the region of interest based on the visual data from the second visual track.

Abstract: A method and device for switching Representations are disclosed. On the server side, leading-picture information associated with leading pictures in an open GOP (group of picture) is signalled in a media presentation description. Each leading picture corresponds to one picture preceding a RAP (Random Access Picture) picture in a segment in an output order and being coded depending on the RAP picture. At the client side, an original Representation and a target representation are received and the leading-picture information for the target Representation is determined from the media presentation description received.

Abstract: Aspects of the disclosure provide a method and an apparatus for deriving composite tracks. The disclosed apparatus includes a processing circuitry. The processing circuitry is configured to generate a file that includes elementary track boxes respectively for elementary tracks. The elementary track box indexes a sequence of media samples in a time order that forms an elementary track. The processing circuitry is configured to construct a composite track box for a composite track. The composite track box identifies one or more elementary tracks, and a composite operation to form the composite track based on the one or more elementary tracks. The processing circuitry is further configured to generate a media presentation based on the composite track.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode or decode a region of interest associated with video data. A spherical region structure is associated with the video data that specifies the region of interest on a sphere, the spherical region structure including a reference point of the region of interest on the sphere, and data indicative of a set of side points, comprising a side point for each side of the region of interest on the sphere. The region of interest in the video data is determined based on the reference point and the set of side points. The video data can be composite video data. The spherical region structure, and/or metadata based on the spherical region structure, can be implicitly or explicitly associated with the video data.

Abstract: A method or system for supporting dynamic construction of a user selected sub-region (e.g., viewport or region of interest) from other sub-regions of a reference media presentation is presented. The components of the reference media presentation are encoded as component tracks. A streaming decoder receives a streaming media file of the reference media presentation and displays an arbitrarily selected sub-region of the reference media presentation. The streaming media file has a derived track that (i) references one or more of the plurality of component tracks and (ii) specifies a set of operations for constructing media samples based on the media samples of the referenced component tracks. The streaming decoder provides media samples for the selected sub-region by retrieving the referenced component tracks and performing the set of operations specified by the derived track.

Abstract: A method that specifies, signals and uses coding-independent code points (CICP) in processing media contents from multiple media sources is provided. An apparatus implementing the method receives media contents captured by a plurality of media sources in one or more clusters. The apparatus processes the media contents to provide a plurality of coding-independent code points for the plurality of media sources. The apparatus also encodes the media contents to provide at least one elementary stream.

Abstract: A mobile device comprising a processor configured to merge a plurality of images each having a distinct focus position in a scene to generate a focus-stacked image that encompasses all focus positions of the plurality of images. Also, an apparatus comprising a camera configured to capture a plurality of color images for one scene each with a distinct focus distance and a processor configured to register the plurality of color images to generate a plurality of registered color images, generate a plurality of luminance (Y) channels from the plurality of registered color images, and stack the plurality of Y channels to generate a focus-stacked Y channel.